Track Large Projects

We often receive feedback from our clients about tracking large number of websites with lots of keywords faster. But the speed of Advanced Web Ranking depends entirely on search engines. They use advanced systems to protect themselves from automatic queries, because they affect their bandwidth and processing power. From this reason there is no way to pass those systems without having your IP address temporarily banned.

To deal with this issue, Advanced Web Ranking uses “human emulation technology”, which makes the queries indistinguishable for search engines. In the same time using “human emulation technology” Advanced Web Ranking will not affect their bandwidth and processing power. This is because it adds a random delay between queries, so that your IP address will not get banned by search engines.

A query represents the search for a specific keyword in a search engines on a page.

You can disable or decrease the delay between each query, although we strongly recommend you to not do this. If you decrease or disable the delay between queries, you will be most probably banned by search engines in a matter of seconds.

To find the time Advanced Web Ranking will take to complete your projects multiply the number of keywords with the search depth and with the minimum delay between queries.

The maximum number of queries Advanced Web Ranking can make in 24 hours is about 5 000 with a delay between queries of 15 to 20 seconds. So if you have to track an website in 2 search engines for 300 keywords with a search depth of 5 pages (50 results) then you will have 1 500 queries and the update will be finished in about 6 hours and a half (300 x 5 = 1 500 queries x 15 seconds = 22 500 / 3 600 = 6.25 hours).

If Advanced Web Ranking has 50 000 queries to make, things can become a little tricky because it can take up to 8 days for Advanced Web Ranking to update such a large project.

But there are some tricks you can use to update your projects faster. To speed up the update for large projects you have two possibilities:

• Use multiple proxy servers
• Update Advanced Web ranking projects from multiple computers with different IP addresses

1. Multiple Proxy Servers

Multiple proxies allow you to increase the number of queries AWR can make by multiplying the queries with the number of proxy servers you will add. For example, if you will use 10 proxy servers, you will be able to make a maximum number of about 50 000 queries in 24 hours.

2. Different IP addresses

Another possibility to update large projects in less time is to use multiple computers with different IP addresses for updates. Using a Server license you can then share the same database and have all the projects in one place.

If you are looking to read more details about this we also added a topic about this on Advanced Web Ranking Forums.

In case you have any further questions about this, do not hesitate to ask them in the comments section.