Note: This article contains references to Advanced Web Ranking Desktop, a version that is no longer under active development.
Doesn’t it seem to you that all things happen too fast these days?
Wake up! Take the kids to school, go to work, do this, do that…There’s just so much to do, and time doesn’t wait for you to keep up with everything that goes on.
With this rush, you, as an SEO consultant, need to gather your search engine rankings really fast in order to meet your customers’ demands and expectations, and still have some time for yourself. But, like you, there are a lot of SEOs out there who need their rankings just as fast for their own demanding customers.
So, you’d better use every second wisely!
But things are not so simple. Search engines are smart and have ways to fight back. They will slow you down if you’re not careful.
What can you do to get a win – win situation?
Play fair and follow the search engine guidelines
To avoid overloading their datacenters and bandwidth, search engines designed clever systems to protect themselves against automatic queries. This helps them provide continuous, high standard services to all searchers, which is their primary scope after all.
Let’s take an in-depth look at how this works:
When checking rankings for 100 keywords in Google, for example, if you use an automatic tool that sends them all in a few minutes, the search engine will “see” you are not a person. Clearly, this would be impossible for a human to do. Google’s protection system would detect your IP address and ban it for up to 24 hours. This may result in discontinuous ranking updates and affect your SEO business in time.
What you need to do to avoid such situations is to embrace a search engine friendly behavior, taking into account random delays between queries. With Google, 15 seconds is the minimum delay to protect its datacenters against overloading.
So, if you take into account Google’s default searching settings (10 results per page), and a search depth of 5 pages, it means that the time needed to gather rankings for your 100 keywords, without the risk of being banned by Google, would be of about two hours (5 queries for each keyword X 15 seconds delay, multiplied by 100 keywords equals 7500 seconds).
Not very impressive, you might say. True, but this does not depend on the automatic querying tool itself, but to the protection mechanism of the search engines.
The solution is to find a way to send your queries from different IP addresses at the same time.
Send multiple queries through proxy servers
The good news is that with Advanced Web Ranking you have a way to go around this: you can use proxy servers to send your queries to search engines from different IP addresses at the same time.
This means that, with one proxy server and the direct connection from the computer where the application is installed, you can divide the 2 hours to update 100 keywords by two. If you have 10 proxy servers and a direct connection, you get to send queries from 11 different IP addresses, so you can further divide the 2 hours by 11.
This would mean that you can update your rankings for 100 keywords in less than 10 minutes. I think things are starting to look much brighter 🙂
How to manage proxy servers with Advanced Web Ranking 8.7
There are two methods that you can use to manage your proxies in the application:
- With a global setting, that covers all your AWR projects
- By assigning proxies per project
You can add the proxies in AWR from the Settings menu -> Performance -> Proxy Settings. Here, you get to add and remove the proxies, or to edit their details.
This is also the place where you assign different types of actions to your proxy servers, telling the application how to use them. To do this, you have two options you can select from:
- Ranking. Proxy servers that have this check box selected are used by the application in order to query search engines and retrieve ranking data.
- Others. This option marks the proxy server or direct connection that is used to retrieve analytics, links and ranking information.
Alternatively, you can override these settings for each of your projects. This helps you when you have proxy servers in different countries, for customers based in different locations.
You can find this setting in the Project menu -> Settings -> Proxy Servers.
Again, you have three options to choose from:
- Use Application Proxy settings. This is the default option, that tells AWR to use the global settings when updating your project, as described above.
- Use only direct connection. This option tells the application to use only the direct connection when updating this particular project. This helps you when you want to update only a particular project through a direct connection, and using proxy servers for the other projects.
- Use only the selected proxy servers. This is probably the one you want, because it allows you to choose the exact proxies from the list you have added in the general settings.
The nice thing about all these options is that they give you the freedom you need in order to retrieve your ranking data according to the size of the projects you manage.
Also, assigning your foreign customers projects proxies from their countries helps you get the relevant rankings for those locations.
Speeding your keyword position tracking is crucial to keep up with the growing number of new customers interested to improve their websites positions. Automatically querying the search engines it no longer an option, it is a need.
But there are several factors that you need to take into account when using automatic queries:
- Search engine’ s protection system imposes random delays between queries.
- If your tool doesn’t comply with these delays, you risk getting your IP address banned for up to 24 hours.
- The way to go around this, and still get fast ranking results, is with multiple proxy servers.
- With AWR, you can track your keyword positions simultaneously by assigning proxy servers per each customer project in the application.
- Proxies from different countries also help you see the results relevant for those locations
So, why risk being banned, when you can get fast rank tracking without breaching the search engines’ rules?
I hope you have enjoyed reading this article. I am looking forward to reading your comments in the section below.
Photo credit: airessantos