Home How Googlebot first finds your site
How Googlebot first finds your site

How Googlebot first finds your site


There are essentially four ways in which Googlebot finds your new site. The first and most obious way is for you to submit your URL to Google for crawling, via the “Add URL” form at www.google.com/addurl.html. The second way is when Google finds a link to your site from another site that it has already indexed and subsequently sends its spider to follow the link. The third way is when you sign up for Google Webmaster Tools, verify your site, and submit a sitemap. The fourth (and final) way is when you redirect an already indexed webpage to the enw page ( for example using a 301 redirect)
In the past you could use search engine submission software, but Google now prevents this – and prevents spammers bombarding it with new sites – by using CAPTCHA , a challenge-response test to determine whether the user is human, on its Add URL page. CAPTCHA stands for Completely Automated Public Turing test to tell Computers and Humans Apart, and typically takes the form of a distorted image of letters and/or numbers that you have to type in a part of the submission.
How quickly you can expect to be crawled?
There are no firm guarantees as to how quickly new sites – or pages – will be crawled by Google and then appear in the search index. However, following one of the four actions above, you would normally expect to be crawled within a month and then see your pages appear in the index two to three weeks afterwards. In our experience, submission via Google Webmaster Tools is the most effective way to manage your crawl and to be crawled quickly, so We typically do this for all customers.