As Brad Callen, SEO guru put it:
“Google is not looking for you, your website, or your content… EVER!”
When your website goes online at “go-live”, Google does not know it exists – why should it?!
Google has something called “Googlebots” – also known as a robots, bots, or spiders – that crawl all over the web and discover new and updated pages of websites. These are then added to the Google Index. One cannot force Google to crawl a particular site and so when a website is new, customers are warned that it may take some weeks for Google to find and index their site.
When a customer searches Google for a product or service, it is to the Index that Google goes to match that information and “serve” a result (give the customer a list of relevant web-pages). In other words when you perform a Google search you are not searching the entire web at that moment in time – you are searching Google’s Index of the web.
If your website is not in Google’s index, it can’t be ranked because Google doesn’t know your site (or the keyword rich content within it) exists. So, in order to rank in Google, you must first get into their index. Once your website is in the index and you do a search, you will appear in the search results – but exactly WHERE will depend on how good the content and the SEO is!
It also follows that when you add new content (which you should do to attract the search engines), Google does not know this exists until it re-indexes the site or more specifically re-indexes that particular page. If it’s a new page then Google has to find it for the first time before that content can help influence your rankings.
This is what Google says:
“In the simplest terms, you could think of searching the web as looking in a very large book with an impressive index telling you exactly where everything is located. When you perform a Google search, our programs check our index to determine the most relevant search results to be returned (“served”) to you.”
RKJOnline Web Design enlists a number of “rapid index techniques” to nudge Google into going to YOUR website and crawling it.
We do this specifically:
- When we build the site, through good thought-out internal page navigation. Without this Google may not even crawl some of your web pages at all and they therefore will not be indexed
- At go live, through XML site maps
- When the website is still new, because we don’t want Google to take weeks before finding it; we will encourage Google to follow links to your website sent via (for example) social media
- When there is new content added to an existing website; again because Google could take a long time to find it and in the meantime it won’t show that new page or content in a search result until it has been crawled – again we’ll use social media links to encourage Google to follow back to your new content but remember that simply by frequently having informative, quality, fresh content on your website, Google will be encouraged to crawl the website more frequently
- When we action the back-links campaign for your website; we will ensure back-links are set up not just to your Home page but to all your pages. If you look at natural organic listings, where a website has good SEO – including rapid indexing techniques – you’ll notice not just the home page is listed. As more of your internal web pages get indexed by Google, the greater the probability they’ll get listed in the natural listings. Our clients know that one aim of RKJOnline is to fill page one of Google with all your web pages appearing in the listing, along with your facebook, Linked-In and online directory pages being listed as well – pushing your competitors further into page 2 and beyond!
With regard to encouraging Google to crawl your website via following links, again, look at what Brad Callen has to say:
“Consider a Google spider a car and links as a road. Google spiders follow the path of links, pointing to your site, to discover new content. And because of that, content that is heavily linked to OR linked in areas which more Google spidering occurs get found much more rapidly.”
There is also a view that the +1 GOOGLE BUTTON may help with rapid indexing – Google may crawl or re-crawl in response to a +1 Button being clicked.
When you become our client and take our SEO services, we’ll explain in more detail to you what we would like to do with Social Media, Google +1 and our other techniques to get your new website or web content indexing as fast as possible!