Google Bot

Googlebot is is the crawler or spider program that index pages for Google. It collects documents from the web to build a searchable index for the Google search engine.

Search engines such as Google, Yahoo and MSN all use ‘bots’ to search for web page. Lets take Google as an example. The Google bot has two versions. The first version is called the Deep bot. The deep bot tries to follow every link and add as many pages as it can to the Google index. The second version called the fresh bot constantly crawls through the web in an attempt to find fresh new content.

Here are some SEO related do's and dont's:

Do:

It’s often said that content is king.  Having content that is different to the average web page is probably the most important step. This will boost the rankings of the site phenomenally as search engines are constantly looking for the freshest, newest information.

Secondly it is important to link your web page from forums, blogs and other popular sites. In saying this it is also natural that people will link your site if your content is worth linking. This boosts rankings as the deep bot tries to add as many pages found, into the index or alternatively people may click on the links in interest of your site.

It is also important to have the link relevant to the key words on your web page, for example the link of this web page would be SEO improvement because the web page has to do with improving search engine optimization. Though on the other hand something like cool web page wouldn’t be relevant to link to this site because it isn’t about a Cool web page.

Constantly update the content on the web page. Not only does this improve the rankings on Google, but it also improves the amount of regular viewers, which intern creates more traffic.

Use Google’s webmaster tools. These tools will show diagnostics of your page(s), statistics, who’s linking to you and who you’re linking to. It can also be beneficial to add a site-map. If you are unsure on how to create a sitemap, an excellent tool to use is http://www.xml-sitemaps.com/

Submit your site to Google’s index. By submitting the site, it generally reduces the time taken for Google to index.

Submit your site manually to all the main search engines and directories.

Use Meta tags.

Buy a domain name that relates to your niche or main keyword. Generally domain names (such as .com, .net, .org, etc.) sound more professional and often get more clicks resulting in a higher position and higher traffic.

Put keywords or phrases into pictures by using ‘alt’.

Put important keywords in <H1> tags.

Put important keywords in the page’s title.

Don’t:

Don’t put any content you want the search engine to see in flash or image files. This is because search engines still struggles to ‘see’ the text in flash files or image files.

Don’t put excessive amounts of content that is unrelated to the site. This reduces the chances of the website coming up on Google for what keywords that are actually wanted.

Don’t copy content. As said before the search engines look for new fresh content. If a web page has identical or very similar content, the ranking of the page will drop dramatically or alternatively not be indexed at all.

Don’t put text the same color as the background and then type lots of key words or phrases in hope to get up rankings. This trick may have worked five years ago, but recently bots have been able to disregard any content with the same hex code as the background. In some cases people have been totally removed from the index of search engines because of excessive ‘invisible’ text.