Search Engine Spiders

I’ve been conducting some experiments with search engines, spiders and getting indexed. The tests were conducted on three new domains that didn’t exist until 3 days before.

  • The only inbound links were comments from popular heavily traffic blogs.
  • I made 3 comments on 3 different blogs for 3 different domains.
  • For each of the domains Google was the first to spider the pages, followed by Yahoo.
  • MSN has only visited two out of the three domains.
  • Google listed one of the domains first, Yahoo the other.
  • Google and Yahoo have listed two of the domains MSN still hasn’t listed any.
  • Google and Yahoo have a single line listing no page text and no cached version is stored.
  • No internal pages have been spidered.

In a previous experiment using popular blog directories only, it took 7 days to get listed. However listing was more comprehensive as it was in all three major engines.

If you’re curious that’s a King Baboon Tarantula.

tags: (search engine optimization | | | yahoo | msn | search engine spiders ) runs on the Genesis Framework

Genesis Framework

Genesis lets you to quickly and easily build amazing websites with WordPress. Whether you're a novice or advanced developer, Genesis provides the secure and search-engine-optimized foundation that takes WordPress to places you never thought it could go.
It's that simple - start using Genesis now!

Take advantage of the 6 default layout options, comprehensive SEO settings, rock-solid security, flexible theme options, cool custom widgets, custom design hooks, and a huge selection of child themes ("skins") that make your site look the way you want it to. With automatic theme updates and world-class support included, Genesis is the smart choice for your WordPress website or blog.

tla starter kit


  1. Text Link Ads - New customers can get $100 in free text links.
  2. - Get a premier listing in the internet's oldest directory.
  3. Need an SEO Audit for your website, look at my SEO Consulting Services
  4. TigerTech - Great Web Hosting service at a great price.