Search Engine Spiders

I’ve been conducting some experiments with search engines, spiders and getting indexed. The tests were conducted on three new domains that didn’t exist until 3 days before.

  • The only inbound links were comments from popular heavily traffic blogs.
  • I made 3 comments on 3 different blogs for 3 different domains.
  • For each of the domains Google was the first to spider the pages, followed by Yahoo.
  • MSN has only visited two out of the three domains.
  • Google listed one of the domains first, Yahoo the other.
  • Google and Yahoo have listed two of the domains MSN still hasn’t listed any.
  • Google and Yahoo have a single line listing no page text and no cached version is stored.
  • No internal pages have been spidered.

In a previous experiment using popular blog directories only, it took 7 days to get listed. However listing was more comprehensive as it was in all three major engines.

If you’re curious that’s a King Baboon Tarantula.

tags: (search engine optimization | | | yahoo | msn | search engine spiders ) runs on the Genesis Framework

Genesis Framework

Genesis lets you to quickly and easily build amazing websites with WordPress. Whether you're a novice or advanced developer, Genesis provides the secure and search-engine-optimized foundation that takes WordPress to places you never thought it could go.
It's that simple - start using Genesis now!

Take advantage of the 6 default layout options, comprehensive SEO settings, rock-solid security, flexible theme options, cool custom widgets, custom design hooks, and a huge selection of child themes ("skins") that make your site look the way you want it to. With automatic theme updates and world-class support included, Genesis is the smart choice for your WordPress website or blog.

tla starter kit


  1. Text Link Ads - New customers can get $100 in free text links.
  2. - Get a premier listing in the internet's oldest directory.
  3. Need an SEO Audit for your website, look at my SEO Consulting Services
  4. TigerTech - Great Web Hosting service at a great price.
More in npb, npp, ntt, SEO
Zen of SEO

Jill Whalen has an excellent article called the Zen of SEO. Often, it's easiest for us when we can just...

Adsense and Heat Maps

Thanks to Jenstar for doing whatever had to be done behind the scenes to get Google to release the Adsense...

Off Topic Advertising

If you are involved in selling text links or "know a guy" who is, you've probably had to wrestle with...