Thursday, 5 April 2012

Major Search Engines Spiders / Crawler

We are sharing major Search Engines Spiders / Crawler

1.Google - Googlebot
2.Yahoo - Yahoo Slurp
3.MSN - MSNbot
4.Ask - Teoma
5.Excite - Architext spider
6.Inktomi.com - Slurp
7.Alexa - ia_archiver
8.Altavista - Scooter
9.Lycus - Lycos_Spider_(T-Rex)
10.Cuil - Twiceler (New Search Engine)
11.Looksmart - MantraAgent

No comments:

Post a Comment