Difference between revisions of "Search Engine Bots"
From Market Ruler Help
(Created page with ''''Search Engine Bots''' is short for '''Search Engine Robots''' and means a computer program which downloads all or a portion of your web site for the purpose of indexing wi...') |
m |
||
Line 13: | Line 13: | ||
* http://www.google.com/bot.html | * http://www.google.com/bot.html | ||
* http://help.yahoo.com/help/us/shop/merchant/ | * http://help.yahoo.com/help/us/shop/merchant/ | ||
+ | |||
+ | [[Category:Glossary]] |
Latest revision as of 02:26, 30 September 2009
Search Engine Bots is short for Search Engine Robots and means a computer program which downloads all or a portion of your web site for the purpose of indexing within a Search Engine.
A Search Engine Bot can typically be identified by its User Agent string.
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) YahooSeeker/1.0 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/shop/merchant/) Baiduspider+(+http://help.baidu.jp/system/05.html)
The number of Search Engine Bots is rather large.