Archive for October, 2007

Internet Archive

Saturday, October 13th, 2007

Owner of the robot : The Internet Archive Country : USA Robot type : search engine Description : The Internet Archive was founded in 1996 as a non-profit organization. It builds an Internet library of digital collections, for researchers, historians, and scholars. Many old versions of web pages are publicly available from their web site. [...]

Microsoft Antispam Bot

Saturday, October 13th, 2007

Owner of the robot : Microsoft Corporation Country : USA Robot type : search engine Description : MSNBot is the main crawler of Microsoft for its Live Search (MSN Search) search engine. This crawler is well known, maybe too well known. Some webmasters show this robot other contents than to regular users. To fight this [...]