Archive for October, 2007

Internet Archive

Saturday, October 13th, 2007

Owner of the robot : The Internet Archive
Country : USA
Robot type : search engine
Description : The Internet Archive was founded in 1996 as a non-profit organization. It builds an Internet library of digital collections, for researchers, historians, and scholars. Many old versions of web pages are publicly available from their web site.
ia_archiver-web.archive.org is a web [...]

Microsoft Antispam Bot

Saturday, October 13th, 2007

Owner of the robot : Microsoft Corporation
Country : USA
Robot type : search engine
Description : MSNBot is the main crawler of Microsoft for its Live Search (MSN Search) search engine. This crawler is well known, maybe too well known. Some webmasters show this robot other contents than to regular users. To fight this spam, Microsoft [...]