Archive for June, 2007

TLink

Monday, June 11th, 2007

Owner of the robot : Thibault Kummer Country : France Robot type : search engine software Description : Tlink original task is the detection of dead links. Thanks to a system of plugins, TLink can be used to perform other maintenance tasks. User Agent transmitted to the visited web server : TLink (http://www.coldsource.net/projets/tlink/     [...]

SygolBot

Monday, June 11th, 2007

Owner of the robot : Giorgio Galeotti Country : Italy Robot type : search engine Description : Search engine (in English and Italian) developped by an Italian impassioned hobbyist. User Agent transmitted to the visited web server : SygolBot http://www.sygol.net     IP address range : from 81.208.26.0 to 81.208.26.63 (fastwebnet.it) URL for more information [...]

StackRambler

Monday, June 11th, 2007

Owner of the robot : Rambler Internet Holdings, LLC Country : Russia Robot type : search engine Description : Russian portal site and search engine. User Agent transmitted to the visited web server : StackRambler/2.0 (MSIE incompatible)     IP address range : from 81.19.64.0 to 81.19.66.255 (rambler.ru) URL for more information : http://www.rambler.ru/doc/robots.shtml Access [...]

SquidClamAV

Monday, June 11th, 2007

Owner of the robot : Michael Lang Country : Austria Robot type : probe (does not spider sites) Description : Squid ClamAV Redirector is a Squid helper script to get virus scanning for defined extensions. User Agent transmitted to the visited web server : SquidClamAV_Redirector 1.6.3     IP address range : from to () [...]

Sproose

Monday, June 11th, 2007

Owner of the robot : Sproose, Inc. Country : USA Robot type : search engine Description : Sproose develops technology for search personalization and social networking. User Agent transmitted to the visited web server : sproose/0.1 (sproose bot; http://www.sproose.com/bot.html; crawler@sproose.com) sproose/1.0beta (sproose bot; http://www.sproose.com/bot.html; crawler@sproose.com)     IP address range : from 38.0.0.0 to 38.255.255.255 [...]

SOHU.com

Monday, June 11th, 2007

Owner of the robot : SOHU.COM Inc. Country : China Robot type : search engine Description : Chinese portal site, search engine and directory. User Agent transmitted to the visited web server : sohu agent sohu-search     IP address range : from 220.181.0.0 to 220.181.255.255 () URL for more information : http://corp.sohu.com/s2005/imwp-en.shtml Access control [...]

SoGou

Monday, June 11th, 2007

Owner of the robot : SOHU.COM Inc. Country : China Robot type : search engine Description : Chinese search engine (index of more than one billion pages in Chinese). User Agent transmitted to the visited web server : sogou spider     IP address range : from 220.181.0.0 to 220.181.255.255 () URL for more information [...]

Snapbot

Monday, June 11th, 2007

Owner of the robot : Perfect Market Technologies, Inc. Country : USA Robot type : search engine Description : Wants to allow you to search faster. It anticipates your search and displays screenshots of the pages in the results. User Agent transmitted to the visited web server : Snapbot/1.0     IP address range : [...]

SiteSell.com

Monday, June 11th, 2007

Owner of the robot : SiteSell Inc. Country : USA Robot type : search engine Description : Each web page visited is categorized under the topics that it represents, allowing SiteSell customers to know the percentage of web pages that are about any particular topic. User Agent transmitted to the visited web server : SBIder/0.8-dev [...]

Singingfish

Monday, June 11th, 2007

Owner of the robot : America Online, Inc. Country : USA Robot type : search engine Description : Singingfish.com is a multimedia search engine. It is used by the Singingfish.com site, by the Windows Media Player, by the RealPlayer and other applications. The Asterias robot uses proprietary technology developed by Singingfish to explore and effectively [...]