Archive for June, 2007

TLink

Monday, June 11th, 2007

Owner of the robot : Thibault Kummer
Country : France
Robot type : search engine software
Description : Tlink original task is the detection of dead links. Thanks to a system of plugins, TLink can be used to perform other maintenance tasks.
User Agent transmitted to the visited web server :

TLink (http://www.coldsource.net/projets/tlink/

 

 
IP address range : from to [...]

SygolBot

Monday, June 11th, 2007

Owner of the robot : Giorgio Galeotti
Country : Italy
Robot type : search engine
Description : Search engine (in English and Italian) developped by an Italian impassioned hobbyist.
User Agent transmitted to the visited web server :

SygolBot http://www.sygol.net

 

 
IP address range : from 81.208.26.0 to 81.208.26.63 (fastwebnet.it)
URL for more information : http://www.sygol.net/SygolBot.asp
Access control options understood by the robot [...]

StackRambler

Monday, June 11th, 2007

Owner of the robot : Rambler Internet Holdings, LLC
Country : Russia
Robot type : search engine
Description : Russian portal site and search engine.
User Agent transmitted to the visited web server :

StackRambler/2.0 (MSIE incompatible)

 

 
IP address range : from 81.19.64.0 to 81.19.66.255 (rambler.ru)
URL for more information : http://www.rambler.ru/doc/robots.shtml
Access control options understood by the robot :

robots.txt
META NAME=”robots”

User Agent [...]

SquidClamAV

Monday, June 11th, 2007

Owner of the robot : Michael Lang
Country : Austria
Robot type : probe (does not spider sites)
Description : Squid ClamAV Redirector is a Squid helper script to get virus scanning for defined extensions.
User Agent transmitted to the visited web server :

SquidClamAV_Redirector 1.6.3

 

 
IP address range : from to ()
URL for more information : http://www.jackal-net.at/
Access [...]

Sproose

Monday, June 11th, 2007

Owner of the robot : Sproose, Inc.
Country : USA
Robot type : search engine
Description : Sproose develops technology for search personalization and social networking.
User Agent transmitted to the visited web server :

sproose/0.1 (sproose bot; http://www.sproose.com/bot.html; crawler@sproose.com)
sproose/1.0beta (sproose bot; http://www.sproose.com/bot.html; crawler@sproose.com)

 

 
IP address range : from 38.0.0.0 to 38.255.255.255 ()
URL for more information : http://www.sproose.com/bot.html
Access control options [...]

SOHU.com

Monday, June 11th, 2007

Owner of the robot : SOHU.COM Inc.
Country : China
Robot type : search engine
Description : Chinese portal site, search engine and directory.
User Agent transmitted to the visited web server :

sohu agent
sohu-search

 

 
IP address range : from 220.181.0.0 to 220.181.255.255 ()
URL for more information : http://corp.sohu.com/s2005/imwp-en.shtml
Access control options understood by the robot :

User Agent to use in [...]

SoGou

Monday, June 11th, 2007

Owner of the robot : SOHU.COM Inc.
Country : China
Robot type : search engine
Description : Chinese search engine (index of more than one billion pages in Chinese).
User Agent transmitted to the visited web server :

sogou spider

 

 
IP address range : from 220.181.0.0 to 220.181.255.255 ()
URL for more information : http://corp.sohu.com/s2005/imwp-en.shtml
Access control options understood by the robot [...]

Snapbot

Monday, June 11th, 2007

Owner of the robot : Perfect Market Technologies, Inc.
Country : USA
Robot type : search engine
Description : Wants to allow you to search faster. It anticipates your search and displays screenshots of the pages in the results.
User Agent transmitted to the visited web server :

Snapbot/1.0

 

 
IP address range : from 38.0.0.0 to 38.255.255.255 (psi.net)
URL for more information [...]

SiteSell.com

Monday, June 11th, 2007

Owner of the robot : SiteSell Inc.
Country : USA
Robot type : search engine
Description : Each web page visited is categorized under the topics that it represents, allowing SiteSell customers to know the percentage of web pages that are about any particular topic.
User Agent transmitted to the visited web server :

SBIder/0.8-dev (SBIder; http://www.sitesell.com/sbider.html; http://support.sitesell.com/contact-support.html)

 

 
IP address range [...]

Singingfish

Monday, June 11th, 2007

Owner of the robot : America Online, Inc.
Country : USA
Robot type : search engine
Description : Singingfish.com is a multimedia search engine. It is used by the Singingfish.com site, by the Windows Media Player, by the RealPlayer and other applications. The Asterias robot uses proprietary technology developed by Singingfish to explore and effectively index multimedia [...]