Tools and Articles for Webmasters and SEO’s
Owner of the robot : Wink Technologies, Inc.
Country : USA
Robot type : search engine
Description : Search engine that integrates tag results from multiple sources such as del.icio.us, Digg,?
User Agent transmitted to the visited web server :
WinkBot/0.06 (Wink.com search engine web crawler; http://www.wink.com/Wink:WinkBot; winkbot@wink.com)
IP address range : from 64.13.128.000 to 64.13.191.255 (wink.com)
URL for more information : [...]
Owner of the robot : Name Intelligence, Inc.
Country : USA
Robot type : probe (does not spider sites)
Description : SurveyBot queries web sites for statistics and other informations of interest to webmasters and domain buyers.
User Agent transmitted to the visited web server :
SurveyBot/2.3 (Whois Source)
IP address range : from 64.246.160.0 to 64.246.191.255 (whois.sc)
URL for more information [...]
Owner of the robot : Telemate.net Software, Inc.
Country : USA
Robot type : probe (does not spider sites)
Description : WebFilter lets managers prevent employees from accessing URLs that contain content the company finds objectionable.
User Agent transmitted to the visited web server :
WebFilter Robot
IP address range : from 216.248.177.128 to 216.248.177.191 ()
URL for more information : [...]
Owner of the robot : Walhello
Country : Netherlands
Robot type : search engine
Description : Walhello combines a search engine and informations from other sources like the DMOZ drectory, as well as products sold by several on-line shops.
User Agent transmitted to the visited web server :
appie 1.1 (www.walhello.com)
IP address range : from 81.205.0.0 to 81.205.255.255 (planet.nl)
URL for [...]
Owner of the robot : wadaino.jp
Country : Japan
Robot type : search engine
Description : Japanese portal site.
User Agent transmitted to the visited web server :
wadaino.jp-crawler 0.2 (http://wadaino.jp/)
IP address range : from 202.51.8.0 to 202.51.15.255 (wadaino.jp)
URL for more information : http://wadaino.jp/
Access control options understood by the robot :
User Agent to use in the robots.txt file : [...]
Owner of the robot : Kosmix Corporation
Country : USA
Robot type : search engine
Description : The Kosmix search engine focusses on health information.
Although the FAQ page of the company says that they do not use the cfetch/1.0 user agent any more since end 2005, it is still active.
User Agent transmitted to the visited web server :
cfetch/1.0
IP [...]
Owner of the robot : France T?l?com S.A.
Country : France
Robot type : search engine
Description : France Telecom search engine.
User Agent transmitted to the visited web server :
Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA 1.2 (http://www.voila.com/)
IP address range : from 193.252.148.0 to 193.252.148.255 ()
URL for more information : http://www.voila.com/
Access control options understood by the [...]
Owner of the robot : Cuill, Inc.
Country : USA
Robot type : search engine
Description : Twiceler is the experimental robot of Cuill, a young company that pioneers a new approach to search. It is led by former IBM and Google engineers.
User Agent transmitted to the visited web server :
Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html)
IP address range :
from 64.0.0.0 to [...]
Owner of the robot : iParadigms, LLC.
Country : USA
Robot type : search engine
Description : Turnitinbot spiders web sites for the sole purpose of helping educational institutions prevent plagiarism (in particular, searching for similarities beteween student papers and content found on the Internet).
User Agent transmitted to the visited web server :
TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html)
TurnitinBot/2.0 (http://www.turnitin.com/robot/crawlerinfo.html)
TurnitinBot/2.0 http://www.turnitin.com/robot/crawlerinfo.html
IP address range [...]
Owner of the robot :
Country : Taiwan
Robot type : unknown
Description : No information available.
User Agent transmitted to the visited web server :
TMCrawler
IP address range : from 59.124.0.0 to 59.127.255.255 (hinet.net)
URL for more information :
Access control options understood by the robot :
User Agent to use in the robots.txt file :
Last visit of [...]