Archive for June, 2007

ZoomInfo

Monday, June 11th, 2007

Owner of the robot : Zoom Information Inc.
Country : USA
Robot type : search engine
Description : ZoomInfo focusses on finding pages with information about businesses and business professionals.
User Agent transmitted to the visited web server :

NextGenSearchBot 1 (for information visit http://about.zoominfo.com/PublicSite/NextGenSearchBot.asp)

 

 
IP address range : from 67.104.0.0 to 67.111.255.255 (xo.net)
URL for more information : http://www.zoominfo.com/About/misc/NextGenSearchBot.aspx
Access control [...]

Zeusbot

Monday, June 11th, 2007

Owner of the robot : Ramon Arnella
Country : Spain
Robot type : search engine
Description : Crawler of the Ulysseek search engine (in English).
User Agent transmitted to the visited web server :

Zeusbot/0.07 (Ulysseek's web-crawling robot; http://www.zeusbot.com; agent@zeusbot.com)

 

 
IP address range : from 217.113.244.112 to 217.113.244.127 ()
URL for more information : http://www.zeusbot.com/
Access control options understood by the robot [...]

Yahoo-MMCrawler

Monday, June 11th, 2007

Owner of the robot : Yahoo! Inc.
Country : USA
Robot type : search engine
Description : The multimedia crawler used by Yahoo! Image Search.
User Agent transmitted to the visited web server :

Yahoo-MMCrawler/3.x (mms dash mmcrawler dash support at yahoo dash inc dot com)

 

 
IP address range : from 209.191.64.0 to 209.191.127.255 (yahoo.com)
URL for more information : http://help.yahoo.com/help/us/ysearch/image/image-08.html
Access [...]

Y!J-BSC

Monday, June 11th, 2007

Owner of the robot : Yahoo Japan Corporation
Country : Japan
Robot type : search engine
Description : Yahoo! Japan blog search service (beta edition).
User Agent transmitted to the visited web server :

Y!J-BSC/1.0 (http://help.yahoo.co.jp/help/jp/blog-search/)

 

 
IP address range : from 203.141.52.0 to 203.141.52.63 (yahoo.co.jp)
URL for more information : http://help.yahoo.co.jp/help/jp/blog-search/
Access control options understood by the robot :

robots.txt
META NAME=”robots”

User Agent to [...]

Yahoo-Blogs

Monday, June 11th, 2007

Owner of the robot : Yahoo! Inc.
Country : USA
Robot type : search engine
Description : Yahoo!'s blog indexing robot.
User Agent transmitted to the visited web server :

Yahoo-Blogs/v3.9 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/ysearch/crawling/crawling-02.html )

 

 
IP address range : from 68.142.192.0 to 68.142.255.255 (yahoo.com)
URL for more information :
Access control options understood by the robot :

robots.txt
META NAME=”robots”

User Agent to [...]

YaCy

Monday, June 11th, 2007

Owner of the robot : Michael Christen
Country : Germany
Robot type : distributed search engine
Description : P2P-based Web indexing network.
User Agent transmitted to the visited web server :

yacy (www.yacy.net; v20040602; i386 Linux 2.6.15-20-k7; java 1.5.0_06; Europe/de)
yacy (www.yacy.net; v20040602; ppc Mac OS X 10.4.6; java 1.5.0_06; Europe/de)
yacybot (ppc Mac OS X 10.4.6; java 1.5.0_06; Europe/de) yacy.net

 

 
IP address [...]

Xenu

Monday, June 11th, 2007

Owner of the robot : Tilman Hausherr
Country : Germany
Robot type : link checker software (follows the internal and external links found in the main analyzed site only; does not spider other sites)
Description : Free link checker software.
User Agent transmitted to the visited web server :

Xenu's Link Sleuth 1.1c
Xenu Link Sleuth 1.2e
Xenu Link Sleuth 1.2g

 

 
IP address [...]

WyseGuys

Monday, June 11th, 2007

Owner of the robot : WiseGuys Internet BV
Country : Netherlands
Robot type : search engine
Description : Search engine with special features for the Dutch market.
User Agent transmitted to the visited web server :

Mozilla/4.0 (compatible; Vagabondo/4.0Beta; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)
Mozilla/4.0 (compatible; Vagabondo/4.0Beta; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/; http://www.wise-guys.nl/)
Vagabondo/3.0 (webagent at wise-guys dot [...]

wwwster

Monday, June 11th, 2007

Owner of the robot : Ludwig-Maximilians-Universit?t M?nchen
Country : Germany
Robot type : search engine
Description : Crawler under development intended for specialized search engines.
User Agent transmitted to the visited web server :

wwwster/1.4 (Beta, mailto:gue@cis.uni-muenchen.de)

 

 
IP address range : from 129.187.0.0 to 129.187.255.255 (uni-muenchen.de)
URL for more information :
Access control options understood by the robot :

robots.txt

User Agent to [...]

WiseNut

Monday, June 11th, 2007

Owner of the robot : LookSmart, Ltd.
Country : USA
Robot type : search engine
Description : Search engine and directory. The results are also available through affiliated sites.
User Agent transmitted to the visited web server :

Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com)
Mozilla/4.0 compatible ZyBorg/1.0 (wn-14.zyborg@looksmart.net; http://www.WISEnutbot.com)
Mozilla/4.0 compatible ZyBorg/1.0 (wn-16.zyborg@looksmart.net; http://www.WISEnutbot.com)

 

 
IP address range : from 64.242.88.0 to [...]