Category Archive for 'web-robot'
Monday, June 11th, 2007
Owner of the robot : Yahoo! Inc. Country : USA Robot type : search engine Description : The multimedia crawler used by Yahoo! Image Search. User Agent transmitted to the visited web server : Yahoo-MMCrawler/3.x (mms dash mmcrawler dash support at yahoo dash inc dot com) IP address range : from 209.191.64.0 to [...]
Posted in web-robot | Comments Off
Monday, June 11th, 2007
Owner of the robot : Yahoo Japan Corporation Country : Japan Robot type : search engine Description : Yahoo! Japan blog search service (beta edition). User Agent transmitted to the visited web server : Y!J-BSC/1.0 (http://help.yahoo.co.jp/help/jp/blog-search/) IP address range : from 203.141.52.0 to 203.141.52.63 (yahoo.co.jp) URL for more information : http://help.yahoo.co.jp/help/jp/blog-search/ Access control [...]
Posted in web-robot | Comments Off
Monday, June 11th, 2007
Owner of the robot : Yahoo! Inc. Country : USA Robot type : search engine Description : Yahoo!'s blog indexing robot. User Agent transmitted to the visited web server : Yahoo-Blogs/v3.9 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/ysearch/crawling/crawling-02.html ) IP address range : from 68.142.192.0 to 68.142.255.255 (yahoo.com) URL for more information : Access [...]
Posted in web-robot | Comments Off
Monday, June 11th, 2007
Owner of the robot : Michael Christen Country : Germany Robot type : distributed search engine Description : P2P-based Web indexing network. User Agent transmitted to the visited web server : yacy (www.yacy.net; v20040602; i386 Linux 2.6.15-20-k7; java 1.5.0_06; Europe/de) yacy (www.yacy.net; v20040602; ppc Mac OS X 10.4.6; java 1.5.0_06; Europe/de) yacybot (ppc Mac OS [...]
Posted in web-robot | Comments Off
Monday, June 11th, 2007
Owner of the robot : Tilman Hausherr Country : Germany Robot type : link checker software (follows the internal and external links found in the main analyzed site only; does not spider other sites) Description : Free link checker software. User Agent transmitted to the visited web server : Xenu's Link Sleuth 1.1c Xenu Link [...]
Posted in web-robot | Comments Off
Monday, June 11th, 2007
Owner of the robot : WiseGuys Internet BV Country : Netherlands Robot type : search engine Description : Search engine with special features for the Dutch market. User Agent transmitted to the visited web server : Mozilla/4.0 (compatible; Vagabondo/4.0Beta; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/) Mozilla/4.0 (compatible; Vagabondo/4.0Beta; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/; http://www.wise-guys.nl/) [...]
Posted in web-robot | Comments Off
Monday, June 11th, 2007
Owner of the robot : Ludwig-Maximilians-Universit?t M?nchen Country : Germany Robot type : search engine Description : Crawler under development intended for specialized search engines. User Agent transmitted to the visited web server : wwwster/1.4 (Beta, mailto:gue@cis.uni-muenchen.de) IP address range : from 129.187.0.0 to 129.187.255.255 (uni-muenchen.de) URL for more information : Access control [...]
Posted in web-robot | 1 Comment »
Monday, June 11th, 2007
Owner of the robot : LookSmart, Ltd. Country : USA Robot type : search engine Description : Search engine and directory. The results are also available through affiliated sites. User Agent transmitted to the visited web server : Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com) Mozilla/4.0 compatible ZyBorg/1.0 (wn-14.zyborg@looksmart.net; http://www.WISEnutbot.com) Mozilla/4.0 compatible ZyBorg/1.0 (wn-16.zyborg@looksmart.net; [...]
Posted in web-robot | 1 Comment »
Monday, June 11th, 2007
Owner of the robot : Wink Technologies, Inc. Country : USA Robot type : search engine Description : Search engine that integrates tag results from multiple sources such as del.icio.us, Digg,? User Agent transmitted to the visited web server : WinkBot/0.06 (Wink.com search engine web crawler; http://www.wink.com/Wink:WinkBot; winkbot@wink.com) IP address range : from [...]
Posted in web-robot | Comments Off
Monday, June 11th, 2007
Owner of the robot : Name Intelligence, Inc. Country : USA Robot type : probe (does not spider sites) Description : SurveyBot queries web sites for statistics and other informations of interest to webmasters and domain buyers. User Agent transmitted to the visited web server : SurveyBot/2.3 (Whois Source) IP address range : [...]
Posted in web-robot | Comments Off