grub
Owner of the robot : LookSmart, Ltd.
Country : USA
Robot type : distributed search engine
Description : Grub was a distributed computing platform, crawling the web from a large number of diverse client machines, using otherwise unused bandwidth and compute cycles. The Grub crawling project is no longer operational.
User Agent transmitted to the visited web server :
- Mozilla/4.0 (compatible; grub-client-2.3)
- Mozilla/4.0 (compatible; grub-client-2.6.0)
IP address range : from to ()
URL for more information : http://www.grub.org/
Access control options understood by the robot :
- robots.txt
User Agent to use in the robots.txt file : grub-client
Last visit of this robot logged in October 2005.
Other informations updated on October 19, 2005.
