grub


Owner of the robot : LookSmart, Ltd.

Country : USA

Robot type : distributed search engine

Description : Grub was a distributed computing platform, crawling the web from a large number of diverse client machines, using otherwise unused bandwidth and compute cycles. The Grub crawling project is no longer operational.

User Agent transmitted to the visited web server :

  • Mozilla/4.0 (compatible; grub-client-2.3)
  • Mozilla/4.0 (compatible; grub-client-2.6.0)

 


 
IP address range : from to ()

URL for more information : http://www.grub.org/

Access control options understood by the robot :

  • robots.txt

User Agent to use in the robots.txt file : grub-client

 
Last visit of this robot logged in October 2005.
Other informations updated on October 19, 2005.