Google-Sitemaps


Owner of the robot : Google Inc.

Country : USA

Robot type : probe

Description : This Google probe sporadically checks the existence of the verification file of the Google Webmaster Tools. It searches for the file name written in upper and in lower case letters. The goal is probably to determine whether the server is case sensitive.

The probe also tries to fetch a non-existing file name. The code returned by the web server should be 404. If it is 200, Google knows that the site does not properly handle non-existing URL’s.

Typical log file content:
66.249.85.87 - - [01/Dec/2007:22:20:37 +0100] "GET /GOOGLE12a3456b78cd90e1.html HTTP/1.1" 404 - "-" "Google-Sitemaps/1.0"
66.249.85.87 - - [01/Dec/2007:22:20:38 +0100] "GET /google12a3456b78cd90e1.html HTTP/1.1" 200 14 "-" "Google-Sitemaps/1.0"
66.249.85.87 - - [01/Dec/2007:22:20:38 +0100] "GET /noexist_12a3456b78cd90e1.html HTTP/1.1" 404 - "-" "Google-Sitemaps/1.0"

    User Agent transmitted to the visited web server :

    • Google-Sitemaps/1.0

    IP address range :

    • from 66.249.64.0 to 66.249.95.255 ()
      (last visit in December 2007)
    • from 74.125.0.0 to 74.125.255.255 ()
      (last visit in March 2008)

    Access control options understood by the robot : unknown

    User Agent to use in the robots.txt file : unknown

    Our pages about other Google robots: