Alexa ia_archiver


Owner of the robot : Alexa Internet, Inc.

Country : USA

Robot type : search engine

Description : Alexa is an Amazon company. Its robot is called ia_archiver. It collects various data about the crawled sites. One of the applications is the publication of traffic rankings and related technical information like lists of inbound links.

ia_archiver crawls many more web pages than the ones that appear in Alexa search results. This is probably an indication that most of the collected data are used for other purposes.

Pages without any inbound link can be visited by ia_archiver, when the page has been visited by a user of the Alexa Toolbar.

    User Agent transmitted to the visited web server :

    • ia_archiver

    IP address range :

    • from 64.208.0.0 to 64.209.127.255 (alexa.com)
      (last visit in March 2008)
    • from 64.212.0.0 to 64.215.255.255 (alexa.com)
      (last visit in January 2008)

    Access control options understood by the robot :

    • robots.txt

    User Agent to use in the robots.txt file : ia_archiver

    URL’s for more information :

    Our pages about other ia_archiver robots :

    Leave a Reply