Search Keywords/Phrases by Search Engine


AWStats provides a standard list of search engine keywords and keyphrases where there is a unique entry for each search phrase.

With our separate lists of search engine phrases for every major search engine, we often see that our successful keywords can be different for Google, Yahoo! Search and Bing (formerly Live.com, from Microsoft). You can edit our examples and make your own selection of search engines. You can also split results by country (search engine top level domain) : google.com, google.co.uk, google.co.jp, google.com.au,…

We list the complete search phrases, including quotes and other special characters, as the visitor from the search engines type them in.

You can add the Extra Sections below at the end of your awstats.your-domain-name.conf configuration file.

New Report

AWStats, keywords by search engine

This AWStats screen has been simulated for better readability.

Extra Sections

ExtraSectionName1="Google Search Keywords/Phrases"
ExtraSectionCodeFilter1="200 304"
ExtraSectionCondition1="REFERER,^http:\/\/www\.google\.[^/]+\/search\?.*q=.*$"
ExtraSectionFirstColumnTitle1="Search Phrases"
ExtraSectionFirstColumnValues1="REFERER,[?&]q= *([^& ][^&]*[^& +])[ +]*(&.*)?$"
ExtraSectionFirstColumnFormat1="%s"
ExtraSectionStatTypes1=PHBL
ExtraSectionAddSumRow1=1
MaxNbOfExtra1=10
MinHitExtra1=1

ExtraSectionName2="Yahoo! Search Keywords/Phrases"
ExtraSectionCodeFilter2="200 304"
ExtraSectionCondition2="REFERER,^http:\/\/(\w*\.)*search\.yahoo\.[^/]+\/.*$"
ExtraSectionFirstColumnTitle2="Search Phrases"
ExtraSectionFirstColumnValues2="REFERER,[?&]p= *([^& ][^&]*[^& +])[ +]*(&.*)?$"
ExtraSectionFirstColumnFormat2="%s"
ExtraSectionStatTypes2=PHBL
ExtraSectionAddSumRow2=1
MaxNbOfExtra2=10
MinHitExtra2=1

ExtraSectionName3="Bing – Live Search (Microsoft) Keywords/Phrases"
ExtraSectionCodeFilter3="200 304"
ExtraSectionCondition3="REFERER,^http:\/\/(search\.(msn\.[^/]+|live\.com)|www\.bing\.com)\/.*$"
ExtraSectionFirstColumnTitle3="Search Phrases"
ExtraSectionFirstColumnValues3="REFERER,[?&]q= *([^& ][^&]*[^& +])[ +]*(&.*)?$"
ExtraSectionFirstColumnFormat3="%s"
ExtraSectionStatTypes3=PHBL
ExtraSectionAddSumRow3=1
MaxNbOfExtra3=10
MinHitExtra3=1

MaxNbOfExtra* is the number of lines that will be listed. Use the most convenient value.

Further Technical Details

Leading and trailing spaces are removed from search phrases.

Phrases with upper and lower case letters are listed separately.

17 Responses to “Search Keywords/Phrases by Search Engine”

  1. Nadir says:

    Hello, thanks for these great tips. I’d like to add more search engines such as http://www.google.com/xhtml (google mobile), do you know how I should write the referrer in regex for that kind of url (with a / after .com)?
    Thanks!

  2. Jean-Luc says:

    My understanding is that these Google Mobile pages do not link to your web site. When you click on a link in these search results, a Google robot reads the page and reformats it for the visitor. As far as I know, your reformatted page is shown with a Google URL starting with http://www.google.com/gwt/…. The special Google robot that visits your page uses Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Google Wireless Transcoder;) as user agent, but it does not pass any information about the query entered by the visitor.

  3. Nadir says:

    Hi Jean-Luc, you’re right about the link to a reformatted page that looks like this in the search results:

    http://www.google.com/gwt/n?mrestrict=xhtml&site=search&q=seo&source=m&…

    There’s a query in the url, do you think it won’t be possible to get this information in AWstats?

    If you do a search in google.com/xhtml and click on “mobile web”, the link isn’t reformated as there are only mobile friendly pages, so I think it should work in that case, don’t you think?
    Thanks!

  4. Jean-Luc says:

    I see. I checked for “Mobile Web” results now. I would try this:
    ExtraSectionCondition1=”REFERER,^http:\/\/www\.google\.com\/xhtml\/search\?.*q=.*$”

  5. fred says:

    hi,

    The extra section is not functionnal. this extra section need to activate a plug-in ?

  6. Jean-Luc says:

    Hi fred,

    There is no need for a plugin. The problem was caused by WordPress replacing my " (quotation mark) by ” (right double quotation mark)… 🙁

    I have found a work-around and I just updated the extra section accordingly.

  7. fred says:

    ok, thank you.

    i test it now. but i wait for google visitor on my site.

  8. Jean-Luc says:

    For those looking for the original version of this page, it is still cached by Alexa as we created it in the beginning of 2006. 🙂

  9. Bruno de Oliveira says:

    Hi Jean-Luc
    I’m trying to use your solution but it’s not working
    IT appears on awstats.pl page but the records just not appear
    It returns like no records exist
    But, exist!

    What this could be ?

  10. Jean-Luc says:

    I see the three extra sections in your AWStats report at genius.org.br and they are not empty. What do you mean with “no records exist” ?

  11. Dean Graziosi says:

    Thanks for tips
    I want to emphasize on one thing.
    Now days 3 major Search engines like Google, Yahoo show the extra search phrases at the bottom of search page.This is a new innovation and we have to trace keywords from suggested key phrases.This is good news for seo community.

    Cheers..

  12. web-to-print says:

    Great job internetofficer guys!

  13. Oliver says:

    Thanks for the very useful information.
    Webshop owners and sellers can easily add another section, which includes Google Base queries:
    Just alter the condition
    ExtraSectionCondition1=”REFERER,^http:\/\/www\.google\.[^/]+\/search\?.*q=.*$”
    to
    ExtraSectionCondition1=”REFERER,^http:\/\/www\.google\.[^/]+\/products\?.*q=.*$”

  14. Romano says:

    Hello Jean-Luc
    thanks for your mod.

    Is it possible also get results in this way?
    http://www.google.com/search?hl=en&q=video+musicali

    Many thanks

  15. Jean-Luc says:

    Try this:
    ExtraSectionFirstColumnValues1="REFERER,^(.*)$"

    Not sure the report will be easy to read though.

  16. hekimboard says:

    Great job internetofficer guys!

  17. Jean-Luc says:

    Bing support added in extra section 3. Bing is the new Microsoft search engine that replaces Live.com.


 

Leave a Reply

You must be logged in to post a comment.