Current User: Guest Login
Please consider registering


Lost Your Password?

Search Forums:


 






Minimum search word length is 4 characters – Maximum search word length is 84 characters
Wildcard Usage:
*  matches any number of characters    %  matches exactly one character

Excluding Spider hits from extra section count

Reply to Post Add a New Topic
UserPost

3:02 pm
October 16, 2008


cssfsu

Member

posts 55

32.97.110.142 – - [15/Oct/2008:08:59:17 00000] “GET /software/brandcatalog/portal/opal/details?NavCode=1TW101003 HTTP/1.1″ 200 7152 “-” "swish-e spider 2.2 http://swish-e.org/" “-” 0.180 TCP_MISS_PRIVATE_ON_STOP_LIST/200 7616 GET http://www-01.xyz.com/software/brandcatalog/portal/opal/details?NavCode=1TW101003 DIRECT/9.57.57.42 “text/html; charset=UTF-8″ – )”

Above is an example of a record in my log file with the spider information.. This is messing up my extra section as all such hits from the spider shows up there as well..

Any way I can exclude this and/or other spiders from my extra sections count which is below..

ExtraSectionName1=”navCode Details (Top 500 terms)”
ExtraSectionCodeFilter1=”200 304″
ExtraSectionCondition1=”URL,\\/software\\
/brandcatalog\\/portal\\/soa\\/details||UR
L,\\/software\\/brandcatalog\\/myportal\\/so
a\\/details”

ExtraSectionFirstColumnTitle1=”navCode”
ExtraSectionFirstColumnValues1=”QUERY_S
TRING,catalog.label=([^&]+)”

ExtraSectionFirstColumnFormat1=”%s”
ExtraSectionStatTypes1=PL
ExtraSectionAddAverageRow1=0
ExtraSectionAddSumRow1=1
MaxNbOfExtra1=500
MinHitExtra1=1\\
ExtraTrackedRowsLimit=1200

I tried to omit the spider by adding this line in the conf file, but it didnt help..

SkipUserAgents=”swish-e spider 2.2 http://swish-e.org/

Plz help as i am stuck over here..

4:07 pm
October 16, 2008


Jean-Luc

Admin

posts 1125

Try this :

SkipUserAgents="REGEX[swish]"

6:24 pm
October 16, 2008


cssfsu

Member

posts 55

No it didnt work.. Still the extra section shows the hits by the spider..  It seems that there is no way to exclude the spider hits in the extra section.. If u ve any more ideas, do let me know..

thanks !

12:32 am
October 17, 2008


Jean-Luc

Admin

posts 1125

SkipUserAgents  does not change what is already in the AWStats database, but it forces AWStats to drop the records with these user agents when reading the log file. This means that the "swish-e" hits which were already in the extra section will stay there, but no new one will be added.

If you delete or rename the AWStats database files and run the update again, no hit from "swish-e" should appear in the extra section.

Reply to Post

Reply to Topic:
Excluding Spider hits from extra section count

Guest Name (Required):

Guest Email (Required):

NOTE: New Posts are subject to administrator approval before being displayed

Smileys
Confused Cool Cry Embarassed Frown Kiss Laugh Smile Surprised Wink Yell
Post New Reply

Guest URL (required)

Math Required!
What is the sum of:
3 + 9
   


About the InternetOfficer.com Forum

Forum Timezone: UTC 1

Most Users Ever Online: 302

Currently Online:
104 Guests

Currently Browsing this Topic:
1 Guest

Forum Stats:

Groups: 2
Forums: 9
Topics: 638
Posts: 2709

Membership:

There are 257 Members
There have been 302 Guests

There is 1 Admin
There is 1 Moderator

Top Posters:

cssfsu – 55
deepakgupta – 34
albert_newton – 30
cosminpana – 20
DTNMike – 19
ahtshun83 – 17

Recent New Members: raju, todd2taylor, sbdcunha, mansigill1987, ThomasDuh, ThomasKic

Administrators: Jean-Luc (1125 Posts)

Moderators: Jean-Luc (1125 Posts)