Current User: Guest Login
Please consider registering


Lost Your Password?

Search Forums:


 






Minimum search word length is 4 characters – Maximum search word length is 84 characters
Wildcard Usage:
*  matches any number of characters    %  matches exactly one character

Help on Extra Section needed

Reply to Post Add a New Topic
UserPost

2:00 pm
September 23, 2008


cssfsu

Member

posts 55

Hey,  I am trying to add an Extra Section to grab stats for our detail pages..

This is an example of a record in my log file..

66.249.71.57 – - [21/Sep/2008:23:35:36
00000] “GET /software/brandcatalog/port
al/opal/details?catalog.label=1TW10TM1Y
 HTTP/1.1″ 200 7688 “-” “Mozilla/5.0 (c
ompatible; Googlebot/2.1; +http://www.g
oogle.com/bot.html)”

203.62.217.11 – - [21/Sep/2008:22:41:24
00000] “GET /software/brandcatalog/porta
l/opal/details?catalog.label=1TW10IM0C H
TTP/1.0″ 500 611 “-” “Mozilla/4.0 (compa
tible; MSIE 7.0; Windows NT 5.1; .NET CL
R 1.1.4322; .NET CLR 2.0.50727; .NET CLR
 3.0.04506.648; .NET CLR 3.5.21022)”

This is how I ve my Extra Section..

ExtraSectionName1=”navCode Details”
ExtraSectionCodeFilter1=”200 304″
ExtraSectionCondition1=”URL,\\/software\\/
brandcatalog\\/portal\\/opal/\\details”
ExtraSectionFirstColumnTitle1=”navCode”
ExtraSectionFirstColumnValues1=”QUERY_ST
RING,catalog.label=([^&]+)”
ExtraSectionFirstColumnFormat1=”%s”
ExtraSectionStatTypes1=PL
ExtraSectionAddAverageRow1=0
ExtraSectionAddSumRow1=1
MaxNbOfExtra1=100
MinHitExtra1=1

On running, it returns nothing .. even though I ve those records in my log file.. Wht am i doing wrong here ?

navCode Details  
navCode Pages Last visit
Total 0  

2:42 pm
September 23, 2008


Jean-Luc

Admin

posts 1125

There is a typo in your extra section:

portal\\/opal/\\detailsshould be

portal\\/opal\\/details

7:07 pm
September 23, 2008


cssfsu

Member

posts 55

Thanks that helped..

But I get an error like this.. I believe I would have about ~ 1000 values which might be returned and I had MaxNbOfExtra1=500

Should I add a parameter as ExtraTrackedRowsLimit=1000 or so to make this run successfully ?

Error: The number of values found for extra section 1 has grown too large.
> In order prevent awstats from using an excessive amount of memory, the number
> of values is currently limited to 500. Perhaps you should consider
> revising extract parameters for extra section 1. If you are certain you
> want to track such a large data set, you can increase the limit by setting
> ExtraTrackedRowsLimit in your awstats configuration file.

12:57 am
September 24, 2008


Jean-Luc

Admin

posts 1125

That's correct. You need to increase the value of ExtraTrackedRowsLimit .

6:55 pm
September 24, 2008


cssfsu

Member

posts 55

Sweet, that helped as well.. There are 2 other extra sections I need to generate.. If u could help, i would appreciate ..

For a log record like this,

9.57.56.253 – - [24/Sep/2008:10:21:12 -
0400] “GET /software/brandcatalog/porta
l/123/details?catalog.label=1TW10OT05&c
atalog.path=featured HTTP/1.1″ 200 7984
 177542 “http://www-abc.com/software/br
andcatalog/portal/123″ “Mozilla/4.0 (co
mpatible; MSIE 6.0; Windows NT 5.1; SV1
; .NET CLR 1.1.4322; .NET CLR 2.0.50727
; .NET CLR 3.0.04506.30; .NET CLR 3.0.0
4506.648)”

I need an extra section to list out all catalog.label (s) which have catalog.path=featured in their methodURL.

Where do I add the condition for 'catalog.path=featured' in the Extra Section below to be able to do what i want ?

ExtraSectionName1=”Featured Assets Count”
ExtraSectionCodeFilter1=”200 304″
ExtraSectionCondition1=”URL,\\/software\\
/brandcatalog\\/portal\\/123/details|URL,
\\/software\\/brandcatalog\\/myportal\\/123
\\/details”
ExtraSectionFirstColumnTitle1=”navCode”
ExtraSectionFirstColumnValues1=”QUERY_S
TRING,catalog.label=([^&]+)”
ExtraSectionFirstColumnFormat1=”%s”
ExtraSectionStatTypes1=PL
ExtraSectionAddAverageRow1=0
ExtraSectionAddSumRow1=1
MaxNbOfExtra1=500
MinHitExtra1=1\\
ExtraTrackedRowsLimit=1200

Next, For a log record like this,

9.57.57.42 – - [24/Sep/2008:04:38:30 -0
400] “GET /images/defaultImage.gif HTTP
/1.1″ 304 – 263 “http://www-abc.com/sof
tware/brandcatalog/portal/123/results?c
atalog.c=Price_Trial&catalog.catalogNam
e=123&catalog.start=0&catalog.searchTer
ms=” “Mozilla/4.0 (compatible; MSIE 6.0
; Windows NT 5.1; SV1; .NET CLR 1.1.432
2; CIBA)”

I need an extra section to list out all the parameters after /123/results?

So in this case I need a listing of params like

catalog.c=Price_Trial&catalog.catalogNa
me=123&catalog.start=0&catalog.searchTe
rms=

What do I add in the below extra sections so that it lists out the whole line and not just catalog.c parameter ? I want

catalog.c=Price_Trial&catalog.catalogNa
me=123&catalog.start=0&catalog.searchTe
rms=

ExtraSectionName1=”Search Terms”
ExtraSectionCodeFilter1=”200 304″
ExtraSectionCondition1=”URL,\\/software\\
/brandcatalog\\/portal\\/123/results|URL,
\\/software\\/brandcatalog\\/myportal\\/123
\\/results”
ExtraSectionFirstColumnTitle1=”navCode”
ExtraSectionFirstColumnValues1=”QUERY_S
TRING,catalog.c=([^&]+)”
ExtraSectionFirstColumnFormat1=”%s”
ExtraSectionStatTypes1=PL
ExtraSectionAddAverageRow1=0
ExtraSectionAddSumRow1=1
MaxNbOfExtra1=500
MinHitExtra1=1\\
ExtraTrackedRowsLimit=1200

2:18 am
September 25, 2008


Jean-Luc

Admin

posts 1125

Try this in the first extra section :

ExtraSectionFirstColumnValues1="QUERY_S
TRING,catalog.label=([^&]+)&catalog.pat
h=featured"

The second one is easy (if I understand you correctly) :

ExtraSectionFirstColumnValues1="QUERY_S
TRING,(.*)"

2:33 pm
September 25, 2008


cssfsu

Member

posts 55

Hey Jean, so the first one worked great, thanks !!

for the second one, it gave me an error saying 'Error: The number of values found for extra section 3 has grown too large.' even though I had set up ExtraTrackedRowsLimit .

I actually dont need the whole string of parameters.. Let me clarify.. from the string below, catalog.c=Price_Trial&catalog.catalogNa
me=123&catalog.start=0&catalog.searchTe
rms=

I just need values of catalog.c= and catalog.searchTerms=

how do i filter these 2 params out ?

3:04 pm
September 25, 2008


Jean-Luc

Admin

posts 1125

You cannot do that. You cannot get two distinct fields in the first column of the extra section.

You could use a more complicated ExtraSectionFirstColumnValues1 that would show the catalog.searchTerms for some given values of catalog.c. You will need a different extra section for each set of values of catalog.c that you want to analyze. So it is a solution if there are a few values to monitor, but it is not realistic if there are many.

8:21 pm
October 10, 2008


cssfsu

Member

posts 55

66.249.71.57 – - [21/Sep/2008:23:35:36 00000] “GET /software brandcatalog/portal/opal/details?catalog.label=1TW10TM1Y HTTP/1.1″ 200 7688 “-” “Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)”

203.62.217.11 – - [21/Sep/2008:22:41:24 00000] “GET /softwarebrandcatalog/portal/opal/details?catalog.label=1TW10IM0C HTTP/1.0″ 500 611 “-” “Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022)

For log records like above, I want an Extra Section to just show me all hits for pages ending in /softwarebrandcatalog/portal/opal/details?catalog.label

So this would be something like the standard section Top Pages in AWStats- only prob is that over there they show me upto a directory level, eg pages for URLs ending in /softwarebrandcatalog/portal/opal/details

I know the above one would contain what I want as well, but I explicitly want an extra section to show me a total of how many page views were there for /softwarebrandcatalog/portal/opal/details?catalog.label

Any ideas ?

4:53 am
October 11, 2008


Jean-Luc

Admin

posts 1125

This should not be particularly difficult. Did you try with URLWITHQUERY in ExtraSectionCondition1 ?

7:49 pm
October 11, 2008


cssfsu

Member

posts 55

I did.. it generated an empty table..

Below is one example of what I tried.. it didnt work.. I tried several other tihngs too.. Any idea wht i m doing wrong ?

ExtraSectionName2=”Total Item Pageviews”
ExtraSectionCodeFilter2=”200 304?
ExtraSectionCondition2=”URLWITHQUERY,\\/s
oftware\\/brandcatalog\\/portal\\/opal\\/det
ails\\?catalog.label=1TW*|URLWITHQUERY,\\/
software\\/brandcatalog\\/myportal\\/opal\\/
details\\?catalog.label=1TW*”
ExtraSectionFirstColumnTitle2=”TotalPages”
ExtraSectionFirstColumnValues2=”URLWITHQ
UERY,(.*)”
ExtraSectionFirstColumnFormat2=”%s”
ExtraSectionStatTypes2=PL
ExtraSectionAddAverageRow2=0
ExtraSectionAddSumRow2=1
MaxNbOfExtra2=1000
MinHitExtra2=1
ExtraTrackedRowsLimit=1200

1:40 am
October 12, 2008


Jean-Luc

Admin

posts 1125

You did not use the right OR symbol. It should be :

ExtraSectionCondition2="URLWITHQUERY,\\/
software\\/brandcatalog\\/portal\\/opal\\/d
etails\\?catalog.label=1TW*||URLWITHQUER
Y,\\/software\\/brandcatalog\\/myportal\\/o
pal\\/details\\?catalog.label=1TW*"

There are two different OR symbols within AWStats extra sections :

 - | must be used within a model (usual regex OR)

 - || must be used to separate two different conditions (special for AWStats).

2:51 am
October 12, 2008


cssfsu

Member

posts 55

Actually, I tried that too. Didnt work. Moreover, I even tried just putting a single condition like below, but that still doesnt work.. Gives me an error like

” Error: Wrong value of parameter ExtraSectionCondition”

ExtraSectionCondition2=”URLWITHQUERY,\\/
software\\/brandcatalog\\/portal\\/opal\\/d
etails\\?catalog.label=1TW*”

Any idea ?

3:07 am
October 12, 2008


Jean-Luc

Admin

posts 1125

The message "wrong value of parameter" indicates a syntax error, but I don't see any error in your ExtraSectionCondition2.

Double-check that you do not have a second definition of ExtraSectionCondition2 in your config file. Also make sure that the double-quote character  ( " ) that you are using is the regular one. This forum software often automatically replaces it by special double-quote characters ( " or ).

Sorry, I have no better idea now.

4:24 am
October 12, 2008


cssfsu

Member

posts 55

ok thanks !

Btw, maybe u can help clear one thing for me..

In the Top Pages section, I was seeing something like this,

/software/brandcatalog/portal/opal/details           6139

Then, in an extra section that I had written to display essentially the same thing as above, but to a more granular level (with individual navcode hits), I see a different total count..

Total                                                           5781

Would u know as to why this might be happening since essentially it should be the same ?

3:57 pm
October 12, 2008


Jean-Luc

Admin

posts 1125

These figures are not possible. If you look for exactly the same thing under "Top Pages" and in an extra section, the number in the extra section will always be higher than under "Top Pages", because "Top Pages" does not include hits from robots and the extra section does.

1:50 am
October 13, 2008


Jean-Luc

Admin

posts 1125

Note that if you use AWStats 6.7 or older, the total made by AWStats at the end of the extra section is the total of the lines that appear in the report; it is not the total of the lines in the AWStats database. In other words, you do not get the same total with MaxNbOfExtra2=10 and with MaxNbOfExtra2=20 if there are more than 10 entries.

With AWStats 6.8 and newer, you can get a full list of the extra section.

Reply to Post

Reply to Topic:
Help on Extra Section needed

Guest Name (Required):

Guest Email (Required):

NOTE: New Posts are subject to administrator approval before being displayed

Smileys
Confused Cool Cry Embarassed Frown Kiss Laugh Smile Surprised Wink Yell
Post New Reply

Guest URL (required)

Math Required!
What is the sum of:
10 + 9
   


About the InternetOfficer.com Forum

Forum Timezone: UTC 1

Most Users Ever Online: 302

Currently Online:
14 Guests

Currently Browsing this Topic:
1 Guest

Forum Stats:

Groups: 2
Forums: 9
Topics: 638
Posts: 2709

Membership:

There are 257 Members
There have been 302 Guests

There is 1 Admin
There is 1 Moderator

Top Posters:

cssfsu – 55
deepakgupta – 34
albert_newton – 30
cosminpana – 20
DTNMike – 19
ahtshun83 – 17

Recent New Members: raju, todd2taylor, sbdcunha, mansigill1987, ThomasDuh, ThomasKic

Administrators: Jean-Luc (1125 Posts)

Moderators: Jean-Luc (1125 Posts)