Current User: Guest Login
Please consider registering


Lost Your Password?

Search Forums:


 






Minimum search word length is 4 characters – Maximum search word length is 84 characters
Wildcard Usage:
*  matches any number of characters    %  matches exactly one character

Statistics on the visits to a particular page

Reply to Post Add a New Topic
UserPost

5:04 pm
July 26, 2008


Paul

Guest

Hi,

I am trying to produce statistics for this page:

http://www.familylawwebguide.com.au/news/index.php?page=aries

I have studied some of the posts in these forums and I have come up with the following Extra section:

ExtraSectionName5="Horoscopes"
ExtraSectionCodeFilter5="200 304"
ExtraSectionCondition5="URL,^\\/news\\/index.php\\?page=a.*"
ExtraSectionFirstColumnTitle5="Star Sign"
ExtraSectionFirstColumnValues5="URL,(.*)"
ExtraSectionStatTypes5=PHBL
ExtraSectionAddAverageRow5=0
ExtraSectionAddSumRow5=1
MaxNbOfExtra5=13
MinHitExtra5=1

However, this, and many other variants are not working. Does anyone have an idea as to what I am doing wrong?

Thanks

1:36 am
July 27, 2008


Jean-Luc

Admin

posts 1125

Hi,

As you intend to test the query (the part of the URL that follows the “?”), you need to use URLWITHQUERY in place of URL in both the ExtraSectionCondition  and the ExtraSectionFirstColumnValues.

Should work fine after this small correction.

4:54 pm
July 28, 2008


Paul

Guest

Hi Jean-Luc,

Thanks for the suggestion.

I tried the URLWITHQUERY but this didn't work either. I also tried the URLWITHQUERY with the ”URL,^\\/forum\\/index.php\\?page=forumview" as there are plenty of log entries for this URL, but that didn't work either.

Do you have any suggestions on some test code that I can use to try and work out why it's not working?

2:29 am
July 29, 2008


Jean-Luc

Admin

posts 1125

Hi Paul,

It should work with URLWITHQUERY ! I tried your extra section here with a short log file that I created for the test and it was working fine.

Did you update the stats after you changed the extra section ? Changes will only be effective for the new log entries read by AWStats after you made the change in the extra section.

6:34 pm
July 29, 2008


Paul

Guest

Thank you for your continued help.

I updated the stats each time I changed the conf file. Also, a batch job updates the stats each night. I still have no entries for the extra section.

In the past I have ran the following command but this does not generate the right output either. I have a pretty standard install but I wonder if something is not working?

perl awstats.pl -config=flwg -output=urldetail:/spca -staticlinks > d:\\familylawwebguide\\webstats\\pages\\ html_custom\\EN\\spca_urldetail.htm

2:08 am
July 30, 2008


Jean-Luc

Admin

posts 1125

Please paste here your extra section as it is now and a few lines from your log file (with some lines that match the condtion of your extra section).

3:32 am
July 31, 2008


Paul

Guest

Hi,

Sorry for the delay in getting back to you but I've been trying to understand my IIS logs. I'm not sure I have figured it out yet.

The Extra section code that I am using is:

ExtraSectionName5=”Horoscopes”
ExtraSectionCodeFilter5=”200 304?
ExtraSectionCondition5=”URLWITHQUERY,^\\/news\\/index.php\\?page=a.*”
ExtraSectionFirstColumnTitle5=”Star Sign”
ExtraSectionFirstColumnValues5=”URLWITHQUERY,(.*)”
ExtraSectionStatTypes5=PHBL
ExtraSectionAddAverageRow5=0
ExtraSectionAddSumRow5=1
MaxNbOfExtra5=13
MinHitExtra5=1

The page is here:

http://www.familylawwebguide.com.au/news/index.php?page=aries

I am not sure what the correct log entries are so I have included a few (sorry for the amount)

2008-07-31 07:31:18 GET /forum/index.php
- 66.249.70.72 HTTP/1.1 Mozilla/5.0+(co
mpatible;+Googlebot/2.1;++http://www.go
ogle.com/bot.html) – 200 36868
 
2008-07-31 07:31:29 GET /news/index.php
- 74.6.18.230 HTTP/1.0 Mozilla/5.0+(com
patible;+Yahoo!+Slurp;+http://help.yaho
o.com/help/us/ysearch/slurp) – 200 2490
9

2008-07-31 07:31:29 GET /themes/www_fam
ilylawwebguide_com_au/templates_cached/
EN/global.css – 211.28.158.220 HTTP/1.1
Mozilla/4.0+(compatible;+MSIE+7.0;+Win
dows+NT+5.1;+MSOffice+12) – 304 191

[ parts of the log file removed by admin ]

7:31 am
July 31, 2008


Jean-Luc

Admin

posts 1125

As you are using IIS, the visited URL's are split in two parts in the log file:

- cs-uri-stem (called %url  by AWStats)

- cs-uri-query (called %query by AWStats)

For http://www.familylawwebguide.com.au/news/index.php?page=aries,

"cs-uri-stem" is "/news/index.php" and "cs-uri-query" is "page=aries".

As far as I can see, there is no cs-uri-query column in your log file. This should be changed in the IIS configuration if you need to monitor the query string.

The first line of your log file contains the list of fields present in the file.

4:29 pm
July 31, 2008


flwg

Australia

Member

posts 12

Jean-Luc, you're quite right !

This is my conf entry:

LogFormat="date time cs-method cs-uri-stem cs-username c-ip cs-version cs(User-Agent) cs(Referer) sc-status sc-bytes"

URI Query is also not checked in my IIS properties for logging.

Can I just edit my conf file and enable URI Query in IIS?

My IIS log file runs for the whole month, and I don't want to corrupt the AWStats figures.

2:55 am
August 1, 2008


Jean-Luc

Admin

posts 1125

I would suggest that you make a backup copy of the AWStats database file for July and August when your AWStats has completely processed that log file in the "old" format.

There are two possible LogFormat definitions for IIS in the AWStats config file: either you use LogFormat=2  or you use an extensive definition specifiying all fields in the LogFormat.

There are known problems in the implementation of  LogFormat=2. AWStats should automatically take the change in format into account, but I I am not sure that this will happen.

On the other hand, if you use the extensive definition, you will need to split the log file into the part before the change and the part after the change in log format. The first part will have to be processed with the "old" LogFormat definition and the second part with the "new" one.

4:30 pm
August 1, 2008


flwg

Australia

Member

posts 12

GREAT!

This is working fine now, Thanks……

I have a number of EXTRA sections that I would like to run but this will make my default page very long. Is there a way to direct the output to a different page?

12:32 am
August 2, 2008


Jean-Luc

Admin

posts 1125

Good to hear that it is working now !

Upgrade to AWStats 6.9 and you will get a "Full list" option in the extra section. You can make the extra sections in the main report as short as you like and you get the full lists in separate reports.

By the way, this upgrade to 6.9 is recommended for security reasons too. 

5:59 am
August 12, 2008


flwg

Australia

Member

posts 12

Sounds like the upgrade is worthwhile. Is there any documentation on the upgrade process?

I've had a quick look arround the awstats site, can't find anything. I guess I'll have to overwrite the existing files, update my conf file…anything else?

I noticed that 6.8 only came out last month, is it worth jumping to 6.9?

6:15 am
August 12, 2008


Jean-Luc

Admin

posts 1125

As a vulnerability was reported in 6.8 shortly after it was released, I recommend you upgrade to 6.9, not because of 6.9 features but for security reasons.

You upgrade by overwriting awstats.pl and the /lib, /plugins and /lang directories. As far as I know, there is no need to change an existing .conf file.

5:57 pm
August 12, 2008


flwg

Australia

Member

posts 12

HI,

I've started to notice a difference in the pages column. The average appears to have dropped by about half from the previous month. Generally figures for this month are slightly lower. All other columns appear to be similar but the 'Pages' figure is significantly lower.

Average for July was 575 visitors with 13644 pages and 41451 hits

Average this month is 499 visitors with 6534 pages and 31496 hits

Has adding the 'cs-uri-query' influenced the figures?

I have deleted this months awstats file, split my log into two, and regenerated the awstats file with the two logs. When updating the secong log file (larger than the first), I got an error about an Extra section having too many extries. So both the logs were processed without any Extra sections in the conf file.

1:49 pm
August 13, 2008


Jean-Luc

Admin

posts 1125

According to AWStats documentation, the file extension in cs-uri-stem determines what a page is. cs-uri-query should not have any influence.

If there are too many entries in some extra sections, change the ExtraTrackedRowsLimit directive in the config file (default is 500 rows) and/or consider to change the definition of the extra section in order to reduce the number of rows it produces.

4:21 pm
August 25, 2008


flwg

Australia

Member

posts 12

I'm definitely getting some conflicting figures now and I'm not sure where to look for a solution or even what might be causing the descrepancies. You helped me out previously with creating an extra section to show what pages were displayed from particular directories, this section shows a total of 292348 (that is pages from all directories), whilst the summary section displays 144270.

How can I figure out the correct amount of pages?

Which figure is correct?

I ran an update for last months figures (the logs did not contain  cs-uri-query) and the two figures are very similar (422974/427737).

12:49 am
August 26, 2008


Jean-Luc

Admin

posts 1125

The summary section shows the number of pages under "viewed traffic" and under "not viewed traffic". "Not viewed traffic" includes traffic from robots and HTTP errors. An extra section counts "viewed traffic" and robots traffic; HTTP errors are excluded.

So, total pages (all directories) from an extra section should be about the same as pages under "viewed traffic" plus pages under "not viewed traffic", if the number of HTTP errors is small (see section of the report titled "HTTP Status Codes").

7:02 am
August 26, 2008


flwg

Australia

Member

posts 12

Thanks……..

Figures are:

viewed – 144270

not viewed – 252270

Extra section directory total – 292348

Status Codes has only hits not pages about 70000

Does this sound right?

9:08 am
August 26, 2008


Jean-Luc

Admin

posts 1125

Sounds okay.

Reply to Post

Reply to Topic:
Statistics on the visits to a particular page

Guest Name (Required):

Guest Email (Required):

NOTE: New Posts are subject to administrator approval before being displayed

Smileys
Confused Cool Cry Embarassed Frown Kiss Laugh Smile Surprised Wink Yell
Post New Reply

Guest URL (required)

Math Required!
What is the sum of:
4 + 1
   


About the InternetOfficer.com Forum

Forum Timezone: UTC 1

Most Users Ever Online: 302

Currently Online:
10 Guests

Currently Browsing this Topic:
1 Guest

Forum Stats:

Groups: 2
Forums: 9
Topics: 638
Posts: 2712

Membership:

There are 257 Members
There have been 305 Guests

There is 1 Admin
There is 1 Moderator

Top Posters:

cssfsu – 55
deepakgupta – 34
albert_newton – 30
cosminpana – 20
DTNMike – 19
ahtshun83 – 17

Recent New Members: raju, todd2taylor, sbdcunha, mansigill1987, ThomasDuh, ThomasKic

Administrators: Jean-Luc (1125 Posts)

Moderators: Jean-Luc (1125 Posts)