Current User: Guest Login
Please consider registering


Lost Your Password?

Search Forums:


 






Minimum search word length is 4 characters – Maximum search word length is 84 characters
Wildcard Usage:
*  matches any number of characters    %  matches exactly one character

browser info section remains blank

Reply to Post Add a New Topic
UserPost

9:42 am
September 19, 2008


JGarc

Guest

Hi all,

I've been using recommendations from another thread on this forum as well as what I've tried to figure out on my own but no dice. I'm attempting to parse old logs on my webserver. Please take a look at the following:
#Fields: date time s-sitename s-ip cs-method cs-uri-stem cs-uri-query s-port cs-username c-ip cs(User-Agent) sc-status sc-substatus sc-win32-status
(I believe this is standard IIS W3C formatting)
I've tried the following LogFormats:
%time2 %other %other %method %url %query %other %logname %host %ua %code %other %bytesd
(modified the 2nd field to 1111 then tried) 
%time2 %bytesd %other %method %url %other %other %logname %host %ua %code %other %other
…the only field I'm interested in is the browser info and detailed report if possible. I've been able to get some of the data but this section of the report always remains blank. Please help!

9:56 am
September 19, 2008


Jean-Luc

Admin

posts 1125

Hi,

I don't see any error in your LogFormats (knowing that you have no true %bytesd  field).

Do you have valid values under both "viewed traffic" and "not viewed traffic" in the "Summary" section of the report ?

Not sure what the problem is, but check that this is set in your AWStats config file:

LevelForBrowsersDetection=2

11:37 am
September 19, 2008


JGarc

Guest

Jean-Luc thank you for your prompt reply sir!  I've confirmed that the value LevelForBrowsersDetection is set to 2.  I've also confirmed that my report does NOT show anything in viewed / not viewed traffic.  In fact, the only data that gets accurately populated on the report  is the date / time as well as the monthly history section just under summary.  Every other section remains empty.  Currently using the following LogFormat:

%time2 %bytesd %other %method %url %other %other %logname %host %ua %code %other %other (keep in mind manipulated 1111 for %bytesd)

Currently using the following perl cmd's to generate reports:

perl awstats.pl -config=cadb -update

perl awstats.pl -config=cadb -output -staticlinks > report.html

perl awstats.pl -config=cadb -output=browserdetail -staticlinks > report2.html

As stated earlier, report.html only shows data populated in the Monthly History section while rerport2.html shows no data populated in the browsers section.

Oddly enough I have a second site that I run privately which I was able to manipulate the log parameters being captured to match what's in the AWSTATS manual, and all the reporting features work beautifully so I know the scripting works!  It seems to be a problem with the logformat.

Again, thank you Jean-Luc you are a master of your craft and your help is always appreciated!

12:40 pm
September 19, 2008


Jean-Luc

Admin

posts 1125

The commands you are using are generatiing the output files for this month. What you describe suggests me that you might have data for some previous months but not for September 2008.

To generate a report file for a given month, add the -month and -year options in the command line, like in this example for August 2008 :

perl awstats.pl -config=cadb -update
perl awstats.pl -config=cadb -output -staticlinks -month=08 -year=2008 > report.html
perl awstats.pl -config=cadb -output=browserdetail -staticlinks -month=08 -year=2008 > report2.html

Does this work better ?

4:16 pm
September 19, 2008


JGarc

Guest

Jean-Luc,

I'm sad to say that the above did not work.  I'm not having a problem making the html reports and the formatting of the html seems to be coming out perfect.  The problem seems to be data making it into the report.

4:39 pm
September 19, 2008


Jean-Luc

Admin

posts 1125

Okay.

For test purpose, before you run a new update, delete or rename all the existing AWStats database files called awstats092008.your_domain.txt , awstats082008.your_domain.txt , awstats072008.your_domain.txt , …

Then run the update (first command). What do you get when you run the update ? There should be something like this:

Parsed lines in file: ***
Found *** dropped records,
Found *** corrupted records,
Found *** old records,
Found *** new qualified records.

Go on with the second and third commands. Do you get a complete report now ?

9:58 am
September 23, 2008


JGarc

Guest

Ok, only found one config file named (awstats072008.cadb.txt) which I've deleted.

Next, I ran the 1st command listed previously (perl awstats.pl -config=cadb -update)

When I ran the update, I got the following output:

C:\\Perl\\bin>perl awstats.pl -config=cadb -update
Create/Update database for config "./awstats.cadb.conf" by AWStats version 6.8 (build 1.910)
From data in log file "C:\\logs\\ex080726.log"…
Phase 1 : First bypass old records, searching new record…
Searching new records from beginning of log file…
Phase 2 : Now process new records (Flush history on disk after 20000 hosts)…
Jumped lines in file: 0
Parsed lines in file: 77906
 Found 21 dropped records,
 Found 63 corrupted records,
 Found 0 old records,
 Found 77822 new qualified records.

Next, I ran the 2nd and 3rd command listed previously (perl awstats.pl -config=cadb -output -staticlinks -month=08 -year=2008 > report.html + perl awstats.pl -config=cadb -output=browserdetail -staticlinks -month=08 -year=2008 > report2.html)

Both the report html files show no browser info I'm sad to report.

10:32 am
September 23, 2008


Jean-Luc

Admin

posts 1125

I see that you have used the data from ex080726.log (which most probably is the log file for July 26) and then you generate the report with the -month=08 option which is August.

Try to run the second and third commands with -month=07. This should solve the problem.

Reply to Post

Reply to Topic:
browser info section remains blank

Guest Name (Required):

Guest Email (Required):

NOTE: New Posts are subject to administrator approval before being displayed

Smileys
Confused Cool Cry Embarassed Frown Kiss Laugh Smile Surprised Wink Yell
Post New Reply

Guest URL (required)

Math Required!
What is the sum of:
7 + 7
   


About the InternetOfficer.com Forum

Forum Timezone: UTC 1

Most Users Ever Online: 302

Currently Online:
10 Guests

Currently Browsing this Topic:
1 Guest

Forum Stats:

Groups: 2
Forums: 9
Topics: 638
Posts: 2712

Membership:

There are 257 Members
There have been 305 Guests

There is 1 Admin
There is 1 Moderator

Top Posters:

cssfsu – 55
deepakgupta – 34
albert_newton – 30
cosminpana – 20
DTNMike – 19
ahtshun83 – 17

Recent New Members: raju, todd2taylor, sbdcunha, mansigill1987, ThomasDuh, ThomasKic

Administrators: Jean-Luc (1125 Posts)

Moderators: Jean-Luc (1125 Posts)