Current User: Guest Login Register
Please consider registering


Register? | Lost Your Password?

Search Forums:


 






Minimum search word length is 3 characters – Maximum search word length is 84 characters
Wildcard Usage:
*  matches any number of characters    %  matches exactly one character

IIS Logfiles. Trying to build static pages. Only Monthly history.

Reply to Post Add a New Topic
UserPost

2:47 pm
March 30, 2009


Arthur

Guest

Hello there.

I'm new to AWStats and to IIS. But unfortunatly I have to get along with IIS.

Otherwise AWStats wouldn't have made such a mess for me. :)

I got AWStats working with:

LogFormat="%time2 %other %other %other %method %url %query %other %logname %host %other %ua %other %code %other %other %bytesd %other %other"

I used “cat” and “grep” to concatenate and filter all the daily logfiles to one big 6 Gig log.

When I build the static pages for 2009 all data is analyzed correctly. Every category “monthly history”, “days of month”, “hours” and so on.

But the parameter “-year=2008″ only brings data to the “monthly history” table.

Every other table is empty.

Does someone know how to solve this problem?

Would be really nice. Since I'm going mad….. :)

Kind regards, Arthur

3:10 pm
March 30, 2009


Jean-Luc

Admin

posts 1063

Hi,

If I correctly understood your problem description, you have generated the January and February reports for 2009 and they are okay, but then you could not generate the static reports of any month of 2008.

The AWStats database files must be generated in chronological order. So you need to generate January before February before March and so on, and of course you need to generate the stats for 2008 before you generate the stats for 2009. If the chronological order was not respected, move the existing AWStats database files from the DirData directory to another temporary directory while you update the stats for the missing months.

3:23 pm
March 30, 2009


Arthur

Guest

Well. Thats the case. I processed all data in the correct order.

The logfiles were merged in the correct order.

And first, I processed 2008. Then 2009.

It still doesnt work. :(

I deleted all awstats data before every try.

3:31 pm
March 30, 2009


Jean-Luc

Admin

posts 1063

Were some 2008 data files created in the DirData directory ? What message do you get at the end of the update ?

4:33 pm
March 30, 2009


Arthur

Guest

Yes. I get some awstatsddmmyyyy.config.txt for 2008 and 2009.

Only the last Month of the "monthly history" have some info.

All othe data fields were left blank.

10:26 pm
March 30, 2009


Jean-Luc

Admin

posts 1063

Please paste here both the exact commands you used to run the updates and the messages that appeared on your screen when running the update. I mean this kind of messages:

Phase 1 : First bypass old records, searching new record…
Direct access to last remembered is out of file.
So searching new records from beginning of log file…

Jumped lines in file: ****
Parsed lines in file: ****
Found **** dropped records,
Found **** corrupted records,
Found **** old records,
Found **** new qualified records.

7:21 am
March 31, 2009


Arthur

Guest

Alright. Sorry misunderstood

This is what I get after some time:

MacPro:cgi-bin arthur$ perl awstats.pl -config=easd -year=2008 -update

Create/Update database for config "./awstats.easd.conf" by AWStats version 6.9 (build 1.925)
From data in log file "/Users/arthur/awstatseasd/easd.log"…
Phase 1 : First bypass old records, searching new record…
Searching new records from beginning of log file…
Phase 2 : Now process new records (Flush history on disk after 20000 hosts)…
Jumped lines in file: 0
Parsed lines in file: 16194635
 Found 0 dropped records,
 Found 0 corrupted records,
 Found 0 old records,
 Found 16194635 new qualified records.

Should be okay?

7:45 am
March 31, 2009


Jean-Luc

Admin

posts 1063

The -year=2008  option in your command is useless. AWStats runs the update from the data it founds in the log file (/Users/arthur/awstatseasd/easd.log ). If this file contains records of last year, AWStats data files for some months of last year will be generated. If there are no records of last year in the log file, AWStats will not be able to generate the last year data files even if you specify -year=2008  .

If you have a log file of last year somewhere else, you can use this command to create the last year database files:

perl awstats.pl -config=easd -update -logfile=/path/last_year.log

where /path/last_year.log  is the name of your log file of last year. Empty the DirData  directory before you run the command.

That the number of new qualified record equals the number of parsed lines indicates that your AWStats setup is okay.

11:31 am
March 31, 2009


Arthur

Guest

I don't have any changes in my resulting html files.

MacPro:cgi-bin arthur$ perl awstats.pl -config=easd -update
Create/Update database for config "./awstats.easd.conf" by AWStats version 6.9 (build 1.925)
From data in log file "/Users/arthur/awstatseasd/easd2008.log"…
Phase 1 : First bypass old records, searching new record…
Searching new records from beginning of log file…
Phase 2 : Now process new records (Flush history on disk after 20000 hosts)…
Jumped lines in file: 0
Parsed lines in file: 13191659
 Found 0 dropped records,
 Found 0 corrupted records,
 Found 0 old records,
 Found 13191659 new qualified records

I filtered all 2008 records to easd2008.log. Resulting in a 5 Gig logfile.

12:11 pm
March 31, 2009


Jean-Luc

Admin

posts 1063

This command creates AWStats database files in the DirData  directory. It does not create the HTML report files. From there, to create the HTML report files, you have to use awstats_buildstaticpages  as described in the documentation about AWStats utilities.

perl awstats_buildstaticpages.pl -config=easd -month=9 -year=2008

will generate a set of HTML report files for September 2008.

12:33 pm
March 31, 2009


Arthur

Guest

Excuse me. I forgot to mention that I executed

awstats_buildstaticpages.pl afterwards.

Only difference is that I did not add the -month parameter.

12:38 pm
March 31, 2009


Jean-Luc

Admin

posts 1063

Please try again with the -month=MM option (where MM is the month number).

12:50 pm
March 31, 2009


Arthur

Guest

Hey, wow. Now that was the problem…

How do I generate static pages for all months that has been logged?

I don't want to execute the command for each month specifically

EDIT: Forgot … thank you :)

1:02 pm
March 31, 2009


Jean-Luc

Admin

posts 1063

If you don't want to have to repeat the command for each month, create a shell script with all the commands.

Reply to Post

Reply to Topic:
IIS Logfiles. Trying to build static pages. Only Monthly history.

Guest Name (Required):

Guest Email (Required):

NOTE: New Posts are subject to administrator approval before being displayed

Smileys
Confused Cool Cry Embarassed Frown Kiss Laugh Smile Surprised Wink Yell
Post New Reply

Guest URL (required)

Math Required!
What is the sum of:
5 + 2
   


About the InternetOfficer.com Forum

Forum Timezone: UTC 1

Most Users Ever Online: 201

Currently Online:
13 Guests

Currently Browsing this Topic:
1 Guest

Forum Stats:

Groups: 2
Forums: 9
Topics: 513
Posts: 2447

Membership:

There are 4127 Members
There have been 254 Guests

There is 1 Admin
There is 1 Moderator

Top Posters:

cssfsu – 55
albert_newton – 30
deepakgupta – 28
cosminpana – 20
DTNMike – 19
ahtshun83 – 17

Recent New Members: eniko, leptserkhan, JohnnyB, dweb3d, buck, newtoawstat

Administrators: Jean-Luc (1063 Posts)

Moderators: Jean-Luc (1063 Posts)