Current User: Guest Login
Please consider registering


Lost Your Password?

Search Forums:


 






Minimum search word length is 4 characters – Maximum search word length is 84 characters
Wildcard Usage:
*  matches any number of characters    %  matches exactly one character

Awstats one IIS site, multiple domains & the logresolvemerge.pl

Reply to Post Add a New Topic
UserPost

2:46 pm
November 9, 2008


ed.kalk

Guest

I tried to register, but the password never made it to me… oh well here is my issue….

We have a problem with the stats for IIS site Allen Printing on web server #2. The situation is as follows:

There is a site on Web Server #2 called Allen Printing. It actually has 3 domains running off of it. Livestockplusinc.com, horsepowermagazine.net, and printersmarketplace.com

There is one log file directory with multiple log files (one for each day) In each log file, there is data for all 3 domains for a given day.

The directory for allen printing log files is on web server #2 e:\\logs\\AllenPrinting

The awstats program is supposed to search the log file in the log file directory and pull out the stats for the domain that is specified only:

For example:

The awstats config file dir is:

C:\\Inetpub\\virtuals\\secure.bitwiselogic.com\\stats

The printersmarketplace config file is:  awstats.printersmarketplace.conf

In this file it says (among other things):

# “SiteDomain” must contain the main domain name, or the main intranet web

# server name, used to reach the web site.

# If you share the same log file for several virtual web servers, this

# parameter is used to tell AWStats to filter record that contains records for

# this virtual host name only (So check that this virtual hostname can be

# found in your log file and use a personalized log format that include the

# %virtualname tag).

# But for multi hosting a better solution is to have one log file for each

# virtual web server. In this case, this parameter is only used to generate

# full URL's links when ShowLinksOnUrl option is set to 1.

# If analysing mail log, enter here the domain name of mail server.

# Example: “myintranetserver”

# Example: “www.domain.com”

# Example: “ftp.domain.com”

# Example: “domain.com”

#

SiteDomain=”www.printersmarketplace.com“

Under normal operation, the awstats program reads the log file from the prev day and posts the data to the data directory (selecting only the data for the domain specified in the above variable “sitedomain”):

C:\\Inetpub\\virtuals\\secure.bitwiselogic.com\\stats\\data

The data files in this directory are the stats that are shown on the stats site when the client checks their stats.

We have a problem with the stats for all 3 sites (they are not correct) and need to resolve the stats by reviewing all the log files again. There is a tool for this called logresolvemerge.pl which will read all log files in a given dir and post data to the data dir. The problem is that logresolvemerge.pl does not seem to take into consideration the sitedomain= variable in the config file and is combining data for all three domains into each domain stats.

Logresolvemerge.pl is a script and is located in the following dir:

C:\\Inetpub\\virtuals\\secure.bitwiselogic.com\\stats\\tools

Do you know how to make logresolvemerge.pl only pull the data from the log files for a single domain? (keep in mind that we do have the sitedomain variable set and according to the awstats instructions, this should be working)

Help?!

3:28 pm
November 9, 2008


Jean-Luc

Admin

posts 1125

Hi,

logresolvemerge  merges log files. It does not take SiteDomain  into consideration, as it does not need to to merge the files. logresolvemerge  does not run the AWStats update. You need to run it after the log files are merged and, at that point, SiteDomain  is taken into consideration, as usual.

If you use logresolvemerge  at the command line level, please paste the command here. If you include logresolvemerge  in the LogFile  directive, please paste the directive here.

Before you run the update for past days, you need to remove or rename all existing AWStats database files that contain data of a later date.

Regarding your registration problem, I have created a new user and I got the confirmation email within seconds. Maybe a problem with your spam filter blocking emails from internetofficer.com  ?

4:28 pm
November 9, 2008


ed.kalk

Guest

I have whitelisted the domain and still nothing is coming through with the password. I did however get the password reset e-mail so it seems that the e-mail with the password is not getting through only…

Here is the way I'm using logresolvemerge.ol:

in the config file i have this:

LogFile=”C:/Inetpub/virtuals/secure.bit
wiselogic.com/stats/tools/logresolvemer
ge.pl Y:\\logs\\AllenPrinting\\W3SVC195893
8642\\*.log |”

I'm updateing with:

C:\\Inetpub\\virtuals\\secure.bitwiselogic.com\\stats\\awstats.pl -config=printersmarketplace –update

When I run this, it pulls all data for all 3 domains out of all log files in the dir and places the data in the data dir under the domain name in question…

4:44 pm
November 9, 2008


Jean-Luc

Admin

posts 1125

What is the LogFormat  definition in the AWStats config file ?

5:29 pm
November 9, 2008


ed.kalk

Guest

Jean-Luc said:

What is the LogFormat  definition in the AWStats config file ?


logtype=w

LogFormat= "%time2 %other %other %other %method %url %query %other %other %host %other %ua %other %referer %other %code %other %other %other %bytesd %other"

1:25 am
November 10, 2008


Jean-Luc

Admin

posts 1125

You need to add the %virtualname  field in the LogFormat  definition in order to selectively process the data of one domain. The value of this field will be compared with the value given to SiteDomain . This should solve the problem.

9:27 am
November 10, 2008


ed.kalk

Guest

This is an example of my IIS logs:

#Software: Microsoft Internet Information Services 6.0
#Version: 1.0
#Date: 2008-11-10 00:00:03
#Fields: date time s-sitename s-computername s-ip cs-method cs-uri-stem cs-uri-query s-port cs-username c-ip cs-version cs(User-Agent) cs(Cookie) cs(Referer) cs-host sc-status sc-substatus sc-win32-status sc-bytes cs-bytes time-taken
2008-11-10 00:00:02 W3SVC1958938642 BITWISEWIN2 216.185.202.34 GET /category.aspx ptid=7&catid=33&categoryname=Breeding 80 – 74.6.22.189 HTTP/1.0 Mozilla/5.0+(compatible;+Yahoo!+Slurp;+http://help.yahoo.com/help/us/ysearch/slurp) – - www.horsepowermagazine.net 200 0 0 33286 265 296
2008-11-10 00:01:50 W3SVC1958938642 BITWISEWIN2 216.185.202.34 GET /robots.txt – 80 – 65.55.208.35 HTTP/1.1 msnbot/1.1+(+http://search.msn.com/msnbot.htm) – - www.printersmarketplace.com 404 0 64 0 218 31
2008-11-10 00:01:50 W3SVC1958938642 BITWISEWIN2 216.185.202.34 GET /Search/web+offset.aspx – 80 – 65.55.208.35 HTTP/1.1 msnbot/1.1+(+http://search.msn.com/msnbot.htm) – - www.printersmarketplace.com 200 0 64 0 303 390
2008-11-10 00:02:07 W3SVC1958938642 BITWISEWIN2 216.185.202.34 GET /PDF+Files/PMP_7-11-06.pdf – 80 – 74.6.22.155 HTTP/1.0 Mozilla/5.0+(compatible;+Yahoo!+Slurp;+http://help.yahoo.com/help/us/ysearch/slurp) – - www.printersmarketplace.com 404 0 3 1814 242 46
2008-11-10 00:04:35 W3SVC1958938642 BITWISEWIN2 216.185.202.34 GET /index.aspx – 80 – 67.195.37.159 HTTP/1.0 Mozilla/5.0+(compatible;+Yahoo!+Slurp/3.0;+http://help.yahoo.com/help/us/ysearch/slurp) – - www.horsepowermagazine.net 200 0 0 51404 395 515
2008-11-10 00:04:35 W3SVC1958938642 BITWISEWIN2 216.185.202.34 GET /Presentation/master.css – 80 – 67.195.37.159 HTTP/1.0 Mozilla/5.0+(compatible;+Yahoo!+Slurp/3.0;+http://help.yahoo.com/help/us/ysearch/slurp) – http://www.horsepowermagazine.net/ www.horsepowermagazine.net 304 0 0 232 523 125

I tried to change the format from:

LogFormat= “%time2 %other %other %other %method %url %query %other %other %host %other %ua %other %referer %other %code %other %other %other %bytesd %other”

to:

LogFormat= “%time2 %other %other %other %method %url %query %other %other %host %other %ua %other %virtualname %other %code %other %other %other %bytesd %other”

Now I do not get any stats:

0 qualified records….

??

9:43 am
November 10, 2008


Jean-Luc

Admin

posts 1125

Try this :

LogFormat= “%time2 %other %other %other %method %url %query %other %other %host %other %ua %other %referer %virtualname %code %other %other %other %bytesd %other”

The position of %virtualname  was not correct. I changed it. I also added the %referer field, but this is not related to your problem.

The value of %virtualname  in your log file is http://www.horsepowermagazine.net . I would use exactly that as value for SiteDomain  in the AWStats config file.

10:08 am
November 10, 2008


ed.kalk

Guest

Actually, looking at this:

GET /Presentation/master.css – 80 – 67.195.37.159 HTTP/1.0 Mozilla/5.0+(compatible;+Yahoo!+Slurp/3.0;+http://help.yahoo.com/help/us/ysearch/slurp) – http://www.horsepowermagazine.net/ www.horsepowermagazine.net 304 0 0 232 523 125

the http://domain.com is the referer and right after that is www.domain.com which is the virtual name. I left the value for sitedomain alone and updated the logformat to:

LogFormat= “%time2 %other %other %other %method %url %other %other %other %host %other %ua %other %referer %virtualname %code %other %other %other %bytesd %other”

which is what you had as well. It's now working. Thank you for all your help.

10:54 am
November 10, 2008


Jean-Luc

Admin

posts 1125

You are absolutely right about the value of SiteDomain . I mixed up the values of the %referer  and %virtualname fields.

11:03 am
November 10, 2008


ed.kalk

New Member

posts 1

Jean-Luc said:

You are absolutely right about the value of SiteDomain . I mixed up the values of the %referer  and %virtualname fields.


Thanks again, I also got my password thing figured out…. sweet.

Reply to Post

Reply to Topic:
Awstats one IIS site, multiple domains & the logresolvemerge.pl

Guest Name (Required):

Guest Email (Required):

NOTE: New Posts are subject to administrator approval before being displayed

Smileys
Confused Cool Cry Embarassed Frown Kiss Laugh Smile Surprised Wink Yell
Post New Reply

Guest URL (required)

Math Required!
What is the sum of:
8 + 3
   


About the InternetOfficer.com Forum

Forum Timezone: UTC 1

Most Users Ever Online: 302

Currently Online:
10 Guests

Currently Browsing this Topic:
1 Guest

Forum Stats:

Groups: 2
Forums: 9
Topics: 638
Posts: 2709

Membership:

There are 257 Members
There have been 302 Guests

There is 1 Admin
There is 1 Moderator

Top Posters:

cssfsu – 55
deepakgupta – 34
albert_newton – 30
cosminpana – 20
DTNMike – 19
ahtshun83 – 17

Recent New Members: raju, todd2taylor, sbdcunha, mansigill1987, ThomasDuh, ThomasKic

Administrators: Jean-Luc (1125 Posts)

Moderators: Jean-Luc (1125 Posts)