Current User: Guest Login
Please consider registering


Lost Your Password?

Search Forums:


 






Minimum search word length is 4 characters – Maximum search word length is 84 characters
Wildcard Usage:
*  matches any number of characters    %  matches exactly one character

Awstats – Response Time Configuration.

Reply to Post Add a New Topic
UserPost

1:55 pm
September 23, 2011


tohariganesh

Member

posts 7

Hi All,

 

I am trying to configure Response Time collection in my Awstats report.

 

The Log Format i have used in httpd.conf is as below:

LogFormat "%h %u %l %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\"%T %D" combined

 

The Logformat in Awstats Conf file is:

LogFormat="%host %other %logname %time1 %methodurl %code %bytesd %refererquot %uaquot %other %extra1"

 

The Extra section config is as below:

ExtraSectionName1="Response Time (in microseconds)"
ExtraSectionCodeFilter1="200 304"
ExtraSectionCondition1="URL,\/"
ExtraSectionFirstColumnTitle1="Response Time"
ExtraSectionFirstColumnValues1="extra1,([0-9]*)$"
ExtraSectionFirstColumnFormat1="%s"
ExtraSectionStatTypes1=P
ExtraSectionAddAverageRow1=0
ExtraSectionAddSumRow1=0
MaxNbOfExtra1=200
MinHitExtra1=1

 

The log file that i have tryed to analyse is as below:

16.182.218.145 – - [23/Sep/2011:15:50:30 +0530] "POST /http-bind/ HTTP/1.1" 200 134 "app:/Main.swf" "Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/526.9+ (KHTML, like Gecko) AdobeAIR/1.5.3"0 24364

 

I am getting below error when i try to update:

 

Your log file C:\Program Files\AWStats\wwwroot\cgi-bin\access_resptest1.log must
 have a bad format or LogFormat parameter setup does not match this format.

 

Can you please help me?

 

Thanks

HG

4:49 pm
September 23, 2011


Jean-Luc

Admin

posts 1125

Hi,

A space is missing between the user agent field and the %T field in the LogFormat definition in httpd.conf. This makes the log file incompatible with AWStats.

Add the space character and the problem will be solved.

7:25 am
September 24, 2011


tohariganesh

Member

posts 7

Hi Jean,

 

Thank you very much for your immediate response. I am able to get the report now.

But it looks quite abstract. It just has the response time and count of pages.Is there any way i can garner more info in this report(like which URL it accessed for the response time). Please help me with the ExrraSection entries also.

I am quite new to this,so please bear with my ignorance. Thanks again.

10:34 am
September 24, 2011


Jean-Luc

Admin

posts 1125

It is difficult to get a useful extra section based on the response times. One thing you could try is

ExtraSectionCondition1="extra1,[0-9]{7}"

to select only the response times higher than a given value (10 seconds in my example if extra1 is expressed in microseconds).

and

ExtraSectionFirstColumnValues1="URL,^(.*)$"

so that you get a count of the hits on URL's with response times higher than 10 seconds.

1:11 pm
September 24, 2011


tohariganesh

Member

posts 7

Hi Jean,

 

Thanks again.

I Don't seem to undertsand much about the syntax for these ExtraSections. But the job is done.

One more doubt,i changed the logformat in httpd.conf file to record response in "seconds".But now i am getting all corrupted records while updating.

LogFormat in httpd.conf:

LogFormat "%h %u %l %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\" %T" combined

LogFormat in Awstats conf:

LogFormat="%host %other %logname %time1 %methodurl %code %bytesd %refererquot %uaquot %other %extra1"

Logfile Entry:

16.212.128.37 – - [24/Sep/2011:16:29:14 +0530] "POST /http-bind/ HTTP/1.1" 200 253 "app:/Main.swf" "Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/526.9+ (KHTML, like Gecko) AdobeAIR/1.5.3" 0

ExtraSection Entries:

ExtraSectionName1="Response Time (in Seconds)"
ExtraSectionCodeFilter1="200 304"
ExtraSectionCondition1="URL,\/"
ExtraSectionFirstColumnTitle1="Response Time"
ExtraSectionFirstColumnValues1="extra1,([0-9]*)$"
ExtraSectionFirstColumnFormat1="%s"
ExtraSectionStatTypes1=P
ExtraSectionAddAverageRow1=0
ExtraSectionAddSumRow1=0
MaxNbOfExtra1=200
MinHitExtra1=1

Can you please bail me out again? I don't seem to find much help. Thanks-in-advance.

 

HG

8:50 pm
September 24, 2011


Jean-Luc

Admin

posts 1125

Hi,

You need to edit LogFormat in the AWStats config file too :

LogFormat="%host %other %logname %time1 %methodurl %code %bytesd %refererquot %uaquot %extra1"

6:56 am
September 27, 2011


tohariganesh

Member

posts 7

Hi Jean,

Thank you again. Smile

After changing the logformat to what you recommended,it's updating the records, but when i generate the report it's showing below error: Frown

 

Logformat in Awstats conf:

LogFormat="%host %other %logname %time1 %methodurl %code %bytesd %refererquot %uaquot %extra1"

 

Actual Log:

16.212.128.37 – – [24/Sep/2011:16:29:01 +0530] "POST /http-bind/ HTTP/1.1" 200 68 "app:/Main.swf" "Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/526.9+ (KHTML, like Gecko) AdobeAIR/1.5.3" 0

ExtraScetion config is the same as in above posts.

 

Also i would like to know what is the "HTTP Status codes"  in the snapshot(HTML). * "Codes shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts." – what does this mean?

 

Thanks

HG

7:53 am
September 27, 2011


Jean-Luc

Admin

posts 1125

Can you paste here the error message you are getting ?

"Not viewed traffic" is the combination of the traffic generated by robots and the hits from visitors on error and redirect pages (hits with an HTTP status code indicating a redirection or an error). 

7:05 am
September 28, 2011


tohariganesh

Member

posts 7

Hi Jean,

This is the error i got. It has not extracted Response time for around 210 pages.

Response Time (in Seconds)  
Response Time  –   Full list Pages
60 1665
7 263
Failed to extract key 210
2 2
6 1
8 1
          
 

Thanks

HG                                                                                         

8:43 am
September 28, 2011


Jean-Luc

Admin

posts 1125

Hi,

This could mean that the value was not a number. I would try with :

ExtraSectionFirstColumnValues1="extra1,^(.*)$"

11:44 am
September 28, 2011


tohariganesh

Member

posts 7

Hi Jean,

 

Same error. Is there anyway i can send you the access_log?

 

Thanks

HG

4:33 pm
September 29, 2011


Jean-Luc

Admin

posts 1125

Can you paste here a few lines that generate the error ?

7:42 am
September 30, 2011


tohariganesh

Member

posts 7

Hi Jean,

 

Some entries which i believe are giving the "Failed to extract key" error is pasted below. I find that all of them were having "0" response time(Have pasted only 3 here). I think for logs with "0" response time it is showing "Failed to extract key".

 

16.213.0.37 – – [26/Sep/2011:08:16:28 +0530] "GET /Brahma/VideoClips?devid=0004-89&sp=ndtv&category=News&refstr=016966628…02da066b8&locale=en_US&start=0&end=11 HTTP/1.1" 200 3995 "-" "-" 0
16.213.0.36 – – [26/Sep/2011:09:12:07 +0530] "GET /Brahma/BrahmaNetworkLockdown?action=networkLockdown&filename=netlock1&deviceId=0000-74&serialNumber=PRODGOLD78 HTTP/1.1" 200 – "-" "-" 0
16.213.0.36 – – [26/Sep/2011:09:12:30 +0530] "GET /favicon.ico HTTP/1.1" 404 287 "http://16.181.233.129/" "-" 0
16.212.128.39 – – [26/Sep/2011:10:33:25 +0530] "GET /Brahma HTTP/1.1" 200 3381 "app:/Main.swf" "Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/531.9 (KHTML, like Gecko) AdobeAIR/2.6" 0

 

Thanks

HG

11:35 am
September 30, 2011


Jean-Luc

Admin

posts 1125

Hi HG,

You are absolutely right. It is a bug in AWStats extra sections. I have entered it in the AWStats bug tracking system (ID: 3415843, "values of 0 gives error in extra section").

Let us hope that the developers will promptly solve it. In the mean time, you need to be aware that "Failed to extract key" means "0".

4:55 am
January 19, 2015


open system solution

Guest

to get response time higher than 5 second (5000000ms) per URL:

 

ExtraSectionCondition1="extra1,^([5-9]d{6}|[1-9]d{7,})$"

 

^([5-9]d{6} meaning start digit is 5-9, with last 6 digits (0-9).

Above wil cover 5000000 till 9999999.

 

| meaning "OR"

 

[1-9]d{7,})$  meaning anything beyond 7 digits

Above will cover 10000000 till infinite

 

Good luck,

Open System Solution Malaysia

Reply to Post

Reply to Topic:
Awstats – Response Time Configuration.

Guest Name (Required):

Guest Email (Required):

NOTE: New Posts are subject to administrator approval before being displayed

Smileys
Confused Cool Cry Embarassed Frown Kiss Laugh Smile Surprised Wink Yell
Post New Reply

Guest URL (required)

Math Required!
What is the sum of:
1 + 12
   


About the InternetOfficer.com Forum

Forum Timezone: UTC 1

Most Users Ever Online: 302

Currently Online:
14 Guests

Currently Browsing this Topic:
1 Guest

Forum Stats:

Groups: 2
Forums: 9
Topics: 639
Posts: 2712

Membership:

There are 257 Members
There have been 305 Guests

There is 1 Admin
There is 1 Moderator

Top Posters:

cssfsu – 55
deepakgupta – 34
albert_newton – 30
cosminpana – 20
DTNMike – 19
ahtshun83 – 17

Recent New Members: raju, todd2taylor, sbdcunha, mansigill1987, ThomasDuh, ThomasKic

Administrators: Jean-Luc (1125 Posts)

Moderators: Jean-Luc (1125 Posts)