The string below is a sanitized excerpt from my web logs. Using Apache 2 and Tomcat 5 to serve various content as a resource for other sites. When I try to import my logs into awstats it pukes on the LogFormat. I know my LogFormat is correct in what fields I'm selecting (not a n00b) and I've managed to even massage the log data to narrow the problem down to a specific handling of my %methodurl field. It seems that the way we include the referrer URL and query string in the GET (this is done for a reason so it can't be changed) breaks awstats ability to parse that field.
Ok, short of deleting everything after …ttpid=TTPID-E6-106 (which I did and it worked sparklingly well) is there any way anyone can figure of getting updateall.pl now to not error out on my logformat?
If I'm just not using the correct search term in google please feel free to tell me what search term you've found helpful for this case and I'll go do my homework. 2 days of searching has yeilded exactly what I have now.
and set LogFormat for 4, ran the update and it drank it in. It appears that I can get away with pre-processing the logs prior to loading them into AWstats for the time being. It's still optimal that I not have to bother with the pre-processing via awk. Is there a mechanism that I can use to send you an unsanitized log snippet and have you try it out and see if it works?
In the meantime, I'm off and looking at long url handling.