From: eldy <>
Date: Sun, 24 Apr 2005 14:28:55 +0000 (+0000)
Subject: Updated 6.5 documentation
X-Git-Tag: AWSTATS_WEBMIN_1_6_BETA~49
X-Git-Url: http://git.ipfire.org/cgi-bin/gitweb.cgi?a=commitdiff_plain;h=a31f220d338ce96cb44f4ee8a311fa4e1e4e678b;p=thirdparty%2FAWStats.git
Updated 6.5 documentation
---
diff --git a/docs/awstats_faq.html b/docs/awstats_faq.html
index 84b372c0..a9d95d8d 100644
--- a/docs/awstats_faq.html
+++ b/docs/awstats_faq.html
@@ -20,7 +20,7 @@
 |
-AWStats logfile analyzer 6.4 Documentation
+AWStats logfile analyzer 6.5 Documentation
|
@@ -56,6 +56,7 @@ FAQ-COM115 Setup/Examples for LogFormat parameter.How to rotate my logs without loosing data.
FAQ-COM130 How to run AWStats frequently ?
FAQ-COM140 How to exclude my IP address (or whole subnet mask) from stats ?
+FAQ-COM142 How to get the screen size and browser capabilities report working ?
FAQ-COM145 How to use the Extra Sections features ?
FAQ-COM150 Benchmark question.
FAQ-COM200 How reverse DNS Lookup works, unresolved IP Addresses ?
@@ -115,8 +116,9 @@ or any other log format that contains all information AWStats expect to find. Most of all others Web/Wap/Proxy/Streaming servers.
Some FTP, Syslog or Mail log files.
Because AWStats is in Perl, it can works on all Operating Systems.
+
Examples of used platforms (bold means 'tested by author', others were reported by AWStats users to work correctly) :
-
+
OS:
Windows 2000, Windows NT 4.0, Windows Me, Linux (RedHat, Mandrake, Debian, Suse...), Macintosh, Solaris, Aix, BeOS, FreeBSD, ...
Web/Wap/Proxy/Streaming servers
@@ -137,9 +139,9 @@ AWStats setup knows predefined log format you can use to make AWStats config eas
you can define your own log format, that's the reason why AWStats can analyze nearly all web, wap
and proxy server log files. Some FTP servers log files, Syslog or mail logs can also be analyzed.
The only requirement is "Your log file must contain required information".
-This is very short examples of possible log format:
-
+This is very short examples of possible log format:
+
Apache common log format (see Note*),
Apache combined log format (known as NCSA combined log format or XLF or ELF format),
Any other personalized Apache log format,
@@ -149,14 +151,15 @@ Realmedia server, Windows Media Server, Darwin streaming server,
ProFTPd server, vsFTPd server,
Postfix, Sendmail, QMail, Mdaemon
A lot of web/wap/proxy/streaming servers log format
+ |
-Note*: Apache common log format (AWStats can now analyze such log files but such log files does not
+*Note: Apache common log format (AWStats can now analyze such log files but such log files does not
contain all information AWStats is looking for. The problem is in the content, not in the
format). I think analyzing common log files is not interesting because there is a lot of
missing information: no way to filter robots, find search engines, keywords, os, browser.
But a lot of users asked me for it, so AWStats support it.
However, a lot of interesting advanced features can't work: browsers, os's, keywords, robot detection...).
-
+
See also F.A.Q.: LOG FORMAT SETUP OR ERRORS .
@@ -167,7 +170,7 @@ alphabetical order (The code you can use for
and ShowFlagLinks parameter are
the ISO-639-1 language codes):
-
+
Albanian=al, Bosnian=ba, Bulgarian=bg, Catalan=ca,
Chinese (Taiwan)=tw, Chinese (Simpliefied)=cn, Czech=cz, Danish=dk,
Dutch=nl, English=en, Estonian=et, Euskara=eu, Finnish=fi,
@@ -210,7 +213,7 @@ However, this is a trick that you can use to have a log file be build. You must
a tag to call a CGI script like pslogger into each of your web pages. This will
allow you to have an artificial log file that can be analyzed by AWStats.
You can find a Perl version of CGI pslogger enhanced by AWStats author here
-or a php version of CGI pslogger made by Florent CHANTRET here.
+or a php version of CGI pslogger made by Florent CHANTRET here.
@@ -242,7 +245,7 @@ AWStats can be used with some FTP server log files.
1- Setup your server log file format:
Modify the proftpd.conf file to add the following two lines :
-
+
LogFormat awstats "%t %h %u %m %f %s %b" # WARNING: You must use a tab char between % tags and not a space !
ExtendedLog /var/log/xferlog read,write awstats # WARNING: ExtendedLog directive might need to be placed inside a virtual host context if you use them.
@@ -251,8 +254,9 @@ Modify the proftpd.conf file to add the following two lines :
ExtendedLog /var/log/xferlog read,write awstats # WARNING: ExtendedLog directive might need to be placed inside a virtual host context if you use them.
-->
|
+
Then turn off old format Transfer log:
-
+|
TransferLog none # WARNING: TransferLog directive might need to be placed inside a virtual host context if you use them.
|
@@ -264,7 +268,7 @@ Download a file by FTP and check that your new log file looks like this:
Copy config file "awstats.model.conf" to "awstats.ftp.conf".
Modify this new config file:
-
+
LogFile="/var/log/xferlog"
LogType=F
@@ -313,15 +317,15 @@ Now you can use AWStats as usual (run the update process and read statistics).
Take a look at your FTP server log file. You must have a format that match the following example to
use this FAQ :
-
-Wed Jan 01 19:29:35 2001 1 192.168.1.1 102 /home/file1.txt b _ o r username ftp 0 * c
+|
+Wed Jan 01 19:29:35 2001 1 192.168.1.1 102 /home/file1.txt b _ o r username ftp 0 * c
|
2- Then setup AWStats to analyze the FTP log file:
If your FTP log file format looks good, copy config file "awstats.model.conf" to "awstats.ftp.conf".
Modify this new config file:
-
+
LogFile="/var/log/xferlog"
LogType=F
@@ -379,7 +383,7 @@ You must setup AWStats to use a mail log file preprocessor (maillogconvert.pl
into AWStats tools directory, but you can use the one of your choice):
For this, copy config "awstats.model.conf" file to "awstats.mail.conf".
Modify this new config file:
-
+
For standard Postfix, Sendmail, MDaemon and standard QMail logfiles, set
LogFile="perl /path/to/maillogconvert.pl standard < /pathtomaillog/maillog |"
@@ -446,7 +450,7 @@ However a little support is provided. In order to analyze Exchange traffic, you
enable "Message Tracking" (see article http://support.microsoft.com/default.aspx?scid=kb;EN-US;246856).
Then copy config awstats.model.conf file to "awstats.mail.conf".
Modify this new config file:
-
+
LogType=M
LogFormat="%time2 %email %email_r %host %host_r %method %url %code %bytesd"
@@ -507,7 +511,7 @@ Your log file will probably looks like this:
Copy config awstats.model.conf file to "awstats.mediaserver.conf".
Modify this new config file:
-
+
LogFile="/pathtomediaserverlog/mediaserverlog"
LogType=S
@@ -604,7 +608,7 @@ Windows Media Server tags.
2- Then setup AWStats to analyze your Media Server log:
Copy config awstats.model.conf file to "awstats.mediaserver.conf".
Modify this new config file:
-
+
LogFile="/pathtomediaserver/mediaserverlog"
LogType=S
@@ -649,95 +653,95 @@ file format ?
The AWStats config file give you all possible values for LogFormat parameter.
To help you, this is some common cases of log file format, and
the corresponding value for LogFormat you must use in your AWStats config file:
-
+
If your log records are EXACTLY like this (NCSA combined/XLF/ELF log format):
62.161.78.73 - - [dd/mmm/yyyy:hh:mm:ss +0x00] "GET /page.html HTTP/1.1" 200 1234 "http://www.from.com/from.htm" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"
You must use : LogFormat=1
This is same than: LogFormat="%host %other %logname %time1 %methodurl %code %bytesd %refererquot %uaquot"
|
-
+
If your log records are EXACTLY like this (NCSA combined with several virtualhostname sharing same log file).
virtualserver1 62.161.78.73 - - [dd/mmm/yyyy:hh:mm:ss +0x00] "GET /page.html HTTP/1.1" 200 1234 "http://www.from.com/from.htm" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"
You must use : LogFormat="%virtualname %host %other %logname %time1 %methodurl %code %bytesd %refererquot %uaquot"
-
+
If your log records are EXACTLY like this (NCSA combined and mod_gzip format 1 with Apache 1.x):
62.161.78.73 - - [dd/mmm/yyyy:hh:mm:ss +0x00] "GET /page.html HTTP/1.1" 200 3904 "http://www.from.com/from.htm" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)" mod_gzip: 66pct.
You must use : LogFormat="%host %other %logname %time1 %methodurl %code %bytesd %refererquot %uaquot %other %gzipratio"
|
-
+
If your log records are EXACTLY like this (NCSA combined and mod_gzip format 2 with Apache 1.x):
62.161.78.73 - - [dd/mmm/yyyy:hh:mm:ss +0x00] "GET /page.html HTTP/1.1" 200 3904 "http://www.from.com/from.htm" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)" mod_gzip: DECHUNK:OK In:11393 Out:3904:66pct.
You must use : LogFormat="%host %other %logname %time1 %methodurl %code %bytesd %refererquot %uaquot %other %other %gzipin %gzipout"
-
+
If your log records are EXACTLY like this (NCSA combined and mod_deflate with Apache 2):
62.161.78.73 - - [dd/mmm/yyyy:hh:mm:ss +0x00] "GET /page.html HTTP/1.1" 200 3904 "http://www.from.com/from.htm" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)" (45)
You must use : LogFormat="%host %other %logname %time1 %methodurl %code %bytesd %refererquot %uaquot %deflateratio"
|
-
+
If your log records are EXACTLY like this (NCSA combined with 2 spaces between some fields with Zope):
62.161.78.73 - - [dd/mmm/yyyy:hh:mm:ss +0x00] "GET /page.html HTTP/1.1" 200 3904 "http://www.from.com/from.htm" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)" (45)
You must use :
LogFormat="%host %other %logname %time1 %methodurl %code %bytesd %refererquot %uaquot"
LogSeparator=" *"
-
+
If your log records are EXACTLY like this (NCSA common CLF log format):
62.161.78.73 - - [dd/mmm/yyyy:hh:mm:ss +0x00] "GET /page.html HTTP/1.1" 200 1234
You must use : LogFormat=4
Note: Browsers, OS's, Keywords and Referers features are not available with a such format.
|
-
+
If your log records are EXACTLY like this (With some Squid versions, after setting emulate_http_log to on):
200.135.30.181 - - [dd/mmm/yyyy:hh:mm:ss +0x00] "GET http://www.mydomain.com/page.html HTTP/1.0" 200 456 TCP_CLIENT_REFRESH_MISS:DIRECT
You must use : LogFormat="%host %other %logname %time1 %methodurl %code %bytesd %other"
-
+
If your log records are EXACTLY like this (Some old IIS W3C log format):
yyyy-mm-dd hh:mm:ss 62.161.78.73 - GET /page.html 200 1234 HTTP/1.1 Mozilla/4.0+(compatible;+MSIE+5.01;+Windows+NT+5.0) http://www.from.com/from.html
You must use : LogFormat=2
|
-
+
If your log records are EXACTLY like this (Some IIS W3C log format with some .net servers):
yyyy-mm-dd hh:mm:ss GET /page.html - 62.161.78.73 - Mozilla/4.0+(compatible;+MSIE+5.01;+Windows+NT+5.0) http://www.from.com/from.html 200 1234 HTTP/1.1
You must use : LogFormat=2 (or LogFormat="%time2 %method %url %logname %host %other %ua %referer %code %bytesd %other")
-
+
If your log records are EXACTLY like this (Some IIS 6+ W3C log format):
yyyy-mm-dd hh:mm:ss GET /page.html - 62.161.78.73 - Mozilla/4.0+(compatible;+MSIE+5.01;+Windows+NT+5.0) http://www.from.com/from.html 200 1234
You must use : LogFormat=2 (or LogFormat="date time cs-method cs-uri-stem cs-username c-ip cs-version cs(User-Agent) cs(Referer) sc-status sc-bytes")
|
-
+
If your log records are EXACTLY like this (Some ISA W3C log format):
62.161.78.73, anonymous, Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1), N, 1/1/2001, 0:00:16, W3ReverseProxy, HCSERV2, -, www.host.be, 192.168.141.101, 80, 266, 406, 10042, http, TCP, GET, http://192.168.141.101/, text/html, Inet, 200, 0x42330010, -, -
You must use :
LogFile="sed -e 's/, /\t/g' "/yourlogpath/yourlogfile.log" |"
LogFormat=2
LogSeparator=" "
-
+
If your log records are EXACTLY like this (With some WebSite versions):
yyyy-mm-dd hh:mm:ss 62.161.78.73 - 192.168.1.1 80 GET /page.html - 200 11205 0 0 HTTP/1.1 mydomain.com Mozilla/4.0+(compatible;+MSIE+5.5;+Windows+98) - http://www.from.com/from.html
You must use : LogFormat="%time2 %host %logname %other %other %method %url %other %code %bytesd %other %other %other %other %ua %other %referer"
|
-
+
If your log records are EXACTLY like this (Webstar native log format):
05/21/00 00:17:31 OK 200 212.242.30.6 Mozilla/4.0 (compatible; MSIE 5.0; Windows 98; DigExt) http://www.cover.dk/ "www.cover.dk" :Documentation:graphics:starninelogo.white.gif 1133
You must use : LogFormat=3
-
+
If your log records are EXACTLY like this (With some Lotus Notes/Domino versions):
62.161.78.73 - Name Surname Service [dd/mmm/yyyy:hh:mm:ss +0x00] "GET /page.html HTTP/1.1" 200 1234 "http://www.from.com/from.htm" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"
You must use : LogFormat=6
|
-
+
If your log records are EXACTLY like this (Lotus Notes/Domino 6.x log format):
62.161.78.73 - "Name Surname" Service [dd/mmm/yyyy:hh:mm:ss +0x00] "GET /page.html HTTP/1.1" 200 1234 "http://www.from.com/from.htm" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"
You must use : LogFormat="%host %other %lognamequot %time1 %methodurl %code %bytesd %refererquot %uaquot"
-
+
If your log records are EXACTLY like this (With Oracle9iAS):
62.161.78.73 - [dd/mmm/yyyy:hh:mm:ss +0x00] GET /page.html HTTP/1.1 200 1234 - "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)"
@@ -745,25 +749,25 @@ Where separators are chars or several spaces,
You must use : LogFormat="%host %logname %time1 %method %url %other %code %bytesd %referer %uaquot"
and LogSeparator="\s+"
|
-
+
If you use a FTP server like ProFTPd:
See FAQ-COM090.
-
+
If you want to analyze a mail log file (Postfix, Sendmail, QMail, MDaemon, Exchange):
See FAQ-COM100.
|
-
+
If you use a Media Server (Realmedia, Windows Media Server):
See FAQ-COM110.
-
+
If your log records are EXACTLY like this (With some providers):
62.161.78.73 - - [dd/Month/yyyy:hh:mm:ss +0x00] "GET /page.html HTTP/1.1" "-" 200 1234
You must use : LogFormat="%host %other %logname %time1 %methodurl %other %code %bytesd"
Note: Browsers, OS's, Keywords and Referers features are not available with a such format.
|
-
+
There is a lot of other possible log formats.
You must use a personalized log format LogFormat ="..." as described in config file to
support other various log formats.
@@ -784,7 +788,8 @@ process, you must run the AWStats update JUST BEFORE the rotate process is done.
The best way to do that on 'Linux like' OS is to use the linux built-in logrotate feature. You must
edit the logrotate config file used for your web server log file (usually stored in /etc/logrotate.d
directory) by adding the AWStats update process as a preprocessor command, like this example (bold
-lines are lines to add for having a prerotate process):
+lines are lines to add for having a prerotate process):
+
/usr/local/apache/logs/*log
{
notifempty
@@ -801,7 +806,7 @@ postrotate
/usr/bin/killall -HUP httpd
endscript
}
-
+ |
If using a such solution, this is sequential steps that happens:
@@ -887,14 +892,18 @@ experience problem of failing task. Try this instead
"C:\WINNT\system32\CMD.EXE /C C:\[awstats_path]\awstats.pl -config=mysite -update"
or
"C:\[perl_path]\perl.exe C:\[awstats_path]\awstats.pl -config=mysite -update"
-A lot of other scheduler (sharewares/freewares) are very good.
+A lot of other open source schedulers are often better (otherwise there is also good sharewares or freewares).
With unix-like operating systems, you can use the "crontab".
This is examples of lines you can add in the cron file (see your unix reference manual for cron) :
To run update every day at 03:50, use :
-50 3 * * * /usr/local/awstats/wwwroot/cgi-bin/awstats.pl -config=mysite -update >/dev/null
+
+50 3 * * * /usr/local/awstats/wwwroot/cgi-bin/awstats.pl -config=mysite -update >/dev/null
+ |
To run update every hour, use :
-0 * * * * /usr/local/awstats/wwwroot/cgi-bin/awstats.pl -config=mysite -update >/dev/null
+
+0 * * * * /usr/local/awstats/wwwroot/cgi-bin/awstats.pl -config=mysite -update >/dev/null
+ |
@@ -910,6 +919,38 @@ For example, to exclude:
log file).
+
+FAQ-COM142 : HOW TO GET THE SCREEN SIZE AND BROWSER CAPABILITIES REPORT WORKING ?
+PROBLEM:
+I see in the AWStats features list that it can report the screen size used by visitors and also if its browser
+support Flash, java, etc... How can I do that ?
+SOLUTION:
+AWStats is a log analyzer, so to report the screen size of your visitor, we need to have information inside the log file.
+For this, the only way to do that is to add some HTML tags inside some of your pages (the home page is enoough to
+get screen size use ratios). This tag will add call to a javascript that ask your browser to call of an URL that
+includes in its parameters, the screen size resolution and other informations about browser capabilities.
+
+This is the code you must add (at bottom of your home page for example) :
+
+<script language="javascript" type="text/javascript" src="/js/awstats_misc_tracker.js" ></script>
+<noscript><img src="/js/awstats_misc_tracker.js?nojs=y" height="0" width="0" border="0" style="display: none"></noscript>
+ |
+
+Note that you must also place the awstats_misc_tracker.js script (provided in /js directory with AWStats) inside
+a js directory stored in your web root.
+Once this is done, load your home page with your browser and go to check that inside your log file
+if you can see a line that looks like that:
+|
+123.123.123.123 - - [24/Apr/2005:16:09:38 +0200] "GET /js/awstats_misc_tracker.js?screen=800x600&win=724x517&cdi=32&java=true&shk=n&fla=y&rp=n&mov=n&wma=y&pdf=y&uid=awsuser_id123&sid=awssession_id123 HTTP/1.1" 200 6237 "http://therefererwebsite.com/index.php" "Mozilla/5.0 (Windows; U; Windows NT 5.1; fr-FR; rv:1.7.7) Gecko/20050414 Firefox/1.0.3" (-)
+ |
+
+If you change directory where awstats_misc_tracker.js is stored (somewhere else than /js directory in your web root),
+you must modify, according to your change:
+- the html tags added
+- the line: var awstatsmisctrackerurl="/js/awstats_misc_tracker.js"; inside the awstats_misc_tracker.js script
+- the parameter MiscTrackerUrl inside AWStats configuration file.
+
+
FAQ-COM145 : HOW TO USE THE EXTRA SECTIONS FEATURES ?
PROBLEM:
@@ -935,7 +976,7 @@ the Benchmark page.
The reported page AWStats shows me has no hostnames, only IP addresses, countries reported are all "unknown".
SOLUTION:
When AWStats find an IP address in your log file, it tries a reverse DNS lookup to find
-the hostname and domain if the DNSLookup parameter, in your AWStats config file, is DNSLookup=1
+the hostname and domain if the DNSLookup parameter, in your AWStats config file, is DNSLookup=1
(Default value). So, first, check if you have the good value. The DNSLookup=0
must be used only if your log file contains already resolved IP address. For example,
when you set up Apache with the HostNameLookups=on directive. When you
@@ -1035,6 +1076,10 @@ all commercial products):
# 80.8.55.9 not a visit (but a worm attack)
# 80.8.55.10 1 visit that come from a web page that is not a search engine
+ #
+ # TOTAL YOU MUST GET: 6 visits made by 5 different human visitors that viewed 21 pages and
+ # 15 not pages (36 hits). Others 7 pages/hits are "not viewed" traffic.
+
80.8.55.1 - - [01/Jan/2001:00:00:10 +0100] "GET /page1.html HTTP/1.0" 200 7009 "-" "Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)"
80.8.55.1 - - [01/Jan/2001:00:00:00 +0100] "GET / HTTP/1.0" 200 7009 "http://www.sitereferer/cgi-bin/search.pl?q=a" "Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)"
80.8.55.1 - - [01/Jan/2001:00:00:20 +0100] "GET /page2.cgi HTTP/1.0" 200 7009 "http://localhost/page1.html" "Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)"
@@ -1043,6 +1088,7 @@ all commercial products):
80.8.55.1 - - [01/Jan/2001:00:00:35 +0100] "GET /image2.png HTTP/1.0" 200 7009 "-" "Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)"
80.8.55.1 - - [01/Jan/2001:00:00:40 +0100] "GET /dir/favicon.ico HTTP/1.0" 404 299 "-" "Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)"
80.8.55.1 - - [01/Jan/2001:00:00:40 +0100] "GET /favicon.ico HTTP/1.0" 200 299 "-" "Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)"
+
80.8.55.1 - - [01/Jan/2001:12:00:00 +0100] "GET / HTTP/1.0" 200 7009 "http://WWW.SiteRefereR:80/cgi-bin/azerty.pl?q=a" "Mozilla/4.7 [fr] (Win95; I)"
80.8.55.1 - - [01/Jan/2001:12:00:10 +0100] "GET /page1.html HTTP/1.0" 200 7009 "-" "Mozilla/4.7 [fr] (Win95; I)"
80.8.55.1 - - [01/Jan/2001:12:00:20 +0100] "GET /page2.cgi HTTP/1.0" 200 7009 "-" "Mozilla/4.7 [fr] (Win95; I)"
@@ -1050,9 +1096,9 @@ all commercial products):
80.8.55.1 - - [01/Jan/2001:12:00:30 +0100] "GET /image.gif HTTP/1.0" 200 7009 "-" "Mozilla/4.7 [fr] (Win95; I)"
80.8.55.1 - - [01/Jan/2001:12:00:35 +0100] "GET /image2.png HTTP/1.0" 200 7009 "-" "Mozilla/4.7 [fr] (Win95; I)"
80.8.55.1 - - [01/Jan/2001:12:00:40 +0100] "GET /js/awstats_misc_tracker.js HTTP/1.1" 200 4998 "-" "Mozilla/4.7 [fr] (Win95; I)"
- 80.8.55.1 - - [01/Jan/2001:12:00:45 +0100] "GET /js/awstats_misc_tracker.js?SCREEN=1024x768&CDI=32&JAVA=true&UC=UserCode1056710428488r6832&SC=SessionCode1056710428488r6832&SHK=N&FLA=Y&RP=N&MOV=N&WMA=Y&PDF=Y HTTP/1.1" 200 4998 "-" "Mozilla/4.7 [fr] (Win95; I)"
+ 80.8.55.1 - - [01/Jan/2001:12:00:45 +0100] "GET /js/awstats_misc_tracker.js?screen=1024x768&cdi=32&java=true&shk=n&fla=y&rp=y&mov=n&wma=y&pdf=y&uid=awsuser_id1073036758306r9417&sid=awssession_id1073036758306r9417 HTTP/1.1" 200 4998 "-" "Mozilla/4.7 [fr] (Win95; I)"
- 80.8.55.2 - - [01/Jan/2001:12:01:00 +0100] "GET /hitfromothersitetoimage.gif HTTP/1.0" 200 7009 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.3) Gecko/20030312"
+ 80.8.55.2 - - [01/Jan/2001:12:01:00 +0100] "GET /hitfromothersitetoimage.gif HTTP/1.0" 200 7009 "-" "Mozilla/5.0+(Macintosh;+U;+PPC+Mac+OS+X+Mach-O;+en-US;+rv:1.4)+Gecko/20030624+Netscape/7.1"
80.8.55.3 - - [01/Jan/2001:12:01:10 +0100] "GET / HTTP/1.0" 200 7009 "http://www.sitereferer:81/cgi-bin/azerty.pl" "Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.5a) Gecko/20030728 Mozilla Firebird/0.6.1"
80.8.55.3 - - [01/Jan/2001:12:01:15 +0100] "GET /page1.html HTTP/1.0" 200 7009 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.5a) Gecko/20030728 Mozilla Firebird/0.6.1"
@@ -1063,22 +1109,34 @@ all commercial products):
80.8.55.4 - - [01/Jan/2001:12:01:45 +0100] "GET /samevisitorthan80.8.55.3usingaolproxy.gif HTTP/1.0" 200 7009 "-" "Mozilla/3.0 (Windows 98; U) Opera 6.03"
+ 80.8.55.5 - - [01/Jan/2001:12:02:00 +0200] "GET /robots.txt HTTP/1.0" 200 299 "-" "Unknown bot"
80.8.55.5 - - [01/Jan/2001:12:02:00 +0200] "GET /robots.txt HTTP/1.0" 200 299 "-" "GoogleBot"
- 80.8.55.5 - - [01/Jan/2001:12:02:05 +0200] "GET / HTTP/1.0" 200 7009 "-" "GoogleBot"
+ 80.8.55.5 - - [01/Jan/2001:12:02:05 +0200] "GET /page2.cgi HTTP/1.0" 200 7009 "-" "GoogleBot"
- 80.8.55.6 - john [01/Jan/2001:13:00:00 +0100] "GET /cgi-bin/order.cgi?x=a&family=a&productId=998&titi=i&y=b&y=b HTTP/1.0" 200 7009 "http://www.google.com/search?sourceid=navclient&ie=utf-8&oe=utf-8&q=ma%C3%AEtre" "SAGEM-myX-5m/1.0_UP.Browser/6.1.0.6.1.103_(GUI)_MMP/1.0_(Google_WAP_Proxy/1.0)"
- 80.8.55.6 - john [01/Jan/2001:13:00:00 +0100] "GET /cgi-bin/order.cgi?x=a&family=a&productId=998&titi=i&y=b&y=b HTTP/1.0" 200 7009 "http://www.google.com/search?sourceid=navclient&ie=utf-8&oe=utf-8&q=élève" "SAGEM-myX-5m/1.0_UP.Browser/6.1.0.6.1.103_(GUI)_MMP/1.0_(Google_WAP_Proxy/1.0)"
+ 80.8.55.6 - john [01/Jan/2001:13:00:00 +0100] "GET /cgi-bin/order.cgi?x=a&family=a&productId=998&titi=i&y=b&y=b HTTP/1.0" 200 7009 "http://www.google.com/search?sourceid=navclient&ie=utf-8&oe=utf-8&q=ma%C3%AEtre+élève" "SAGEM-myX-5m/1.0_UP.Browser/6.1.0.6.1.103_(GUI)_MMP/1.0_(Google_WAP_Proxy/1.0)"
+ 80.8.55.6 - john [01/Jan/2001:13:00:00 +0100] "GET /images/image1.gif HTTP/1.0" 200 364 "http://www.google.fr/search?q=cache:dccTQ_Zn4isJ:www.chiensderace.com/cgi-bin/liste_annonces.pl%3FTYPE%3D5%26ORIGINE%3Dchiensderace+labrador+chiensderace&hl=en&lr=lang_en|lang_fr&ie=UTF-8" "SAGEM-myX-5m/1.0_UP.Browser/6.1.0.6.1.103_(GUI)_MMP/1.0_(Google_WAP_Proxy/1.0)"
+ 80.8.55.6 - john [01/Jan/2001:13:00:00 +0100] "GET /images/image2.gif HTTP/1.0" 200 364 "http://www.google.fr/search?q=cache:dccTQ_Zn4isJ:www.chiensderace.com/cgi-bin/liste_annonces.pl%3FTYPE%3D5%26ORIGINE%3Dchiensderace+labrador+chiensderace&hl=en&lr=lang_en|lang_fr&ie=UTF-8" "SAGEM-myX-5m/1.0_UP.Browser/6.1.0.6.1.103_(GUI)_MMP/1.0_(Google_WAP_Proxy/1.0)"
+ 80.8.55.6 - john [01/Jan/2001:13:00:00 +0100] "GET /images/image3.gif HTTP/1.0" 200 364 "http://www.google.fr/search?q=cache:dccTQ_Zn4isJ:www.chiensderace.com/cgi-bin/liste_annonces.pl%3FTYPE%3D5%26ORIGINE%3Dchiensderace+labrador+chiensderace&hl=en&lr=lang_en|lang_fr&ie=UTF-8" "SAGEM-myX-5m/1.0_UP.Browser/6.1.0.6.1.103_(GUI)_MMP/1.0_(Google_WAP_Proxy/1.0)"
+ 80.8.55.6 - john [01/Jan/2001:13:00:00 +0100] "GET /images/image4.gif HTTP/1.0" 200 364 "http://www.google.fr/search?q=cache:dccTQ_Zn4isJ:www.chiensderace.com/cgi-bin/liste_annonces.pl%3FTYPE%3D5%26ORIGINE%3Dchiensderace+labrador+chiensderace&hl=en&lr=lang_en|lang_fr&ie=UTF-8" "SAGEM-myX-5m/1.0_UP.Browser/6.1.0.6.1.103_(GUI)_MMP/1.0_(Google_WAP_Proxy/1.0)"
+ 80.8.55.6 - john [01/Jan/2001:13:00:00 +0100] "GET /images/image5.gif HTTP/1.0" 200 364 "http://www.google.fr/search?q=cache:dccTQ_Zn4isJ:www.chiensderace.com/cgi-bin/liste_annonces.pl%3FTYPE%3D5%26ORIGINE%3Dchiensderace+labrador+chiensderace&hl=en&lr=lang_en|lang_fr&ie=UTF-8" "SAGEM-myX-5m/1.0_UP.Browser/6.1.0.6.1.103_(GUI)_MMP/1.0_(Google_WAP_Proxy/1.0)"
- 80.8.55.7 - John Begood [01/Jan/2001:13:01:00 +0100] "GET /cgi-bin/order.cgi;family=f&type=t&productId=999&titi=i#BIS HTTP/1.0" 200 7009 "-" "Mozilla/3.01 (compatible;)"
+ 80.8.55.7 - John Begood [01/Jan/2001:13:01:00 +0100] "GET /cgi-bin/order.cgi;family=f&type=t&productId=999&titi=i#BIS HTTP/1.0" 200 7009 "http://www.a9.com/searchkeyfroma9" "Mozilla/3.01 (compatible;)"
+ 80.8.55.7 - John Begood [01/Jan/2001:13:01:00 +0100] "GET /do/Show;jsessionid=6BEF030AB1677BEC333FFCC7BF4DF564?param=1477 HTTP/1.0" 200 7009 "-" "Mozilla/3.01 (compatible;)"
80.8.55.8 - - [01/Jan/2001:14:01:20 +0100] "GET /404notfoundpage.html?paramnotpagefound=valparamnotpagefound HTTP/1.0" 404 0 "http://refererto404nofoundpage/pageswithbadlink.html?paramrefnotpagefound=valparamrefnotpagefound" "Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)"
80.8.55.8 - - [01/Jan/2001:14:01:20 +0100] "GET /405error.html HTTP/1.0" 405 0 "http://refererto405error/pagesfrom405.html" "Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)"
- 80.8.55.9 - - [01/Jan/2001:15:00:00 +0200] "GET /default.ida?XXXXXXXXXXXXXXXXXX%u6858%ucbd3%u7801%u9090%u9090%u8190%u00c3%u0003%u8b00%u531b%u53ff%u0078%u0000%u00=a HTTP/1.0" 404 299 "-" "-"
+ 80.8.55.9 - - [01/Jan/2001:15:00:00 +0200] "GET /default.ida?XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX%u9090%u6858%ucbd3%u7801%u9090%u6858%ucbd3%u7801%u9090%u6858%ucbd3%u7801%u9090%u9090%u8190%u00c3%u0003%u8b00%u531b%u53ff%u0078%u0000%u00=a HTTP/1.0" 404 299 "-" "-"
+ 80.8.55.9 - - [01/Jan/2001:15:00:00 +0200] "SEARCH / -" 411 - "-" "-"
+
+ 80.8.55.10 - - [01/Jan/2001:16:00:00 -0300] "GET / HTTP/1.1" 200 70476 "http://us.f109.mail.yahoo.com/ym/ShowLetter?box=Inbox&MoreYahooParams..." "Mozilla/5.0 (Windows; U; Windows NT 5.0; fr-FR; rv:1.7.5) Gecko/20041108 Firefox/1.0"
+ 80.8.55.10 - - [01/Jan/2001:16:00:00 -0300] "GET / HTTP/1.1" 200 70476 "http://us.f109.mail.yahoo.com/ym/ShowLetter?box=Inbox&MoreYahooParams..." "Mozilla/5.0 (Windows; U; Windows NT 5.0; fr-FR; rv:1.7.5) Gecko/20041108 Firefox/1.0"
+ 80.8.55.10 - - [01/Jan/2001:16:00:00 -0300] "GET / HTTP/1.1" 200 70476 "http://us.f109.mail.yahoo.com/ym/ShowLetter?box=Inbox&MoreYahooParams..." "Mozilla/5.0 (Windows; U; Windows NT 5.0; fr-FR; rv:1.7.5) Gecko/20041108 Firefox/1.0"
+ 80.8.55.10 - - [01/Jan/2001:16:00:00 -0300] "GET / HTTP/1.1" 200 70476 "http://us.f109.mail.yahoo.com/ym/ShowLetter?box=Inbox&MoreYahooParams..." "Mozilla/5.0 (Windows; U; Windows NT 5.0; fr-FR; rv:1.7.5) Gecko/20041108 Firefox/1.0"
- 80.8.55.10 - - [01/Jan/2001:16:00:00 -0300] "GET / HTTP/1.1" 200 70476 "http://us.f109.mail.yahoo.com/ym/ShowLetter?box=Inbox&MoreYahooParams..." "Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90; Hotbar 4.2.8.0)"
- 80.8.55.10 - - [01/Jan/2001:17:00:00 -0300] "GET /page1.html HTTP/1.1" 200 70476 "http://www.freeweb.hu/icecat/filmek/film04.html" "Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90; Hotbar 4.2.8.0)"
- 80.8.55.10 - - [01/Jan/2001:18:00:00 -0300] "GET /cgi-bin/awredir.pl?url=http://xxx.com/aa.html HTTP/1.1" 302 70476 "http://us.f109.mail.yahoo.com/ym/ShowLetter?box=Inbox&MoreYahooParams..." "Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90; Hotbar 4.2.8.0)"
+ 80.8.55.10 - - [01/Jan/2001:16:00:00 -0300] "GET / HTTP/1.1" 200 70476 "http://us.f109.mail.yahoo.com/ym/ShowLetter?box=Inbox&MoreYahooParams..." "Mozilla/5.0 (Windows; U; Windows NT 5.0; fr-FR; rv:1.7.5) Gecko/20041108 Firefox/1.0"
+ 80.8.55.10 - - [01/Jan/2001:16:30:00 -0300] "GET /page1.html HTTP/1.1" 200 70476 "http://www.freeweb.hu/icecat/filmek/film04.html" "Mozilla/5.0 (Windows; U; Windows NT 5.0; fr-FR; rv:1.7.5) Gecko/20041108 Firefox/1.0"
+ 80.8.55.10 - - [01/Jan/2001:17:00:00 -0300] "GET /cgi-bin/awredir.pl?url=http://xxx.com/aa.html HTTP/1.1" 302 70476 "http://us.f109.mail.yahoo.com/ym/ShowLetter?box=Inbox&MoreYahooParams..." "Mozilla/5.0 (Windows; U; Windows NT 5.0; fr-FR; rv:1.7.5) Gecko/20041108 Firefox/1.0"
This is what you should find:
@@ -1112,7 +1170,9 @@ is by design.
So this means this way of working might never be changed, so another chance is to use the AWStats plugin 'timezone'.
Warning, this plugin need the perl module Time::Local and it reduces seriously AWStats speed.
To enable the plugin, uncomment the following line in your config file.
+
LoadPlugin="timezone TZ"
+ |
where TZ is value of your signed timezone (+2 for Paris, -8 for ...)
@@ -1153,10 +1213,12 @@ A solution should be to setup your config file with something like:
LogFile=mylog*.log
However, with such a syntax, AWStats can't know in wich order processing log files (wich log file is the first, next or last). So
to work like this you must use the following syntax:
+
LogFile="/pathto/logresolvemerge.pl mylog*.log |"
+ |
Logresolvemerge is a tool provided with
-AWStats (in tools directory) that merge several log files on the fly sending line by line always the older record
-from a list of several log files. Using such a tool as a pipe source for AWStats LogFile
+AWStats (in tools directory) that merge several log files on the fly. It opens pointer on each files
+and sends, line by line, the oldest record from this. Using such a tool as a pipe source for AWStats LogFile
parameter is a very good solution because, it allows you to merge log files whatever their size
with no memory use, no hard disk use (no temporary files built), it is fast, it prevents
you from a bad order if your log files are not correctly ordered, etc...
@@ -1175,7 +1237,9 @@ And setup the LogFile parameter in you
the -LogFile command line option to overwrite LogFile value.
As an other solution, if you miss disk space, or to save time, you can ask logresolvemerge
to merge log files on the fly during the AWStats update process. For this, you can use the following syntax in your AWStats config file:
+
LogFile="/pathto/logresolvemerge.pl file*.log |"
+ |
See also FAQ-COM360 for explanation on logresolvemerge use.
@@ -1278,7 +1342,9 @@ servers with no internal Perl interpreter (mod_perl not active). To solve this,
tell Apache where is your external Perl interpreter.
For this, you have 2 solutions:
1) Add the following directive in your Apache httpd.conf config (or remove the # to uncomment it if line is already available)
-ScriptInterpreterSource registry
+
+ScriptInterpreterSource registry
+ |
Then restart Apache. This will tell Apache to look into the registry to find the program associated to .pl extension.
2) Other solution (not necessary if first solution works): Change the first line of awstats.pl file with the full path of your Perl interpreter.
Example with Windows OS and ActivePerl Perl interpreter (installed in C:\Program Files\ActiveState\ActivePerl),
@@ -1356,6 +1422,7 @@ This means your AWStats reference database files (operating systems, browsers, r
First try to update to last version. Then check in your disk that you have only ONE of those files. They should be
in 'lib' directory ('db' with 4.0) where awstats.pl is installed:
browsers.pm
+browsers_phone.pm
domains.pm
operating_systems.pm
robots.pm
@@ -1576,7 +1643,9 @@ However, this feature reduce seriously AWStats speed and the worms database (lib
all worms signatures. So if you still have rubish hits, you can modify the worms.pm file yourself or
edit your config file to add in the SkipFiles parameter some
values to discard the not required records, using a regex syntax like example :
-SkipFiles="REGEX[^\/default\.ida] REGEX[\/winnt\/system32\/cmd\.exe]"
+
+SkipFiles="REGEX[^\/default\.ida] REGEX[\/winnt\/system32\/cmd\.exe]"
+ |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|