From: eldy <> Date: Fri, 21 Feb 2003 05:13:18 +0000 (+0000) Subject: Updated documentation. X-Git-Tag: AWSTATS_5_4_RELEASE~3 X-Git-Url: http://git.ipfire.org/cgi-bin/gitweb.cgi?a=commitdiff_plain;h=8b5bbf2672f4da2eeb57a4baf3ae21b355de043e;p=thirdparty%2FAWStats.git Updated documentation. --- diff --git a/docs/awstats_benchmark.html b/docs/awstats_benchmark.html index c4067d39..42cc10f2 100644 --- a/docs/awstats_benchmark.html +++ b/docs/awstats_benchmark.html @@ -44,7 +44,7 @@ AWStats speed depends on AWStats version and options/setup you use in configurat This is benchmark results with AWStats version 5.1 and a common configuration:

HARDWARE: Athlon 1 GHz / 128Mb
-SOFTWARE: Windows 2000 / Perl 5.8
+SOFTWARE: Windows 2000 / Perl 5.8 (Standard Perl, ActiveState is much slower)
CONFIG OPTIONS: LogFormat=1, DNSLookup=0, URLWithQuery=0, URLReferrerWithQuery=0, No plugins
AVERAGE SPEED: 4500 lines by seconds
Other times for different kind of web sites sizes are shown later in this page...
@@ -53,19 +53,18 @@ Other times for different kind of web sites sizes are shown later in this page..
This is other important information to know:

-- A log file size is about 150 (NCSA common/CLF log files) to 300 times (NCSA extended/XLF/ELF log files) its number of lines,
-- A 30Mb file = 100,000 lines = 20,000 pages (with 5 hits/page) = 2,500 visits (with 8 pages/visits) => 75 seconds (Athlon 1GHz)
-- History files (resuming the log analyze) has the following size (one file a month) : - -15000+160*x+100*y bytes (where x is number of unique visitors a month and y is number of different pages on web sites)
-WARNING ! All those data are average values for a common public site. Calculation rule can be seriously changed -according to web server or AWStats configuration and web site content.
+- A log file size is about 150 (NCSA common/CLF log files) to 320 times (NCSA extended/XLF/ELF log files) its number of lines,
+- 1,000 visits = 8,000 pages (with 8 pages/visits) = 64,000 lines (with 8 hits/page) = 20 MB file => 15 seconds (Athlon 1GHz, Standard Perl 5.8)
+- History files (resuming the log analysis) has the following size (one file a month) : +15000+90*x+100*y bytes (where x is number of unique visitors a month and y is number of different pages on web sites)
+WARNING ! All those data are average values for a common public site with default configuration. +Calculation rule can be seriously changed according to web server or AWStats configuration and web site content.

-Don't forget that benchmarks of log analyzers are made without reverse DNS lookup -because this depends on your system, networks and Internet and not on the -log analyzer you use. And the reverse DNS lookup can take more than 95% of time of a log analysis !
-So, have a look at the following chart to:
+Don't forget that benchmarks of log analyzers are made without reverse DNS lookup because DNS +lookup is so slow (depending on Internet network and your system), that if enabled in AWStats +configuration file, it would take more than 99% of the time of a log analysis ! +Take a look at the following chart to:
- Get more real ideas on benchmarks results
- Get more information and advice on a good setup for your site.
@@ -76,26 +75,26 @@ So, have a look at the following chart to:
- - - - - - - - - - + + + + + + + + + +
Your Web site sizeRecommended values for parametersRecommended update frequency
(Rotate log delay)		Memory required**Duration***
DNSLookup*URLWithQueryURLReferrerWithQuery
0 - 1,000 visits/month10 or 10 or 1Once a week
Log files are 0-3 MB
10000 lines to process		<4 MB<2mn
0 (or 2)0 or 10 or 1Once a month
Log files are 0-12 MB
40000 lines to process		<4 MB<20s.
1,000 - 10,000 visits/month10 or 10 or 1Every 12 hours
Log files are 1-2 MB
660-6600 lines		4-8 MB1-2mn
0 (or 2)0 or 10 or 1Once a week
Log files are 3-30 MB
10000-100000 lines		4-8 MB5-50s
10,000 - 50,000 visits/month10 or 10 or 1Every 4 hours
Log files are 1-4 MB
2200-11000 lines		8-16 MB1-4mn
0 (or 2)0 or 10 or 1Once a day
Log Files are 4-20 MB
13000-65000 lines		8-16 MB10-40s
50,000 - 250,000 visits/month100 or 1Every hour
Log Files are 1-4 MB
2700-14000 lines		16-64 MB2-4mn
0 (or 2)00 or 1Every 6 hours
Log Files are 5-25 MB
17000-80000 lines		16-64 MB20-80s
250,000 - 1,000,000 visits/month0 (or 2)00Every hour
Log Files are 4-16 MB
14000-56000 lines		64-256 MB30-120s
1,000,000 - 5,000,000 visits/monthAWStats is not a good choice for such web sites. Try a tool with less features but faster like Analog or Webalizer
0 - 1,000 visits/month10 or 10 or 1Once a day
Log files are 0-1 MB
2000 lines to process		4 MB2mn
0 (or 2)0 or 10 or 1Once a day
Log files are 0-1 MB
2000 lines to process		4 MB1s
1,000 - 10,000 visits/month10 or 10 or 1Once a day
Log files are 1-10 MB
2000-20000 lines		4-8 MB2-10mn
0 (or 2)0 or 10 or 1Once a day
Log files are 1-10 MB
2000-20000 lines		4-8 MB1-10s
10,000 - 100,000 visits/month10 or 10 or 1Every 12 hours
Log files are 5-50 MB
10000-100000 lines		8-16 MB5-50mn
0 (or 2)0 or 10 or 1Every 12 hours
Log Files are 5-50 MB
10000-100000 lines		8-16 MB5-50s
100,000 - 500,000 visits/month100 or 1Every hour
Log Files are 4-16 MB
10000-50000 lines		16-64 MB5-25mn
0 (or 2)00 or 1Every hour
Log Files are 4-16 MB
10000-50000 lines		16-64 MB5-25s
500,000 - 2,000,000 visits/month0 (or 2)00Every hour
Log Files are 16-64 MB
50000-200000 lines		64-256 MB25-120s
2,000,000 - 5,000,000 visits/monthAWStats is not a good choice for such web sites. Try a tool with less features but faster like Analog or Webalizer
+5,000,000 visits/monthAWStats is not a good choice for such web sites. Try a tool with less features but faster like Analog
* You should set DNSLookup parameter to 0 (or 2) if
      - reverse DNS lookup is already done in your log file,
      - or if your web site has more than 250,000 visits a month.
Note: Country report can works without reverse DNS lookup if plugin 'geoip' is enabled (faster and more accurate than reverse DNS lookup).
-** Free memory required for update process (in MB).
+** Free memory required for update process (in MB), not hardware memory installed.
Warning: If you use the URLWithQuery or URLReferrerWithQuery option, or forget to complete correctly URLQuerySeparators for some sites, this value can be dramatically increased.
-*** Duration is with Athlon 1GHz/128Mb and LogFormat=1.
+*** Duration is with Athlon 1GHz/128Mb, Standard Perl 5.8 and LogFormat=1.


@@ -107,10 +106,10 @@ be set to 0, or 2 to only use a DNS file resolver). Note that you still can have without DNS lookup enabled. For this you must enable the 'geoip' plugin. Without this plugin, 'Country' report will works only if hosts addresses in your log file are already resolved (need to setup your web server to do so, your web server will be slowed). With DNSLookup enabled, log analyze speed is decreased -by 20 to 100 times.
+by 40 to 100 times.
-- Use carefully parameters URLWithQuery and URLReferrerWithQuery -(Let them set to 0 if you don't know what they means) and check your web site URLs' syntax to know if you don't need to complete parameter URLQuerySeparators. +- Use carefully parameters URLWithQuery, URLReferrerWithQuery and URLWithAnchor +(Let them set to 0 if you don't know what they means) and check your web site URLs' syntax to know if you don't need to complete the parameter URLQuerySeparators. If you really need to use URLWithQuery=1, check that URLWithQueryWithoutFollowingParameters is set properly.
- Be sure that your HostAliases parameter list is complete.