processors: Collect usage for all individual cores

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Collect every plugin immediately after daemon launched

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

plugins: Add a simple helper function to read integers from files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Open all files in a with statement block

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Tidy up imports of other modules

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

colours: Fix importing functions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

loadavg: Fix legend alignment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Add plugins to scheduler when the daemon launches

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Do not load util submodule in __init__.py

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Remove unused list

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

re: Avoid pre-compiling regular expressions

Python has a cache for these

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop unused Timer class

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Give plugin a lower priority

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Allow launch without any plugins

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Do not log supported locales

This does not seem to be very helpful to me

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Drop our own scheduler and use sched

Our own implementation was trying to be very accurate which
comes with a large overhead and is largely unnecessary.

This patch removes the threading approach which kept multiple
timers and replaces it with one simple deadline scheduler.

Plugins will have to ensure that they are not blocking the
collection.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

colours: Fix string formatting for transparency

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

logging: Tidy up code and align with other projects

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Fix import of _collecty module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Move color functions into the color module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop entropy plugin

This is no longer useful.

The Linux kernel has changed to only use the its internal PRNG
for /dev/random and /dev/urandom.

Once it is seeded, it will spit out as many random data as you
would like, but would not require an entropy pool being filled
up as much.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Makefile: Fix generating man-pages only

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Remove TODO list

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Show "Default Gateway" in headline for gateway

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

processor: Show processor usage in percent instead of jiffies

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

disk: Fix exporting graphs

Colour module was not included

Signed-off-by: Arne Fitzenreiter <arne_f@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

disk: Catch error for SMART devices w/o tmp sensors

Signed-off-by: Arne Fitzenreiter <arne_f@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Silence "no replies received" when no IPv6 connectivity

This will just clutter the log files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Replace Nones with UNKNOWN instead of NaN

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Ping 'gateway'

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

conntrack: Reformat now/avg/min/max values below graph

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Split the C module into multiple smaller files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Merge branch 'master' of ssh://git.ipfire.org/pub/git/collecty

Conflicts:
src/collecty/plugins/base.py
src/collecty/plugins/cpufreq.py
src/collecty/plugins/sensors.py

Introduce a colour scheme and fix design of the graphs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cpufreq: Fix graph generation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sensors: Make the lines less fat

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sensors: Fall back to ACPI temperature sensor to processor temperature

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Refectoring of the main classes

This is supposed to remove some too complicated and
redundant code.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Refectoring of the main classes

This is supposed to remove some too complicated and
redundant code.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Remove some unused code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

conntrack: Sort graph areas by standard deviation

This makes the graphs more readable

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Allow getting the standard deviation of the plotted values

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Make RRD key names accessible as a list

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add some magic to collecty that makes the graph templates smaller

This patch will automatically add DEFs for all DSes in a
RR database. For all DEFs and CDEFs will be VDEFs generated
with the current, minimum and maximum values.

That reduces the size of the RRD graph templates massively
and makes them better readable and editable.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

entropy: Remove trend line

This does not add any useful information

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Allow generating thumbnails of graph images

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Make the graph title optional

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Bump version to 004

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Commit all collected data in the write cache to disk when generating a graph

Therefore we will always get the latest data drawn
in the graph image even when writing data to disk
is happening delayed.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add graphs for IP fragmentation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Check for all headers we use

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add df plugin

The df plugin collects data about the filesystem and
inode usage.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Update translations

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

.gitignore: Ignore any graph files in the source directory

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add system interrupts plugin

This will graph all system interrupts

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Automatically guess image format when generating graphs

This allows us to omit the --format parameter.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add lastupdate()

Allow to request the latest dataset of the database so
that sensory data can be shown at various other places, too.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sensors: Fix typo in property name

Caused an exception when "minimum" did not yield anything

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Change the background colour to white

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add context switches plugin

This monitors the number of context switches of the entire system.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

memory: Remove too much whitespace

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Remove left-over variables from overlayed methods

These should not be there and caused a runtime error
that made rendering the conntrack graphs impossible.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

processor: Fix title

We shouldn't use useless abbreviations and words in headlines
should start with a capital letter.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cpufreq: Fix graph title

There was an old title from the processor graph

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add graph info functionality

The GraphInfo interface will return some basic information about
a graph (like title, etc.) and can be extended in the future.

This patch also changed the return value of the GenerateGraph
interface which is now a dictionary which is more extensible
and comes with some metrics about the graph now.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

locale: Fix fallback to default locale

A typo caused an exception.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Fix import of processor plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Sync translations

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Rename cpu plugin to 'processor'

It is internally called like that and the file should
have the same name.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sensors: Localise plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

memory: Localise plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

loadavg: Localise plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Localise plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

interface: Localise plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

entropy: Localise plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

disk: Localise plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cpufreq: Localise plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cpu: Localise plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

conntrack: Localise plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add code to localise graph templates

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Don't show full packet loss in background

If a system has no connectivity to either IPv6 or IPv4 the background
will turn dark because 100% packet loss is detected.

We will now only paint the background dark for packet loss up to
99% and for 100% packet loss the line will not be continued so that
this is easily readable, too.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add options to generate localised graphs

This patch adds options to generate localised graphs
(in the right timezone and correct number formatting) from
command line and the dbus API.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Enforce running with UTC

collecty records all data in UTC and writes them to the database
in UTC as well. When the system uses a different timezone the database
"corrects" the timestamps what we don't want here. Hence we force
resetting the timezone to UTC.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Improve logging when host could not be reached

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Catch exception when cpufreq is not supported on a system

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Rewrite latency module

This patch replaces the builtin python implementation
that pinged hosts by a Python C module that uses liboping.

liboping is able to ping IPv6 hosts as well and should
implement the ICMP protocol more appropriately.

The graph has been extended so that hosts will have a
line for latency over IPv6 and IPv4 if available and
the packet loss is merged from both protocols, too.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

plugins: Automatically replace None by NaN

rrdtool uses NaN to represent no value. Python uses None.
This patch automatically translates from None to NaN.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Bump version to 003

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Don't wait until the worker thread has finished after sending shutdown signal

There is no need to wait for each worker thread individually.
Instead we send all worker threads the shutdown signal and
wait after that until they all have finished.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Decrease minimum number of worker threads to two

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add version information

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Allow better escaping for custom intervals

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Return the graph as a bytes object

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Add interval "month"

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Fix shebang of collectyd and collecty-client

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cpu: Collect CPU stats once a minute

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

interface: Collect interface stats twice a minute

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Remove default interval

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

loadavg: Collect data only once a minute

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Generate graphs in memory

Remove Python 2 hack that created a temporary file on disk
in which the graph was written and then read the file content
back in. The Python 3 module allows us to write the graph
directly into a buffer.