daemon: Make WriteQueue thread-safe

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Tidy up collection and remove double-handling of unexpected exceptions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

conntrack: Refactor plugin

This drops most of the functionality which is not sustainable
with a large number of connections.

Fixes: #12475
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Remove deprecated STACK command

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

processor: Add outlines like all other graphs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Make areas less opaque

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

memory: Refactor plugin to store data in kilobytes instead of percentages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

memory: Refactor graph

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

loadavg: Refactor graph

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Refactor graph

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ipfrag: Refactor graphs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

interrupts: Refactor graphs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

interfaces: Refactor graphs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

disk: Refactor bad sectors graph

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

df: Refactor graphs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Correctly apply area opacity

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Make the first column slightly wider

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

context switches: Refactor graph

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

processor: Redesign graph

Justify everything to use the full width and remove
idle percentages.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Justify all legends

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

processors: Add line with total usage

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Ping 10 times within 10 seconds

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

interrupts: Rename to interrupts from system-interrupts

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

interrupts: Fix graph title when showing a specific interrupt

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

interrupts: Collect data for all interrupts

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add a simply backup mechanism

This is now called through DBUS and I am not sure whether
that is a good idea or not.

The upsides are that the client will never access files
directory, the downside is that the backup process blocks
the DBUS thread.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop loading some unused modules

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

processor: Add guest_nice usage, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

processors: Plot steal and guest usage in graphs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

processors: Collect usage for all individual cores

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Collect every plugin immediately after daemon launched

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

plugins: Add a simple helper function to read integers from files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Open all files in a with statement block

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Tidy up imports of other modules

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

colours: Fix importing functions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

loadavg: Fix legend alignment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Add plugins to scheduler when the daemon launches

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Do not load util submodule in __init__.py

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Remove unused list

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

re: Avoid pre-compiling regular expressions

Python has a cache for these

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop unused Timer class

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Give plugin a lower priority

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Allow launch without any plugins

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Do not log supported locales

This does not seem to be very helpful to me

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Drop our own scheduler and use sched

Our own implementation was trying to be very accurate which
comes with a large overhead and is largely unnecessary.

This patch removes the threading approach which kept multiple
timers and replaces it with one simple deadline scheduler.

Plugins will have to ensure that they are not blocking the
collection.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

colours: Fix string formatting for transparency

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

logging: Tidy up code and align with other projects

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Fix import of _collecty module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Move color functions into the color module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop entropy plugin

This is no longer useful.

The Linux kernel has changed to only use the its internal PRNG
for /dev/random and /dev/urandom.

Once it is seeded, it will spit out as many random data as you
would like, but would not require an entropy pool being filled
up as much.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Makefile: Fix generating man-pages only

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Remove TODO list

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Show "Default Gateway" in headline for gateway

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

processor: Show processor usage in percent instead of jiffies

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

disk: Fix exporting graphs

Colour module was not included

Signed-off-by: Arne Fitzenreiter <arne_f@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

disk: Catch error for SMART devices w/o tmp sensors

Signed-off-by: Arne Fitzenreiter <arne_f@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Silence "no replies received" when no IPv6 connectivity

This will just clutter the log files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Replace Nones with UNKNOWN instead of NaN

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

latency: Ping 'gateway'

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

conntrack: Reformat now/avg/min/max values below graph

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Split the C module into multiple smaller files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Merge branch 'master' of ssh://git.ipfire.org/pub/git/collecty

Conflicts:
src/collecty/plugins/base.py
src/collecty/plugins/cpufreq.py
src/collecty/plugins/sensors.py

Introduce a colour scheme and fix design of the graphs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cpufreq: Fix graph generation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sensors: Make the lines less fat

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sensors: Fall back to ACPI temperature sensor to processor temperature

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Refectoring of the main classes

This is supposed to remove some too complicated and
redundant code.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Refectoring of the main classes

This is supposed to remove some too complicated and
redundant code.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Remove some unused code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

conntrack: Sort graph areas by standard deviation

This makes the graphs more readable

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Allow getting the standard deviation of the plotted values

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Make RRD key names accessible as a list

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add some magic to collecty that makes the graph templates smaller

This patch will automatically add DEFs for all DSes in a
RR database. For all DEFs and CDEFs will be VDEFs generated
with the current, minimum and maximum values.

That reduces the size of the RRD graph templates massively
and makes them better readable and editable.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

entropy: Remove trend line

This does not add any useful information

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Allow generating thumbnails of graph images

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Make the graph title optional

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Bump version to 004

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Commit all collected data in the write cache to disk when generating a graph

Therefore we will always get the latest data drawn
in the graph image even when writing data to disk
is happening delayed.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add graphs for IP fragmentation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Check for all headers we use

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add df plugin

The df plugin collects data about the filesystem and
inode usage.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Update translations

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

.gitignore: Ignore any graph files in the source directory

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add system interrupts plugin

This will graph all system interrupts

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Automatically guess image format when generating graphs

This allows us to omit the --format parameter.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add lastupdate()

Allow to request the latest dataset of the database so
that sensory data can be shown at various other places, too.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sensors: Fix typo in property name

Caused an exception when "minimum" did not yield anything

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Change the background colour to white

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add context switches plugin

This monitors the number of context switches of the entire system.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

memory: Remove too much whitespace

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Remove left-over variables from overlayed methods

These should not be there and caused a runtime error
that made rendering the conntrack graphs impossible.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

processor: Fix title

We shouldn't use useless abbreviations and words in headlines
should start with a capital letter.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cpufreq: Fix graph title

There was an old title from the processor graph

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add graph info functionality

The GraphInfo interface will return some basic information about
a graph (like title, etc.) and can be extended in the future.

This patch also changed the return value of the GenerateGraph
interface which is now a dictionary which is more extensible
and comes with some metrics about the graph now.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

locale: Fix fallback to default locale

A typo caused an exception.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Fix import of processor plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Sync translations

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Rename cpu plugin to 'processor'

It is internally called like that and the file should
have the same name.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sensors: Localise plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

memory: Localise plugin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>