graphs: Implement adjusting the interval

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Send --since= and --until

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Remove extra colon

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Print any error messages from the daemon

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Remove unused GRAPH_TITLE macro

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Add an inline drawing function

This will help us to not sink into more preprocessor hell by adding a
little bit of stuff that is actually somewhat executed at runtime.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Include the unit with the macro

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Simplify the LINE macros

We should pass the strength of the line instead of replicating the same
macro again and again.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Makefile: Don't reset dist_doc_DATA

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Add cpufreq graph

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Make it possible to set colors as a non-literal

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: iptables: Make the static analyzer happy

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: iptables: Initialize r

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: cpufreq: Disable source if there is no support

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

source: Add option for sources to disable themselves

This happens when we don't have support for something and the source
usually asks to be disabled.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Collect cpufreq information

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

file: Implement path formatting into the quick read function

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

DESIGN: Add some thoughts on the design of this project

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Bps -> bps

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

source: Run some basic checks

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Install iptables-devel on Fedora

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: sensors: Collect current metrics

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: sensors: Collect energy sensors

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: sensors: Collect power metrics

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: sensors: Collect fan metrics

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: sensors: Remove the extra callback

We can just directly send the map to the collection function.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: sensors: Collect voltage/input sensors

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: sensors: Reset r if there are no features

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: sensors: Implement reading temp sensors

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Fix detection for libsensors

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: iptables: Accumulate counters of the same comments

This is to be compatible with collectd and what we are currently using
in IPFire. When there is the same comment, we just add up the counters
so that we can collect metrics in different tables/chains.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Add iptables

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Terminate the daemon if no sources have been loaded

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

metrics: Constify the value pointers

Sometimes we will receive some data which has been constified and in
order to pass it on straight away, we will constify the value pointer,
too.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: disk: Convert temperate from mK to K

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Remove old print macros

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

po: Update translations

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

metrics: Only require one allocation

Since we know how many metrics we might expect from the beginning we can
realise the metrics as a variable array and only have one allocation.

Since this application is having a lot of allocations, this would quite
save a bit of memory fragmentation and load on the allocator.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Collect metrics from suricata

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

source: Migrate RRDs if we have lost fields

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: hostapd: Convert rates after they have been parsed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

source: Don't try to commit metrics too soon

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

source: Fetch the last update timestamp

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

source: Use rrd_info_r() to check if a RRD file exists

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

queue: Remove the old way to submit sample data

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: hostapd: Migrate to new metrics submission

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: disk: Create a metrics object and populate as we go

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

metrics: Add support for bool

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Convert all sources to submit metrics the new way

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

metrics: Create a shorthand to submit stats with less code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

file: Implement parsing the entire file as JSON object

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add a new metrics object

When we have larger RRD files, it will become increasingly difficult to
serialize the format strings. This new object is supposed to store
metrics more efficiently and with more metadata.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Install libudev-dev on Debian-based machines

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Release memory when the system is under pressure

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: disk: Read SMART data if available

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

source: Implement actually migrating databases

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

source: Check if RRD files need migration

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Add source to collect disk IO stats

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

file: Return the error code if we could not read the file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Connect to udev

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

colors: Define a special color for rx/tx traffic

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Add a graph to show rate information

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Correct rate information of hostapd stations

hostapd returns this in hundredth of kilobits. We will store it in bits.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Try to make the signal graph a bit more colourful

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Add bandwidth graphs for hostapd stations

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Rename hostapd station signal graph

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

po: Add telemetry.po to .gitignore

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: hostapd: Add graph that shows the station signal

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Add some more macros

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Take VDEFs from the graphs macros

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

command: Cleanup events before closing file descriptors

This makes the trace slightly cleaner when FDs will be removed from the
event loop before they are closed and not the other way round.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

command: Defer cleaning up the command to avoid zombies

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Simplify headers by removing option to pass extra arguments

We should keep it so that the macros print simple things and we won't
have to deal with the extra arguments.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Add automatic field composition for objects

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: hostapd: Don't use colons

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

queue: Don't allow colons in object names

This breaks generating graphs where colons are used as delimiter.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: hostapd: Zero-pad MAC addresses

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Pass the object in the options array

This makes it all a little bit easier

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Add source for hostapd clients

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

file: Only finish parsing when we have found enough fields

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

file: There is no need to attempt to parse empty lines

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

file: Add function to run the parser on a single line

This is useful if we want to use the parser when we cannot walk through
the file line by line.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Allow to select sources on the CLI

This is only useful for testing to basically disable all other sources
for better log readability.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Properly turn off the event when we disable a source

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

po: Update translations

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Rename the entire project to "IPFire Telemetry"

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

source: Disable all sources that fail all the time

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Always show the top of the memory graph

I am not sure whether this is what I actually want but some members on
the team think that it should  be this way. So I will commit this for
now and maybe later revert it again.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: df: Cleanup /proc/self/mounts on error

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

command: Close the pidfd

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

file: Reset the file pointer on error

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

file: Another attempt to make the static analyzer happy

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

file: Try to make the static analyzer happy

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Add a memory graph

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

proc: Also convert total memory to bytes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

queue: Flush all data when we want to draw a graph

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

graphs: Write title/vlabel to the stack

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

po: Update translations

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Add option to enable tests

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Remove the old file walking functions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>