util: Rename JSON function to add integers to int64

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Add new helper function to add double values to JSON objects

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Don't require a reference to pakfire for the JSON functions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

_pakfire: buildservice: Remove submit_stats()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Keep the stats timer running continuously

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Send dummy stats using the event loop

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Implement sending a WebSocket message

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

buildservice: Remove the event loop

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Remove the buildservice

It is becoming too complicated to make the buildservice event-driven
when it does not need to be. It can live as a single request abstraction
model.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

buildservice: Remove holding the base URL

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

httpclient: Set the base URL for new xfers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

httpclient: Add option to set a base URL

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Submit stats regularly

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

buildservice: Tidy up creating the daemon control connection

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

buildservice: Enable authentication when uploading the payload

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Register any workers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Split stuff into a new worker thing

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Ignore CURLE_AGAIN

This is happening when the server is sending a ping over WebSocket which
triggers the socket, but there is no data for us to deal with as it has
already been handled by cURL.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Fail if the connection was unexpectedly closed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Free the allocated buffer

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Parse the received job

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Automatically try to reconnect when the connection gets lost

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Refactor handling any transfer problems and call the close callback

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

buildservice: Move daemon stuff to the daemon

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

httpclient: Implement basic WebSocket communication

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Send authentication headers straight away when asked to

We don't need to check whether the server does not require
authentication first.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

buildservice: Allow passing the event loop to the HTTP client

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

httpclient: Remove queueing our own transfers

We now throw everything into cURL and let it handle all of that...

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

httpclient: Tell cURL how many transfers we want to run in parallel

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

httpclient: Register the progress with the client

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

httpclient: Implement parallel transfers with sd-events

This patch will create a new event loop for each HTTP client which will
be used to connect to cURL.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Use the systemd event loop instead of epoll

This will allow us more flexiblity and already implements a lot of
features.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Makefile: Build the C daemon again

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Fix typo

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mount: Remove the excessive parameter passing

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

deps: Revert all the braindead logging changes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

logging: Add convenience functions to call the logger without having a context

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mount: Loop devices are actually block devices

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

logging: Remove *_ERRNO logging

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pwd: Remove legacy logger

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

compress: Remove legacy logger

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mount: Remove the legacy logger

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

file: Remove the legacy logger

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

dependencies: Drop the legacy logger

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

problem: Store a reference to the context

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

parser: Store a reference to the context

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Replace legacy logger

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Replace (most of) the legacy logger

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

logging: Make the legacy logger configurable

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Move to new logging in pakfire.c

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

python: Make sure we hold the GIL when jumping into the logging callback

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Re-enable jail tests that pass

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

python: Pakfire.execute(): Fix parsing some arguments

There have been a couple of problems here when no or invalid values have
been passed.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Fix path to test configuration file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Test the locally built binaries

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Dump log onto the console for Python tests

This is not very elegant, but I don't have a better way to do this now.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

python: Add tests for the Archive class

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Add functions to make opening files in the test env easier

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Add Python tests for context

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

python: ctx: Cleanup code that dereferences the logging function

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

python: ctx: Setup the default logger

There was some code that started implementing this, but weirdly it was
never called...

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Disable all jail tests

Those mess up the console.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Migrate other Python tests to the new framework

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Build a common basis for Python tests

This new class has some methods that make it easy for us to set up some
simple Pakfire environments.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Fix syntax errors in keys tests

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Remove dummy Python test

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

httpclient: Don't store finished transfers internally

This caused a recursion in reference counting resulting in the HTTP
client and all finished transfers never being freed.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Fix cgroup tests building from source

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Reset all callbacks after execution

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Remove unnecessary pakfire_jail_exec wrapper function

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Remove callbacks from command calls

This makes those functions having fewer arguments which should help us
to write cleaner code.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Replace communication callbacks by setting callbacks

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Add functions to set standard input/output callbacks

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Fix incorrect variable name

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Drop extra function to check if buffer is full

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Rename PTY forwarding flags

The term flags is slightly overused and makes things confusing.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Move struct declarations out of the large struct

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Remove unused stdout/stderr buffers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Drop custom log callback stuff

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Drop setting jail callback and use output callback instead

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Implement sending data into standard input

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Keep reading from/writing to PTY for as long as there is work to do

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Forward function names of child processes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Remove duplicate logging function

There were two functions essentially doing the same, so one can go.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Honour the buffer length when forwarding log messages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: PTY forwarding: Call the output callback if available

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Only connect the current terminal if requested

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Do not try to attempt any TTY operations if we don't have a TTY

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Refactor how to drain logging buffers with callbacks

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Make PTY forwarding a flag and remove interactive bool

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Use the "fill buffer" function for logging, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Align processing of file descriptors in the event loop

This is slightly easier to read than checking the event type first and
then handle the rest.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Implement PTY forwarding

This replaces the previous pipe forwarding with a new controlling PTY
that is set up for each jail.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Only try to restore file descriptors if they are still open

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Fix setting raw mode only on the correct side

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Store flags of stdin/stdout

We will need to restore them after we are finish the PTY forwarding.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mount: No longer create /dev/console in the jail

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Fix creating symlinks

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Setup PTY in the master process and add it to the event loop

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Create a better struct to hold all PTY related stuff

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>