xfer: Compile even if cURL does not have support for WebSockets

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Support compiling with older versions of cURL

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

transaction: Don't declare anything after the label

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Set __attribute__((format(...))) wherever needed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Replace the bitfield with a state enum

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

file: Don't declare hardlink in the switch statement

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

log stream: Initialize r in case events was zero

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

os: Make more space for the distro information

ArchLinux is using a longer version_id with timestamps which is why we
need some more space here. There is no point in being too tight with
this.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Drop dependencies on Python modules

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Don't fail if standard input/output are not TTYs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Make it easier to configure the jail as interactive

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Fallback to the original file descriptor if the clone fails

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: shell: Implement running commands via CLI

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Remove the shell convenience function

This is not very flexible.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: shell: Make sure packages is always initialized and terminated by NULL

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Parse the correct option for packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Fix setting raw mode

If the standard input & output share the same inode, we can't overwrite
the attributes and need to take care of this.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Re-open standard input/output

This is helpful so that we don't have to worry about resetting the
original file descriptors in case we crash unintentionally.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Reset file-descriptors into blocking mode again when done

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Don't open standard input in read-only mode

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Always enable forwarding

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Terminate if we encountered an error

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Disconnect as early as possible

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Implement draining the buffers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Handle resizing the terminal window

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Store events and add a description

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Be less smart about the forwarding and make it work again

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Move the PTY into an extra file

The code for this is rather large and makes jail.c almost unreadable.

This patch does not move the entire feature over just yet, but it is a
start.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Block SIGCHLD

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Actually call the new event loop

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Move the timer into the event loop

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Catch any PID events by the event loop

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Use new log streamer

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

logging: Create an abstraction to stream log lines from a child process

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Create a new systemd event loop

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Remove the legacy logger

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Remove the build and legacy logger

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: build: No longer use the build logger

We have so many loggers and we need to remove a few...

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ctx: Move the magic context to here

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

python: Remove build/mkimage/shell from the Pakfire object

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

python: Remove the build service implementation wrapper

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

python: Remove the Python daemon implementation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

job: Fix typo

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

job: Send log messages to the build service

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Implement adding strings with length to a JSON object

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Make the WebSocket send callback more sensible

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

job: Buffer log lines in a ring buffer

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

logging: Add a simple ring buffer for buffering log lines

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

job: Pipe any log output back to the parent process

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

job: Create an own independant context for the child process

This prevents us to inherit anything from the parent process and allows
us to run a totally different configuration in the child.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

job: Create scaffolding to run a build

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

job: Fix replace error in flags

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

job: Initialize Pakfire in the child process

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Have them monitor themselves and update their state

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Automatically launch jobs once it has connected to the build service

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

job: Show what job we are connecting to

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Should more detail when a transfer fails

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Rename workers to jobs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Remove the worker's own HTTP client and event loop

It makes no sense to duplicate so much code, so the control connection
of the worker will have to run in the main process, too.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

worker: Store a reference to the daemon's HTTP client

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

worker: Fetch the daemon's event loop

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Terminate all workers when terminating

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

worker: Initialize the event loop and cURL in the child process

cURL is not multi-threaded and so to avoid any problems, we will
initialize everything in the forked child process.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

worker: Establish a control connection

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

buildservice: Use new URL formatting feature

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Make it easier to format URLs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

worker: Create our own event loop and HTTP client

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Connect the worker with the daemon

The daemon will now process when the worker exits and at least clean up.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Move the clone3() wrapper

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Fix format of the stats message

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Enable stat submission only when we have a control connection

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Build out submitting stats

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Add JSON helper function for unsigned integers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Rename JSON function to add integers to int64

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Add new helper function to add double values to JSON objects

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Don't require a reference to pakfire for the JSON functions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

_pakfire: buildservice: Remove submit_stats()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Keep the stats timer running continuously

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Send dummy stats using the event loop

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Implement sending a WebSocket message

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

buildservice: Remove the event loop

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Remove the buildservice

It is becoming too complicated to make the buildservice event-driven
when it does not need to be. It can live as a single request abstraction
model.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

buildservice: Remove holding the base URL

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

httpclient: Set the base URL for new xfers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

httpclient: Add option to set a base URL

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Submit stats regularly

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

buildservice: Tidy up creating the daemon control connection

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

buildservice: Enable authentication when uploading the payload

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Register any workers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Split stuff into a new worker thing

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Ignore CURLE_AGAIN

This is happening when the server is sending a ping over WebSocket which
triggers the socket, but there is no data for us to deal with as it has
already been handled by cURL.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Fail if the connection was unexpectedly closed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Free the allocated buffer

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Parse the received job

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Automatically try to reconnect when the connection gets lost

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Refactor handling any transfer problems and call the close callback

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

buildservice: Move daemon stuff to the daemon

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

httpclient: Implement basic WebSocket communication

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

xfer: Send authentication headers straight away when asked to

We don't need to check whether the server does not require
authentication first.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

buildservice: Allow passing the event loop to the HTTP client

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>