Drop PakfireServer

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop unused arch.py

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repo: Add function to scan repos for archives

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Prepare repository tests

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pakfire: Rename local repository to @system

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Read install time back from database

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

package: Give build_host/build_time proper names and types

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Capitalize headlines

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

relationlists: Sort before printing them

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Add weak dependencies supplements/enhances

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: dump: Process dependencies in a big loop

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Truncate dependencies correctly at the markers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

package: Use solvable_*_deparray instead of idarray

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Time how long the import takes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pakfire: Improve performance when importing relation lists

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop Python implementation of the local repository

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

request: Check whether installed repository is set

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Load dependencies

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

package: Rename pakfire_package_create2 to pakfire_package_create

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

package: Keep a copy of the repository

This increases performance when the repository needs to be accessed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

package: Rename pakfire_package_create to pakfire_package_create_from_solvable

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Load filelists

To avoid running an extra query for the filelist, we simply have SQLite
concatenate the filelist and we split it again after.

It would have been nicer to use NUL to concatenate the string, but that
is unfortunately difficult in SQLite, so that we use newline and replace
it later so that we can only run memcpy() once instead of once per line.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Import more text fields into the package database

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Internalize repository after load

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Load a couple of attributes for packages into repo

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pakfire: Automatically create the installed repository

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pakfire: Tidy up initialisation

The code that sets up the pool has now entirely moved into a separate
function.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Drop pakfire_strdup

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Drop pakfire_realloc

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Drop pakfire_malloc

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Drop pakfire_calloc

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Drop pakfire_free

There is no point in using an own function to free any memory.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Run scriptlets from database

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

scriptlets: Constify list of scriptlet types

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Create a unique index over package UUIDs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Implement removing packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Fix field number for vendor (and do not overwrite UUID)

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Add function which returns how many packages are installed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Add test for add_package()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repo: Do not call pakfire_repo_identical() without a repository

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

relationlists: Rename _count() and _get_clone()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

relationlist: Refactor create

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Import dependencies

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Add scriptlets

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: scriptlets live in "scriptlets/"

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: archive: Do not break on successful memory allocation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: scriptlets: Actually free on free()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: execute: Call chdir("/") after chroot

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: scriptlets: Move them into an own data structure

We deal with scriptlets in several places and carrying them around as
loose pointers to some data is not very comfortable.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Initialise r

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Drop unused build_date column

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Drop dependency on libgcrypt

This library was chosen as a lightweight and more easy to use
alternative to OpenSSL.

Unfortunately it does not seem to be up to standard in terms of
reliability, performance and most importantly security.

Therefore we are using OpenSSL which is the de-facto standard library,
well-audited and has a transparent development process.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Use OpenSSL instead of libcrypt to compute hashes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Link against OpenSSL

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Add a basic test for filelists

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Drop filelists from packages

Filelists are now being allocated when needed.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Remove dropped functions from symbols table

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: filelist: Implement sorting filelists

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Refactor files

This used to be used to implement lists which was a right mess.

Lists are now filelists and files are now files only.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: filelist: Refactor filelist

The code that was written was not even used and has now been rewritten
in order to make it usable and to remove any linked-list stuff from
PakfireFile.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: filelist: Move object declaration into .c file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Add files to filelist

This is incomplete because we can currently not access some attributes
from the file object.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: steps: Make them independent from libsolv

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Drop build_id column from INSERT statement

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Add check function to check database integrity

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Add some tests for database

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Fix typo in optimize

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Fix reading settings

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Drop old build_id column

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Add packages to database when installed

This does not add any metadata, yet.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Add foreign keys to tables

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Add scriptlets table

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Add files table

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Add dependencies table

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Create packages table

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Self-populate schema

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Set database to WAL mode

We disable autocheckpointing since we are expected to writer rather
large transactions and we would like to keep the database as compact as
possible, too. That is achieved by truncating the WAL log in the end
where the data is being copied into the main database and the WAL log
being emptied after.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Set some sensible defaults for the connection

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: execute: status might have been used uninitialised

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

python: execute: Raise OS error when starting the process failed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Setup some basic database logging

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Use SQLite3

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Add flags to decide whether we need write access

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Export functions like everything else

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Remove LMDB

This does not seem to be the right tool for our task

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Call database routines when packages are added/removed

These functions are empty right now and serve as placeholders

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: transaction: Pass the open database down to steps

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: transaction: Open the database when needed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: db: Assume that the private directory already exists

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Define and always create private dir

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Skip freeing repositories when pool isn't set

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Add lmdb database environment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Do not allocate more space than we need

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Depend on lmdb

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: execute: Allow passing the logging callback from Python

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: execute: Reduce logging callback to one function

This function is now being passed the loglevel and can therefore
distinguish between stdout and stderr.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: archive: Only load support for what we use

This reduces the footprint of libpakfire in memory as well as not
opening us up to any vulnerabilities in filters and formats of
libarchive that we do not use.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: execute: Statically allocate the log buffer

This prevents the buffer from growing unboundedly, but limits us to only
process log messages of up to the buffer size.

I have chosen 64k which should be more than enought that we never run
into this situation.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: execute: Make logging functions exchangeable

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: execute: Add test with multiple newlines in one read

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>