parser: Unify fetching declarations and implement template lookaside

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

parser: Set name for all packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Add scaffolding to build packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

parser: Set package name when using shortcut declaration

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

parser: Add function to list all namespaces

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Add logging_callback

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Move build process into libpakfire

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

execute: Log how much CPU time was spent

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

filelist: Drop unused total_filesize function

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builder: Raise error after dropping into shell

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packager: Write checksums in mtree format

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Reset r after reaching end of file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pakfire: Add PackageFormat-6 capability

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Remove debugging line

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Bump package version to 6

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Read filelist in mtree format

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packager: Drop using own filelist

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packager: Write filelist of payload in mtree format

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Close archive if an entry could not be found

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libpakfire: Set number of max open files to 512k

Following this: http://0pointer.net/blog/file-descriptor-limits.html

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

execute: Move faking architecture into libpakfire

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

execute: Move setting default environment into libpakfire

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Stop parsing filelist during extraction

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

filelist: Free file during scan

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

testsuite: Drop useless errno test

This raises loads of false positives

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Fix passing modified archive pointer

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Fix two refcounting issues with filelists

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Refactor reading files from the archive

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Only unref parser when it was set

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Make files sticky

We can now return to open the archive file once and keep it opened. This
makes files sticky and nobody can replace or delete a file
mid-transaction.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: makefile: Set architecture to make creating a package successful

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

parser: Another attempt to fix refcounting

This allows tests to run without any problems, but there must be other
problems elsewhere.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

parser: Simplify passing parent parser to if statement evaluation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

parser: Make exiting the expand function easier

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

parser: Correctly skip parantheses in commands

This regular expression handles balanced parantheses correctly so that
we will find all commands that use ().

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builder: Simplify shell code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

snapshots: Drop static list of excludes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

snapshot: Do not archive any mountpoints

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

arch: Internalize function to check if the host is compatible

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builder: No longer check if the host supports an architecture

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Allow passing the target architecture

This switch enabled Pakfire to bootstrap for a different architecture
than the host architecture.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

arch: Use buildtarget to make machine and append "-gnu"

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

arch: Cut off vendor if it has any spaces

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

arch: Use qemu emulator for foreign arches

This patch allows Pakfire to emulate any architecture that the host
system supports using binfmt_misc.

We bind-mount the interpreter into the chroot and execute everything as
normal.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pakfire info: Add --long switch and --filelist

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

transaction: Show correct package order for upgrades/downgrades

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

execute: Do not close stdin in forked processes

Configure scripts try reading from this file descriptor and duplicating
it which will fail if stdin has been closed.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Drop duplicate and unused filelist parsing function

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

filelist: Make parsing more robust

This code is utterly broken and probably should be rewritten from
scratch.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Read legacy filelists

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

execute: Search for command if not given as absolute path

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: execute: Log output to console

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Add execute command

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pakfire: Do not overlay root mountpoint when path was given

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cgroup: killall: Break if cgroup could not be opened

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

execute: Log errors when cgroup could not be created

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Pass configuration to Pakfire

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Revert "archive: Drop parsing the filelist"

This reverts commit 1b970ec26ba977df90f233bb4d5106bf915848b8.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Free parser after test

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

parser: Attempt to fix refcounting problems

This is still leaking some references and I cannot bloody find out why

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

parser: Check if subparsers are set before freeing them

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

dist: Hard-code architecture of source packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Ignore empty dependencies

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

parser: Correct pass down the parent parser

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packager: Disable padding for Zstandard

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

parser: Make it re-entrant

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

parser: Move namespace & name to stack

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

testsuite: Show when errno is unintentionally set

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

test: arch: Fix build

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

dist: Set various default variables when reading makefiles

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builder: Move console logger into logger module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

arch: Make some functions private and write to stack

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

execute: Avoid calling read() multiple times when reading logs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

transaction: Reload database after finishing transaction

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Refactor pakfire_split_string

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: packager: Fix build

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builder: Add option to disable snapshots

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: No longer import obsolete repository module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

execute: Return 127 when a command could not be found

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

execute: Log the entire script

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builder: Add a simple console log handler

This is quite similar to the stream handler but writes error messages to
stderr and everything else to stdout.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive: Do not try to compare empty arch

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

execute: Log correct exit code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ipfire3: Do not include architecture in local repository path

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builder: Re-enable Build group

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repo: Internalize all scanned content

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

request: Log what we are solving

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop unused Step type

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packager: Write package format for compatibility checks

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packager: Add compression feature when compressed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

dist: Use pakfire_string_* functions everywhere

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Use our custom mktemp function everywhere

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Add a unified function to parse dependencies

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

package: Reset title after first dependency line

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

package: Sort dependencies on dump

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop all dropped functions from symbol table

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop relations entirely

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Handle dependencies as strings

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: Add new dependency parsing function

This function can handle namespaces and has a better approach than the
brute-force one that we used before that tries to find operators like =,
>=, etc.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pakfire: Add a custom namespace for features

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>