linter: Skip script interpreter check for ELF files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

linter: Skip linting kernel modules

There is pretty much nothing we can do with them.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

linter: Move skipping files we never want to lint

This saves us from initializing the linter and reading the entire
payload.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Remove extra step when installing any custom packages

Since there is only one place where this happens, we can also add this
all to the existing large transaction.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Install source package/update in one step

This patch makes launching a new environment even faster. Everything
will always be resolved in one go and installed in one huge transaction.
Any dependency errors will be caught really early on and we will have
less noise in the console/log.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Find pre-requirements without a shell script

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pty: Add helper function to stream a buffer into stdin

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

util: which: Fix return code on invalid input

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

package: Allow building noarch on any host architecture

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

linter: Skip valgrind for the SSP check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

linter: Whitelist the runtime linker for the SSP check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

stripper: Never try to strip any firmware

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Fix order of arguments to set the arch

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

strings: Don't clear the entire buffer when resetting a string

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

strings: setn: Don't copy anything if length is zero

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

strings: Create a function to copy a fixed-length string

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

string: Choose a more sensible error code when we run out of space

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jail: Remove headers for removed functions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Exclude *.py[co] and *.packlist from BUILDROOT check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Set PKG_CONFIG_PATH a little bit elegantly

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

env: Add a function to append values

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Create buildroot outside the build environment

This will help us to avoid all the path maths and we will simply
bind-mount the temporary directory into the build environment instead.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

CLI: Remove option to pass the build ID

I don't think we need this and currently it is a no-op.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: build: Use the correct macros to check for errors

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: build: Pass the configuration

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Always globally load the test configuration file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop PAKFIRE_PRIVATE

Everything is now private so we won't need this guard any more.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

CLI: Create a convenience function to set up a build environment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Fix conflicting flag name

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

CLI: Only pass distro globally for all build commands

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

CLI: Rename config to args

We use the name config for too many things it was not very clear where
things were coming from. Hence this change.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Remove legacy distro configuration loading code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Pass the configuration to Pakfire

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Fix them after the recent changes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pakfire: Pass the configuration as a config object

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Create and manage the Pakfire instance ourselves

This allows us to pass arguments around easier and keep the
configuration closer together.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

debian: Install all files in the main package

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pakfire: Tell the compiler that we always expect a path for openat()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

strings: Copy strings a lot when appending to an array

The static analyzer thinks we are leaking memory, and so we have to make
things a little bit easier for it.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Implement buildroot check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

file: Build a function to search a file for a string

This is done by mapping the file into memory and performing a fast
string search.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

strings: Implement a fast search that even works over large buffers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

filelist: Implement binary search for paths

This is a fast path if we are looking for an exact match which will be a
lot faster than the linear pattern matching search.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Drop the old find-requires script

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Implement symlink dependencies

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Automatically ignore any dependencies that are provided by the package itself

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

stripper: There should be no need to check if the destination exists now

We should have performed deduplication.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

stripper: Be smarter when copying sources

The naive approach was not very good when it came to copying sources.
Sometimes there are too many and we keep sitting here for a minute.

It is smarter to collect all files first and then look them up and copy
them only once in the end.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

filelist: Increment progress after a file has been processed

The progressbar suspiciously was "done" when there was still some work
to do and the application looked like it had stalled.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Don't log when finding a source file

This is a huge amount of output for C++ projects where there are so many
of those files.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

scripts: Remove the old find-provides script

All the functionality has been replaced.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Fix reading note sections

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Fix offset for aux sections for dependencies

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Declare offsets outside of the switch block

This should make clang happy.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Actually return findings on the CF protection check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Don't return an error if there are no sections

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Return a more detailed error message if deps search fails

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: ELF files must always be executable

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Use convenience function to match filenames

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Fetch provided dependencies

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Add a function to fetch the SONAME

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Process pkg-config provides

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Move filtering dependencies into the package object

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Fix the Python ABI and store it as a requirement

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

find-requires: Remove more replaced code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Parse any runtime dependencies

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

string: Move array functions into strings.c

The inline option has some limitations and it makes things messy. The
compiler will hopefully inline these functions no matter what.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

strings: Help the compiler to understand what array we mean

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Add a custom pointer when walking through all sections

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

find-requires: Remove things that have been implemented elsewhere

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Require ELF interpreters

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Add a function to fetch the interpreter

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Don't try to find dependencies for debug files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Create a function to easily walk through all program headers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Read the number of program headers only once

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Find pkg-config requires in C

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

env: Allow string formatting when setting a value

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Accept format arguments when adding a new dependency

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Remove libpakfire as a shared object

There seems to very little point in having a shared library with a
stable API. Most stuff is opaque anyways and there won't be any
third-party programs that can take advantage of this. Therefore we can
save ourselves the extra work that it takes to make this all exported
and stable for now.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

strings: Include string.h

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Move any source file handling

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pakfire: Add openat() relative to the root

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pakfire: Keep a fd open to the root

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

pakfire: Remove unused lock

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

string: Import errno.h

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Allow uninstallation of incompatible packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build: Correctly handle dependency problems on the install test

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Improve the stripped check

This now checks if we have relocation information and any sections
starting with .debug_* or .zdebug_*.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Fetch the string index only once

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

stripper: Strip relocation information again

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Base the SSP check on the dynamic section

This works even if we have fully stripped the binary.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

strings: Add a simple function to compare two strings

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

linter: Put less pressure on the reference counter

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

file: Remove libelf stuff and use our own abstraction

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

linter: Remove the unused ELF stuff

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Move RUNPATH check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Move the CF Protection check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Move RELRO check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Move execstack check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ELF: Move SSP check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>