make.sh: Pass extra options in lfsmake1

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cdrom: Fix typo

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

.gitignore: Ignore images_* directories

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

flash-images: Create the base image as a sparse file

This will be much faster as it creates less IO.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Use less aggressive compression for Zstandard

Otherwise this takes way too long.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Rewrite how we are looking for rootfiles

No function changes, just performance.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

flash-images: Don't mess with depmod

This file could not be created anyways as the directory did not exist.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

images: Ensure that all mount points are created

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Drop stripping

This will massively improve the build process because we will only strip
the files that we need. The build system will remain as is.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Correctly pass ZSTD_OPT

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Use --long for Zstandard compression

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

flash-images: Collect files again instead of relying on the tarball

This has always been an ugly hack.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

flash-images: There is no need to for the mount check any more

We always start with a fresh mount namespace, so there cannot be
anything left.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Config: Create common functions to create archives

The compression code is very messy because it has changed so many times.
This cleans this up and creates common functions that can be used for
the ISO images as well as packages.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cdrom: Fix syntax error

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

archive.files: Make this slightly more efficient

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Config: Remove debugging code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Create Core Update packages, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Create loop devices as block devices

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Don't drop into the lfs/ directory when entering a shell

This is not a very useful place to be.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Refactor building packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Simplify the initial configuration a little bit more

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Change execute() so that it can be used outside the namespaces, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Use the new package function to download sources

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: tail on the preparation log file, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Explicitely download packages when building the toolchain

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Don't revalidate the images all the time

Calling b2 causes make to verify all source which creates a lot of IO.

This is not really necessary because install will do the same and the
build would fail if the source checksums didn't match.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Refactor the execute function

The first version was a little bit messy with all the checks in all
sorts of places. We now create one large array and update it whenever
the configuration changes.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Create a large unified function to run commands

This now includes the toolchain for which we need to set up the same
environment, except slightly differently.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cdrom+flash-images: Write images to the images directory

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Split environment and make variables

This got very messed up in the past and I think we would benefit greatly
from splitting this again for a less cluttered environment in the build
chroot and reusability of the make commands for the different stages.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Call the correct target for checksum check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Bind-mount the QEMU helper instead of copying the binary

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Install the QEMU helper only once

This needs to be done only once when we initialize the environment.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Pass variables before the commands

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Correctly pass the command return code in run_command

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

flash-images: No need to sleep for automount any more

I am not sure whether automount is being used at all any more, but since
we are now running in our own namespace, it certainly has no business
here.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Create and mount and images directory

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Add a tail command to stream any logs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Pass on individual build arguments

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Don't generate any documentation in the source directory

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Kill all child processes if unshare terminates

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Update the runtime after the interrupt

This is a lot better because this puts the code where it is being
executed and allows us to run run_command in a subshell, too.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Build the entire distribution in one go

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Fix indentation

No functional changes.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Move a comment to where it should be

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Launch the timer only when we need it

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Have the background timer update the process runtime

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Create a timer co-process

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Don't export loads of variables in the main script

We clear and reset the environment when we launch any build commands and
therefore don't need to do this here.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Don't mess with Bash's command hashing

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Refactor downloading sources

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: run_command: Fix basedir in and outside the chroot

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Disconnect standard input from make commands

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Move download and check to lfsmake2 and out of the common check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Add --quiet to run_command

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Allow run_command to execute multiple actions at a time

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Move lfscommoncheck out of run_command

We would quite likely create an infinite loop here later and so should
rather treat run_command as a low-level function.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Remove some dead code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Show total runtime of commands after they are finished

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Add helper function to run a make command

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Fix checking if we have a fake environment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Config: Drop toolchain URL

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Refactor uploading sources

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Make the disk space check optional

There is little value in running this when entering a shell...

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Mount the log directory for the correct architecture

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Refactor compression the toolchain

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Create a custom log function

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Use path variables for cleanup

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Refactor downloading the toolchain

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

.gitignore: Ignore architecture directories

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Forward the architecture to the namespace

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Refactor the toolchain extraction

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Build in a separate directory for each architecture

This allows running multiple builds in the same working directory.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Use LOG_DIR for logs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Check free space in the base directory

This makes more sense if we want to support building multiple
architectures and if we consider cache and ccache, too.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Create all bind-mounts as read-only where possible

This way, the build environment can no longer modify any source any
more. This was not a huge integrity problem before as Git would have
shown differences, but it might cause damage to the build system which
need to manually be recovered.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Create /dev and /sys in the build environment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

perl-Device-SerialPort: Use /dev/null as test port

The build failed with the new minimal /dev it is looking for some TTY
devices which are no longer present. This patch fixes the build.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Create /proc in the chroot environment before mounting it

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Move PS1 to the header

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Remove TARGET_ARCH compatibility

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Remove option to make /usr/src a ramdisk

I am not sure this is helping in any way these days that we have SSDs
everywhere...

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Remove docker stuff

This is basically unused for years. I even forgot we had this.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Tidy up LOGFILE

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Refactor determining BASEDIR

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Group variables and initialization together

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Set the CCACHE_DIR with the ccache to use

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Refactor the root user check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Tidy up the environment creation function

NFC

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Refactor the space check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: No longer export LFS as it is not being used

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Replace LFS with BUILD_DIR

This is probably a more specific name for this.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Always mount a separate /tmp

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Make BUILD_DIR a mountpoint

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Create a new, minimal /dev in the build environment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Don't bind-mount the host's /proc

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Create the second mount namespace as slave

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Don't create a new IPC namespace

If we do this, we no longer can interrupt the build process on the
console.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

make.sh: Create lots more namespaces when we enter the chroot

This allows us to protect the host system a little bit more from the
host system by decoupling all namespaces.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>