]> git.ipfire.org Git - ipfire-2.x.git/log
ipfire-2.x.git
12 months agocore188: Ship PCRE2
Michael Tremer [Mon, 22 Jul 2024 15:14:03 +0000 (15:14 +0000)] 
core188: Ship PCRE2

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agopcre2: Update to version 10.44
Adolf Belka [Wed, 10 Jul 2024 20:33:27 +0000 (22:33 +0200)] 
pcre2: Update to version 10.44

- Update from version 10.43 to 10.44
- Update of rootfile
- Changelog
    10.44
This is mostly a bug-fix and tidying release. There is one new function, to set
 a maximum size for a compiled pattern. The maximum name length for groups is
 increased to 128. Some auxiliary files for building under VMS are added.

Signed-off-by: Adolf Belka <adolf.belka@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agocore188: Ship man-pages
Michael Tremer [Mon, 22 Jul 2024 15:12:49 +0000 (15:12 +0000)] 
core188: Ship man-pages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoman-pages: Update to version 6.9.1
Adolf Belka [Wed, 10 Jul 2024 20:33:26 +0000 (22:33 +0200)] 
man-pages: Update to version 6.9.1

- Update from 6.8 to 6.9.1
- Update of rootfile
- Changelog details can be see in the file named Changes in the source tarball.

Signed-off-by: Adolf Belka <adolf.belka@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agocore188: Ship less
Michael Tremer [Mon, 22 Jul 2024 15:12:29 +0000 (15:12 +0000)] 
core188: Ship less

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoless: Update to version 661
Adolf Belka [Wed, 10 Jul 2024 20:33:25 +0000 (22:33 +0200)] 
less: Update to version 661

- Update from version 633 to 661
- Update of rootfile not required
- Changelog
    661
* Add ^O^N, ^O^P, ^O^L and ^O^O commands and mouse clicks (with --mouse)
  to find and open OSC8 hyperlinks (github #251).
* Add --match-shift option.
* Add --lesskey-content option (github #447).
* Add LESSKEY_CONTENT environment variable (github #447).
* Add --no-search-header-lines and --no-search-header-columns options
  (github #397).
* Add ctrl-L search modifier (github #367).
* A ctrl-P at the start of a shell command suppresses the "done"
  message (github #462).
* Add attribute characters ('*', '~', '_', '&') to --color
  parameter (github #471).
* Allow expansion of environment variables in lesskey files.
* Add LESSSECURE_ALLOW environment variable (github #449).
* Add LESS_UNSUPPORT environment variable.
* Add line number parameter to --header option (github #436).
* Mouse right-click jumps to position marked by left-click (github #390).
* Ensure that the target line is not obscured by a header line
  set by --header (github #444).
* Change default character set to "utf-8", except remains "dos" on MS-DOS.
* Add message when search with ^W wraps (github #459).
* UCRT builds on Windows 10 and later now support Unicode file names
  (github #438).
* Improve behavior of interrupt while reading non-terminated pipe
  (github #414).
* Improve parsing of -j, -x and -# options (github #393).
* Support files larger than 4GB on Windows (github #417).
* Support entry of Unicode chars larger than U+FFFF on Windows (github #391).
* Improve colors of bold, underline and standout text on Windows.
* Allow --rscroll to accept non-ASCII characters (github #483).
* Allow the parameter to certain options to be terminated with a
  space (--color, --quotes, --rscroll, --search-options
  and --intr) (github #495).
* Fix bug where # substitution failed after viewing help (github #420).
* Fix crash if files are deleted while less is viewing them (github #404).
* Workaround unreliable ReadConsoleInputW behavior on Windows
  with non-ASCII input.
* Fix -J display when searching for non-ASCII characters (github #422).
* Don't filter header lines via the & command (github #423).
* Fix bug when horizontally shifting long lines (github #425).
* Add -x and -D options to lesstest, to make it easier to diagnose
  a failed lesstest run.
* Fix bug searching long lines with --incsearch and -S (github #428).
* Fix bug that made ESC-} fail if top line on screen was empty (github #429).
* Fix bug with --mouse on Windows when used with pipes (github #440).
* Fix bug in --+OPTION command line syntax.
* Fix display bug when using -w with an empty line with a CR/LF
  line ending (github #474).
* When substituting '#' or '%' with a filename, quote the filename
  if it contains a space (github #480).
* Fix wrong sleep time when system has usleep but not nanosleep (github #489).
* Fix bug when file name contains a newline.
* Fix bug when file name contains nonprintable characters (github #503).
* Fix DJGPP build (github #497).
* Update Unicode tables.
    643
* Fix problem when a program piping into less reads from the tty,
  like sudo asking for password (github #368).
* Fix search modifier ^E after ^W.
* Fix bug using negated (^N) search (github #374).
* Fix bug setting colors with -D on Windows build (github #386).
* Fix reading special chars like PageDown on Windows (github #378).
* Fix mouse wheel scrolling on Windows (github #379).
* Fix erroneous EOF when terminal window size changes (github #372).
* Fix compile error with some definitions of ECHONL (github #395).
* Fix crash on Windows when writing logfile (github #405).
* Fix regression in exit code when stdin is /dev/null and
  output is a file (github #373).
* Add lesstest test suite to production release (github #344).
* Change lesstest output to conform with
  automake Simple Test Format (github #399).

Signed-off-by: Adolf Belka <adolf.belka@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agocore188: Ship iana-etc
Michael Tremer [Mon, 22 Jul 2024 15:12:04 +0000 (15:12 +0000)] 
core188: Ship iana-etc

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoiana-etc: Update to version 20240701
Adolf Belka [Wed, 10 Jul 2024 20:33:24 +0000 (22:33 +0200)] 
iana-etc: Update to version 20240701

- Update from version 20240502 to 20240701
- Update of rootfile not required
- Changelog is not created. These files are created automatically to collect all iana
   changes.

Signed-off-by: Adolf Belka <adolf.belka@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agocore188: Ship findutils
Michael Tremer [Mon, 22 Jul 2024 15:11:37 +0000 (15:11 +0000)] 
core188: Ship findutils

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agofindutils: Update to version 4.10.0
Adolf Belka [Wed, 10 Jul 2024 20:33:23 +0000 (22:33 +0200)] 
findutils: Update to version 4.10.0

- Update from version 4.9.0 to 4.10.0
- Update of rootfile not required
- Changelog
    4.10.0
** Bug Fixes
  Find now defaults to optimization level 1 rather than 2 and the
    cost-based optimizer will only run at level 2 and above.  This
    should prevent changes of operation order which result in
    user-visible differences in behaviour. [#58427]
  If the -P option to xargs is not used, xargs will not change the way
    in which the SIGUSR1 and SIGUSR2 signals are handled.  This means
    that they will cause the program to terminate if the signals were
    not ignored in the process which started xargs.  This also means that
    xargs does not use parallel execution at all.
    If you start xargs with '-P 1', then xargs will not be killed by these
    signals, and they instead change the degree of parallelism.
    This change improves xargs' POSIX compliance.
  'xargs -P' now waits for all its child processes to complete before
    exiting, even if one of them exits with status 255. [#64451]
  If the -P option of xargs is in use, reads on standard input which are
    interrupted by a signal are re-started. [#64442]
  'find -name /' no longer outputs a warning, because that is a valid pattern
    to match the root directory "/".  Previously, a diagnostic falsely claimed
    that this pattern would not match anything. [#62227]
  'find -gid' (without the mandatory argument) now outputs a correct error
    diagnostic.  Previously it output: "find: invalid argument `-gid' to `-gid'".
    The error diagnostic for non-numeric arguments has been improved as well.
    Likewise for -inum, -links and -uid.
  'find -user' and 'find -group' now allow to specify larger UIDs/GIDs.
    Previously, that was limited to INT_MAX, although the types uid_t and gid_t
    are larger on many systems, including x86_64 GNU/Linux. [#64900]
  'find -xtype l' no longer fails on symbolic links that point to
    themselves.  These are treated similarly to broken links. [#51926]
** Improvements
  The find predicates -used, -amin, -cmin, -mmin, -atime, -ctime, and -mtime
   now properly diagnose a not-a-number argument.  Previously, find dumped
   core via an assertion.  [#64717]
** Changes to the build process
  findutils now builds again on systems with musl-libc.
   This requires gettext-0.19.8.
  findutils programs no longer fail for timestamps past the year 2038
   on obsolete configurations with 32-bit signed time_t, because the
   build procedure now rejects these configurations.
   On systems without any year2038 support configure with --disable-year2038.
** Documentation Changes
  When generating the Texinfo manual, `makeinfo` is invoked with the --no-split
   option for all output formats now; this avoids files like find.info-[12].
  The xargs documentation now describes the double dash "--" option delimiter.
  The xargs examples in the Texinfo manual now use the -L and --replace options
   instead of the deprecated -l and -i options.  [#64480]
  The TexInfo manual now uses upper-case 'B' as birthtime for the -newerXY
   comparison consistently.  [#65378]
** Translations
Updated the following translations: Belarusian, Brazilian Portuguese,
Bulgarian, Catalan, Chinese (simplified), Chinese (traditional),
Croatian, Czech, Danish, Dutch, Esperanto, Estonian, Finnish, French,
Galician, Georgian, German, Greek, Hungarian, Indonesian, Irish,
Italian, Japanese, Korean, Lithuanian, Luganda, Malay, Norwegian
Bokmaal, Polish, Portuguese, Romanian, Russian, Serbian, Slovak,
Slovenian, Spanish, Swedish, Turkish, Ukrainian, Vietnamese.

Signed-off-by: Adolf Belka <adolf.belka@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agocore188: Ship btrfs-progs + e2fsprogs
Michael Tremer [Mon, 22 Jul 2024 15:11:04 +0000 (15:11 +0000)] 
core188: Ship btrfs-progs + e2fsprogs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agobtrfs-progs: Update to version 6.9.2
Adolf Belka [Wed, 10 Jul 2024 20:32:10 +0000 (22:32 +0200)] 
btrfs-progs: Update to version 6.9.2

- Update from 6.7.1 to 6.9.2
- Update of rootfile
- Update of e2fsprogs to 1.47.1 changed a variable from inode_includes to
   ext2fs_inode_includes. btrfs-progs version 6.7.1 failed to build as it was still looking
   for the old variable name. The fix for e2fsprogs 1.47.1 was implemented in btrfs-progs
   version 6.9
- Changelog
    6.9.2
    subvol list: fix accidental trimming of subvolume name
    check: revert checking file extent item 'ram_bytes'
    libbtrfsutil:
        patchlevel version update 1.3.2
        fix accidentally closing fd passed to subvolume iterator
    6.9.1 (Not to be used)
    fix detection of intermediate super block flags (e.g. csum change and other conversions)
    raid-stripe-tree support (still experimental):
        moved under experimental build flags (mkfs, convert)
        format change, removed encoding type; backward incompatible
    receive dump: escape special chars in xattr names and values, and clone source path
    tune change csum: fix reservation size when starting a transaction
    other:
        new and updated tests
        updated CI images, new reference build targets
        cleanups and refactoring
    6.9
    mkfs:
        if --force used, don't continue if the mount status cannot be determined (e.g. due to permissions)
        fix minimum size calculation on zoned devices, make it work with option -b
    check:
        option --clear-ino-cache removed (functionality still provided in 'rescue' command group)
        detect and repair wrong file extent item ram_bytes value
    qgroup clear-stale:
        sync the filesystem before search to read the up to date state
        handle cases where qgroup cannot be deleted due to uncleaned subvolume or when squota is enabled
    qgroup show: display status of qgroup regarding the cleaning of the subvolume or if it's squota
    receive: fix stream parsing on strict alignment hosts (e.g. ARM v5 or v6)
    tune change-csum: fix check of dev-replace status item, continue if no dev-replace in progress
    dump-tree: print contents of dev-replace status item
    convert: fix extent iteration to handle prealloc/unwritten extents
    libbtrfsutil:
        patchlevel version update 1.3.1
        fix potentially unaligned access to send stream
        create library links to all version levels
    libbtrfs:
        patchlevel version update 0.1.3
        fix potentially unaligned access to send stream
        create library links to all version levels
    build:
        fix compatibility with e2fsprogs 1.47.1
        fix header file dependency tracking
        -O2 by default
    other:
        new and updated tests
        ASAN and UBSAN test coverage in CI
        documentation updates
    6.8.1
    mkfs: fix writing on zoned device when block-group-tree is selected
    tune: fix writing on zoned device with option --convert-to-block-group-tree
    check:
        more progress and error messages
        unify handling of unknown command line options with other commands
    subvolume delete: remove options --delete-qgroup and --no-delete-qgroup (added in 6.6.3), qgroup deletion does not always work due to delayed background processing of subvolume or set value in sysfs:ggroup/drop_subtree_threshold
    other:
        misc refactoring
        error handling fixes reported by gcc -fanalyzer
        documentation updates
        new and updated tests
    6.8
    fix --enqueue option timeout handling
    subvolume: remove support for undocumented options -c and -x, functionality disabled in kernel
    libbtrfsutil:
        version 0.1.3, backward compabile
        add aliases for all existing functions with unified naming scheme
        updated header defintions for recently added kernel features
    send: v3 supported in experimental mode
    other:
        docs: manual page references, graphs, enhancements, clarifications
        error handling fixes
        cleanups and refactoring

Signed-off-by: Adolf Belka <adolf.belka@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoe2fsprogs: Update to version 1.47.1
Adolf Belka [Wed, 10 Jul 2024 20:32:09 +0000 (22:32 +0200)] 
e2fsprogs: Update to version 1.47.1

- Update from version 1.47.0 to 1.47.1
- Update of rootfile not required
- Changelog
    1.47.1
UI and Features
Add post-2038 handling when e2fsprogs is compiled on a system with a
 64-bit time_t.
Mke2fs -d can now support an input tar file if the libarchive library is
 available.
Add a udev rule which inhibits ext4 file systems from being automounted
 by udisks.  This avoid security issues from exposing potentially
 maliciously fuzzed file systems from being mounted without being
 inspected using fsck first.  Distributions can of course override this
 feature inhibition, but then they get to own the security vulnerability
 liability.  Upstream ext4 file system developers are putting
 distributions on notice that blindly automounting file systems from
 (potentially) USB thumb drives which clueless users may have picked up
 in a parking lot is a ***bad*** idea, no matter what clueless enterprise
 Linux product managers might think.
The debugfs 'hash' command will use the hash seed and algorithm from the
 superblock if debugfs has a file system open, instead of requiring the
 user to specify those parameters explicitly as options to the hash
 command.  Also add a hash -v option which prints the hash parameters so
 the user knows what parameters were used when calculating the hash for
 the filename.
Teach mke2fs a new extended options, root_perms, which overrides the
 permissions for the root directory for the new file system.
Fixes
When various e2fsprogs are replaying the journal (tune2fs, fuse2fs,
 e2fsck, etc.) save any error indicator in the superblock, so it can be
 restored afterwards.  Most of the time (at least with modern kernels) if
 file system corruptions are discovered, the superblock update is
 journalled.  However, if the journal is aborted or the journal commit
 fails, the error code might only be written in the superblock, so we
 need to save it so that a subsequent fsck can repair the file system
 after the journal replay.
When mke2fs was creating a file system with the orphan file inode, it
 tries to read and truncate the orphan inode before it has been
 initialized.  If there is an inode from a previous file system located
 there (as opposed to a all zeroes inode table block caused by a discard
 of the flash device or a newly created cloud block device or fille
 image), it can fail with bad checksum error, aborting the mke2fs
 operation.  Fix this in ext2fs_create_orphan_file() not trying to
 truncate the orphan file if it is newly allocated (which will always be
 the case when mke2fs calls this library function).
In the case where e2fsck comes across an orphan file which is empty but
 the orphan_present feature is set, in preen mode, e2fsck will now clear
 the orphan_present feature flag silently.
E2fsck will now perform more consistency checks on EA (extended
 attribute value) inodes.
Fix a big where e2fsck could potentially leak an acl block when
 releasing an orphan inode.
Avoid a divide by zero crash in libext2fs if the container
 infrastructure, such as lxcfs, reports that the system has zero CPU's
 via sysconf(_SC_NPROCESSORS_CONF).
When resize2fs is performing an online resize, it's possible for reading
 the superblock can race with a kernel modifying the superblock with the
 checksum being invalid and causing the resize to fail with an bad
 superblock checksum in the buffer cache.  Have resize2fs open the file
 system using O_DIRECT to avoid the superblock with an invalid checksum.
Fix a bug where a checksum failure in an htree directory can cause
 e2fsck's preen mode to abort unnecessarily.
Fix e2fsck's handling of an invalid symlink in an inline_data directory.
Fix e4crypt from issuing a spurious "success" error message when trying
 to set a policy on a non-directory.
Fix a potential infinite loop in debugfs's logdump command in some edge
 cases.
Fix e2fsck to correctly update quota usage after optimizing directories
 or deleting corrupted inodes.
Fix fuse2fs so that directories are created with the correct permissions
 instead of having the other and group write permissions masked off.
Fix a potential e2fsck divide by zero crash caused by a maliciously
 fuzzed file system.
Fix dumpe2fs to report free block ranges correctly for bigalloc file
 systems.
Fix resize2fs where resizing a bigalloc file system can result in the
 free cluster count in the last block group and the total free clusters
 count to be incorrect.
Avoid spurious e2scrub failures caused by trying to scrub file syustems
 that do not have the journal enabled, and by aborting scrub runs while
 upgrading the e2fsprogs package on Debian/Ubuntu.
Teach tune2fs to detect a file system which is mounted but is not
 mentioned in the mount namespace where tune2fs is run by treating a
 block device which is busy as if it is mounted.
If tune2fs can't find the mountpoint for a file system which is
 apparently mounted (perhaps because it's not present in the current
 mount namespace) when attempting to set the label or UUID in the
 superblock, fall back to the old method of modifying block device and
 silence printing any error messages.
If both the primary superblock and first block group's backup superblock
 are corrupted, e2fsck will now try additional backup superblocks if they
 are available.
Avoid mke2fs from creating an invalid file system with an insufficient
 number of inodes when creating a file system which is very small (100k),
 a block size of 1k, and an inode size of 256 bytes.
Fix a potential deadlock caused by e2fsck being run in Direct I/O mode
 with the threading optimization enabled.
Fix e2scrub when the "systemctl" package is installed instead of
 systemd.  (Addresses Debian Bug #1070107)
Fixed/improved various Debian packaging issues.
Update and clarify various man pages.  (Addresses Debian Bugs #1038286,
 #1041115)
Performance, Internal Implementation, Development Support etc.
Add support for SOURCE_DATE_EPOCH environment variable per the
 specification https://reproducible-builds.org/specs/source-date-epoch
Improve resize2fs's performance by eliminating extra cache flushes.
Improve mke2fs's performance when zeroing a large number of inode table
 blocks (when lazy inode table initialization is not enabled) by batching
 calls to ext2fs_zero_blocks.
Use a safe_getenv function for all calls to fetch the environment
 variable in libext2fs.
Fix a massive buffer overrun bug in ext2fs_image_super_read().  This
 function isn't actually used by e2image, and it's unlikely that there
 are any users of this function since the most common way the e2image
 file is read is via ext2fs_openfs() with the EXT2_FLAG_IMAGE_FILE, which
 doesn't actually use ext2fs_image_super_read().
Add support for building fuse2fs using Fuse V3.
Use FORTIFY_SOURCE=3 when hardening is enabled for more protection.
Add support for continuous integration tests using Github Actions.
Fix Windows-specific portability bugs to allow mke2fs to create a file
 system in a file which doesn't yet exist and to support file systems
 larger than 2GB.
Fix a FreeBSD 14 build failure caused by changing the function signature
 of qsort_r() to be aligned with the POSIX and glibc definition of
 qsort_r().
Fix various portability issues for the Linux 32-bit musl C library,
 GNU/Hurd and Android.  (Addresses Debian Bug: #1056145)
Fix various portability problems in the regression test suite.
Fix various sanitizer, static code analysis, and compiler warnings.
Synchronized changes from Android's AOSP e2fsprogs tree.
Updated config.guess and config.sub with newer versions from the FSF.
Add Romainian translation.
Update Chinese, Czech, French, Malay, Polish, Swedish, and Ukrainian
 translations.

Signed-off-by: Adolf Belka <adolf.belka@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agocore188: Ship shadow
Michael Tremer [Mon, 22 Jul 2024 15:10:19 +0000 (15:10 +0000)] 
core188: Ship shadow

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoshadow: Update to version 4.16.0
Adolf Belka [Tue, 9 Jul 2024 18:31:21 +0000 (20:31 +0200)] 
shadow: Update to version 4.16.0

- Update from version 4.15.1 to 4.16.0
- Update rootfile
- sobump in rootfile. Ran find-dependencies but no other linked programs identified.
- nscd is disabled in glibc so it has been disabled in shadow. nscd is enabled by default.
- id and groups (deprecated in shadow) are used from coreutils in IPFire.
- Changelog
    4.16.0
The shadow implementations of id(1) and groups(1) are deprecated in favor of the
 GNU coreutils and binutils versions. They will be removed in 4.17.0.
Support for rlogind in the login(1) implementation has been removed. That is, the
 login(1) -r flag has been removed.
The libsubid major version has been bumped, since it now requires specification of
 the module's free() implementation.
    4.15.2
Bugfix release.
This release includes a large amount of fixes, including memory leaks,
 leaks of other resources such as file descriptors, added missing error
 handling, and more.
    4.15.3
Bugfix release.
This release includes changes to the build system, packaging, and tests;
 most of which, were reported by Debian packagers. There's also a fix
 for check_subid_range.

Signed-off-by: Adolf Belka <adolf.belka@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoStart Core Update 188
Michael Tremer [Mon, 22 Jul 2024 15:09:13 +0000 (15:09 +0000)] 
Start Core Update 188

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoConfig: Fix the path for the stripper
Michael Tremer [Wed, 10 Jul 2024 18:22:34 +0000 (18:22 +0000)] 
Config: Fix the path for the stripper

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoflash-images: Fix argument order for copying files
Michael Tremer [Wed, 10 Jul 2024 18:14:56 +0000 (18:14 +0000)] 
flash-images: Fix argument order for copying files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Only catch the error code that triggered the timer
Michael Tremer [Wed, 10 Jul 2024 18:12:01 +0000 (18:12 +0000)] 
make.sh: Only catch the error code that triggered the timer

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoConfig: Build packages with the new macros
Michael Tremer [Wed, 10 Jul 2024 17:49:28 +0000 (17:49 +0000)] 
Config: Build packages with the new macros

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agocore-updates: Don't line-break make macros
Michael Tremer [Wed, 10 Jul 2024 17:49:03 +0000 (17:49 +0000)] 
core-updates: Don't line-break make macros

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoConfig: Show the transformed paths when creating tarballs
Michael Tremer [Wed, 10 Jul 2024 17:48:26 +0000 (17:48 +0000)] 
Config: Show the transformed paths when creating tarballs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoConfig: Make the ARCHIVE_* variables generally available
Michael Tremer [Wed, 10 Jul 2024 17:48:05 +0000 (17:48 +0000)] 
Config: Make the ARCHIVE_* variables generally available

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Ignore directories as packages
Michael Tremer [Wed, 10 Jul 2024 17:40:40 +0000 (17:40 +0000)] 
make.sh: Ignore directories as packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Store the PID in a variable to avoid $! being overwritten
Michael Tremer [Wed, 10 Jul 2024 17:40:11 +0000 (17:40 +0000)] 
make.sh: Store the PID in a variable to avoid $! being overwritten

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoConfig: Remove ./ from filenames in archives
Michael Tremer [Wed, 10 Jul 2024 17:19:46 +0000 (17:19 +0000)] 
Config: Remove ./ from filenames in archives

I am not sure if this would actually create any problems, but it looks
ugly and is inconsistent with the older code.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoConfig: Don't quote arguments in Makefiles
Michael Tremer [Wed, 10 Jul 2024 17:19:21 +0000 (17:19 +0000)] 
Config: Don't quote arguments in Makefiles

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoConfig: Reorganise the arguments for COPY_FILES
Michael Tremer [Wed, 10 Jul 2024 17:16:48 +0000 (17:16 +0000)] 
Config: Reorganise the arguments for COPY_FILES

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agointel-microcode: Hardlink all files to save space
Michael Tremer [Wed, 10 Jul 2024 17:02:24 +0000 (17:02 +0000)] 
intel-microcode: Hardlink all files to save space

This will save about 3 MiB.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agocore-updates: Refactor how we package the archive
Michael Tremer [Wed, 10 Jul 2024 16:54:33 +0000 (16:54 +0000)] 
core-updates: Refactor how we package the archive

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agocore-updates: Remove importing the meta file
Michael Tremer [Wed, 10 Jul 2024 15:41:17 +0000 (15:41 +0000)] 
core-updates: Remove importing the meta file

We don't use these any more and even if we did, we cannot import any
variables into a make script just like that.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoflash-images: Fix typo
Michael Tremer [Wed, 10 Jul 2024 14:26:49 +0000 (14:26 +0000)] 
flash-images: Fix typo

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Fix checksum generation of the toolchain once again
Michael Tremer [Wed, 10 Jul 2024 09:50:35 +0000 (09:50 +0000)] 
make.sh: Fix checksum generation of the toolchain once again

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Join compression arguments as a string
Michael Tremer [Wed, 10 Jul 2024 08:49:57 +0000 (08:49 +0000)] 
make.sh: Join compression arguments as a string

Otherwise, the array gets split and tar cannot identify which option
belongs to where.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agogcc: Build libstdc++ in parallel
Michael Tremer [Wed, 10 Jul 2024 08:48:01 +0000 (08:48 +0000)] 
gcc: Build libstdc++ in parallel

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agogcc: Fix limits.h in first toolchain pass
Michael Tremer [Wed, 10 Jul 2024 08:46:30 +0000 (08:46 +0000)] 
gcc: Fix limits.h in first toolchain pass

This is necessary so that the compiler is using the correct glibc
headers.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Use the print_line function for correct padding
Michael Tremer [Tue, 9 Jul 2024 22:08:04 +0000 (22:08 +0000)] 
make.sh: Use the print_line function for correct padding

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Don't be verbose when creating the packages dir
Michael Tremer [Tue, 9 Jul 2024 22:07:28 +0000 (22:07 +0000)] 
make.sh: Don't be verbose when creating the packages dir

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Erase the line when resizing the screen
Michael Tremer [Tue, 9 Jul 2024 21:26:25 +0000 (21:26 +0000)] 
make.sh: Erase the line when resizing the screen

This should leave less clutter, but there is still some.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Remove the PWD variable
Michael Tremer [Tue, 9 Jul 2024 21:22:23 +0000 (21:22 +0000)] 
make.sh: Remove the PWD variable

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Refactor the terminal output
Michael Tremer [Tue, 9 Jul 2024 21:21:33 +0000 (21:21 +0000)] 
make.sh: Refactor the terminal output

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Enable the timer for the toolchain, too
Michael Tremer [Tue, 9 Jul 2024 20:22:15 +0000 (20:22 +0000)] 
make.sh: Enable the timer for the toolchain, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoConfig: Unexport lots of environment variables
Michael Tremer [Tue, 9 Jul 2024 20:20:17 +0000 (20:20 +0000)] 
Config: Unexport lots of environment variables

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Always create /root in the chroot environment
Michael Tremer [Tue, 9 Jul 2024 20:17:05 +0000 (20:17 +0000)] 
make.sh: Always create /root in the chroot environment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Fix mounting the QEMU helper binary
Michael Tremer [Tue, 9 Jul 2024 20:16:41 +0000 (20:16 +0000)] 
make.sh: Fix mounting the QEMU helper binary

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Set PATH before entering the chroot environment
Michael Tremer [Tue, 9 Jul 2024 20:16:15 +0000 (20:16 +0000)] 
make.sh: Set PATH before entering the chroot environment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Fix toolchain checksum validation
Michael Tremer [Tue, 9 Jul 2024 19:56:52 +0000 (19:56 +0000)] 
make.sh: Fix toolchain checksum validation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Export BUILD_DIR and LOG_DIR
Michael Tremer [Tue, 9 Jul 2024 19:53:15 +0000 (19:53 +0000)] 
make.sh: Export BUILD_DIR and LOG_DIR

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Create the /tools symlink to the right place
Michael Tremer [Tue, 9 Jul 2024 19:53:00 +0000 (19:53 +0000)] 
make.sh: Create the /tools symlink to the right place

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Pass extra options in lfsmake1
Michael Tremer [Tue, 9 Jul 2024 19:46:30 +0000 (19:46 +0000)] 
make.sh: Pass extra options in lfsmake1

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agocdrom: Fix typo
Michael Tremer [Tue, 9 Jul 2024 19:25:17 +0000 (19:25 +0000)] 
cdrom: Fix typo

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months ago.gitignore: Ignore images_* directories
Michael Tremer [Tue, 9 Jul 2024 19:24:55 +0000 (19:24 +0000)] 
.gitignore: Ignore images_* directories

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoflash-images: Create the base image as a sparse file
Michael Tremer [Tue, 9 Jul 2024 19:24:14 +0000 (19:24 +0000)] 
flash-images: Create the base image as a sparse file

This will be much faster as it creates less IO.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Use less aggressive compression for Zstandard
Michael Tremer [Tue, 9 Jul 2024 19:23:44 +0000 (19:23 +0000)] 
make.sh: Use less aggressive compression for Zstandard

Otherwise this takes way too long.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Rewrite how we are looking for rootfiles
Michael Tremer [Tue, 9 Jul 2024 19:23:11 +0000 (19:23 +0000)] 
make.sh: Rewrite how we are looking for rootfiles

No function changes, just performance.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoflash-images: Don't mess with depmod
Michael Tremer [Tue, 9 Jul 2024 17:52:02 +0000 (17:52 +0000)] 
flash-images: Don't mess with depmod

This file could not be created anyways as the directory did not exist.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoimages: Ensure that all mount points are created
Michael Tremer [Tue, 9 Jul 2024 17:51:37 +0000 (17:51 +0000)] 
images: Ensure that all mount points are created

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Drop stripping
Michael Tremer [Tue, 9 Jul 2024 17:47:04 +0000 (17:47 +0000)] 
make.sh: Drop stripping

This will massively improve the build process because we will only strip
the files that we need. The build system will remain as is.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Correctly pass ZSTD_OPT
Michael Tremer [Tue, 9 Jul 2024 17:46:48 +0000 (17:46 +0000)] 
make.sh: Correctly pass ZSTD_OPT

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Use --long for Zstandard compression
Michael Tremer [Tue, 9 Jul 2024 17:46:15 +0000 (17:46 +0000)] 
make.sh: Use --long for Zstandard compression

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoflash-images: Collect files again instead of relying on the tarball
Michael Tremer [Tue, 9 Jul 2024 17:38:12 +0000 (17:38 +0000)] 
flash-images: Collect files again instead of relying on the tarball

This has always been an ugly hack.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoflash-images: There is no need to for the mount check any more
Michael Tremer [Tue, 9 Jul 2024 17:36:10 +0000 (17:36 +0000)] 
flash-images: There is no need to for the mount check any more

We always start with a fresh mount namespace, so there cannot be
anything left.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoConfig: Create common functions to create archives
Michael Tremer [Tue, 9 Jul 2024 17:33:22 +0000 (17:33 +0000)] 
Config: Create common functions to create archives

The compression code is very messy because it has changed so many times.
This cleans this up and creates common functions that can be used for
the ISO images as well as packages.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agocdrom: Fix syntax error
Michael Tremer [Tue, 9 Jul 2024 17:32:32 +0000 (17:32 +0000)] 
cdrom: Fix syntax error

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoarchive.files: Make this slightly more efficient
Michael Tremer [Tue, 9 Jul 2024 16:52:26 +0000 (16:52 +0000)] 
archive.files: Make this slightly more efficient

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoConfig: Remove debugging code
Michael Tremer [Tue, 9 Jul 2024 16:44:37 +0000 (16:44 +0000)] 
Config: Remove debugging code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Create Core Update packages, too
Michael Tremer [Tue, 9 Jul 2024 16:42:11 +0000 (16:42 +0000)] 
make.sh: Create Core Update packages, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Create loop devices as block devices
Michael Tremer [Tue, 9 Jul 2024 16:41:25 +0000 (16:41 +0000)] 
make.sh: Create loop devices as block devices

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Don't drop into the lfs/ directory when entering a shell
Michael Tremer [Tue, 9 Jul 2024 16:04:47 +0000 (16:04 +0000)] 
make.sh: Don't drop into the lfs/ directory when entering a shell

This is not a very useful place to be.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Refactor building packages
Michael Tremer [Tue, 9 Jul 2024 15:56:41 +0000 (15:56 +0000)] 
make.sh: Refactor building packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Simplify the initial configuration a little bit more
Michael Tremer [Tue, 9 Jul 2024 15:32:21 +0000 (15:32 +0000)] 
make.sh: Simplify the initial configuration a little bit more

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Change execute() so that it can be used outside the namespaces, too
Michael Tremer [Tue, 9 Jul 2024 15:11:35 +0000 (15:11 +0000)] 
make.sh: Change execute() so that it can be used outside the namespaces, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Use the new package function to download sources
Michael Tremer [Tue, 9 Jul 2024 15:11:19 +0000 (15:11 +0000)] 
make.sh: Use the new package function to download sources

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: tail on the preparation log file, too
Michael Tremer [Tue, 9 Jul 2024 15:10:57 +0000 (15:10 +0000)] 
make.sh: tail on the preparation log file, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Explicitely download packages when building the toolchain
Michael Tremer [Tue, 9 Jul 2024 15:01:58 +0000 (15:01 +0000)] 
make.sh: Explicitely download packages when building the toolchain

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Don't revalidate the images all the time
Michael Tremer [Tue, 9 Jul 2024 15:00:42 +0000 (15:00 +0000)] 
make.sh: Don't revalidate the images all the time

Calling b2 causes make to verify all source which creates a lot of IO.

This is not really necessary because install will do the same and the
build would fail if the source checksums didn't match.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Refactor the execute function
Michael Tremer [Tue, 9 Jul 2024 14:59:45 +0000 (14:59 +0000)] 
make.sh: Refactor the execute function

The first version was a little bit messy with all the checks in all
sorts of places. We now create one large array and update it whenever
the configuration changes.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Create a large unified function to run commands
Michael Tremer [Tue, 9 Jul 2024 14:09:56 +0000 (14:09 +0000)] 
make.sh: Create a large unified function to run commands

This now includes the toolchain for which we need to set up the same
environment, except slightly differently.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agocdrom+flash-images: Write images to the images directory
Michael Tremer [Tue, 9 Jul 2024 13:01:27 +0000 (13:01 +0000)] 
cdrom+flash-images: Write images to the images directory

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Split environment and make variables
Michael Tremer [Tue, 9 Jul 2024 10:32:24 +0000 (10:32 +0000)] 
make.sh: Split environment and make variables

This got very messed up in the past and I think we would benefit greatly
from splitting this again for a less cluttered environment in the build
chroot and reusability of the make commands for the different stages.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Call the correct target for checksum check
Michael Tremer [Tue, 9 Jul 2024 10:19:37 +0000 (10:19 +0000)] 
make.sh: Call the correct target for checksum check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Bind-mount the QEMU helper instead of copying the binary
Michael Tremer [Tue, 9 Jul 2024 10:19:05 +0000 (10:19 +0000)] 
make.sh: Bind-mount the QEMU helper instead of copying the binary

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Install the QEMU helper only once
Michael Tremer [Tue, 9 Jul 2024 10:18:23 +0000 (10:18 +0000)] 
make.sh: Install the QEMU helper only once

This needs to be done only once when we initialize the environment.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Pass variables before the commands
Michael Tremer [Tue, 9 Jul 2024 09:33:33 +0000 (09:33 +0000)] 
make.sh: Pass variables before the commands

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Correctly pass the command return code in run_command
Michael Tremer [Tue, 9 Jul 2024 08:36:39 +0000 (08:36 +0000)] 
make.sh: Correctly pass the command return code in run_command

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agoflash-images: No need to sleep for automount any more
Michael Tremer [Mon, 8 Jul 2024 16:32:27 +0000 (16:32 +0000)] 
flash-images: No need to sleep for automount any more

I am not sure whether automount is being used at all any more, but since
we are now running in our own namespace, it certainly has no business
here.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Create and mount and images directory
Michael Tremer [Mon, 8 Jul 2024 16:24:07 +0000 (16:24 +0000)] 
make.sh: Create and mount and images directory

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Add a tail command to stream any logs
Michael Tremer [Mon, 8 Jul 2024 16:18:57 +0000 (16:18 +0000)] 
make.sh: Add a tail command to stream any logs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Pass on individual build arguments
Michael Tremer [Sun, 7 Jul 2024 17:26:55 +0000 (17:26 +0000)] 
make.sh: Pass on individual build arguments

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Don't generate any documentation in the source directory
Michael Tremer [Fri, 5 Jul 2024 15:42:05 +0000 (15:42 +0000)] 
make.sh: Don't generate any documentation in the source directory

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Kill all child processes if unshare terminates
Michael Tremer [Fri, 5 Jul 2024 15:39:05 +0000 (15:39 +0000)] 
make.sh: Kill all child processes if unshare terminates

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Update the runtime after the interrupt
Michael Tremer [Fri, 5 Jul 2024 15:32:45 +0000 (15:32 +0000)] 
make.sh: Update the runtime after the interrupt

This is a lot better because this puts the code where it is being
executed and allows us to run run_command in a subshell, too.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Build the entire distribution in one go
Michael Tremer [Fri, 5 Jul 2024 15:00:59 +0000 (15:00 +0000)] 
make.sh: Build the entire distribution in one go

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Fix indentation
Michael Tremer [Fri, 5 Jul 2024 14:08:18 +0000 (14:08 +0000)] 
make.sh: Fix indentation

No functional changes.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Move a comment to where it should be
Michael Tremer [Fri, 5 Jul 2024 14:02:41 +0000 (14:02 +0000)] 
make.sh: Move a comment to where it should be

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Launch the timer only when we need it
Michael Tremer [Fri, 5 Jul 2024 14:02:12 +0000 (14:02 +0000)] 
make.sh: Launch the timer only when we need it

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Have the background timer update the process runtime
Michael Tremer [Fri, 5 Jul 2024 14:01:26 +0000 (14:01 +0000)] 
make.sh: Have the background timer update the process runtime

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Create a timer co-process
Michael Tremer [Fri, 5 Jul 2024 13:37:15 +0000 (13:37 +0000)] 
make.sh: Create a timer co-process

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Don't export loads of variables in the main script
Michael Tremer [Fri, 5 Jul 2024 10:47:12 +0000 (10:47 +0000)] 
make.sh: Don't export loads of variables in the main script

We clear and reset the environment when we launch any build commands and
therefore don't need to do this here.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
12 months agomake.sh: Don't mess with Bash's command hashing
Michael Tremer [Fri, 5 Jul 2024 10:46:11 +0000 (10:46 +0000)] 
make.sh: Don't mess with Bash's command hashing

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>