Wang Mingyu [Fri, 3 Nov 2023 07:50:50 +0000 (15:50 +0800)]
python3-wcwidth: upgrade 0.2.8 -> 0.2.9
Changelog:
===========
-Bugfix zero-width characters used in Emoji ZWJ sequences, Balinese,
Jamo, Devanagari, Tamil, Kannada and others (PR #91).
-Updated to include a Specification of character measurements.
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Fri, 3 Nov 2023 07:49:09 +0000 (15:49 +0800)]
python3-testtools: upgrade 2.6.0 -> 2.7.0
Changelog:
============
* Fix compatibility with Python 3.12.
* Add typing in various modules (still lacking full coverage).
* Drop the 'test' command for distutils. This has been
deprecated since 2.6.0.
* Drop support for Python 3.6.
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Fri, 3 Nov 2023 07:47:58 +0000 (15:47 +0800)]
python3-setuptools-rust: upgrade 1.7.0 -> 1.8.1
Changelog:
===========
-Fix regression in install_extension crashing since 1.8.0. #380
-Drop support for Python 3.7. #357
-Remove direct imports from pkg_resources. #359
-Add support for setting a custom cargo profile with the
SETUPTOOLS_RUST_CARGO_PROFILE environment variable. #364
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Fri, 3 Nov 2023 07:42:38 +0000 (15:42 +0800)]
python3-pytest: upgrade 7.4.2 -> 7.4.3
Changelog:
============
-Markers are now considered in the reverse mro order to ensure base class
markers are considered first – this resolves a regression.
-Fixed := in asserts impacting unrelated test cases.
-Handled an edge case where sys.stderr might already be closed when Fault
Handler is tearing down.
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Fri, 3 Nov 2023 07:40:05 +0000 (15:40 +0800)]
python3-pyopenssl: upgrade 23.2.0 -> 23.3.0
Changelog:
============
-Dropped support for Python 3.6.
-The minimum cryptography version is now 41.0.5.
-Removed OpenSSL.crypto.loads_pkcs7 and OpenSSL.crypto.loads_pkcs12 which had
been deprecated for 3 years.
-Added OpenSSL.SSL.OP_LEGACY_SERVER_CONNECT to allow legacy insecure
renegotiation between OpenSSL and unpatched servers. #1234.
-Changed OpenSSL.crypto.X509Store.add_crl to also accept cryptography's
x509.CertificateRevocationList arguments in addition to the now deprecated
OpenSSL.crypto.CRL arguments.
-Fixed test_set_default_verify_paths test so that it is skipped if no network
connection is available.
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Fri, 3 Nov 2023 07:32:27 +0000 (15:32 +0800)]
python3-hypothesis: upgrade 6.87.4 -> 6.88.1
Changelog:
============
*improves register_type_strategy() when used with tuple subclasses, by
preventing them from being interpreted as generic and provided to
strategies like st.from_type(Sequence[int]) (issue #3767).
*allows strategy-generating functions registered with
register_type_strategy() to conditionally not return a strategy,
by returning NotImplemented (issue #3767).
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Fri, 3 Nov 2023 07:29:55 +0000 (15:29 +0800)]
python3-git: upgrade 3.1.37 -> 3.1.40
Changelog:
============
Add missing info in Submodule.remove docstring
Have init script clone submodules unconditionally
Add missing assert keywords
Make clear every test's status in every CI run
Fix new link to license in readme
Drop unneeded flake8 suppressions
Update instructions and test helpers for git-daemon
Fix Git.execute shell use and reporting bugs
No longer allow CI to select a prerelease for 3.12
Clarify Git.execute and Popen arguments
Ask git where its daemon is and use that
Fix bugs affecting exception wrapping in rmtree callback
Fix dynamically-set all variable
Fix small #1662 regression due to #1659
Drop obsolete info on yanking from security policy
Have Dependabot offer submodule updates
Bump git/ext/gitdb from 49c3178 to 8ec2390
Bump git/ext/gitdb from 8ec2390 to 6a22706
Update readme for milestone-less releasing
Run Cygwin CI workflow commands in login shells
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Fri, 3 Nov 2023 07:29:16 +0000 (15:29 +0800)]
python3-gitdb: upgrade 4.0.10 -> 4.0.11
Changelog:
==========
Use ZLIB_RUNTIME_VERSION if available
Add support for Python 3.12 and drop EOL 3.7
Enable Dependabot version updates for Actions
Test installing project on CI
Fix mkdir race condition in LooseObjectDB.store
Don't cancel other jobs from the 3.12 job failing
Use actions/checkout feature to fetch all commits
Revert "Drop support for EOL Python 3.7"
Fix top-of-file license URLs here in gitdb too
No longer treat 3.12 as experimental on CI
Add all to exc for linting
Have Dependabot update smmap submodule dependency
Bump gitdb/ext/smmap from 334ef84 to f1ace75
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Fri, 3 Nov 2023 07:21:26 +0000 (15:21 +0800)]
python3-pyrsistent: upgrade 0.19.3 -> 0.20.0
Changelog:
===========
* Fix #245, never introduce new nodes during discard.
* Fix #268, do not rely on well implemented __ne__ for keys in pmaps, instead do explicit inversion of equality
comparison when checking for inequality.
* Officially support Python 3.12.
* Officially drop support for Python 3.7.
* Fix #273, build more types of wheels. Thanks @jams2 for this!
* Fix #282, add generic types to types. Thanks @lukasK9999 for this!
* Fix #281, defaultdict can now be frozen. NB! This is a backwards incompatible fix since defaultdict was not
previously frozen.
License-Update: Copyright year updated to 2023.
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Fri, 3 Nov 2023 07:20:44 +0000 (15:20 +0800)]
glib-2.0: upgrade 2.78.0 -> 2.78.1
Changelog:
=========
* Fix truncating files when "g_file_set_contents_full()" is called without
"G_FILE_SET_CONTENTS_CONSISTENT"
* Fix "-Dlibelf=disabled" on Linux
* Bugs fixed:
- #3105 NetworkManager 1.44.0 crashes repeatedly with glib 2.78.0
- #3111 gsubprocess-testprog.c: build error with cygwin (sys/ptrace.h: No such
file or directory)
- #3116 gio clears modification time in microseconds when setting with
"set_modification_date_time"
- #3120 Build of glib 2.78.0 ignores -Dlibelf=disabled
- #3128 glib-2.78.0 fails at gio/tests/gsubprocess.p/gsubprocess.c.o
- #3130 Segfault when creating GIO GPropertyAction without properties
- #3144 "g_file_set_contents_full()" doesn't truncate the file (without
"G_FILE_SET_CONTENTS_CONSISTENT")
- !3576 guniprop.c: Avoid creating (temporarily) out-of-bounds pointers
- !3579 Fixes for integer cast warnings when targeting CHERI
- !3580 Fix test_find_program on FreeBSD
- !3589 gconstructor.h: Ensure [c|d]tor prototypes are present for MSVC
- !3594 Fix gutils-user-database test on macOS
- !3596 Add value annotation to G_TYPE_FUNDAMENTAL_MAX
- !3601 meson: Fix Windows build with PCRE2 as sibling subproject
- !3604 Backport !3589 "gconstructor.h: Ensure [c|d]tor prototypes are present
for MSVC" to glib-2-78
- !3608 Backport !3587 "glocalfileinfo: Preserve microseconds for
access/modify times" to glib-2-78
- !3609 Backport !3607 "Make sure the "GTask" is freed on a graceful
disconnect" to glib-2-78
- !3614 Backport !3582 "Buffer needs to be aligned correctly to receive
linux_dirent64." to glib-2-78
- !3616 Backport !3590 "gtestutils.h: Fix warning with -Wsign-conversion
caused by g_assert_cmpint" to glib-2-78
- !3619 Backport !3617 "tests: Drop unnecessary include from gsubprocess-
testprog.c" to glib-2-78
- !3622 Backport !3621 "wakeup: do single read when using eventfd()" to
glib-2-78
- !3625 Backport !3624 "wakeup: Fix g_wakeup_acknowledge if signal comes in"
to glib-2-78
- !3644 Backport !3633 "Use g_task_return in task threads" to glib-2-78
- !3649 Backport !3648 "build: Fix -Dlibelf=disabled on Linux" to glib-2-78
- !3659 Backport !3650 "gfileutils: Add a missing ftruncate() call when
writing files" to glib-2-78
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Fri, 3 Nov 2023 07:12:14 +0000 (15:12 +0800)]
libjpeg-turbo: upgrade 3.0.0 -> 3.0.1
Changelog:
=============
1. The x86-64 SIMD functions now use a standard stack frame, prologue, and
epilogue so that debuggers and profilers can reliably capture backtraces from
within the functions.
2. Fixed two minor issues in the interblock smoothing algorithm that caused
mathematical (but not necessarily perceptible) edge block errors when
decompressing progressive JPEG images exactly two MCU blocks in width or that
use vertical chrominance subsampling.
3. Fixed a regression introduced by 3.0 beta2[6] that, in rare cases, caused
the C Huffman encoder (which is not used by default on x86 and Arm CPUs) to
generate incorrect results if the Neon SIMD extensions were explicitly disabled
at build time (by setting the 'WITH_SIMD' CMake variable to '0') in an AArch64
build of libjpeg-turbo.
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Fri, 3 Nov 2023 07:09:15 +0000 (15:09 +0800)]
harfbuzz: upgrade 8.2.1 -> 8.2.2
Changelog:
===========
- Fix regression from 8.1.0 in shaping fonts with duplicate feature tags.
- Fix regression from 8.2.0 in parsing CSS-style feature strings.
- Variable fonts instanciation now handles more tables.
- Various CMake build improvements.
- various fixes to build without errors with gcc 4.9.2.
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Fri, 3 Nov 2023 07:08:38 +0000 (15:08 +0800)]
gpgme: upgrade 1.22.0 -> 1.23.1
Changelog:
==========
* w32: Change gpgme-w32-spawn to use Unicode arguments.
* Support GPGME_ENCRYPT_ALWAYS_TRUST also for S/MIME.
* New keylist mode GPGME_KEYLIST_MODE_WITH_V5FPR.
* New key capability flags has_*.
* gpgme-tool: Support use of Windows HANDLE.
* qt: Support refreshing keys via WKD.
* qt: Handle cancel in changeexpiryjob.
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Thu, 2 Nov 2023 08:17:56 +0000 (16:17 +0800)]
debianutils: upgrade 5.13 -> 5.14
License-Update:
"Files: which" changed to "Files: which.debianutils"
"which is in the public domain." changed to "which.debianutils is in the public domain."
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Thu, 2 Nov 2023 08:17:53 +0000 (16:17 +0800)]
dhcpcd: upgrade 10.0.3 -> 10.0.4
Changelog:
===========
privsep: allow __NR_mmap2 call
privsep: allow __NR_clock_gettime32 syscall
compat/arc4random.c: use memset instead of explicit_bzero
privsep: avoid SIGPIPE errors when scripts write to stderr/stdout after dhcpcd is daemonised
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Thu, 2 Nov 2023 08:17:52 +0000 (16:17 +0800)]
cronie: upgrade 1.6.1 -> 1.7.0
Changelog:
=============
* anacron: Add support for NO_MAIL_OUTPUT environment variable
* anacron: Support enabling anacron jobs on battery power
* crond: Support -n crontab entry option to disable mailing the output
* crontab: Make a backup of the crontab file on edition and deletion
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Wang Mingyu [Thu, 2 Nov 2023 08:17:51 +0000 (16:17 +0800)]
createrepo-c: upgrade 1.0.1 -> 1.0.2
time64fix.patch
removed since it's included in 1.0.2
Changelog:
==========
Fix building on EL9
Don't allow building without zstd
Adjust printf formats for 64bit time_t on 32bit systems
Remove dependency on libmagic, hardcode magic number detection
Add automation for uploading prebuilt binary wheels to PyPI
Signed-off-by: Wang Mingyu <wangmy@fujitsu.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Khem Raj [Fri, 3 Nov 2023 02:25:52 +0000 (19:25 -0700)]
llvm: Upgrade to 17.0.4 release
Brings following changes/fixes
* 309d55140c46 [AArch64][GlobalISel] Fix incorrect ABI when tail call not supported (#70215)
* 9477268e4247 [AArch64] Add test for #70207 (NFC)
* c2eab59e622c [GVN] Fix use-after-free in load PRE with select available value (#69314)
* 586481468a07 [clang-tidy] Fix crash in modernize-use-trailing-return-type (#70709)
* 9d0ca259eed6 [OpenMP] Fix building for 32-bit DragonFly, NetBSD, OpenBSD (#70527)
* a8046f72bfb3 [OpenMP] record-replay use static-cast (#70516)
* 12bbcd627f60 [flang] Add comdats to functions with linkonce linkage (#66516)
* bdb1553c7639 [mlir] Add pass to add comdat to all linkonce functions (#65270)
* 3347c8441588 Update release note for the fix
* f6fb6a996c7f [clang][ExprConst] Fix crash on uninitialized array subobject (#67817)
* 8c8abe6b93c0 [RISCV] Correct copyPhysReg for GPRPF64. (#70419)
* 615beaec04f9 [SVE] Fix incorrect offset calculation when rewriting an instruction's frame index. (#70315)
* bb29e1ead22f [MemCpyOpt] Combine alias metadatas when replacing byval arguments (#70580)
* 2b82ec7947fe [OpenMP] Use the more appropriate function to retrieve the thread id on OpenBSD (#65553)
* 8909a24d0af1 [libc++] Encode additional ODR-affecting properties in the ABI tag (#69669)
* e9dcc15f514a [AArch64] Prevent argument promotion of vector with size > 128 bits (#70034)
* 4b7f4152a8d1 [LoongArch] Implement COPY instruction between CFRs (#69300)
* fb62a201a199 Revert "[clang-format] Fix align consecutive declarations over function pointers"
* 1f6d35b36681 Fix tests for c23 <-> c2x
* 030d68ef2cd7 Fix a c23 -> c2x think-o
* 2a41d978b4fa [C23] Use thread_local semantics (#70107)
* afbe3549af4d [clangd] Disable crashy unchecked-optional-access tidy check (#69427)
* 7f790f9a39e3 [ConstraintElim] Don't decompose values wider than 64 bits (#68803)
* a1c67ffd0a1f [ConstraintElim] Add test for #68751 (NFC)
* ef50a367e3d5 [mlir] Avoid including <alloca.h> on DragonFly
* a7101379d75e [LVI][CVP] Treat undef like a full range on abs(x, false) (#68711)
* aa03fba83b17 [libcxx] [test] Add a test parameter for disabling memory intensive tests (#68214)
* 71f408bc3623 workflows/release-tasks: Fix release note artifact upload (#69522)
* 9ab3ce1d7a06 Bump version to 17.0.4
* 880a282a40e3 workflows/release-lit: Pass correct build directory to pypa/gh-action-pypi-publish (#69438)
* 8719ee0cb39a workflows/release-lit: Fix dev suffix removal (#69397)
kernel-arch: drop CCACHE from KERNEL_STRIP definition
Building linux-yocto with ccache enabled results in the 'command not
found' error, because kernel-yocto.bbclass passes the KERNEL_STRIP
as a single value, whic is then interpreted as a command name.
ERROR: Fatal errors occurred in subprocesses:
[Errno 2] No such file or directory: 'ccache aarch64-linaro-linux-strip': Traceback (most recent call last):
File "/home/lumag/Projects/RPB/build-rpb/conf/../../layers/openembedded-core/meta/lib/oe/utils.py", line 288, in run
ret = self._target(*self._args, **self._kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Changelog:
added optional encoding parameter for parsing files
fixed handling of the FilesAnalyzed field in Tag-Value format
fixed the validation of the DownloadLocation field
fixed the error handling while parsing license expressions
fixed output of timezone-sensitive datetimes
added code architecture documentation
Signed-off-by: Marta Rybczynska <marta.rybczynska@syslinbit.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Changelog for 0.16.4 [1]:
In beartype.claw type-check PEP 526-compliant annotated variable
assignments in methods
Fix an inheritance regression introduced in 0.16.3
Changelog for 0.16.3 [2]:
Add hot reloading
Support root superclass validators
Forward reference issubclass() proxying
Readable forward reference exceptions
Class redecoration eliding
Documentation update
William Lyu [Wed, 1 Nov 2023 13:37:41 +0000 (09:37 -0400)]
openssl: improve handshake test error reporting
Fixes [YOCTO #15225]
Yocto Bug #15255 is not reproducible. To obtain more useful information
for debugging, the OpenSSL test code is improved so that more detailed
state information in the handshake loop is printed when an error occurs.
Signed-off-by: William Lyu <William.Lyu@windriver.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Randy MacLeod [Wed, 1 Nov 2023 00:54:23 +0000 (17:54 -0700)]
strace: upgrade 6.5 -> 6.6
Update the COPYING checksum; only the copyright date changed.
Noteworthy changes in strace 6.6 (2023-10-31)
=============================================
* Improvements
* Implemented --kill-on-exit option that instructs the tracer to set
PTRACE_O_EXITKILL option to all tracee processes and not to detach them
on cleanup so they will not be left running after the tracer exit.
* Implemented automatic activation of --kill-on-exit option when
--seccomp-bpf is enabled and -p/--attach option is not used.
* Implemented decoding of map_shadow_stack syscall.
* Implemented decoding of FSCONFIG_CMD_CREATE_EXCL fsconfig command.
* Implemented decoding of IFLA_BRPORT_BACKUP_NHID netlink attribute.
* Implemented decoding of SECCOMP_IOCTL_NOTIF_SET_FLAGS ioctl.
* Implemented decoding of UFFDIO_CONTINUE, UFFDIO_POISON, and
UFFDIO_WRITEPROTECT ioctls.
* Updated lists of ARCH_*, BPF_*, DEVCONF_*, IORING_*, KEXEC_*, MAP_*, NT_*,
PTRACE_*, QFMT_*, SEGV_*, UFFD_*, V4L2_*, and XDP_* constants.
* Updated lists of ioctl commands from Linux 6.6.
ptest-runner results on qemux86-64/kvm with qemuparms="-m 1024 -smp 4":
============================================================================
Testsuite summary for strace 6.6
============================================================================
============================================================================
Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Niko Mauno [Tue, 31 Oct 2023 14:13:26 +0000 (14:13 +0000)]
ccache.conf: Remove obsolete configuration option
Since ccache version 4.0, according to
https://github.com/ccache/ccache/blob/master/doc/NEWS.adoc#ccache-40
* An appropriate cache directory level structure is now chosen automatically. The cache_dir_levels (CCACHE_NLEVELS) configuration option has therefore been removed.
Therefore remove the option which has not been supported by ccache
recipe version since Yocto Hardknott.
Signed-off-by: Niko Mauno <niko.mauno@vaisala.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Niko Mauno [Mon, 30 Oct 2023 13:12:53 +0000 (13:12 +0000)]
image_types.bbclass: Use xz default compression preset level
Commit ef0654f1453ff0afe98d7e921626b2a96cf2f6f6
("Set XZ_COMPRESSION_LEVEL to -9") changed the xz compression preset
level from previous value of -3 to -9. The commit message explains that
the change was made in order to be consistent with other compressors
that also use their best compression. However looking at xz man page,
under the compression preset level selection chapter there is mentioned
that
The differences between the presets are more significant than with gzip(1) and
bzip2(1). The selected compression settings determine the memory requirements of
the decompressor, thus using a too high preset level might make it painful to
decompress the file on an old system with little RAM. Specifically, it's not a
good idea to blindly use -9 for everything like it often is with gzip(1) and
bzip2(1).
which is then followed by a table, which mentions that the decompressor
memory requirement for preset -9 is 65 MiB, whereas for xz default
preset -6 it is just 9 MiB. Given that the use case where a device
running a Yocto generated Linux OS decompresses an ext4 root filesystem
image to non-volatile memory as part of firmware upgrade process is not
far-fetched, and considering that a range of these devices can run low
on available RAM when there are other applications running at the same
time, the lower decompressor memory requirement of the default preset
level makes sense in order to prevent an OOM situation from occurring.
This change was tested on a 32 CPU core build host with 128 GB RAM by
issuing
$ bitbake -c cleansstate core-image-minimal core-image-sato
$ time bitbake core-image-minimal
$ time bitbake core-image-sato
With MACHINE="qemux86-64" and IMAGE_FSTYPES="ext4 ext4.xz" using
XZ_COMPRESSION_LEVEL values "-6" and "-9". In both cases the resulting
'ext4' image size remained same, 38141952 bytes for core-image-minimal,
and 565043200 bytes for core-image-sato.
The observation was that with this change there is a small increase in
the resulting 'ext4.xz' file size, and a build speed improvement that
was significant for larger rootfs image.
core-image XZ real time time delta ext4.xz size size delta
-----------------------------------------------------------------------
minimal -9 0m44.992s 15932508
minimal -6 0m42.445s -5.66% 16243484 +1.95%
sato -9 2m40.828s 85080416
sato -6 1m38.891s -38.51% 87447456 +2.78%
Regarding decompression speed, issuing following command in qemux86-64
target OS
$ time xz -dkc --memlimit=MEMLIMIT core-image-sato-qemux86-64.rootfs.ext4.xz > /dev/null
using the lowest accepted value for MEMLIMIT for each case (providing a
lower value caused xz to exit with 'Memory usage limit reached' error)
showed that decompression time saw a minuscule improvement with the -6
compression preset level:
XZ MEMLIMIT real time
-------------------------
-9 65M 0m43.83s
-6 9M 0m43.28s
(In the above tables, XZ refers to XZ_COMPRESSION_LEVEL value used when
images were generated with Yocto).
Signed-off-by: Niko Mauno <niko.mauno@vaisala.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com>
Richard Purdie [Sun, 29 Oct 2023 10:21:22 +0000 (10:21 +0000)]
oeqa/selftest: Drop machines support
The machines option to oe-selftest isn't used in our CI and is never likely to
be, we focus and execute testing explictly. The YOCTO #15247 is about how
this code doesn't interact well with build directory cleanup and at this point
I think we should just remove the option/code.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
valgrind: split helper scripts to separate packages, update dependencies
The cachegrind scripts have been rewritten in python3, so the RDEPENDS
on perl is no longer sufficient. This is unfortunately not caught by
QA checks since the scripts use
#! /usr/bin/env python3
as shebang line.
Since the valgrind binary by itself can be quite useful on target,
allow including that in the rootfs without also having to pull in the
whole perl and python interpreters and stdlibs.
Signed-off-by: Rasmus Villemoes <rasmus.villemoes@prevas.dk> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Alexis Lothoré [Fri, 3 Nov 2023 20:50:18 +0000 (13:50 -0700)]
scripts/resulttool: group all regressions in regression report
Commit c304fcbe0588b1078373558c2ddf36064bcdf214 introduced a grouping when
listing regressions. This grouping has been added only for ptests. It has
been observed that any other kind of tests could benefit from it. For
example, current regression reports can show the following:
1 regression(s) for oescripts.OEGitproxyTests.test_oegitproxy_proxy_dash
oescripts.OEGitproxyTests.test_oegitproxy_proxy_dash: PASSED -> SKIPPED
1 regression(s) for oescripts.OEPybootchartguyTests.test_pybootchartguy_help
oescripts.OEPybootchartguyTests.test_pybootchartguy_help: PASSED -> SKIPPED
1 regression(s) for oescripts.OEPybootchartguyTests.test_pybootchartguy_to_generate_build_pdf_output
oescripts.OEPybootchartguyTests.test_pybootchartguy_to_generate_build_pdf_output: PASSED -> SKIPPED
1 regression(s) for oescripts.OEPybootchartguyTests.test_pybootchartguy_to_generate_build_png_output
oescripts.OEPybootchartguyTests.test_pybootchartguy_to_generate_build_png_output: PASSED -> SKIPPED
1 regression(s) for oescripts.OEPybootchartguyTests.test_pybootchartguy_to_generate_build_svg_output
oescripts.OEPybootchartguyTests.test_pybootchartguy_to_generate_build_svg_output: PASSED -> SKIPPED
[...]
This output is not so useful in its current state and should be grouped per
test type too.
Enable grouping for all kind of tests, to make it llok like the following
in reports:
5 regression(s) for oescripts
oescripts.OEGitproxyTests.test_oegitproxy_proxy_dash: PASSED -> SKIPPED
oescripts.OEPybootchartguyTests.test_pybootchartguy_help: PASSED -> SKIPPED
oescripts.OEPybootchartguyTests.test_pybootchartguy_to_generate_build_pdf_output: PASSED -> SKIPPED
oescripts.OEPybootchartguyTests.test_pybootchartguy_to_generate_build_png_output: PASSED -> SKIPPED
oescripts.OEPybootchartguyTests.test_pybootchartguy_to_generate_build_svg_output: PASSED -> SKIPPED
Signed-off-by: Alexis Lothoré <alexis.lothore@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
baremetal-helloworld: Pull in fix for race condition on x86-64
It was previously discovered that there was a race condition during the Makefile
execution between the assemble and compile targets, the previous fix attempted
to serialize the build targets, but the fix was missing for x86-64.
Pull in latest commit from upstream to fix this issue on x86-64.
[YOCTO #15146]
Signed-off-by: Alejandro Enedino Hernandez Samaniego <alejandro@enedino.org> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Florian Wickert [Fri, 3 Nov 2023 14:50:37 +0000 (15:50 +0100)]
systemd: fix libnss-mymachines packaging
By removing libnss_mymachines.so.2 from FILES:${PN}-container it
correctly gets packaged into libnss-mymachines, just like the other
libnss-* components, due to PACKAGES_DYNAMIC.
To make up for the missing lib in the container package, I added
libnss-mymachines to RDEPENDS:${PN}-container. As I understand it,
the lib should be installed even without this if anything from the
container package links against it. But since I don't know if there
was a special reason to explicitly add it to the container files list,
like something using dlopen to load the lib, it seemd to be the
safest option.
Signed-off-by: Florian Wickert <fw@ferncast.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
scripts/esdk-tools: use a dedicated, static directory for esdk tools
This allows easier replication of esdk environment (which provides
a curated, limited set of tools that for example does not include bitbake)
in a standard yocto build. Switchover between various sets can be achieved
via PATH manipulation.
Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
meta/lib/oe/copy_buildsystem.py: do not derefence symlinks
This was added (I think) for the purpose of supporting layers that refer
to items outside of the layer via relative symlinks:
https://git.yoctoproject.org/poky-contrib/commit/?id=d31d1ad4e566e42d0bbcf1f41ac25e33181fb517
I do not think copying the link target into the layer that references it is the
correct solution: rather the original target should be included
into the SDK with the same relative path.
This change is done for the sake of preserving symlinks
that are referencing things inside the layer as they are;
particularly the content of scripts/esdk-tools/.
Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
populate_sdk_ext.bbclass: do not symlink unfsd from sdk image sysroot into eSDK tools path
This was done in 2016 to support Eclipse plugin (long dead),
it's currently broken as image sysroot is not in the SDK
until the image is built in that context, and current tools
all rely on runqemu-export-rootfs which does not rely on PATH
and runs unfsd with full path to recipe-specific sysroots.
Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Ross Burton [Fri, 3 Nov 2023 13:28:11 +0000 (13:28 +0000)]
cve-check: don't warn if a patch is remote
We don't make do_cve_check depend on do_unpack because that would be a
waste of time 99% of the time. The compromise here is that we can't
scan remote patches for issues, but this isn't a problem so downgrade
the warning to a note.
Also move the check for CVEs in the filename before the local file check
so that even with remote patches, we still check for CVE references in
the name.
Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Trevor Gamblin [Thu, 2 Nov 2023 17:25:49 +0000 (13:25 -0400)]
patchtest-send-results: fix sender parsing
Not all mbox 'from' fields will contain angle brackets, so the
re.findall invocation used for getting a reply_address may fail. Use a
simpler reference to the field to get the sender's email address.
Signed-off-by: Trevor Gamblin <tgamblin@baylibre.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Trevor Gamblin [Wed, 1 Nov 2023 14:20:55 +0000 (10:20 -0400)]
patchtest: remove test for CVE tag in mbox
After patchtest went live it was determined that testing for a CVE tag
in the mbox commit message is unnecessary, since it will already be in
the shortlog and in any carried patches. Remove the test and the
associated selftest files so that its absence isn't flagged in future
test results.
Signed-off-by: Trevor Gamblin <tgamblin@baylibre.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Trevor Gamblin [Tue, 31 Oct 2023 18:16:13 +0000 (14:16 -0400)]
patchtest: make pylint tests compatible with 3.x
pylint 3.x has removed epylint, which is now a separate module. To avoid
adding another recipe or using outdated modules, modify the
test_python_pylint tests so that they use the standard pylint API.
Signed-off-by: Trevor Gamblin <tgamblin@baylibre.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Trevor Gamblin [Wed, 1 Nov 2023 18:08:21 +0000 (14:08 -0400)]
patchtest-send-results: add In-Reply-To
Rework the script for sending results to use send_raw_email and specify
the 'In-Reply-To' field so that patchtest replies to the emails, rather
than sending them standalone to the submitter and mailing list.
Signed-off-by: Trevor Gamblin <tgamblin@baylibre.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
selftest/sstatetests: add a test for CDN sstate cache
Specifically, the test checks that everything needed for building
standard oe-core images for x86_64 and arm64 is available from
the cache (with minor exceptions). Going forward, a complete
world check could be enabled and additional configurations,
but that requires improvements to performance of hash equivalence
server in particular.
RP: I've disabled the tests by default so we can merge them. We will
make them live once we get to the bottom of the failures.
Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Chen Qi [Mon, 30 Oct 2023 06:31:33 +0000 (14:31 +0800)]
kernel.bbclass: add preceding space in appendVar setting
The appendVar setting should have a preceding space, otherwise, when
KERNEL_MODULE_SPLIT is set to "0", we'll sometimes get dependency error
due to lacking of space.
Signed-off-by: Chen Qi <Qi.Chen@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Trevor Gamblin [Mon, 30 Oct 2023 15:44:41 +0000 (11:44 -0400)]
patchtest-send-results: send results to submitter
Modify patchtest-send-results so that it extracts the submitter's email
address and responds to them with the patch testresults. Also make a
minor adjustment to the suggestions provided with each email and include
a link to the Patchtest wiki page for additional clarification on
specific failures.
Signed-off-by: Trevor Gamblin <tgamblin@baylibre.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
git show-ref looks at the _remote_ ref called HEAD, which is fine when it
matches the local HEAD but problematic when you're iterating a series of
commits.
Use rev-parse to resolve the local name to a proper hash.
Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
The hooks are pulled from the impure environment and are often broken in
our environments. There is no reason to add extra metadata or verify the
commit message as its arbitrary to turn the tarball into a git repo.
Signed-off-by: William A. Kennington III <wak@google.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Stéphane Veyret [Mon, 28 Aug 2023 17:52:56 +0000 (19:52 +0200)]
volatile-binds: Calculate the name of the /var/lib service
By default, /var/lib is bind mounted on /var/volatile/lib. If this is
the case, the recipe adds conditions on systemd-random-seed in the
service file mounting it. But as the VOLATILE_BINDS may be modified,
/var/lib may be mounted elsewhere, for example in /persistent/var/lib.
In this case, the conditions are not set because the service file name
does not match expected one.
This patch automatically records the name of the service mounting
/var/lib, if any, in order to set the condition in the appropriate file.
Signed-off-by: Stéphane Veyret <sveyret@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Stéphane Veyret [Sun, 27 Aug 2023 16:41:23 +0000 (18:41 +0200)]
volatile-binds: Allow creation of subdirectories
The mount-copybind script will create the parent directory of the bind
mount if it does not exist. But actually, if this is the case, the
service will not even start because of the ConditionPathIsReadWrite.
This patch adds a "or" condition to allow the service to start also if
the parent directory of the bind mount does not exist.
Signed-off-by: Stéphane Veyret <sveyret@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
The commit not only removes the dependencies on the cross compiler
but also does not depend on e.g. virtual/${TARGET_PREFIX}compilerlibs
and virtual/libc which in turn makes the file-rdeps qa check fail
if installing binaries linked against e.g. libc or libstdc++.
Signed-off-by: Max Krummenacher <max.krummenacher@toradex.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Trevor Gamblin [Sun, 29 Oct 2023 14:54:26 +0000 (10:54 -0400)]
patchtest: shorten test result outputs
Some test result lines in TestMbox and TestPatch are still too long to
avoid being flagged by the mailer script. Clean them up by removing
redundant information, so that they are all under the length limit of
220 characters.
Signed-off-by: Trevor Gamblin <tgamblin@baylibre.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Trevor Gamblin [Fri, 27 Oct 2023 15:43:38 +0000 (11:43 -0400)]
patchtest: reduce checksum test output length
The test_lic_files_chksum_modified_not_mentioned test in TestMetadata is
outputting very long lines that fail the maximum length check when
sending email results, preventing the actual errors from being
displayed. Reduce the length of the failure message by rewording and
removing redundant information.
Signed-off-by: Trevor Gamblin <tgamblin@baylibre.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Ross Burton [Fri, 27 Oct 2023 15:29:40 +0000 (16:29 +0100)]
scripts/contrib/patchreview: add commit and recipe count fields to JSON
The autobuilder scripts post-process the generated JSON to inject recipe
and commit counts into the data. We can do this easily in patchreview
instead.
Signed-off-by: Ross Burton <ross.burton@arm.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Ross Burton [Fri, 27 Oct 2023 15:29:39 +0000 (16:29 +0100)]
scripts/patchreview: rework patch detection
A previous patch[1] added the ability to allow the search pattern for
patches to be changed, so that patchreview can be used across the entire
meta-oe repository by changing the patterns.
However, this means the caller needs to write long patterns when calling
patchreview.
Instead, we can see if the specified directory contains a layer by
checking if conf/layer.conf exists. If it does, then search for patches
inside this directory. If it doesn't, assume that the specified
directory is a repository that contains sublayers (such as
meta-openembedded) and look through each of the directories that match
the pattern meta-*.
This means patchreview can both scan either a single layer (eg
.../poky/meta) or a repository of sublayers (eg .../meta-openembedded).
Richard Purdie [Thu, 26 Oct 2023 10:36:10 +0000 (11:36 +0100)]
base: Ensure recipes using mercurial-native have certificates
If you try and fetch using mercurial-native, you see certificate errors since
it is configured to find ones in the sysroot, not the system. Add the missing
dependency so that mercurial recipes using the native tool work.
Found trying to make mirroring for old meta-oe stable branches work.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
lib/oe/sstatesig.py: dump locked.sigs.inc only when explicitly asked via -S lockedsigs
This was writing out locked-sigs.inc into cwd with every
'bitbake -S' invocation. When the intent is only to to get task
stamps (-S none), or print the difference between them (-S printdiff),
the file is unnecessary clutter.
A couple of selftests/scripts were however relying on this, so they're
adjusted to explicitly request the file.
eSDK code calls dump_lockedsigs() separately via
oe.copy_buildsystem.generate_locked_sigs() and so isn't affected.
Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
selftest/sstatetests: add tests for 'bitbake -S printdiff'
'bitbake -S printdiff' is a useful diagnostic facility for finding out
why sstate is not being reused, but until now it had no tests that would
ensure it works. This commit adds three basic scenarios:
1. make a change in a really basic, common recipe that is at the very root
of dependency trees (quilt-native), and ensure that change is correctly discovered when
building an image.
2. make a change in gcc-source recipe, which is somewhat special
(operates in work-shared), and ensure that gcc-runtime builds track
that down as well.
3. make a change in base_do_configure() definition from base.bbclass,
which is not recipe-specific, but affects many basic recipes, and ensure that
is correctly reported as well.
The test itself actually runs twice:
- first against a fully populated build directory, where
the printdiff code is guaranteed to find the correct previous
stamp that can be compared with in a predictable manner.
- then in an empty build directory where the printdiff code
goes to look in the sstate cache, and so the existence of the
previous signature can be tested, but not the difference with it
(what the exact difference would be is unpredictable as the
sstate cache is indeed shared between many builds).
Signed-off-by: Alexander Kanavin <alex@linutronix.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Xiangyu Chen [Thu, 26 Oct 2023 06:38:48 +0000 (14:38 +0800)]
linux-yocto: make sure the pahole-native available before do_kernel_configme
When using debug-btf.scc in a clean workspace, the CONFIG_MODULE_ALLOW_BTF_MISMATCH cannot
apply to kernel until clean the kernel code(bitbake linux-yocto -c cleanall) and rebuild.
After tracking the code, some options depend on CONFIG_PAHOLE_VERSION, it was generated by
scripts/pahole-version.sh in kernel, but during do_kernel_configme step, the pahole-native
is not available in sysroot-native, so need to wait pahole-native install to sysroot-native
before do_kernel_configme.
Julien Stephan [Wed, 25 Oct 2023 15:46:59 +0000 (17:46 +0200)]
oeqa/selftest/recipetool: add selftest for PEP-517 recipe creation
Add 3 tests to check the creation of PEP-517 project using the 3
backends supported by bitbake:
- setuptools.build_meta
- poetry.core.masonry.api
- flit_core.buildapi
Theses tests requires the tomllib python module, so skip theses tests
if module is not present. tomllib module is part of python starting from 3.11
Signed-off-by: Julien Stephan <jstephan@baylibre.com> Signed-off-by: Luca Ceresoli <luca.ceresoli@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Julien Stephan [Wed, 25 Oct 2023 15:46:58 +0000 (17:46 +0200)]
recipetool/create_buildsys_python: add PEP517 support
Add basic support for PEP517 [1] for the 3 following backends that are
supported by bitbake:
- setuptools.build_meta
- poetry.core.masonry.api
- flit_core.buildapi
If a pyproject.toml file is found, use it to create the recipe,
otherwise fallback to the old setup.py method.
Some projects can declare a minimal pyproject.toml file, and put all
the metadata in setup.py/setup.cfg/requirements.txt .. theses cases
are not handled. If a pyproject.toml file is found, assumes it has all
necessary metadata.
As for the old setup.py method, version numbers for dependencies are not
handled.
Some features may be missing, such as the extra dependencies.
[YOCTO #14737]
[1]: https://peps.python.org/pep-0517/
Signed-off-by: Julien Stephan <jstephan@baylibre.com> Signed-off-by: Luca Ceresoli <luca.ceresoli@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Julien Stephan [Wed, 25 Oct 2023 15:46:57 +0000 (17:46 +0200)]
recipetool/create_buildsys_python: refactor code for futur PEP517 addition
In order to prepare the support for pyproject.toml (PEP517 [1]) enabled
projects, refactor the code and move setup.py specific code into a
specific class in order to allow sharing the PythonRecipeHandler class
License field of setup is not always standardized, so we usually use the
classifier to determine the correct license format to use in the recipe.
A warning note is added above the LICENSE field of the create recipe
in case a license is provided in setup. But when the plugin is called,
"LICENSE =" is not yet present so we can never display this note.
Replace the "LICENSE =" condition with "##LICENSE_PLACEHOLDER##"
to actually be able to display the note message
Signed-off-by: Julien Stephan <jstephan@baylibre.com> Signed-off-by: Luca Ceresoli <luca.ceresoli@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Julien Stephan [Wed, 25 Oct 2023 16:02:44 +0000 (18:02 +0200)]
oeqa/selftest/devtool: abort if a local workspace already exist
if user run devtool selftests with a local workspacelayer
the tests fail with various error such as:
- devtool.DevtoolAddTests.test_devtool_add just hangs
- devtool.DevtoolModifyTests.* fail with the following error:
ERROR: Found duplicated BBFILE_COLLECTIONS 'workspacelayer', check bblayers.conf or layer.conf to fix it.
Found duplicated BBFILE_COLLECTIONS 'workspacelayer', check bblayers.conf or layer.conf to fix it.
Check if a workspacelayer exists, warn the user and abort the tests
Signed-off-by: Julien Stephan <jstephan@baylibre.com> Signed-off-by: Luca Ceresoli <luca.ceresoli@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>