]> git.ipfire.org Git - thirdparty/systemd.git/log
thirdparty/systemd.git
4 years agotest-network: increase wait_online timeout to handle longer dhcpv4 transient timeout 17908/head
Dan Streetman [Wed, 9 Dec 2020 20:24:09 +0000 (15:24 -0500)] 
test-network: increase wait_online timeout to handle longer dhcpv4 transient timeout

Previous commits changed the dhcpv4 retransmission algorithm to be
slightly slower, changing the amount of time it takes to notify
systemd-networkd that the dhcpv4 configuration has (transiently)
failed from around 14 second up to 28 seconds.

Since the test_dhcp_client_with_ipv4ll_without_dhcp_server test
configures an interface to use dhcpv4 without any operating dhcpv4
server running, it must increase the amount of time it waits for
the test interface to reach degraded state.

4 years agosd-dhcp-client: correct retransmission timeout to match RFC
Dan Streetman [Wed, 9 Dec 2020 19:32:06 +0000 (14:32 -0500)] 
sd-dhcp-client: correct retransmission timeout to match RFC

This changes the retransmission timeout algorithm for requests
other than RENEW and REBIND. Previously, the retransmission timeout
started at 2 seconds, then doubling each retransmission up to a max
of 64 seconds. This is changed to match what RFC2131 section 4.1 describes,
which skips the initial 2 second timeout and starts with a 4 second timeout
instead. Note that -1 to +1 seconds of random 'fuzz' is added to each
timeout, in previous and current behavior.

This change is therefore slightly slower than the previous behavior in
attempting retransmissions when no server response is received, since the
first transmission times out in 4 seconds instead of 2.

Since TRANSIENT_FAILURE_ATTEMPTS is set to 3, the previous length of time
before a transient failure was reported back to systemd-networkd was
2 + 4 + 8 = 14 seconds, plus, on average, 3 seconds of random 'fuzz' for
a transient failure timeout between 11 and 17 seconds. Now, since the
first timeout starts at 4, the transient failure will be reported at
4 + 8 + 16 = 28 seconds, again plus 3 random seconds for a transient
failure timeout between 25 and 31 seconds.

Additionally, if MaxAttempts= is set, it will take slightly longer to
reach than with previous behavior.

4 years agosd-dhcp-client: correct dhcpv4 renew/rebind retransmit timeouts
Dan Streetman [Tue, 8 Dec 2020 20:40:10 +0000 (15:40 -0500)] 
sd-dhcp-client: correct dhcpv4 renew/rebind retransmit timeouts

Use the request timeout algorithm specified in RFC2131 section 4.4.5 for
handling timed out RENEW and REBIND requests.

This changes behavior, as previously only 2 RENEW and 2 REBIND requests
were sent, no matter how long the lease lifetime. Now, requests are
send according to the RFC, which results in starting with a timeout
of 1/2 the t1 or t2 period, and halving the timeout for each retry
down to a minimum of 60 seconds.

Fixes: #17909
4 years agosd-dhcp-client: simplify dhcp4 t1/t2 parsing
Dan Streetman [Tue, 8 Dec 2020 20:36:19 +0000 (15:36 -0500)] 
sd-dhcp-client: simplify dhcp4 t1/t2 parsing

The parsing of the dhcpv4 lease lifetime, as well as the t1/t2
times, is simplified by this commit.

This differs from previous behavior; previously, the lease lifetime and
t1/t2 values were modified by random 'fuzz' by subtracting 3, then adding
a random number between 0 and (slightly over) 2 seconds. The resulting
values were therefore always between 1-3 seconds shorter than the value
provided by the server (or the default, in case of t1/t2). Now, as
described in RFC2131, the random 'fuzz' is between -1 and +1 seconds,
meaning the actual t1 and t2 value will be up to 1 second earlier or
later than the server-provided (or default) t1/t2 value.

This also differs in handling the lease lifetime, as described above it
previously was adjusted by the random 'fuzz', but the RFC does not state
that the lease expiration time should be adjusted, so now the code uses
exactly the lease lifetime as provided by the server with no adjustment.

4 years agosd-dhcp-client: add RFC2131 retransmission details
Dan Streetman [Tue, 8 Dec 2020 20:33:29 +0000 (15:33 -0500)] 
sd-dhcp-client: add RFC2131 retransmission details

RFC2131, providing the details for dhcpv4, has specific retransmission
intervals that it outlines. This adds functions to compute the timeouts
as the RFC describes.

4 years agosd-dhcp-client: track dhcp4 t1, t2, expire times
Dan Streetman [Tue, 8 Dec 2020 19:37:59 +0000 (14:37 -0500)] 
sd-dhcp-client: track dhcp4 t1, t2, expire times

Add fields to dhcp4 client to track t1, t2, and lease expiry times

4 years agosd-dhcp-client: don't log timeouts if already expired
Dan Streetman [Mon, 14 Dec 2020 20:50:11 +0000 (15:50 -0500)] 
sd-dhcp-client: don't log timeouts if already expired

4 years agoMerge pull request #17960 from yuwata/network-log-routing-policy-rule
Luca Boccassi [Mon, 14 Dec 2020 22:22:51 +0000 (22:22 +0000)] 
Merge pull request #17960 from yuwata/network-log-routing-policy-rule

network: introduce log_routing_policy_rule()

4 years agoMerge pull request #17959 from yuwata/network-log-address
Luca Boccassi [Mon, 14 Dec 2020 22:21:50 +0000 (22:21 +0000)] 
Merge pull request #17959 from yuwata/network-log-address

network: introduce log_address_debug()

4 years agoMerge pull request #17958 from yuwata/network-route-log
Luca Boccassi [Mon, 14 Dec 2020 22:17:33 +0000 (22:17 +0000)] 
Merge pull request #17958 from yuwata/network-route-log

network: introduce log_route_debug()

4 years agocore: detect_container() may return negative errno
Yu Watanabe [Mon, 14 Dec 2020 16:13:32 +0000 (01:13 +0900)] 
core: detect_container() may return negative errno

4 years agotime-util: fix typo
Yu Watanabe [Mon, 14 Dec 2020 13:57:06 +0000 (22:57 +0900)] 
time-util: fix typo

4 years agocore/namespace: use existing /proc when not enough priviledge
Yu Watanabe [Sun, 6 Dec 2020 13:29:43 +0000 (22:29 +0900)] 
core/namespace: use existing /proc when not enough priviledge

Fixes #17860.

4 years agonetwork: use netlink_message_read_in_addr_union() where applicable 17960/head
Yu Watanabe [Wed, 28 Oct 2020 08:28:36 +0000 (17:28 +0900)] 
network: use netlink_message_read_in_addr_union() where applicable

4 years agonetwork: introduce log_routing_policy_rule_debug()
Yu Watanabe [Wed, 28 Oct 2020 08:22:58 +0000 (17:22 +0900)] 
network: introduce log_routing_policy_rule_debug()

4 years agonetwork: introduce routing_policy_rule_equal()
Yu Watanabe [Thu, 29 Oct 2020 02:41:01 +0000 (11:41 +0900)] 
network: introduce routing_policy_rule_equal()

4 years agonetwork: make routing_policy_rule_remove() take Manager instead of Link
Yu Watanabe [Wed, 28 Oct 2020 07:16:58 +0000 (16:16 +0900)] 
network: make routing_policy_rule_remove() take Manager instead of Link

As routing policy rules are managed by Manager.

4 years agonetwork: make address_drop() accept NULL 17959/head
Yu Watanabe [Wed, 28 Oct 2020 09:09:51 +0000 (18:09 +0900)] 
network: make address_drop() accept NULL

4 years agonetwork: introduce log_address_debug()
Yu Watanabe [Wed, 28 Oct 2020 09:09:16 +0000 (18:09 +0900)] 
network: introduce log_address_debug()

4 years agonetwork: merge manager_drop_routes() and manager_drop_foreign_routes() 17958/head
Yu Watanabe [Wed, 28 Oct 2020 12:16:22 +0000 (21:16 +0900)] 
network: merge manager_drop_routes() and manager_drop_foreign_routes()

4 years agonetwork: introduce log_route_debug()
Yu Watanabe [Wed, 28 Oct 2020 08:41:06 +0000 (17:41 +0900)] 
network: introduce log_route_debug()

4 years agonetwork: use netlink_message_read_in_addr_union() where applicable
Yu Watanabe [Wed, 28 Oct 2020 08:49:49 +0000 (17:49 +0900)] 
network: use netlink_message_read_in_addr_union() where applicable

4 years agocore/namespace: ignore ENOENT for /proc/sys/kernel/domainname and hostname
Yu Watanabe [Mon, 14 Dec 2020 03:37:23 +0000 (12:37 +0900)] 
core/namespace: ignore ENOENT for /proc/sys/kernel/domainname and hostname

If they do not exist, hostname or domainname cannot be modified. So, it is ok.

Fixes #17866, especially https://github.com/systemd/systemd/issues/17866#issuecomment-744118614.

4 years agoUpdate TODO
Lennart Poettering [Mon, 14 Dec 2020 12:15:31 +0000 (13:15 +0100)] 
Update TODO

4 years agotree-wide: fix typo
Yu Watanabe [Mon, 14 Dec 2020 00:40:45 +0000 (09:40 +0900)] 
tree-wide: fix typo

4 years agonspawn: remove outdated comment regarding bpffs
Ilya Dmitrichenko [Mon, 14 Dec 2020 09:35:08 +0000 (09:35 +0000)] 
nspawn: remove outdated comment regarding bpffs

bpffs fully respects mount namespaces since kernel version 4.7

References:

- https://github.com/torvalds/linux/commit/e27f4a942a0ee4b84567a3c6cfa84f273e55cbb7
- https://github.com/torvalds/linux/commit/612bacad78ba6d0a91166fc4487af114bac172a8

4 years agosd-device: make TAGS= property prefixed and suffixed with ":"
Yu Watanabe [Thu, 10 Dec 2020 23:34:13 +0000 (08:34 +0900)] 
sd-device: make TAGS= property prefixed and suffixed with ":"

The commit 6f3ac0d51766b0b9101676cefe5c4ba81feba436 drops the prefix and
suffix in TAGS= property. But there exists several rules that have like
`TAGS=="*:tag:*"`. So, the property must be always prefixed and suffixed
with ":".

Fixes #17930.

4 years agoMerge pull request #17928 from keszybz/nss-logging
Yu Watanabe [Mon, 14 Dec 2020 00:48:23 +0000 (09:48 +0900)] 
Merge pull request #17928 from keszybz/nss-logging

Enable logging in nss modules

4 years agoAdd Pull Request Labeler
Jameer Pathan [Sat, 12 Dec 2020 06:30:26 +0000 (12:00 +0530)] 
Add Pull Request Labeler

4 years agommap-cache: drop ret_size from mmap_cache_get()
Vito Caputo [Sun, 6 Dec 2020 08:21:17 +0000 (00:21 -0800)] 
mmap-cache: drop ret_size from mmap_cache_get()

The ret_size result is a bit of an awkward optimization that in a
sense enables bypassing the mmap-cache API, while encouraging
duplication of logic it already implements.

It's only utilized in one place; journal_file_move_to_object(),
apparently to avoid the overhead of remapping the whole object
again once its header, and thus its actual size, is known.

With mmap-cache's context cache, the overhead of simply
re-getting the object with the now known size should already be
negligible.  So it's not clear what benefit this brings, unless
avoiding some function calls that do very little in the hot
context-cache hit case is of such a priority.

There's value in having all object-sized gets pass through
mmap_cache_get(), as it provides a single entrypoint for
instrumentation in profiling/statistics gathering.  When
journal_file_move_to_object() bypasses getting the full object
size, you don't capture the full picture on the mmap-cache side
in terms of object sizes explicitly loaded from a journal file.

I'd like to see additional accounting in mmap_cache_get() in a
future commit, taking advantage of this change.

4 years agoUpdate 60-keyboard.hwdb
dropsignal [Sat, 12 Dec 2020 13:31:36 +0000 (07:31 -0600)] 
Update 60-keyboard.hwdb

added support for samsung series 3 np355v4c laptop keyboard

4 years agomeson: Fix reallocarray check
Khem Raj [Sun, 13 Dec 2020 00:15:57 +0000 (16:15 -0800)] 
meson: Fix reallocarray check

reallocarray() is defined in stdlib.h, so that would be right header to
check for its presense.

Signed-off-by: Khem Raj <raj.khem@gmail.com>
4 years agopid1: stop making /dev noexec
Zbigniew Jędrzejewski-Szmek [Fri, 11 Dec 2020 11:28:44 +0000 (12:28 +0100)] 
pid1: stop making /dev noexec

Quoting Andy Lutomirski:
> The upcoming Linux SGX driver has a device node /dev/sgx.  User code opens
> it, does various setup things, mmaps it, and needs to be able to create
> PROT_EXEC mappings.  This gets quite awkward if /dev is mounted noexec.

We already didn't use noexec in spawn, and this extends this behaviour to other
systems.

Afaik, the kernel would refuse execve() on a character or block device
anyway. Thus noexec on /dev matters only for actual binaries copied to /dev,
which requires root privileges in the first place.

We don't do noexec on either /tmp or /dev/shm (because that causes immediate
problems with stuff like Java and cffi). And if you have those two at your
disposal anyway, having noexec on /dev doesn't seem important. So the 'noexec'
attribute on /dev doesn't really mean much, since there are multiple other
similar directories which don't require root privileges to write to.

C.f. https://salsa.debian.org/kernel-team/initramfs-tools/-/commit/33c10ef43b03dc6d9ee09a46c598f6ee34ad0b81.

4 years agoudev-builtin-blkid: add VOLUME_ID, LOGICAL_VOLUME_ID, VOLUME_SET_ID and DATA_PREPARER_ID
Karel Zak [Thu, 10 Dec 2020 11:27:33 +0000 (12:27 +0100)] 
udev-builtin-blkid: add VOLUME_ID, LOGICAL_VOLUME_ID, VOLUME_SET_ID and DATA_PREPARER_ID

The new libblkid release will provide these variables. Let's keep is
accessible also from udev-db for the rest of the system.

4 years agoMerge pull request #17921 from yuwata/network-drop-assertion-17920
Luca Boccassi [Fri, 11 Dec 2020 22:53:33 +0000 (22:53 +0000)] 
Merge pull request #17921 from yuwata/network-drop-assertion-17920

network: drop assertions to check link state in netlink callback handlers

4 years agoMerge pull request #17935 from yuwata/network-fix-another-race-in-link-reconfigure...
Zbigniew Jędrzejewski-Szmek [Fri, 11 Dec 2020 10:39:44 +0000 (11:39 +0100)] 
Merge pull request #17935 from yuwata/network-fix-another-race-in-link-reconfigure-17929

network: do not reconfigure interface when the link gains carrier but udev not initialized it yet

4 years agonetwork: adjust comments 17935/head
Zbigniew Jędrzejewski-Szmek [Fri, 11 Dec 2020 10:39:16 +0000 (11:39 +0100)] 
network: adjust comments

Co-authored-by: Carlo Teubner <435950+c4rlo@users.noreply.github.com>
4 years agonetwork: do not configure static configs more than once simultaneously 17921/head
Yu Watanabe [Fri, 11 Dec 2020 05:39:46 +0000 (14:39 +0900)] 
network: do not configure static configs more than once simultaneously

4 years agonetwork: do not assume address ready callback is always set to static addresses
Yu Watanabe [Fri, 11 Dec 2020 05:22:35 +0000 (14:22 +0900)] 
network: do not assume address ready callback is always set to static addresses

4 years agonetwork: drop assertions to check link state in netlink callback handlers
Yu Watanabe [Thu, 10 Dec 2020 05:16:22 +0000 (14:16 +0900)] 
network: drop assertions to check link state in netlink callback handlers

As, the link may be dropped while configuring addresses or routes.

Fixes #17920.

4 years agonetwork: do not reconfigure interface when the link gains carrier but udev not initia...
Yu Watanabe [Fri, 11 Dec 2020 03:15:45 +0000 (12:15 +0900)] 
network: do not reconfigure interface when the link gains carrier but udev not initialized it yet

When an interface gains carrier but udev have not initialized the
interface or link_initialized_handler() has not been called yet,
then link_configure will be called twice. Thus LLDP client will be
configured twice, and triggers assertion.

Fixes #17929.

4 years agonss-mymachines: initialize logging 17928/head
Zbigniew Jędrzejewski-Szmek [Thu, 10 Dec 2020 11:46:23 +0000 (12:46 +0100)] 
nss-mymachines: initialize logging

No logging is done directly by nss-mymachines.c code, but we call into sd-bus,
which will log.

4 years agonss-systemd: initialize logging
Zbigniew Jędrzejewski-Szmek [Thu, 10 Dec 2020 11:45:48 +0000 (12:45 +0100)] 
nss-systemd: initialize logging

4 years agonss-resolve: initialize logging, log json errors
Zbigniew Jędrzejewski-Szmek [Thu, 10 Dec 2020 11:32:12 +0000 (12:32 +0100)] 
nss-resolve: initialize logging, log json errors

When the .so module is loaded, it gets a separate copy of stuff in src/basic,
including the log level variables. So any logging settings are unaffected by
the loading program calling log_parse_environment() or such. Let's also parse
the environment here so that we can have nice logging.

Initialization is done from each exported function, and pthread_once_t is used
to avoid duplicate initialization. I didn't merge PROTECT_ERRNO into
NSS_ENTRYPOINT_BEGIN because UNPROTECT_ERRNO is called in a bunch of places
and it would feel strange to have PROTECT_ERRNO hidden, but not UNPROTECT_ERRNO.

The most interesting stuff in this module is the varlink messages, and any
potential errors in json. So let's enable json logging when debug messages are
enabled.

With those changes, figuring out the issue in
https://github.com/systemd/systemd/pull/17823 is trivial:

$ LD_LIBRARY_PATH=build/ SYSTEMD_LOG_COLOR=1 SYSTEMD_LOG_LOCATION=1 SYSTEMD_LOG_LEVEL=debug getent hosts mirrors.fedoraproject.org
src/shared/varlink.c:237: n/a: varlink: setting state idle-client
src/shared/varlink.c:1240: n/a: Sending message: {"method":"io.systemd.Resolve.ResolveHostname","parameters":{"name":"mirrors.fedoraproject.org","family":10}}
src/shared/varlink.c:240: n/a: varlink: changing state idle-client → calling
src/shared/varlink.c:588: n/a: New incoming message: {"parameters":{"addresses":[{"ifindex":0,"family":10,"address":[42,5,208,20,0,16,120,3,247,116,77,124,226,119,164,87]},{"ifindex":0,"family":10,"address":[42,5,208,28,12,106,204,3,38,58,132,9,185,97,126,2]},{"ifindex":0,"family":10,"address":[38,32,0,82,0,3,0,1,222,173,190,239,202,254,254,215]},{"ifindex":0,"family":10,"address":[38,5,188,128,48,16,6,0,222,173,190,239,202,254,254,217]},{"ifindex":0,"family":10,"address":[38,4,21,128,254,0,0,0,222,173,190,239,202,254,254,209]},{"ifindex":0,"family":10,"address":[38,32,0,82,0,3,0,1,222,173,190,239,202,254,254,214]},{"ifindex":0,"family":10,"address":[38,16,0,40,48,144,48,1,222,173,190,239,202,254,254,211]},{"ifindex":0,"family":10,"address":[32,1,65,120,0,2,18,105,0,0,0,0,0,0,254,210]}],"name":"wildcard.fedoraproject.org","flags":1}}
src/shared/varlink.c:240: n/a: varlink: changing state calling → called
src/shared/varlink.c:240: n/a: varlink: changing state called → idle-client
src/nss-resolve/nss-resolve.c:84: (string):1:40: JSON field 'ifindex' is out of bounds for an interface index.

4 years agocryptsetup: Fix crypto device missing issue after bootup
Jinyuan Si [Fri, 4 Dec 2020 02:38:28 +0000 (10:38 +0800)] 
cryptsetup: Fix crypto device missing issue after bootup

Normally, the udev rules operate on "change" events. But when
coldplugging, there's an "add" event present. The udev rules have to
recognize this and do some actions in this particular situation, too.
Also, we don't want the nodes to be created prematurely on "add"
events while not coldplugging. The udev rules will check
DM_UDEV_PRIMARY_SOURCE_FLAG to see if the device was activated
correctly before and if not, it ignore the "add" event totally.
This way the udev rules can support udev triggers generating "add"
events (e.g. "udevadm trigger --action=add" or
"echo add > /sys/block/<dm_device>/uevent").

In this case, the udevd service is started after
systemd-cryptsetup@config.service, is started, which will cause udevd
service to miss the "change" uevent with DM_UDEV_PRIMARY_SOURCE_FLAG
flag generated by systemd-cryptsetup@config.service. To solve this
issue, we let the cryptsetup service be started after the udevd
service.

4 years agoMerge pull request #17903 from yuwata/udev-options-log-level
Lennart Poettering [Thu, 10 Dec 2020 19:45:32 +0000 (20:45 +0100)] 
Merge pull request #17903 from yuwata/udev-options-log-level

udev: introduce OPTIONS="log_level=xxx" rule

4 years agoDrop compat "gateway" name
Zbigniew Jędrzejewski-Szmek [Thu, 10 Dec 2020 10:10:54 +0000 (11:10 +0100)] 
Drop compat "gateway" name

Back in 5248e7e1f11aba6859de0b28f0dd3778b22842f2 (July 2017) we moved over to
"_gateway", with the old name declared to be temporary measure. Since we're
doing a bunch of changes to resolved now, it seems to be a good moment to make
this simplification and not add support for the compat name in new code.

4 years agoveritysetup: also place udev socket dep
Lennart Poettering [Thu, 10 Dec 2020 10:48:37 +0000 (11:48 +0100)] 
veritysetup: also place udev socket dep

In light of #17848, also place udev socket dep in veritysetup, it's the
same issue after all.

4 years agoseccomp: don't install filters for archs that can't use syscalls
Greg Depoire--Ferrer [Wed, 28 Oct 2020 23:51:30 +0000 (00:51 +0100)] 
seccomp: don't install filters for archs that can't use syscalls

When seccomp_restrict_archs is called, architectures that are blocked
are replaced by the SECCOMP_LOCAL_ARCH_BLOCKED marker so that they are
not disabled again and filters are not installed for them.

This can make some service that use SystemCallArchitecture= and
SystemCallFilter= start faster.

4 years agommap-cache: bind prot(ection) to MMapFileDescriptor
Vito Caputo [Thu, 3 Dec 2020 06:11:23 +0000 (22:11 -0800)] 
mmap-cache: bind prot(ection) to MMapFileDescriptor

There are no mmap_cache_get() users that actually deviate prot
from the JournalFile's f->prot.

So there's no point in making this a separate parameter to
mmap_cache_get(), nor is there any need to store it in
JournalFile's f->prot.

Instead just pass it to mmap_cache_add_fd() at MMapFileDescriptor
creation, storing it in there for the mmap() callers, which
already receive MMapFileDescriptor *.

For functions receiving both an MMapFileDescriptor * and prot,
the prot argument has been simply removed and call sites updated.

Formalizing this fd:prot binding at the public API also enables
discarding the prot check in window_matches(), which is a hot
function on long window lists, so a minor CPU efficiency gain
should be had there as seen with the past removal of the fd
check.  Unnoticable for uncached journals, but maybe a little
runtime improvement when cached in specific circumstances.

window_matches_fd() has also been simplified to treat the
MMapFileDescrptor * as equivalent to its fd and prot.

4 years agothree spdx header fixes
Lennart Poettering [Thu, 10 Dec 2020 10:38:43 +0000 (11:38 +0100)] 
three spdx header fixes

4 years agobasic/static-destruct: fix grammar in comment
Zbigniew Jędrzejewski-Szmek [Thu, 10 Dec 2020 11:17:14 +0000 (12:17 +0100)] 
basic/static-destruct: fix grammar in comment

4 years agojson: log location also when there is no file
Zbigniew Jędrzejewski-Szmek [Thu, 10 Dec 2020 10:56:05 +0000 (11:56 +0100)] 
json: log location also when there is no file

E.g. in nss-resolve it is still useful to print the location of the error:
src/test/test-nss.c:231: dlsym(0x0x1dc6fb0, _nss_resolve_gethostbyname2_r) → 0x0x7fdbfc53f626
(string):1:40: JSON field ifindex is out of bounds for an interface index.

I opted to use a partially duplicated if condition to avoid nesting. It's nice
to have the log calls vertically aligned. The compiler will optimize this nicely.

4 years agoMerge pull request #17851 from yuwata/network-address-compare-func
Lennart Poettering [Thu, 10 Dec 2020 09:43:47 +0000 (10:43 +0100)] 
Merge pull request #17851 from yuwata/network-address-compare-func

network: revert previous changes to address_compare_func()

4 years agommap-cache: separate context and window list cache hit accounting
Vito Caputo [Sun, 6 Dec 2020 08:16:17 +0000 (00:16 -0800)] 
mmap-cache: separate context and window list cache hit accounting

Account and log these statistics separately since their overheads
are potentially quite different when the window lists are large.

There should probably be a histogram of window list traversal
counts too.

4 years agonetworkd-test: add final newlines in generated files, use .format()
Zbigniew Jędrzejewski-Szmek [Wed, 9 Dec 2020 09:35:10 +0000 (10:35 +0100)] 
networkd-test: add final newlines in generated files, use .format()

4 years agoudev: Fix sound.target dependency
Takashi Iwai [Wed, 9 Dec 2020 09:56:51 +0000 (10:56 +0100)] 
udev: Fix sound.target dependency

The recent bug report indicated a race at device creation and the
sound.target dependencies, and the cause turned out to be the condition
of the sound.target trigger.  Currently it's set for "card*", but this
is actually the parent object; i.e. the sound.target is triggered before
the sound devices are created.

For assuring the whole sound device creations beforehand, we need to use
"controlC*" instead of "card*"; as already described in
78-sound-card.rules, this is guaranteed to be the last device, and can
be used as a synchronization point.

BugLink: https://bugzilla.suse.com/show_bug.cgi?id=1179363
Signed-off-by: Takashi Iwai <tiwai@suse.de>
4 years agoMerge pull request #17877 from yuwata/missing-syscall-sort
Yu Watanabe [Thu, 10 Dec 2020 03:42:35 +0000 (12:42 +0900)] 
Merge pull request #17877 from yuwata/missing-syscall-sort

missing: sort architectures in missing_syscall.h

4 years agoman: mention new OPTIONS=log_level= udev rule 17903/head
Yu Watanabe [Tue, 8 Dec 2020 14:11:03 +0000 (23:11 +0900)] 
man: mention new OPTIONS=log_level= udev rule

4 years agoudev: introduce new OPTIONS="log_level=" udev rule
Yu Watanabe [Tue, 8 Dec 2020 13:37:12 +0000 (22:37 +0900)] 
udev: introduce new OPTIONS="log_level=" udev rule

4 years agoudev: introduce log_device_uevent() helper function
Yu Watanabe [Tue, 8 Dec 2020 13:36:42 +0000 (22:36 +0900)] 
udev: introduce log_device_uevent() helper function

And this drops duplicated check for seqnum and device action.

4 years agoudev: drop meaningless size optimization
Yu Watanabe [Tue, 8 Dec 2020 12:49:34 +0000 (21:49 +0900)] 
udev: drop meaningless size optimization

These objects are not allocated multiple times simultaneously per
single process.

4 years agoMerge pull request #17869 from DaanDeMeyer/mkosi-gdb
Lennart Poettering [Wed, 9 Dec 2020 20:09:59 +0000 (21:09 +0100)] 
Merge pull request #17869 from DaanDeMeyer/mkosi-gdb

mkosi: Add gdb to final images

4 years agoMerge pull request #17884 from poettering/test-dlopen
Lennart Poettering [Wed, 9 Dec 2020 20:09:33 +0000 (21:09 +0100)] 
Merge pull request #17884 from poettering/test-dlopen

tests: add test that dlopen()s our weak shared library deps once

4 years agoudev: link_update() should fail if the entry in symlink dir couldn't have been created
Franck Bui [Wed, 9 Dec 2020 08:46:08 +0000 (09:46 +0100)] 
udev: link_update() should fail if the entry in symlink dir couldn't have been created

Follow-up for 30f6dce62cb3a738b20253f2192270607c31b55b

4 years agovirt: drop /proc/1/sched hack
Lennart Poettering [Wed, 9 Dec 2020 15:16:21 +0000 (16:16 +0100)] 
virt: drop /proc/1/sched hack

On really old kernels (< 4.14+) a bug in /proc/1/sched handling in the
kernel could be used to determine whether we are running in a PID
namespace. This hasn't worked for a long time, and there's little point
in making things work on old kernels we can't make work on current
kernels, hence let's drop that old cruft.

See: #8153

4 years agomkosi: Add strace to final images 17869/head
Daan De Meyer [Wed, 9 Dec 2020 17:28:51 +0000 (17:28 +0000)] 
mkosi: Add strace to final images

Useful for debugging purposes.

4 years agomkosi: Add gdb to final images
Daan De Meyer [Sun, 6 Dec 2020 11:42:45 +0000 (11:42 +0000)] 
mkosi: Add gdb to final images

Let's add a debugger to the mkosi images so we can debug coredumps
from inside mkosi qemu VMs (and hopefully in the future from
mkosi systemd-nspawn containers as well).

4 years agolog: add helper set sets log level in all realms
Lennart Poettering [Wed, 9 Dec 2020 10:12:33 +0000 (11:12 +0100)] 
log: add helper set sets log level in all realms

Prompted-by: #17903
4 years agoman: document that automount units are privileged
Lennart Poettering [Wed, 9 Dec 2020 13:04:21 +0000 (14:04 +0100)] 
man: document that automount units are privileged

Fixes: #17886
4 years agoMerge pull request #17911 from yuwata/log-cli-program-use-journal
Luca Boccassi [Wed, 9 Dec 2020 14:30:32 +0000 (14:30 +0000)] 
Merge pull request #17911 from yuwata/log-cli-program-use-journal

log: open journal when cli program run in a service unit

4 years agoMerge pull request #17882 from poettering/logind-async-close
Luca Boccassi [Wed, 9 Dec 2020 14:27:03 +0000 (14:27 +0000)] 
Merge pull request #17882 from poettering/logind-async-close

logind: fix closing of button input devices

4 years agoSilence cgroups v1 read-only filesystem warning
Daan De Meyer [Mon, 7 Dec 2020 22:18:28 +0000 (22:18 +0000)] 
Silence cgroups v1 read-only filesystem warning

Avoid warning messages when booting systemd-nspawn containers and using
hybrid or legacy cgroups. systemd-nspawn mounts the cgroups v1 controller
tree as read-only so these errors are expected and not problematic.
Partially fixes #17862.

Test plan:

- Before: `mkosi --default .mkosi/mkosi.fedora boot`

```
‣ Processing default...
Spawning container image on /home/daan/projects/systemd/image.raw.
Press ^] three times within 1s to kill container.
systemd 247 running in system mode. (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
Detected virtualization systemd-nspawn.
Detected architecture x86-64.

Welcome to Fedora 33 (Thirty Three)!

Queued start job for default target Graphical Interface.
-.slice: Failed to migrate controller cgroups from , ignoring: Read-only file system
system.slice: Failed to delete controller cgroups /system.slice, ignoring: Read-only file system
[  OK  ] Created slice system-getty.slice.
[  OK  ] Created slice system-modprobe.slice.
user.slice: Failed to delete controller cgroups /user.slice, ignoring: Read-only file system
[  OK  ] Created slice User and Session Slice.
[  OK  ] Started Dispatch Password Requests to Console Directory Watch.
[  OK  ] Started Forward Password Requests to Wall Directory Watch.
[  OK  ] Reached target Local Encrypted Volumes.
[  OK  ] Reached target Paths.
[  OK  ] Reached target Remote File Systems.
[  OK  ] Reached target Slices.
[  OK  ] Reached target Swap.
[  OK  ] Listening on Process Core Dump Socket.
[  OK  ] Listening on initctl Compatibility Named Pipe.
[  OK  ] Listening on Journal Socket (/dev/log).
[  OK  ] Listening on Journal Socket.
[  OK  ] Listening on User Database Manager Socket.
dev-hugepages.mount: Failed to delete controller cgroups /dev-hugepages.mount, ignoring: Read-only file system
         Mounting Huge Pages File System...
sys-fs-fuse-connections.mount: Failed to delete controller cgroups /sys-fs-fuse-connections.mount, ignoring: Read-only file system
         Mounting FUSE Control File System...
         Starting Journal Service...
         Starting Remount Root and Kernel File Systems...
system.slice: Failed to delete controller cgroups /system.slice, ignoring: Read-only file system
```

After: `mkosi --default .mkosi/mkosi.fedora boot`

```
‣ Processing default...
Spawning container image on /home/daan/projects/systemd/mkosi.output/image.raw.
Press ^] three times within 1s to kill container.
systemd 247 running in system mode. (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
Detected virtualization systemd-nspawn.
Detected architecture x86-64.

Welcome to Fedora 33 (Thirty Three)!

Queued start job for default target Graphical Interface.
[  OK  ] Created slice system-getty.slice.
[  OK  ] Created slice system-modprobe.slice.
[  OK  ] Created slice User and Session Slice.
[  OK  ] Started Dispatch Password Requests to Console Directory Watch.
[  OK  ] Started Forward Password Requests to Wall Directory Watch.
[  OK  ] Reached target Local Encrypted Volumes.
[  OK  ] Reached target Paths.
[  OK  ] Reached target Remote File Systems.
[  OK  ] Reached target Slices.
[  OK  ] Reached target Swap.
[  OK  ] Listening on Process Core Dump Socket.
[  OK  ] Listening on initctl Compatibility Named Pipe.
[  OK  ] Listening on Journal Socket (/dev/log).
[  OK  ] Listening on Journal Socket.
[  OK  ] Listening on User Database Manager Socket.
         Mounting Huge Pages File System...
         Mounting FUSE Control File System...
         Starting Journal Service...
         Starting Remount Root and Kernel File Systems...
[  OK  ] Mounted Huge Pages File System.
[  OK  ] Mounted FUSE Control File System.
[  OK  ] Finished Remount Root and Kernel File Systems.
         Starting Create Static Device Nodes in /dev...
[  OK  ] Finished Create Static Device Nodes in /dev.
[  OK  ] Reached target Local File Systems (Pre).
[  OK  ] Reached target Local File Systems.
         Starting Restore /run/initramfs on shutdown...
[  OK  ] Finished Restore /run/initramfs on shutdown.
[  OK  ] Started Journal Service.
         Starting Flush Journal to Persistent Storage...
[  OK  ] Finished Flush Journal to Persistent Storage.
         Starting Create Volatile Files and Directories...
[  OK  ] Finished Create Volatile Files and Directories.
         Starting Network Name Resolution...
         Starting Update UTMP about System Boot/Shutdown...
[  OK  ] Finished Update UTMP about System Boot/Shutdown.
[  OK  ] Reached target System Initialization.
[  OK  ] Started Daily Cleanup of Temporary Directories.
[  OK  ] Reached target Timers.
[  OK  ] Listening on D-Bus System Message Bus Socket.
[  OK  ] Reached target Sockets.
[  OK  ] Reached target Basic System.
         Starting Home Area Manager...
         Starting User Login Management...
         Starting Permit User Sessions...
[  OK  ] Finished Permit User Sessions.
[  OK  ] Started Console Getty.
[  OK  ] Reached target Login Prompts.
         Starting D-Bus System Message Bus...
[  OK  ] Started D-Bus System Message Bus.
[  OK  ] Started Home Area Manager.
[  OK  ] Started User Login Management.
[  OK  ] Reached target Multi-User System.
[  OK  ] Reached target Graphical Interface.
         Starting Update UTMP about System Runlevel Changes...
[  OK  ] Finished Update UTMP about System Runlevel Changes.
[  OK  ] Started Network Name Resolution.
[  OK  ] Reached target Host and Network Name Lookups.

Fedora 33 (Thirty Three) (built from systemd tree)
Kernel 5.9.11-arch2-1 on an x86_64 (console)
```

4 years agomeson: specify correct libqrencode version in meson dep 17884/head
Luca Boccassi [Wed, 9 Dec 2020 12:33:54 +0000 (13:33 +0100)] 
meson: specify correct libqrencode version in meson dep

4 years agotest: pull in weak deps into tests
Luca Boccassi [Wed, 9 Dec 2020 09:15:36 +0000 (10:15 +0100)] 
test: pull in weak deps into tests

(Pulled from @bluca's comment here:
https://github.com/systemd/systemd/pull/17884#issuecomment-740005624 and
turned into a commit by @poettering)

4 years agotest: add test that dlopen()'s all our weak library deps once
Lennart Poettering [Mon, 7 Dec 2020 13:15:36 +0000 (14:15 +0100)] 
test: add test that dlopen()'s all our weak library deps once

This test should ensure we notice if distros update shared libraries
that broke so name, and we still use the old soname.

(In contrast to what the commit summary says, this currently doesn#t
cover really all such deps, specifically xkbcommon and PCRE are missing,
since they currently aren't loaded from src/shared/. This is stuff to
fix later)

4 years agoqrcode-util: make dlopen() logic more like the other cases
Lennart Poettering [Mon, 7 Dec 2020 13:09:37 +0000 (14:09 +0100)] 
qrcode-util: make dlopen() logic more like the other cases

Let's add a dlopen_qrencode() function that does the actual dlopen()
stuff and caches the result.

This is useful so that we later can automatically test for all dlopen
hookups to work correctly.

4 years agomanager: Fix HW watchdog when systemd starts before driver loaded
Michael Marley [Tue, 8 Dec 2020 02:27:38 +0000 (21:27 -0500)] 
manager: Fix HW watchdog when systemd starts before driver loaded

When manager_{set|override}_watchdog is called, set the watchdog timeout
regardless of whether the hardware watchdog was successfully initialized.  If
the watchdog was requested but could not be initialized, then instead of
pinging it, attempt to initialize it again.  This ensures that the hardware
watchdog is initialized even if the kernel module for it isn't loaded when
systemd starts (which is quite likely, unless it is compiled in).

This builds on work by @danc86 in https://github.com/systemd/systemd/pull/17460,
but fixes the issue of not updating the watchdog timeout with the actual value
from the hardware.

Fixes https://github.com/systemd/systemd/issues/17838

Co-authored-by: Dan Callaghan <djc@djc.id.au>
Co-authored-by: Michael Marley <michael@michaelmarley.com>
4 years agologind: use free_and_strdup() where appropriate 17882/head
Lennart Poettering [Wed, 9 Dec 2020 09:07:37 +0000 (10:07 +0100)] 
logind: use free_and_strdup() where appropriate

4 years agologind: fix closing of button input devices
Lennart Poettering [Mon, 7 Dec 2020 09:51:15 +0000 (10:51 +0100)] 
logind: fix closing of button input devices

This is a fix of #17751. Specifically:

1. Sort #include headers again

2. Remove tabs, as per coding style

3. Don't install fds in half-initialized objects

4. Use asynchronous_close() everywhere

That all said:

Quit frankly, I am not convinced we should do all this at all. If
close()ing of these input devices is really that slow, then this should
probably be fixed in the kernel, not worked around in userspace like
this.

4 years agoasync: add trivial cleanup wrapper for asynchronous_close()
Lennart Poettering [Wed, 9 Dec 2020 09:07:12 +0000 (10:07 +0100)] 
async: add trivial cleanup wrapper for asynchronous_close()

4 years agolog: open journal when cli program run in a service unit 17911/head
Yu Watanabe [Tue, 8 Dec 2020 16:49:13 +0000 (01:49 +0900)] 
log: open journal when cli program run in a service unit

Previously, cli programs like networkctl always use console for logging.

4 years agolog: make show_color variable tristate
Yu Watanabe [Tue, 8 Dec 2020 16:44:36 +0000 (01:44 +0900)] 
log: make show_color variable tristate

Should not change any behavior.

4 years agolog: merge conditions to reduce indentation
Yu Watanabe [Tue, 8 Dec 2020 16:21:31 +0000 (01:21 +0900)] 
log: merge conditions to reduce indentation

4 years agounit: make systemd-networkd.service support reload command 17906/head
Yu Watanabe [Tue, 8 Dec 2020 15:21:58 +0000 (00:21 +0900)] 
unit: make systemd-networkd.service support reload command

4 years agomount-util: fix typo
Yu Watanabe [Tue, 8 Dec 2020 18:04:43 +0000 (03:04 +0900)] 
mount-util: fix typo

4 years agocgroup: Also set blkio.bfq.weight
Pavel Hrdina [Wed, 25 Nov 2020 08:05:36 +0000 (09:05 +0100)] 
cgroup: Also set blkio.bfq.weight

Commit [1] added a workaround when unified cgroups are used but missed
legacy cgroups where there is the same issue.

[1] <https://github.com/systemd/systemd/commit/2dbc45aea747f25cc1c3848fded2ec0062f96bcf>

Signed-off-by: Pavel Hrdina <phrdina@redhat.com>
4 years agoMerge pull request #17871 from yuwata/sd-device-issue-17772
Zbigniew Jędrzejewski-Szmek [Tue, 8 Dec 2020 09:14:43 +0000 (10:14 +0100)] 
Merge pull request #17871 from yuwata/sd-device-issue-17772

sd-device: keep escaped strings in DEVLINK= property

4 years agomkosi: Enable --qemu-headless option for all distros
Daan De Meyer [Mon, 7 Dec 2020 23:00:37 +0000 (23:00 +0000)] 
mkosi: Enable --qemu-headless option for all distros

--qemu-headless configures the generated image and mkosi's qemu
command to connect to the VM via the serial port. This allows
spawning a qemu VM within the user's terminal instead of spawning
a graphical GTK GUI. --qemu-headless sets TERM, COLUMNS and LINES
in serial-getty@ttyS0.service in the container which makes the
terminal in the VM behave almost equivalent to the one on the host.

This change makes testing changes to systemd using mkosi + QEMU a
lot easier compared to before as commands can be executed in the VM
from the comfort of one's terminal compared to the Linux console
available when running via the GTK GUI.

4 years agohwdb: add funcional keys for MSI Modern series (tested on Modern 14) (#17880)
l4gfcm [Tue, 8 Dec 2020 08:57:17 +0000 (10:57 +0200)] 
hwdb: add funcional keys for MSI Modern series (tested on Modern 14) (#17880)

4 years agoman: synthetize(d) -> synthesize(d)
Yu Watanabe [Tue, 8 Dec 2020 00:26:00 +0000 (09:26 +0900)] 
man: synthetize(d) -> synthesize(d)

4 years agomissing: update warning messages 17877/head
Yu Watanabe [Tue, 8 Dec 2020 06:35:57 +0000 (15:35 +0900)] 
missing: update warning messages

4 years agomissing: add missing syscalls for ia64, m68k, sparc, arc, and tilegx
Yu Watanabe [Tue, 8 Dec 2020 05:59:45 +0000 (14:59 +0900)] 
missing: add missing syscalls for ia64, m68k, sparc, arc, and tilegx

These are not tested, but several syscalls are defined for these
architectures. Let's add syscalls comprehensively.

4 years agomissing: drop redundant condition
Yu Watanabe [Tue, 8 Dec 2020 05:54:20 +0000 (14:54 +0900)] 
missing: drop redundant condition

4 years agomissing: support 32bit powerpc
Yu Watanabe [Tue, 8 Dec 2020 05:51:58 +0000 (14:51 +0900)] 
missing: support 32bit powerpc

4 years agomissing: sort architectures in missing_syscall.h
Yu Watanabe [Mon, 7 Dec 2020 04:32:04 +0000 (13:32 +0900)] 
missing: sort architectures in missing_syscall.h

4 years agonetwork: warn when NDISC and DHCPv6 provide the same address 17851/head
Yu Watanabe [Tue, 8 Dec 2020 04:35:48 +0000 (13:35 +0900)] 
network: warn when NDISC and DHCPv6 provide the same address

With some router, the address in NDISC generated with EUI-64 conflicts
with an address provided by DHCPv6.

Prompted by #17831.

4 years agonetwork: fix SIGABRT related to unreachable route with DHCP6
Yu Watanabe [Fri, 4 Dec 2020 11:50:34 +0000 (20:50 +0900)] 
network: fix SIGABRT related to unreachable route with DHCP6

After #17834, unreachable routes generated through DHCP6 are managed by
Manager. But they are referrenced by the DHCP6 uplink. So, the routes
managed by Manager must be freed after all Link objects are freed.

Follow-up for 575f14eef010101c60e9d4d970e542c815be1994.

Fixes SIGABRT reproted in #17831.

4 years agonetwork: use address_get() in address_exists()
Yu Watanabe [Fri, 4 Dec 2020 08:29:16 +0000 (17:29 +0900)] 
network: use address_get() in address_exists()

And rename address_exists() to link_has_ipv6_address().

4 years agonetwork: revert previous changes to address_compare_func()
Yu Watanabe [Fri, 4 Dec 2020 07:41:08 +0000 (16:41 +0900)] 
network: revert previous changes to address_compare_func()

This partially reverts fe841414ef157f7f01d339c5d5730126e7b5fe0a and
2a236f9fc0ff8fb2152032551436fde74da7217a.

For IPv4, kernel compares the local address, prefix, and prefixlen.
For IPv6, kernel compares only the local address.
Let's follow the kernel's comparison way.

Fixes #17831.