]> git.ipfire.org Git - thirdparty/systemd.git/blob - TODO
TODO: update
[thirdparty/systemd.git] / TODO
1 Bugfixes:
2
3 * Many manager configuration settings that are only applicable to user
4 manager or system manager can be always set. It would be better to reject
5 them when parsing config.
6
7 * busctl --user call org.freedesktop.systemd1 /org/freedesktop/systemd1 org.freedesktop.systemd1.Manager GetUnitProcesses "s" run-rbff1b85427b34ba3adf864281aeda8e7.service
8 Failed to set address: No such file or directory
9
10 → improve error message
11
12 External:
13
14 * Fedora: add an rpmlint check that verifies that all unit files in the RPM are listed in %systemd_post macros.
15
16 * wiki: update journal format documentation for lz4 additions
17
18 Janitorial Clean-ups:
19
20 * Rearrange tests so that the various test-xyz.c match a specific src/basic/xyz.c again
21
22 * rework mount.c and swap.c to follow proper state enumeration/deserialization
23 semantics, like we do for device.c now
24
25 Features:
26
27 * when killing due to service watchdog timeout maybe detect whether target
28 process is under ptracing and then log loudly and continue instead.
29
30 * tweak journald context caching. In addition to caching per-process attributes
31 keyed by PID, cache per-cgroup attributes (i.e. the various xattrs we read)
32 keyed by cgroup path, and guarded by ctime changes. This should provide us
33 with a nice speed-up on services that have many processes running in the same
34 cgroup.
35
36 * clean up sleep.c:
37 - Use CLOCK_BOOTTIME_ALARM for waking up s2h instead of RTC ioctls
38 - Parse sleep.conf only once, and parse its whole contents so that we don't
39 have to parse it again and again in s2h
40 - Make sure resume= and resume_offset= on the kernel cmdline always take
41 precedence
42
43 * make MAINPID= message reception checks even stricter: if service uses User=,
44 then check sending UID and ignore message if it doesn't match the user or
45 root.
46
47 * maybe trigger a uevent "change" on a device if "systemctl reload xyz.device"
48 is issued.
49
50 * when importing an fs tree with machined, optionally apply userns-rec-chown
51
52 * when importing an fs tree with machined, complain if image is not an OS
53
54 * Maybe introduce a helper safe_exec() or so, which is to execve() which
55 safe_fork() is to fork(). And then make revert the RLIMIT_NOFILE soft limit
56 to 1K implicitly, unless explicitly opted-out.
57
58 * rework seccomp/nnp logic that that even if User= is used in combination with
59 a seccomp option we don't have to set NNP. For that, change uid first whil
60 keeping CAP_SYS_ADMIN, then apply seccomp, the drop cap.
61
62 * add a concept for automatically loading per-unit secrets off disk and
63 inserting them into the kernel keyring. Maybe SecretsDirectory= similar to
64 ConfigurationDirectory=.
65
66 * when no locale is configured, default to UEFI's PlatformLang variable
67
68 * When logind.conf contains HandleLidSwitch=suspend-then-hibernate and we can't
69 hibernate because the swap partition isn't large enough, still suspend
70
71 * bootctl,sd-boot: actually honour the "architecture" key
72
73 * add a new syscall group "@esoteric" for more esoteric stuff such as bpf() and
74 usefaultd() and make systemd-analyze check for it.
75
76 * paranoia: whenever we process passwords, call mlock() on the memory
77 first. i.e. look for all places we use string_erase()/string_free_erase() and
78 augment them with mlock(). Also use MADV_DONTDUMP
79
80 * Move RestrictAddressFamily= to the new cgroup create socket
81
82 * support the bind/connect/sendmsg cgroup stuff for sandboxing, and possibly
83 patching around
84
85 * maybe implicitly attach monotonic+realtime timestamps to outgoing messages in
86 log.c and sd-journal-send
87
88 * optionally: turn on cgroup delegation for per-session scope units
89
90 * introduce per-unit (i.e. per-slice, per-service) journal log size limits.
91
92 * optionally, if a per-partition GPT flag is set for the root/home/… partitions
93 format the partition on next boot and unset the flag, in order to implement
94 factory reset. also, add a second flag that simply indicates whether such a
95 scheme is supported. then, add a tool (or maybe beef up systemd-dissect) to
96 show state of these flags, and optionally trigger such a factory reset on
97 next boot by setting the flag.
98
99 * sd-boot: automatically load EFI modules from some drop-in dir, so that people
100 can add in file system drivers and such
101
102 * sd-boot: optionally, show boot menu when previous default boot item has
103 non-zero "tries done" count
104
105 * maybe set a special xattr on cgroups that have delegate=yes set, to make it
106 easy to mark cut points
107
108 * introduce an option (or replacement) for "systemctl show" that outputs all
109 properties as JSON, similar to busctl's new JSON output. In contrast to that
110 it should skip the variant type string though.
111
112 * augment CODE_FILE=, CODE_LINE= with something like CODE_BASE= or so which
113 contains some identifier for the project, which allows us to include
114 clickable links to source files generating these log messages. The identifier
115 could be some abberviated URL prefix or so (taking inspiration from Go
116 imports). For example, for systemd we could use
117 CODE_BASE=github.com/systemd/systemd/blob/98b0b1123cc or so which is
118 sufficient to build a link by prefixing "http://" and suffixing the
119 CODE_FILE.
120
121 * when outputting log data with journalctl and the log data includes references
122 to configuration files (CONFIG_FILE=), create a clickable link for it.
123
124 * Augment MESSAGE_ID with MESSAGE_BASE, in a similar fashion so that we can
125 make clickable links from log messages carrying a MESSAGE_ID, that lead to
126 some explanatory text online.
127
128 * maybe extend .path units to expose fanotify() per-mount change events
129
130 * Add a "systemctl list-units --by-slice" mode or so, which rearranges the
131 output of "systemctl list-units" slightly by showing the tree structure of
132 the slices, and the units attached to them.
133
134 * the a-posteriori stopping of units bound to units that disappeared logic
135 should be reworked: there should be a queue of units, and we should only
136 enqeue stop jobs from a defer event that processes queue instead of
137 right-away when we find a unit that is bound to one that doesn't exist
138 anymore. (similar to how the stop-unneeded queue has been reworked the same
139 way)
140
141 * nspawn: make nspawn suitable for shell pipelines: instead of triggering a
142 hangup when input is finished, send ^D, which synthesizes an EOF. Then wait
143 for hangup or ^D before passing on the EOF.
144
145 * When reloading configuration PID 1 should reset all its properties to the
146 original defaults before calling parse_config()
147
148 * nspawn: greater control over selinux label?
149
150 * hibernate/s2h: make this robust and safe to enable in Fedora by default.
151 Specifically:
152
153 1. add resume_offset support to the resume code (i.e. support swap files
154 properly)
155 2. check if swap is on weird storage and refuse if so
156 3. add autodetection of hibernation images
157
158 * cgroups: use inotify to get notified when somebody else modifies cgroups
159 owned by us, then log a friendly warning.
160
161 * beef up log.c with support for stripping ANSI sequences from strings, so that
162 it is OK to include them in log strings. This would be particularly useful so
163 that our log messages could contain clickable links for example for unit
164 files and suchlike we operate on.
165
166 * add support for "portablectl attach http://foobar.com/waaa.raw (i.e. importd integration)
167
168 * add attach --enable and attach --now (for attach+enable+start)
169
170 * sync dynamic uids/gids between host+portable srvice (i.e. if DynamicUser=1 is set for a service, make sure that the
171 selected user is resolvable in the service even if it ships its own /etc/passwd)
172
173 * Fix DECIMAL_STR_MAX or DECIMAL_STR_WIDTH. One includes a trailing NUL, the
174 other doesn't. What a disaster. Probably to exclude it. Also
175 DECIMAL_STR_WIDTH should probably add an extra "-" into account for negative
176 numbers.
177
178 * Check that users of inotify's IN_DELETE_SELF flag are using it properly, as
179 usually IN_ATTRIB is the right way to watch deleted files, as the former only
180 fires when a file is actually removed from disk, i.e. the link count drops to
181 zero and is not open anymore, while the latter happens when a file is
182 unlinked from any dir.
183
184 * port systemctl, busctl, … over to format-table.[ch]'s table formatters
185
186 * pid1: lock image configured with RootDirectory=/RootImage= using the usual nspawn semantics while the unit is up
187
188 * add --vacuum-xyz options to coredumpctl, matching those journalctl already has.
189
190 * SuccessExitStatus= and friends should probably also accept symbolic exit
191 codes names, i.e. error codes from the list maintained in exit-codes.[ch]
192
193 * introduce Ephemeral= unit file switch, that creates an ephemeral copy of all
194 files and directories that are left writable for a unit, and which are
195 removed after the unit goes down again. A bit like --ephemeral for
196 systemd-nspawn but for system services. If used together with RootImage= this
197 should reflink the image file itself.
198
199 Related: add Ephemeral=<path1> <path2> … which would allow marking
200 specific paths only like this.
201
202 * add CopyFile= or so as unit file setting that may be used to copy files or
203 directory trees from the host to the services RootImage= and RootDirectory=
204 environment. Which we can use for /etc/machine-id and in particular
205 /etc/resolv.conf. Should be smart and do something useful on read-only
206 images, for example fallback to read-only bind mounting the file instead.
207
208 * nspawn's console TTY should be allocated from within the container, not
209 mounted in from the outside
210
211 * show invocation ID in systemd-run output
212
213 * bypass SIGTERM state in unit files if KillSignal is SIGKILL
214
215 * tree-wide: ensure we always block the signals we hook into with
216 sd_event_add_signal() first
217
218 * add proper dbus APIs for the various sd_notify() commands, such as MAINPID=1
219 and so on, which would mean we could report errors and such.
220
221 * teach tmpfiles.d q/Q logic something sensible in the context of XFS/ext4
222 project quota
223
224 * introduce DefaultSlice= or so in system.conf that allows changing where we
225 place our units by default, i.e. change system.slice to something
226 else. Similar, ManagerSlice= should exist so that PID1's own scope unit could
227 be moved somewhere else too. Finally machined and logind should get similar
228 options so that it is possible to move user session scopes and machines to a
229 different slice too by default. Usecase: people who want to put resources on
230 the entire system, with the exception of one specific service. See:
231 https://lists.freedesktop.org/archives/systemd-devel/2018-February/040369.html
232
233 * maybe rework get_user_creds() to query the user database if $SHELL is used
234 for root, but only then.
235
236 * be stricter with fds we receive for the fdstore: close them asynchronously
237
238 * calenderspec: add support for week numbers and day numbers within a
239 year. This would allow us to define "bi-weekly" triggers safely.
240
241 * sd-bus: add vtable flag, that may be used to request client creds implicitly
242 and asynchronously before dispatching the operation
243
244 * make use of ethtool veth peer info in machined, for automatically finding out
245 host-side interface pointing to the container.
246
247 * add some special mode to LogsDirectory=/StateDirectory=… that allows
248 declaring these directories without necessarily pulling in deps for them, or
249 creating them when starting up. That way, we could declare that
250 systemd-journald writes to /var/log/journal, which could be useful when we
251 doing disk usage calculations and so on.
252
253 * taint systemd if there are fewer than 65536 users assigned (userns) to the system.
254
255 * deprecate RootDirectoryStartOnly= in favour of a new ExecStart= prefix char
256
257 * add a new RuntimeDirectoryPreserve= mode that defines a similar lifecycle for
258 the runtime dir as we maintain for the fdstore: i.e. keep it around as long
259 as the unit is running or has a job queued.
260
261 * support projid-based quota in machinectl for containers
262
263 * maybe use SOURCE_DATE_EPOCH (i.e. the env var the reproducible builds folks
264 introduced) as the RTC epoch, instead of the mtime of NEWS.
265
266 * add a way to lock down cgroup migration: a boolean, which when set for a unit
267 makes sure the processes in it can never migrate out of it
268
269 * blog about fd store and restartable services
270
271 * document Environment=SYSTEMD_LOG_LEVEL=debug drop-in in debugging document
272
273 * rework ExecOutput and ExecInput enums so that EXEC_OUTPUT_NULL loses its
274 magic meaning and is no longer upgraded to something else if set explicitly.
275
276 * in the long run: permit a system with /etc/machine-id linked to /dev/null, to
277 make it lose its identity, i.e. be anonymous. For this we'd have to patch
278 through the whole tree to make all code deal with the case where no machine
279 ID is available.
280
281 * optionally, collect cgroup resource data, and store it in per-unit RRD files,
282 suitable for processing with rrdtool. Add bus API to access this data, and
283 possibly implement a CPULoad property based on it.
284
285 * beef up pam_systemd to take unit file settings such as cgroups properties as
286 parameters
287
288 * maybe hook of xfs/ext4 quotactl() with services? i.e. automatically manage
289 the quota of a the user indicated in User= via unit file settings, like the
290 other resource management concepts. Would mix nicely with DynamicUser=1. Or
291 alternatively, do this with projids, so that we can also cover services
292 running as root. Quota should probably cover all the special dirs such as
293 StateDirectory=, LogsDirectory=, CacheDirectory=, as well as RootDirectory= if it
294 is set, plus the whole disk space any image configured with RootImage=.
295
296 * In DynamicUser= mode: before selecting a UID, use disk quota APIs on relevant
297 disks to see if the UID is already in use.
298
299 * add "systemctl wait" or so, which does what "systemd-run --wait" does, but
300 for all units. It should be both a way to pin units into memory as well as a
301 wait to retrieve their exit data.
302
303 * expose IO accounting data on the bus, show it in systemd-run --wait and log
304 about it in the resource log message
305
306 * add "systemctl purge" for flushing out configuration, state, logs, ... of a
307 unit when it is stopped
308
309 * show whether a service has out-of-date configuration in "systemctl status" by
310 using mtime data of ConfigurationDirectory=.
311
312 * replace all remaining uses of fgets() + LINE_MAX by read_line()
313
314 * Add AddUser= setting to unit files, similar to DynamicUser=1 which however
315 creates a static, persistent user rather than a dynamic, transient user. We
316 can leverage code from sysusers.d for this.
317
318 * add some optional flag to ReadWritePaths= and friends, that has the effect
319 that we create the dir in question when the service is started. Example:
320
321 ReadWritePaths=:/var/lib/foobar
322
323 * maybe add call sd_journal_set_block_timeout() or so to set SO_SNDTIMEO for
324 the sd-journal logging socket, and, if the timeout is set to 0, sets
325 O_NONBLOCK on it. That way people can control if and when to block for
326 logging.
327
328 * hostnamed: populate form factor data from a new hwdb database, so that old
329 yogas can be recognized as "convertible" too, even if they predate the DMI
330 "convertible" form factor
331
332 * Maybe add a small tool invoked early at boot, that adds in or resizes
333 partitions automatically, to be used when the media used is actually larger
334 than the image written onto it is.
335
336 * Maybe add PrivatePIDs= as new unit setting, and do minimal PID namespacing
337 after all. Be strict however, only support the equivalent of nspawn's
338 --as-pid2 switch, and sanely proxy sd_notify() messages dropping stuff such
339 as MAINPID.
340
341 * Add ExecMonitor= setting. May be used multiple times. Forks off a process in
342 the service cgroup, which is supposed to monitor the service, and when it
343 exits the service is considered failed by its monitor.
344
345 * track the per-service PAM process properly (i.e. as an additional control
346 process), so that it may be queried on the bus and everything.
347
348 * add a new "debug" job mode, that is propagated to unit_start() and for
349 services results in two things: we raise SIGSTOP right before invoking
350 execve() and turn off watchdog support. Then, use that to implement
351 "systemd-gdb" for attaching to the start-up of any system service in its
352 natural habitat.
353
354 * maybe introduce gpt auto discovery for /var/tmp?
355
356 * maybe add gpt-partition-based user management: each user gets his own
357 LUKS-encrypted GPT partition with a new GPT type. A small nss module
358 enumerates users via udev partition enumeration. UIDs are assigned in a fixed
359 way: the partition index is added as offset to some fixed base uid. User name
360 is stored in GPT partition name. A PAM module authenticates the user via the
361 LUKS partition password. Benefits: strong per-user security, compatibility
362 with stateless/read-only/verity-enabled root. (other idea: do this based on
363 loopback files in /home, without GPT involvement)
364
365 * gpt-auto logic: introduce support for discovering /var matching an image. For
366 that, use a partition type UUID that is hashed from the OS name (as encoded
367 in /etc/os-release), the architecture, and 4 new bits from the gpt flags
368 field of the root partition. This way can easily support multiple OS
369 installations on the same GPT partition table, without problems with
370 unmatched /var partitions.
371
372 * gpt-auto logic: related to the above, maybe support a "secondary" root
373 partition, that is mounted to / and is writable, and where the actual root's
374 /usr is mounted into.
375
376 * gpt-auto logic: support encrypted swap, add kernel cmdline option to force it, and honour a gpt bit about it, plus maybe a configuration file
377
378 * drop nss-myhostname in favour of nss-resolve?
379
380 * add a percentage syntax for TimeoutStopSec=, e.g. TimeoutStopSec=150%, and
381 then use that for the setting used in user@.service. It should be understood
382 relative to the configured default value.
383
384 * in networkd, when matching device types, fix up DEVTYPE rubbish the kernel passes to us
385
386 * enable LockMLOCK to take a percentage value relative to physical memory
387
388 * Permit masking specific netlink APIs with RestrictAddressFamily=
389
390 * nspawn: support that /proc, /sys/, /dev are pre-mounted
391
392 * define gpt header bits to select volatility mode
393
394 * ProtectKernelLogs= (drops CAP_SYSLOG, add seccomp for syslog() syscall, and DeviceAllow to /dev/kmsg) in service files
395
396 * ProtectClock= (drops CAP_SYS_TIMES, adds seecomp filters for settimeofday, adjtimex), sets DeviceAllow o /dev/rtc
397
398 * ProtectTracing= (drops CAP_SYS_PTRACE, blocks ptrace syscall, makes /sys/kernel/tracing go away)
399
400 * ProtectMount= (drop mount/umount/pivot_root from seccomp, disallow fuse via DeviceAllow, imply Mountflags=slave)
401
402 * ProtectKeyRing= to take keyring calls away
403
404 * RemoveKeyRing= to remove all keyring entries of the specified user
405
406 * ProtectReboot= that masks reboot() and kexec_load() syscalls, prohibits kill
407 on PID 1 with the relevant signals, and makes relevant files in /sys and
408 /proc (such as the sysrq stuff) unavailable
409
410 * make sure the ratelimit object can deal with USEC_INFINITY as way to turn off things
411
412 * journalctl: make sure -f ends when the container indicated by -M terminates
413
414 * mount: automatically search for "main" partition of an image has multiple
415 partitions
416
417 * expose the "privileged" flag of ExecCommand on the bus, and open it up to
418 transient units
419
420 * in nss-systemd, if we run inside of RootDirectory= with PrivateUsers= set,
421 find a way to map the User=/Group= of the service to the right name. This way
422 a user/group for a service only has to exist on the host for the right
423 mapping to work.
424
425 * add bus API for creating unit files in /etc, reusing the code for transient units
426
427 * add bus API to remove unit files from /etc
428
429 * add bus API to retrieve current unit file contents (i.e. implement "systemctl cat" on the bus only)
430
431 * rework fopen_temporary() to make use of open_tmpfile_linkable() (problem: the
432 kernel doesn't support linkat() that replaces existing files, currently)
433
434 * transient units: don't bother with actually setting unit properties, we
435 reload the unit file anyway
436
437 * journald: sigbus API via a signal-handler safe function that people may call
438 from the SIGBUS handler
439
440 * optionally, also require WATCHDOG=1 notifications during service start-up and shutdown
441
442 * delay activation of logind until somebody logs in, or when /dev/tty0 pulls it
443 in or lingering is on (so that containers don't bother with it until PAM is used). also exit-on-idle
444
445 * cache sd_event_now() result from before the first iteration...
446
447 * add systemctl stop --job-mode=triggering that follows TRIGGERED_BY deps and adds them to the same transaction
448
449 * PID1: find a way how we can reload unit file configuration for
450 specific units only, without reloading the whole of systemd
451
452 * add an explicit parser for LimitRTPRIO= that verifies
453 the specified range and generates sane error messages for incorrect
454 specifications.
455
456 * when we detect that there are waiting jobs but no running jobs, do something
457
458 * push CPUAffinity= also into the "cpuset" cgroup controller (only after the cpuset controller got ported to the unified hierarchy)
459
460 * PID 1 should send out sd_notify("WATCHDOG=1") messages (for usage in the --user mode, and when run via nspawn)
461
462 * there's probably something wrong with having user mounts below /sys,
463 as we have for debugfs. for example, src/core/mount.c handles mounts
464 prefixed with /sys generally special.
465 http://lists.freedesktop.org/archives/systemd-devel/2015-June/032962.html
466
467 * fstab-generator: default to tmpfs-as-root if only usr= is specified on the kernel cmdline
468
469 * docs: bring http://www.freedesktop.org/wiki/Software/systemd/MyServiceCantGetRealtime up to date
470
471 * add a job mode that will fail if a transaction would mean stopping
472 running units. Use this in timedated to manage the NTP service
473 state.
474 http://lists.freedesktop.org/archives/systemd-devel/2015-April/030229.html
475
476 * The udev blkid built-in should expose a property that reflects
477 whether media was sensed in USB CF/SD card readers. This should then
478 be used to control SYSTEMD_READY=1/0 so that USB card readers aren't
479 picked up by systemd unless they contain a medium. This would mirror
480 the behaviour we already have for CD drives.
481
482 * networkd/udev: implement SR_IOV configuration in .link files:
483 http://lists.freedesktop.org/archives/systemd-devel/2015-January/027451.html
484
485 * hostnamectl: show root image uuid
486
487 * Find a solution for SMACK capabilities stuff:
488 http://lists.freedesktop.org/archives/systemd-devel/2014-December/026188.html
489
490 * "systemctl preset-all" should probably order the unit files it
491 operates on lexicographically before starting to work, in order to
492 ensure deterministic behaviour if two unit files conflict (like DMs
493 do, for example)
494
495 * synchronize console access with BSD locks:
496 http://lists.freedesktop.org/archives/systemd-devel/2014-October/024582.html
497
498 * as soon as we have sender timestamps, revisit coalescing multiple parallel daemon reloads:
499 http://lists.freedesktop.org/archives/systemd-devel/2014-December/025862.html
500
501 * in systemctl list-unit-files: show the install value the presets would suggest for a service in a third column
502
503 * figure out when we can use the coarse timers
504
505 * add "systemctl start -v foobar.service" that shows logs of a service
506 while the start command runs. This is non-trivial to do without
507 races though, since we should flush out all journal messages before
508 returning from the "systemctl stop".
509
510 * firstboot: make it useful to be run immediately after yum --installroot to set up a machine. (most specifically, make --copy-root-password work even if /etc/passwd already exists
511
512 * maybe add support for specifier expansion in user.conf, specifically DefaultEnvironment=
513
514 * consider showing the unit names during boot up in the status output, not just the unit descriptions
515
516 * maybe allow timer units with an empty Units= setting, so that they
517 can be used for resuming the system but nothing else.
518
519 * what to do about udev db binary stability for apps? (raw access is not an option)
520
521 * man: maybe use the word "inspect" rather than "introspect"?
522
523 * systemctl: if some operation fails, show log output?
524
525 * systemctl edit: use equivalent of cat() to insert existing config as a comment, prepended with #.
526 Upon editor exit, lines with one # are removed, lines with two # are left with one #, etc.
527
528 * exponential backoff in timesyncd when we cannot reach a server
529
530 * timesyncd: add ugly bus calls to set NTP servers per-interface, for usage by NM
531
532 * merge ~/.local/share and ~/.local/lib into one similar /usr/lib and /usr/share....
533
534 * systemd.show_status= should probably have a mode where only failed
535 units are shown.
536
537 * add systemd.abort_on_kill or some other such flag to send SIGABRT instead of SIGKILL
538 (throughout the codebase, not only PID1)
539
540 * resolved:
541 - mDNS/DNS-SD
542 - service registration
543 - service/domain/types browsing
544 - avahi compat
545 - DNS-SD service registration from socket units
546 - resolved should optionally register additional per-interface LLMNR
547 names, so that for the container case we can establish the same name
548 (maybe "host") for referencing the server, everywhere.
549 - allow clients to request DNSSEC for a single lookup even if DNSSEC is off (?)
550 - hook up resolved with machined-based address resolution
551
552 * refcounting in sd-resolve is borked
553
554 * Add a new verb "systemctl top"
555
556 * add new gpt type for btrfs volumes
557
558 * support empty /etc boots nicely:
559 - nspawn/gpt-generator: introduce new gpt partition type for /usr
560
561 * generator that automatically discovers btrfs subvolumes, identifies their purpose based on some xattr on them.
562
563 * a way for container managers to turn off getty starting via $container_headless= or so...
564
565 * figure out a nice way how we can let the admin know what child/sibling unit causes cgroup membership for a specific unit
566
567 * For timer units: add some mechanisms so that timer units that trigger immediately on boot do not have the services
568 they run added to the initial transaction and thus confuse Type=idle.
569
570 * add bus api to query unit file's X fields.
571
572 * gpt-auto-generator:
573 - Define new partition type for encrypted swap? Support probed LUKS for encrypted swap?
574 - Make /home automount rather than mount?
575
576 * add generator that pulls in systemd-network from containers when
577 CAP_NET_ADMIN is set, more than the loopback device is defined, even
578 when it is otherwise off
579
580 * MessageQueueMessageSize= (and suchlike) should use parse_iec_size().
581
582 * implement Distribute= in socket units to allow running multiple
583 service instances processing the listening socket, and open this up
584 for ReusePort=
585
586 * introduce bus call FreezeUnit(s, b), as well as "systemctl freeze
587 $UNIT" and "systemctl thaw $UNIT" as wrappers around this. The calls
588 should SIGSTOP all unit processes in a loop until all processes of
589 it are fully stopped. This can later be used for app management by
590 desktop UIs such as gnome-shell to freeze apps that are not visible
591 on screen, not unlike how job control works on the shell
592
593 * cgroups:
594 - implement per-slice CPUFairScheduling=1 switch
595 - introduce high-level settings for RT budget, swappiness
596 - how to reset dynamically changed unit cgroup attributes sanely?
597 - when reloading configuration, apply new cgroup configuration
598 - when recursively showing the cgroup hierarchy, optionally also show
599 the hierarchies of child processes
600
601 * transient units:
602 - add field to transient units that indicate whether systemd or somebody else saves/restores its settings, for integration with libvirt
603
604 * Automatically configure swap partition to use for hibernation by looking for largest swap partition on the root disk?
605
606 * when we detect low battery and no AC on boot, show pretty splash and refuse boot
607
608 * libsystemd-journal, libsystemd-login, libudev: add calls to easily attach these objects to sd-event event loops
609
610 * be more careful what we export on the bus as (usec_t) 0 and (usec_t) -1
611
612 * rfkill,backlight: we probably should run the load tools inside of the udev rules so that the state is properly initialized by the time other software sees it
613
614 * After coming back from hibernation reset hibernation swap partition using the /dev/snapshot ioctl APIs
615
616 * If we try to find a unit via a dangling symlink, generate a clean
617 error. Currently, we just ignore it and read the unit from the search
618 path anyway.
619
620 * refuse boot if /usr/lib/os-release is missing or /etc/machine-id cannot be set up
621
622 * man: the documentation of Restart= currently is very misleading and suggests the tools from ExecStartPre= might get restarted.
623
624 * load .d/*.conf dropins for device units
625
626 * sd-bus:
627 - EBADSLT handling
628 - GetAllProperties() on a non-existing object does not result in a failure currently
629 - port to sd-resolve for connecting to TCP dbus servers
630 - see if we can introduce a new sd_bus_get_owner_machine_id() call to retrieve the machine ID of the machine of the bus itself
631 - see if we can drop more message validation on the sending side
632 - add API to clone sd_bus_message objects
633 - longer term: priority inheritance
634 - dbus spec updates:
635 - NameLost/NameAcquired obsolete
636 - GVariant
637 - path escaping
638 - update systemd.special(7) to mention that dbus.socket is only about the compatibility socket now
639
640 * sd-event
641 - allow multiple signal handlers per signal?
642 - document chaining of signal handler for SIGCHLD and child handlers
643 - define more intervals where we will shift wakeup intervals around in, 1h, 6h, 24h, ...
644 - generate a failure of a default event loop is executed out-of-thread
645
646 * investigate endianness issues of UUID vs. GUID
647
648 * dbus: when a unit failed to load (i.e. is in UNIT_ERROR state), we
649 should be able to safely try another attempt when the bus call LoadUnit() is invoked.
650
651 * add a pam module that passes the hdd passphrase into the PAM stack and then expires it, for usage by gdm auto-login.
652
653 * add a pam module that on password changes updates any LUKS slot where the password matches
654
655 * test/:
656 - add unit tests for config_parse_device_allow()
657
658 * seems that when we follow symlinks to units we prefer the symlink
659 destination path over /etc and /usr. We should not do that. Instead
660 /etc should always override /run+/usr and also any symlink
661 destination.
662
663 * when isolating, try to figure out a way how we implicitly can order
664 all units we stop before the isolating unit...
665
666 * teach ConditionKernelCommandLine= globs or regexes (in order to match foobar={no,0,off})
667
668 * BootLoaderSpec: Clarify that the kernel has to be in $BOOT. Clarify
669 that the boot loader should be installed to the ESP. Define a way
670 how an installer can figure out whether a BLS compliant boot loader
671 is installed.
672
673 * think about requeuing jobs when daemon-reload is issued? usecase:
674 the initrd issues a reload after fstab from the host is accessible
675 and we might want to requeue the mounts local-fs acquired through
676 that automatically.
677
678 * systemd-inhibit: make taking delay locks useful: support sending SIGINT or SIGTERM on PrepareForSleep()
679
680 * remove any syslog support from log.c — we probably cannot do this before split-off udev is gone for good
681
682 * shutdown logging: store to EFI var, and store to USB stick?
683
684 * merge unit_kill_common() and unit_kill_context()
685
686 * introduce ExecCondition= in services
687
688 * EFI:
689 - honor language efi variables for default language selection (if there are any?)
690 - honor timezone efi variables for default timezone selection (if there are any?)
691 - change bootctl to be backed by systemd-bootd to control temporary and persistent default boot goal plus efi variables
692 * bootctl
693 - recognize the case when not booted on EFI
694
695 * maybe do not install getty@tty1.service symlink in /etc but in /usr?
696
697 * print a nicer explanation if people use variable/specifier expansion in ExecStart= for the first word
698
699 * mount: turn dependency information from /proc/self/mountinfo into dependency information between systemd units.
700
701 * logind:
702 - logind: optionally, ignore idle-hint logic for autosuspend, block suspend as long as a session is around
703 - logind: wakelock/opportunistic suspend support
704 - Add pretty name for seats in logind
705 - logind: allow showing logout dialog from system?
706 - add Suspend() bus calls which take timestamps to fix double suspend issues when somebody hits suspend and closes laptop quickly.
707 - if pam_systemd is invoked by su from a process that is outside of a
708 any session we should probably just become a NOP, since that's
709 usually not a real user session but just some system code that just
710 needs setuid().
711 - logind: make the Suspend()/Hibernate() bus calls wait for the for
712 the job to be completed. before returning, so that clients can wait
713 for "systemctl suspend" to finish to know when the suspending is
714 complete.
715 - logind: when the power button is pressed short, just popup a
716 logout dialog. If it is pressed for 1s, do the usual
717 shutdown. Inspiration are Macs here.
718 - expose "Locked" property on logind sesison objects
719 - maybe allow configuration of the StopTimeout for session scopes
720 - rename session scope so that it includes the UID. THat way
721 the session scope can be arranged freely in slices and we don't have
722 make assumptions about their slice anymore.
723 - follow PropertiesChanged state more closely, to deal with quick logouts and
724 relogins
725
726 * journal:
727 - consider introducing implicit _TTY= + _PPID= + _EUID= + _EGID= + _FSUID= + _FSGID= fields
728 - import and delete pstore filesystem content at startup
729 - journald: also get thread ID from client, plus thread name
730 - journal: when waiting for journal additions in the client always sleep at least 1s or so, in order to minimize wakeups
731 - add API to close/reopen/get fd for journal client fd in libsystemd-journal.
732 - fallback to /dev/log based logging in libsystemd-journal, if we cannot log natively?
733 - declare the local journal protocol stable in the wiki interface chart
734 - sd-journal: speed up sd_journal_get_data() with transparent hash table in bg
735 - journald: when dropping msgs due to ratelimit make sure to write
736 "dropped %u messages" not only when we are about to print the next
737 message that works, but already after a short timeout
738 - check if we can make journalctl by default use --follow mode inside of less if called without args?
739 - maybe add API to send pairs of iovecs via sd_journal_send
740 - journal: add a setgid "systemd-journal" utility to invoke from libsystemd-journal, which passes fds via STDOUT and does PK access
741 - journactl: support negative filtering, i.e. FOOBAR!="waldo",
742 and !FOOBAR for events without FOOBAR.
743 - journal: store timestamp of journal_file_set_offline() int he header,
744 so it is possible to display when the file was last synced.
745 - journal-send.c, log.c: when the log socket is clogged, and we drop, count this and write a message about this when it gets unclogged again.
746 - journal: find a way to allow dropping history early, based on priority, other rules
747 - journal: When used on NFS, check payload hashes
748 - journald: add kernel cmdline option to disable ratelimiting for debug purposes
749 - refuse taking lower-case variable names in sd_journal_send() and friends.
750 - journald: we currently rotate only after MaxUse+MaxFilesize has been reached.
751 - journal: deal nicely with byte-by-byte copied files, especially regards header
752 - journal: sanely deal with entries which are larger than the individual file size, but where the components would fit
753 - Replace utmp, wtmp, btmp, and lastlog completely with journal
754 - journalctl: instead --after-cursor= maybe have a --cursor=XYZ+1 syntax?
755 - when a kernel driver logs in a tight loop, we should ratelimit that too.
756 - journald: optionally, log debug messages to /run but everything else to /var
757 - journald: when we drop syslog messages because the syslog socket is
758 full, make sure to write how many messages are lost as first thing
759 to syslog when it works again.
760 - change systemd-journal-flush into a service that stays around during
761 boot, and causes the journal to be moved back to /run on shutdown,
762 so that we do not keep /var busy. This needs to happen synchronously,
763 hence doing this via signals is not going to work.
764 - optionally support running journald from the command line for testing purposes in external projects
765 - journald: allow per-priority and per-service retention times when rotating/vacuuming
766 - journald: make use of uid-range.h to managed uid ranges to split
767 journals in.
768 - journalctl: add the ability to look for the most recent process of a binary. journalctl /usr/bin/X11 --pid=-1 or so...
769 - improve journalctl performance by loading journal files
770 lazily. Encode just enough information in the file name, so that we
771 do not have to open it to know that it is not interesting for us, for
772 the most common operations.
773 - man: document that corrupted journal files is nothing to act on
774 - rework journald sigbus stuff to use mutex
775 - Set RLIMIT_NPROC for systemd-journal-xyz, and all other of our
776 services that run under their own user ids, and use User= (but only
777 in a world where userns is ubiquitous since otherwise we cannot
778 invoke those daemons on the host AND in a container anymore). Also,
779 if LimitNPROC= is used without User= we should warn and refuse
780 operation.
781 - journalctl --verify: don't show files that are currently being
782 written to as FAIL, but instead show that their are being written to.
783 - add journalctl -H that talks via ssh to a remote peer and passes through
784 binary logs data
785 - add a version of --merge which also merges /var/log/journal/remote
786 - journalctl: -m should access container journals directly by enumerating
787 them via machined, and also watch containers coming and going.
788 Benefit: nspawn --ephemeral would start working nicely with the journal.
789 - assign MESSAGE_ID to log messages about failed services
790
791 * add a test if all entries in the catalog are properly formatted.
792 (Adding dashes in a catalog entry currently results in the catalog entry
793 being silently skipped. journalctl --update-catalog must warn about this,
794 and we should also have a unit test to check that all our message are OK.)
795
796 * document:
797 - document that deps in [Unit] sections ignore Alias= fields in
798 [Install] units of other units, unless those units are disabled
799 - man: clarify that time-sync.target is not only sysv compat but also useful otherwise. Same for similar targets
800 - document that service reload may be implemented as service reexec
801 - add a man page containing packaging guidelines and recommending usage of things like Documentation=, PrivateTmp=, PrivateNetwork= and ReadOnlyDirectories=/etc /usr.
802 - document systemd-journal-flush.service properly
803 - documentation: recommend to connect the timer units of a service to the service via Also= in [Install]
804 - man: document the very specific env the shutdown drop-in tools live in
805 - man: add more examples to man pages
806 - man: maybe sort directives in man pages, and take sections from --help and apply them to man too
807 - document root=gpt-auto properly
808
809 * systemctl:
810 - add systemctl switch to dump transaction without executing it
811 - Add a verbose mode to "systemctl start" and friends that explains what is being done or not done
812 - "systemctl disable" on a static unit prints no message and does
813 nothing. "systemctl enable" does nothing, and gives a bad message
814 about it. Should fix both to print nice actionable messages.
815 - print nice message from systemctl --failed if there are no entries shown, and hook that into ExecStartPre of rescue.service/emergency.service
816 - add new command to systemctl: "systemctl system-reexec" which reexecs as many daemons as virtually possible
817 - systemctl enable: fail if target to alias into does not exist? maybe show how many units are enabled afterwards?
818 - systemctl: "Journal has been rotated since unit was started." message is misleading
819 - systemctl status output should include list of triggering units and their status
820
821 * unit install:
822 - "systemctl mask" should find all names by which a unit is accessible
823 (i.e. by scanning for symlinks to it) and link them all to /dev/null
824
825 * timer units:
826 - timer units should get the ability to trigger when:
827 o DST changes
828 - Modulate timer frequency based on battery state
829
830 * add libsystemd-password or so to query passwords during boot using the password agent logic
831
832 * clean up date formatting and parsing so that all absolute/relative timestamps we format can also be parsed
833
834 * on shutdown: move utmp, wall, audit logic all into PID 1 (or logind?), get rid of systemd-update-utmp-runlevel
835
836 * make repeated alt-ctrl-del presses printing a dump
837
838 * hostnamed: before returning information from /etc/machine-info.conf check the modification data and reread. Similar for localed, ...
839
840 * currently x-systemd.timeout is lost in the initrd, since crypttab is copied into dracut, but fstab is not
841
842 * nspawn:
843 - emulate /dev/kmsg using CUSE and turn off the syslog syscall
844 with seccomp. That should provide us with a useful log buffer that
845 systemd can log to during early boot, and disconnect container logs
846 from the kernel's logs.
847 - as soon as networkd has a bus interface, hook up --network-interface=,
848 --network-bridge= with networkd, to trigger netdev creation should an
849 interface be missing
850 - a nice way to boot up without machine id set, so that it is set at boot
851 automatically for supporting --ephemeral. Maybe hash the host machine id
852 together with the machine name to generate the machine id for the container
853 - fix logic always print a final newline on output.
854 https://github.com/systemd/systemd/pull/272#issuecomment-113153176
855 - should optionally support receiving WATCHDOG=1 messages from its payload
856 PID 1...
857 - optionally automatically add FORWARD rules to iptables whenever nspawn is
858 running, remove them when shut down.
859
860 * dissect
861 - refuse mounting over a mount point
862 - automatically discover .roothash files in dissect, similarly to nspawn
863
864 * machined:
865 - add an API so that libvirt-lxc can inform us about network interfaces being
866 removed or added to an existing machine
867 - "machinectl migrate" or similar to copy a container from or to a
868 difference host, via ssh
869 - introduce systemd-nspawn-ephemeral@.service, and hook it into
870 "machinectl start" with a new --ephemeral switch
871 - "machinectl status" should also show internal logs of the container in
872 question
873 - "machinectl history"
874 - "machinectl diff"
875 - "machinectl commit" that takes a writable snapshot of a tree, invokes a
876 shell in it, and marks it read-only after use
877
878 * cryptsetup:
879 - cryptsetup-generator: allow specification of passwords in crypttab itself
880 - support rd.luks.allow-discards= kernel cmdline params in cryptsetup generator
881
882 * hw watchdog: optionally try to use the preset watchdog timeout instead of always overriding it
883 https://bugs.freedesktop.org/show_bug.cgi?id=54712
884
885 * add a dependency on standard-conf.xml and other included files to man pages
886
887 * MountFlags=shared acts as MountFlags=slave right now.
888
889 * properly handle loop back mounts via fstab, especially regards to fsck/passno
890
891 * initialize the hostname from the fs label of /, if /etc/hostname does not exist?
892
893 * udev:
894 - move to LGPL
895 - kill scsi_id
896 - add trigger --subsystem-match=usb/usb_device device
897 - reimport udev db after MOVE events for devices without dev_t
898
899 * There's currently no way to cancel fsck (used to be possible via C-c or c on the console)
900
901 * add option to sockets to avoid activation. Instead just drop packets/connections, see http://cyberelk.net/tim/2012/02/15/portreserve-systemd-solution/
902
903 * coredump:
904 - save coredump in Windows/Mozilla minidump format
905 - when truncating coredumps, also log the full size that the process had, and make a metadata field so we can report truncated coredumps
906
907 * support crash reporting operation modes (https://live.gnome.org/GnomeOS/Design/Whiteboards/ProblemReporting)
908
909 * be able to specify a forced restart of service A where service B depends on, in case B
910 needs to be auto-respawned?
911
912 * tmpfiles:
913 - apply "x" on "D" too (see patch from William Douglas)
914 - replace F with f+.
915 - instead of ignoring unknown fields, reject them.
916 - creating new directories/subvolumes/fifos/device nodes
917 should not follow symlinks. None of the other adjustment or creation
918 calls follow symlinks.
919
920 * make sure systemd-ask-password-wall does not shutdown systemd-ask-password-console too early
921
922 * verify that the AF_UNIX sockets of a service in the fs still exist
923 when we start a service in order to avoid confusion when a user
924 assumes starting a service is enough to make it accessible
925
926 * Make it possible to set the keymap independently from the font on
927 the kernel cmdline. Right now setting one resets also the other.
928
929 * and a dbus call to generate target from current state
930
931 * write blog stories about:
932 - hwdb: what belongs into it, lsusb
933 - enabling dbus services
934 - how to make changes to sysctl and sysfs attributes
935 - remote access
936 - how to pass throw-away units to systemd, or dynamically change properties of existing units
937 - testing with Harald's awesome test kit
938 - auto-restart
939 - how to develop against journal browsing APIs
940 - the journal HTTP iface
941 - non-cgroup resource management
942 - dynamic resource management with cgroups
943 - refreshed, longer missions statement
944 - calendar time events
945 - init=/bin/sh vs. "emergency" mode, vs. "rescue" mode, vs. "multi-user" mode, vs. "graphical" mode, and the debug shell
946 - how to create your own target
947 - instantiated apache, dovecot and so on
948 - hooking a script into various stages of shutdown/rearly booot
949
950 * investigate whether the gnome pty helper should be moved into systemd, to provide cgroup support.
951
952 * dot output for --test showing the 'initial transaction'
953
954 * pid1:
955 - When logging about multiple units (stopping BoundTo units, conflicts, etc.),
956 log both units as UNIT=, so that journalctl -u triggers on both.
957 - generate better errors when people try to set transient properties
958 that are not supported...
959 http://lists.freedesktop.org/archives/systemd-devel/2015-February/028076.html
960 - maybe introduce WantsMountsFor=? Usecase:
961 http://lists.freedesktop.org/archives/systemd-devel/2015-January/027729.html
962 - recreate systemd's D-Bus private socket file on SIGUSR2
963 - move PAM code into its own binary
964 - when we automatically restart a service, ensure we restart its rdeps, too.
965 - hide PAM options in fragment parser when compile time disabled
966 - Support --test based on current system state
967 - If we show an error about a unit (such as not showing up) and it has no Description string, then show a description string generated form the reverse of unit_name_mangle().
968 - after deserializing sockets in socket.c we should reapply sockopts and things
969 - drop PID 1 reloading, only do reexecing (difficult: Reload()
970 currently is properly synchronous, Reexec() is weird, because we
971 cannot delay the response properly until we are back, so instead of
972 being properly synchronous we just keep open the fd and close it
973 when done. That means clients do not get a successful method reply,
974 but much rather a disconnect on success.
975 - when breaking cycles drop sysv services first, then services from /run, then from /etc, then from /usr
976 - when a bus name of a service disappears from the bus make sure to queue further activation requests
977
978 * unit files:
979 - allow port=0 in .socket units
980 - maybe introduce ExecRestartPre=
981 - add ReloadSignal= for configuring a reload signal to use
982 - implement Register= switch in .socket units to enable registration
983 in Avahi, RPC and other socket registration services.
984 - allow Type=simple with PIDFile=
985 https://bugzilla.redhat.com/show_bug.cgi?id=723942
986 - allow writing multiple conditions in unit files on one line
987 - load-fragment: when loading a unit file via a chain of symlinks
988 verify that it is not masked via any of the names traversed.
989 - introduce Type=pid-file
990 - introduce mix of BindTo and Requisite
991 - add a concept of RemainAfterExit= to scope units
992 - Allow multiple ExecStart= for all Type= settings, so that we can cover rescue.service nicely
993
994 * udev-link-config:
995 - Make sure ID_PATH is always exported and complete for
996 network devices where possible, so we can safely rely
997 on Path= matching
998 - check MTUBytes parsing (expecting size_t but we are using unsigned)
999
1000 * sd-rtnl:
1001 - add support for more attribute types
1002 - inbuilt piping support (essentially degenerate async)? see loopback-setup.c and other places
1003
1004 * networkd:
1005 - add more keys to [Route] and [Address] sections
1006 - add support for more DHCPv4 options (and, longer term, other kinds of dynamic config)
1007 - add proper initrd support (in particular generate .network/.link files based on /proc/cmdline)
1008 - add reduced [Link] support to .network files
1009 - add Scope= parsing option for [Network]
1010 - properly handle routerless dhcp leases
1011 - work with non-Ethernet devices
1012 - add support for more bond options
1013 - dhcp: do we allow configuring dhcp routes on interfaces that are not the one we got the dhcp info from?
1014 - the DHCP lease data (such as NTP/DNS) is still made available when
1015 a carrier is lost on a link. It should be removed instantly.
1016 - expose in the API the following bits:
1017 - option 15, domain name and/or option 119, search list
1018 - option 12, host name and/or option 81, fqdn
1019 - option 123, 144, geolocation
1020 - option 252, configure http proxy (PAC/wpad)
1021 - provide a way to define a per-network interface default metric value
1022 for all routes to it. possibly a second default for DHCP routes.
1023 - allow Name= to be specified repeatedly in the [Match] section. Maybe also
1024 support Name=foo*|bar*|baz ?
1025 - duplicate address check for static IPs (like ARPCHECK in network-scripts)
1026 - allow DUID/IAID to be customized, see issue #394.
1027 - whenever uplink info changes, make DHCP server send out FORCERENEW
1028
1029 * networkd-wait-online:
1030 - make operstates to wait for configurable?
1031
1032 * dhcp:
1033 - figure out how much we can increase Maximum Message Size
1034
1035 * dhcp6:
1036 - add functions to set previously stored IPv6 addresses on startup and get
1037 them at shutdown; store them in client->ia_na
1038 - write more test cases
1039 - implement reconfigure support, see 5.3., 15.11. and 22.20.
1040 - implement support for temporary adressess (IA_TA)
1041 - implement dhcpv6 authentication
1042 - investigate the usefulness of Confirm messages; i.e. are there any
1043 situations where the link changes without any loss in carrier detection
1044 or interface down
1045 - some servers don't do rapid commit without a filled in IA_NA, verify
1046 this behavior
1047 - RouteTable= ?
1048
1049 External:
1050
1051 * dbus:
1052 - natively watch for dbus-*.service symlinks (PENDING)
1053 - teach dbus to activate all services it finds in /etc/systemd/services/org-*.service
1054
1055 * fix alsa mixer restore to not print error when no config is stored
1056
1057 * make cryptsetup lower --iter-time
1058
1059 * patch kernel for xattr support in /dev, /proc/, /sys?
1060
1061 * kernel: add device_type = "fb", "fbcon" to class "graphics"
1062
1063 * /usr/bin/service should actually show the new command line
1064
1065 * fedora: suggest auto-restart on failure, but not on success and not on coredump. also, ask people to think about changing the start limit logic. Also point people to RestartPreventExitStatus=, SuccessExitStatus=
1066
1067 * fedora: F20: go timer units all the way, leave cron.daily for cron
1068
1069 * neither pkexec nor sudo initialize environ[] from the PAM environment?
1070
1071 * fedora: update policy to declare access mode and ownership of unit files to root:root 0644, and add an rpmlint check for it
1072
1073 * register catalog database signature as file magic
1074
1075 * zsh shell completion:
1076 - <command> <verb> -<TAB> should complete options, but currently does not
1077 - systemctl add-wants,add-requires
1078
1079
1080 Regularly:
1081
1082 * look for close() vs. close_nointr() vs. close_nointr_nofail()
1083
1084 * check for strerror(r) instead of strerror(-r)
1085
1086 * pahole
1087
1088 * set_put(), hashmap_put() return values check. i.e. == 0 does not free()!
1089
1090 * use secure_getenv() instead of getenv() where appropriate
1091
1092 * link up selected blog stories from man pages and unit files Documentation= fields
1093 String is not UTF-8 clean, ignoring assignment
1094 timedatex.service: Consumed 26ms CPU time.