]> git.ipfire.org Git - thirdparty/coreutils.git/log
thirdparty/coreutils.git
23 months agouptime: simplify following gnulib changes
Bruno Haible [Tue, 15 Aug 2023 22:20:05 +0000 (15:20 -0700)] 
uptime: simplify following gnulib changes

* build-aux/gen-lists-of-programs.sh (build_if_possible_progs):
Remove uptime.
(normal_progs): Add uptime.
* configure.ac: Remove GNULIB_BOOT_TIME invocation.
* m4/boottime.m4: Remove file.
* src/uptime.c: Don't include <sys/sysctl.h>, <OS.h>.
(print_uptime): Don't call sysctl, get_system_info, as Gnulib's
readutmp module now does this.

23 months agomaint: update uptime NEWS
Paul Eggert [Tue, 15 Aug 2023 22:20:05 +0000 (15:20 -0700)] 
maint: update uptime NEWS

* NEWS: Update as per Bruno Haible <https://bugs.gnu.org/65255#14>.

23 months agotests: fix false failure due to locale on alpine
Pádraig Brady [Tue, 15 Aug 2023 15:44:26 +0000 (16:44 +0100)] 
tests: fix false failure due to locale on alpine

* tests/sort/sort-debug-keys.sh: Decimal point was seen to be '.'
on fr_FR.UTF-8 on Alpine Linux 3.18, so add an extra guard
to ensure we've a ',' as the decimal point on this locale.
Fixes https://bugs.gnu.org/65310

23 months agouptime: be more generous about read_utmp failure
Paul Eggert [Tue, 15 Aug 2023 21:00:54 +0000 (14:00 -0700)] 
uptime: be more generous about read_utmp failure

* src/uptime.c (print_uptime): Check for overflow
when computing uptime.  Use C99-style decl after statements.
Do not let an idx_t value go negative.
(print_uptime, uptime): Be more generous about read_utmp failures,
or when read_utmp does not report the boot time.  Instead of
failing, warn but keep going, printing the information that we did
get, and then exit with nonzero status.
(print_uptime): Return the desired exit status.  Caller changed.

23 months agouptime: Include VM sleep time in the "up" duration
Bruno Haible [Tue, 15 Aug 2023 19:01:13 +0000 (12:01 -0700)] 
uptime: Include VM sleep time in the "up" duration

* src/uptime.c: Don't include c-strtod.h.
(print_uptime): Don't read /proc/uptime, because the value it provides
does not change when a date adjustment occurs.
* bootstrap.conf (gnulib_modules): Remove 'uptime'.

23 months agobuild: update gnulib submodule to latest
Paul Eggert [Tue, 15 Aug 2023 18:45:40 +0000 (11:45 -0700)] 
build: update gnulib submodule to latest

23 months agomaint: fix typo in NEWS
Bernhard Voelker [Tue, 15 Aug 2023 11:35:13 +0000 (13:35 +0200)] 
maint: fix typo in NEWS

* NEWS: s|/who/log/wtmp|/var/log/tmp|, introduced in commit 85edb4afbd1.

23 months agodoc: reference install(1) and cp(1) from each other
Bernhard Voelker [Tue, 15 Aug 2023 11:22:42 +0000 (13:22 +0200)] 
doc: reference install(1) and cp(1) from each other

* man/cp.x (SEE ALSO): Add install(1).
* man/install.x (SEE ALSO): Add cp(1).

Discussed at
https://lists.gnu.org/r/coreutils/2023-08/msg00026.html

23 months agobuild: fix recent compilation error on GNU/Hurd
Bruno Haible [Mon, 14 Aug 2023 18:59:41 +0000 (20:59 +0200)] 
build: fix recent compilation error on GNU/Hurd

* src/copy.c (set_author): Revert change from MACH_PORT_NULL to
MACH_PORT_nullptr from commit 16b5ca6e (2023-06-29).

23 months agomaint: avoid syntax-check failure
Pádraig Brady [Mon, 14 Aug 2023 13:03:35 +0000 (14:03 +0100)] 
maint: avoid syntax-check failure

* po/POTFILES.in: Cater to lib/file-type.c adjustments
as suggested by sc_po_check.

23 months agobuild: fix link errors with gcc < 4.8
Bruno Haible [Sun, 13 Aug 2023 23:45:39 +0000 (01:45 +0200)] 
build: fix link errors with gcc < 4.8

* configure.ac: Attempt to link, not only compile, the test programs
with __builtin_cpu_supports, to avoid link errors with cksum and wc.

23 months agodoc: improve NEWS discussion of systemd
Paul Eggert [Sun, 13 Aug 2023 06:50:50 +0000 (23:50 -0700)] 
doc: improve NEWS discussion of systemd

23 months agobuild: update gnulib submodule to latest
Paul Eggert [Sun, 13 Aug 2023 06:38:16 +0000 (23:38 -0700)] 
build: update gnulib submodule to latest

23 months agomaint: allow use of printf C99 integer size specifiers
Pádraig Brady [Sat, 12 Aug 2023 10:21:50 +0000 (11:21 +0100)] 
maint: allow use of printf C99 integer size specifiers

Older systems that had issues with these like HP-UX and Solaris 8
are now obsolete, and can easily apply patches to provide support.
Also we've used %td since coreutils 9.1, with no reported issues.

* cfg.mk (sc_prohibit-c99-printf-format): Remove to allow use of
%[jtz] size specifiers, which allows for cleaner code
by avoiding the need to cast to PRI?MAX etc.

23 months agodoc: separate out description of 2038 time stamp change
Pádraig Brady [Fri, 11 Aug 2023 13:27:59 +0000 (14:27 +0100)] 
doc: separate out description of 2038 time stamp change

* NEWS: Separate out the description of the _existing_ issues
with outputting timestamps on 32 bit systems, from _future_ issues
outputting timestamps on all systems.  Also move this to the
"improvement" section, since it's not really a coreutils
specific issue, and also is a build time configurable option.

23 months agopinky,users,who: optimize read_utmp invocation
Bruno Haible [Thu, 10 Aug 2023 11:50:57 +0000 (13:50 +0200)] 
pinky,users,who: optimize read_utmp invocation

When we are only interested in entries of type USER_PROCESS, tell
read_utmp that it does not need to determine the boot time.

* src/pinky.c (short_pinky): Pass option READ_UTMP_USER_PROCESS.
* src/users.c (users): Likewise.
* src/who.c (who): Likewise, if calling list_entries_who.

2 years agowho: simplify based on readutmp changes
Paul Eggert [Wed, 9 Aug 2023 03:03:40 +0000 (20:03 -0700)] 
who: simplify based on readutmp changes

* src/pinky.c (time_string, print_entry, scan_entries, short_pinky):
* src/uptime.c (print_uptime, uptime):
* src/users.c (list_entries_users, users):
* src/who.c (UT_TYPE_RUN_LVL, UT_TYPE_INIT_PROCESS)
(UT_TYPE_LOGIN_PROCESS, UT_TYPE_DEAD_PROCESS, UT_TYPE_NEW_TIME)
(time_string, print_user, print_boottime)
(make_id_equals_comment, print_deadprocs, print_login)
(print_initspawn, print_clockchange, print_runlevel)
(list_entries_who, scan_entries, who):
Simplify, partly by using plain -> rather than macros.

2 years agopinky,who: omit pragma
Paul Eggert [Wed, 9 Aug 2023 02:32:49 +0000 (19:32 -0700)] 
pinky,who: omit pragma

* src/pinky.c, src/who.c:
Omit no-longer-needed -Wstringop-overread pragma.

2 years agomaint: Simplify after gnulib changed
Bruno Haible [Tue, 8 Aug 2023 16:56:39 +0000 (18:56 +0200)] 
maint: Simplify after gnulib changed

Update gnulib submodule to latest.
All of UT_USER_SIZE, UT_ID_SIZE, UT_LINE_SIZE, UT_HOST_SIZE are now -1.

* src/pinky.c (print_entry): Remove code for bounded-length ut_line,
ut_user, ut_host.
(scan_entries): Remove code for bounded-length ut_user.
* src/who.c (print_line): Remove userlen, linelen arguments.
(print_user): Remove code for bounded-length ut_line, ut_user, ut_host.
(make_id_equals_comment): Remove code for bounded-length ut_id.
(print_boottime, print_deadprocs, print_login, print_initspawn,
print_clockchange, print_runlevel, print_heading): Update print_line
invocations.
(scan_entries): Remove code for bounded-length ut_line.

2 years agomaint: Update after gnulib module 'readutmp' changed
Paul Eggert [Fri, 4 Aug 2023 01:35:29 +0000 (18:35 -0700)] 
maint: Update after gnulib module 'readutmp' changed

(This patch is coauthored with Bruno Haible,
with original version at <https://bugs.gnu.org/64937#>.)
This updates the gnulib submodule to latest.
For year-2038 safety on Linux/{x86,arm},
this adds an --enable-systemd option to ‘configure’.
The idea is that this sort of thing will become the default
after it has been tested more.
* configure.ac: Don't test whether struct utmp and struct utmpx
have the ut_host field; this is now done in gnulib's readutmp module.
* src/local.mk: Link the programs 'pinky', 'uptime', 'users',
'who' with $(READUTMP_LIB).
* src/pinky.c, src/who.c:
Test HAVE_STRUCT_XTMP_UT_HOST instead of HAVE_UT_HOST.
* src/pinky.c (print_entry):
* src/who.c (print_user, print_deadprocs, print_login)
(print_initspawn, scan_entries):
Support the situation where ut_line is a 'char *' rather than a
'char[]' of fixed size.  Likewise for ut_user and ut_host.
(make_id_equals_comment): Likewise for ut_id.
* src/pinky.c (print_entry):
* src/who.c (print_user):
Open /dev to simplify looking up its entries.
Don’t use printf if the output might in theory be longer than INT_MAX.
* src/pinky.c (scan_entries, short_pinky):
* src/uptime.c (print_uptime, uptime):
* src/users.c (list_entries_users, users):
* src/who.c (who):
Use idx_t where new read_utmp needs it.
* src/system.h (STREQ_LEN): Add comment that last arg can be -1.

2 years agouptime: fix Y5881633 bug
Paul Eggert [Wed, 2 Aug 2023 13:51:55 +0000 (06:51 -0700)] 
uptime: fix Y5881633 bug

* src/uptime.c (print_uptime): Prefer signed types.
Fix unlikely bug on platforms with 32-bit long and 64-bit time_t
if the idle time exceeds 2**31 days (about 6 million years...).

2 years agopinky: fix "d" typo
Paul Eggert [Wed, 2 Aug 2023 13:47:13 +0000 (06:47 -0700)] 
pinky: fix "d" typo

Problem reported by Bruno Haible (bug#65003).
* src/pinky.c (idle_string): Fix recently-introduced typo:
missing "d" for "days".

2 years agomaint: minor comment cleanups
Dragan Simic [Tue, 1 Aug 2023 09:07:42 +0000 (11:07 +0200)] 
maint: minor comment cleanups

* src/cut.c: Adjust a few comments slightly, simply to have their
trailing whitespace the same as in the majority of the comments.

2 years agocut: promptly diagnose write errors, continued
Dragan Simic [Tue, 1 Aug 2023 09:07:41 +0000 (11:07 +0200)] 
cut: promptly diagnose write errors, continued

* src/cut.c: Complete the error-handling improvements started in
commit e0a4a60af5, by adding a couple of remaining checks for putchar().
While there, sprinkle a few rather useful comments, and perform a few
small code cleanups, to make the code and the comments more uniform
and more conformant to the official coding style.  Also make the help
message slightly more uniform.

2 years agomaint: reformat text width in HACKING
Dragan Simic [Tue, 1 Aug 2023 09:07:40 +0000 (11:07 +0200)] 
maint: reformat text width in HACKING

* HACKING: Adjust line lengths.

2 years agopinky: fix buffer size on 32 bit builds
Pádraig Brady [Tue, 1 Aug 2023 13:54:15 +0000 (14:54 +0100)] 
pinky: fix buffer size on 32 bit builds

* src/pinky.c (idle_string): Use the correct buffer size
following the recent int type adjustment.

2 years agood: fix issues with recent format string changes
Pádraig Brady [Tue, 1 Aug 2023 12:30:02 +0000 (13:30 +0100)] 
od: fix issues with recent format string changes

* src/ioblksize.h: Avoid syntax check with redundant idx.h inclusion.
* src/od.c (FMT_BYTES_ALLOCATED): Increase by two to avoid:
  error: '%s' directive writing between 1 and 2 bytes into a region
  of size between 1 and 4 [-Werror=format-overflow=]
(maint): Use %td to print idx_t rather than invalid %jt format.

2 years agopinky: prefer signed types
Paul Eggert [Tue, 1 Aug 2023 00:51:03 +0000 (17:51 -0700)] 
pinky: prefer signed types

* src/pinky.c (idle_string): Prefer intmax_t to unsigned long int;
this avoids an overflow on platforms where unsigned long is 32
bits and time_t is 64 bits (the bug could occur on such a system
that was idle for more than 6 million years, so it’s a bit
hard to supply a test case...).

2 years agopathchk: prefer signed types
Paul Eggert [Tue, 1 Aug 2023 00:47:01 +0000 (17:47 -0700)] 
pathchk: prefer signed types

* src/pathchk.c (validate_file_name): Prefer signed types.

2 years agonumfmt: prefer signed types
Paul Eggert [Tue, 1 Aug 2023 00:46:15 +0000 (17:46 -0700)] 
numfmt: prefer signed types

* src/numfmt.c (suffix_power_char, powerld, expld)
(simple_strtod_int, double_to_human, prepare_padded_number)
(process_suffixed_number): Prefer signed types.
(process_suffixed_number): Fix an unlikely bug if an
arg has exactly 2**32 spaces at the start.

2 years agomktemp,seq: prefer signed types
Paul Eggert [Tue, 1 Aug 2023 00:43:05 +0000 (17:43 -0700)] 
mktemp,seq: prefer signed types

* src/mktemp.c (main):
* src/seq.c (main): Prefer signed types.

2 years agokill: prefer signed types
Paul Eggert [Mon, 31 Jul 2023 23:38:02 +0000 (16:38 -0700)] 
kill: prefer signed types

* src/kill.c (list_signals):
Prefer signed types.  This avoids undefined behavior on
theoretical platforms where unsigned and signed int have
different representations.

2 years agogroups,id: don’t assume gid_t fits in unsigned long
Paul Eggert [Mon, 31 Jul 2023 23:36:38 +0000 (16:36 -0700)] 
groups,id: don’t assume gid_t fits in unsigned long

* src/group-list.c (print_group): Convert to intmax_t or
uintmax_t, not to unsigned long.

2 years agodircolors,du,expr: prefer signed types
Paul Eggert [Mon, 31 Jul 2023 23:35:32 +0000 (16:35 -0700)] 
dircolors,du,expr: prefer signed types

* src/dircolors.c (dc_parse_stream):
* src/du.c (max_depth, main):
* src/expr.c (main):
Prefer signed types.

2 years agood: prefer signed types
Paul Eggert [Mon, 31 Jul 2023 23:33:38 +0000 (16:33 -0700)] 
od: prefer signed types

* src/od.c: Include stdckdint.h.
(bytes_to_oct_digits, bytes_to_signed_dec_digits)
(bytes_to_unsigned_dec_digits, bytes_to_hex_digits):
Use ‘char’ for these small constants.
(simple_strtoi): Rename from simple_strtoul.  Convert to int
instead of unsigned long; that’s good enough.  All uses changed.
Simplify by using ckd_mul and ckd_add to check for overflow.
(main): Prefer signed types to unsigned.

2 years agocksum,df,digest: prefer signed types
Paul Eggert [Mon, 31 Jul 2023 23:30:24 +0000 (16:30 -0700)] 
cksum,df,digest: prefer signed types

* src/cksum.c (main):
* src/df.c (decode_output_arg):
* src/digest.c (valid_digits):
Prefer idx_t to unsigned types when the value is an index
into an array.

2 years agojoin: prefer signed types
Paul Eggert [Mon, 31 Jul 2023 23:29:49 +0000 (16:29 -0700)] 
join: prefer signed types

* src/join.c (struct outlist, struct field, struct line)
(struct seq, autocount_1, autocount_2, join_field_1, join_field_2)
(extract_field, keycmp, check_order, init_linep, free_spareline)
(getseq, delseq, prfield, prfields, prjoin, join, add_field)
(string_to_join_field, decode_field_spec, add_field_list)
(set_join_field, main):
Prefer signed integers to unsigned.

2 years agofactor: prefer signed types
Paul Eggert [Mon, 31 Jul 2023 20:43:19 +0000 (13:43 -0700)] 
factor: prefer signed types

When it’s easy, prefer signed types to unsigned, as
they are less confusing and allow overflow checking.
* src/factor.c (struct mp_factors, udiv_qrnnd)
(count_leading_zeros, count_trailing_zeros)
(factor_insert_multiplicity, mp_factor_clear, mp_factor_insert)
(factor_insert_refind, factor_using_division)
(mp_factor_using_division, powm2, millerrabin, millerrabin2)
(mp_millerrabin, prime_p, prime2_p, mp_prime_p, isqrt, isqrt2)
(invtab, q_freq, factor_using_squfof, strto2uintmax)
(print_factors_single, main):
Prefer signed integers to unsigned.

2 years agomaint: include idx.h everywhere
Paul Eggert [Mon, 31 Jul 2023 18:24:08 +0000 (11:24 -0700)] 
maint: include idx.h everywhere

* src/system.h: Include idx.h here, instead of in every file
that currently uses idx_t.  This should make it easier to use
idx_t in the future.

2 years agowho: fix only-theoretical overflow
Paul Eggert [Mon, 31 Jul 2023 18:21:25 +0000 (11:21 -0700)] 
who: fix only-theoretical overflow

Change stzncpy’s implementation to match its comment, in the case
where SRC + LEN would overflow.  This case never happens in coreutils.
* src/system.h (stzncpy): Work even if SRC + LEN would overflow.

2 years agotac: handle short reads on input
Pádraig Brady [Mon, 31 Jul 2023 11:41:26 +0000 (12:41 +0100)] 
tac: handle short reads on input

This can be reproduced by getting the read() above 2G,
which induces a short read, thus triggering the erroneous failure.

  $ truncate -s 5G 5G

  $ cat 5G | TMPDIR=$PWD tac | wc -c
  tac: /tmp/tacFt7txA: read error: Illegal seek
  0

With the fix in place we now get:

  $ cat 5G | TMPDIR=$PWD src/tac | wc -c
  5368709120

* src/tac.c (tac_seekable): Use full_read() to handle short reads.
* NEWS: Mention the bug fix.
Reported at https://bugs.debian.org/1042546

2 years agouptime: output correct user count on OpenBSD
Bruno Haible [Sun, 30 Jul 2023 14:30:08 +0000 (16:30 +0200)] 
uptime: output correct user count on OpenBSD

* src/uptime.c (print_uptime, uptime): Always call read_utmp
and count the result.
* NEWS: Mention the fix (text by Bruno Haible).

2 years agobuild: update gnulib submodule to latest
Paul Eggert [Mon, 31 Jul 2023 16:13:23 +0000 (09:13 -0700)] 
build: update gnulib submodule to latest

2 years agobuild: update gnulib submodule to latest
Paul Eggert [Sun, 30 Jul 2023 00:12:39 +0000 (17:12 -0700)] 
build: update gnulib submodule to latest

* NEWS: Mention a bug that this fixes.

2 years agomv: better diagnostic for 'mv dir x' failure
Paul Eggert [Sat, 22 Jul 2023 20:39:17 +0000 (13:39 -0700)] 
mv: better diagnostic for 'mv dir x' failure

Problem reported by Nir Oren <https://bugs.gnu.org/64785>.
* src/copy.c (copy_internal): Use a more-specific diagnostic when
a rename fails due to a problem that must be due to the
destination, avoiding user confusion in cases like 'mv dir x'
where x is a nonempty directory.
* tests/mv/dir2dir.sh: Adjust to match.

2 years agodoc: clarify tail -n/-c +NUM operation
Pádraig Brady [Thu, 20 Jul 2023 13:50:56 +0000 (14:50 +0100)] 
doc: clarify tail -n/-c +NUM operation

tail -n/-c +NUM, is different from tail -n/-c NUM,
and head -n/-c NUM, and head -n/c -NUM, in that it
specifies a 1 based index rather than a count to skip/include.
So clarify this in tail --help and tail info manual.
Note we also mention this gotcha at:
https://www.pixelbeat.org/docs/coreutils-gotchas.html#tail

* doc/coreutils.texi (tail invocation): Give examples for -c/-n +NUM,
to make it clear one has to specify a number 1 larger than
might be expected.
* src/tail.c (usage): State the skip at start edge case more clearly
in the -n description. -c is not often used with tail so we leave
full explanation of that to the info manual.  Also split the string
to simplify translation.

2 years agomaint: add a syntax check to prevent use of NULL
Pádraig Brady [Tue, 18 Jul 2023 22:08:42 +0000 (23:08 +0100)] 
maint: add a syntax check to prevent use of NULL

* cfg.mk (sc_prohibit_NULL): Direct to use nullptr instead.

2 years agotests: split: provide more isolated /tmp handling
Pádraig Brady [Tue, 18 Jul 2023 11:40:57 +0000 (12:40 +0100)] 
tests: split: provide more isolated /tmp handling

* tests/split/l-chunk.sh: Move the "expensive" portion to ...
* tests/split/l-chunk-root.sh: .. A new test split from l-chunk.sh
which uses an isolated TMPDIR, rather than exhausting /tmp,
as that gives false positive failures with some other coreutils tests
like tac-2-nonseekable.sh and shuf-reservoir.sh at least.
* tests/local.mk: Reference the new test.

2 years agosplit: honor $TMPDIR for temp files
Pádraig Brady [Tue, 18 Jul 2023 17:55:30 +0000 (18:55 +0100)] 
split: honor $TMPDIR for temp files

* bootstrap.conf: Depend on tmpdir rather than tmpfile,
as the standard tmpfile() doesn't honor $TMPDIR.
* src/split.c (copy_to_tmpfile): Adjust to call temp_stream() rather
than tmpfile();
* NEWS: Mention the improvement.

2 years agotac: fall back to /tmp if $TMPDIR is unavailable
Pádraig Brady [Tue, 18 Jul 2023 14:39:05 +0000 (15:39 +0100)] 
tac: fall back to /tmp if $TMPDIR is unavailable

This also refactors temp_stream() to its own module,
in preparation for use by split.

* src/tac.c: Refactor temp_stream() out to ...
* src/temp-stream.c: ... A new module mostly refactored from tac,
but uses tmpdir to more robustly support $TMPDIR,
while falling back to /tmp if not available.
* src/temp-stream.h: The new module interface.
* src/local.mk: Reference the new module from tac.
* tests/tac/tac.pl: Adjust to non failing missing $TMPDIR.
* po/POTFILES.in: Reference the new module with translatable strings.
* NEWS: Mention the user visible improvements to tac TMPDIR handling.

2 years agomaint: add syntax check to ensure safe mkstemp usage
Pádraig Brady [Tue, 18 Jul 2023 17:38:42 +0000 (18:38 +0100)] 
maint: add syntax check to ensure safe mkstemp usage

One needs to include stdlib--.h if using mkstemp()
lest one hits esoteric bugs with closed stdin etc.

* cfg.mk (sc_require_stdlib_safer): Add a new syntax check.
(sc_require_stdio_safer): Fix this; broken since commit fa7ed969c3.

2 years agojoin: promptly diagnose write errors
Pádraig Brady [Sat, 15 Jul 2023 20:55:23 +0000 (21:55 +0100)] 
join: promptly diagnose write errors

* src/join.c (prjoin): Check for write errors after each line.
* tests/misc/write-errors.sh: enable the test for join.
* NEWS: Mention the improvement.

2 years agocomm: promptly diagnose write errors
Pádraig Brady [Sat, 15 Jul 2023 20:43:07 +0000 (21:43 +0100)] 
comm: promptly diagnose write errors

* src/comm.c (writeline): Simplify by removing the unneeded STREAM
parameter.  Call write_error() upon ferror().
(compare_files): Adjust to simplified writeline().
* tests/misc/write-errors.sh: Enable comm test.
* NEWS: Mention the improvement.

2 years agocut: promptly diagnose write errors
Pádraig Brady [Sat, 15 Jul 2023 20:23:55 +0000 (21:23 +0100)] 
cut: promptly diagnose write errors

* src/cut.c (cut_bytes): Diagnose errors from fwrite() and putchar().
(cut_fields): Likewise.
* tests/misc/write-errors.sh: Enable the test for cut,
and augment to cover both cut_bytes() and cut_fields().
* NEWS: Mention the improvement.

2 years agouniq: promptly diagnose write errors
Pádraig Brady [Sat, 15 Jul 2023 20:10:38 +0000 (21:10 +0100)] 
uniq: promptly diagnose write errors

* src/uniq.c (write_line): Check the output from fwrite() immediately.
(check_file): Likewise.
* tests/misc/write-errors.sh: Enable the test case.
* NEWS: Mention the improvement.

2 years agood: promptly diagnose write errors
Pádraig Brady [Tue, 11 Jul 2023 11:46:50 +0000 (12:46 +0100)] 
od: promptly diagnose write errors

* src/od.c (dump): Check for write errors after each block written,
to exit early even with large / unbounded inputs.
* tests/misc/write-errors.sh: enable od check.
* NEWS: Mention the improvement.
Fixes https://bugs.gnu.org/64540

2 years agoall: avoid repeated diagnostic upon write error
Pádraig Brady [Sat, 15 Jul 2023 19:41:44 +0000 (20:41 +0100)] 
all: avoid repeated diagnostic upon write error

* cfg.mk (sc_some_programs_must_avoid_exit_failure): Adjust to
avoid false positive.
(sc_prohibit_exit_write_error): A new syntax check to prohibit
open coding error(..., "write error"); instead directing to use...
* src/system.h (write_error): ... a new function to clear stdout errors
before we explicitly diagnose a write error and exit.
* src/basenc.c: Use write_error() to ensure no repeated diagnostics.
* src/cat.c: Likewise.
* src/expand.c: Likewise.
* src/factor.c: Likewise.
* src/paste.c: Likewise.
* src/seq.c: Likewise.
* src/shuf.c: Likewise.
* src/split.c: Likewise.
* src/tail.c: Likewise.
* src/tr.c: Likewise.
* src/unexpand.c: Likewise.
* tests/misc/write-errors.sh: Remove TODOs for the fixed utilities:
expand, factor, paste, shuf, tr, unexpand.

2 years agotests: ensure utilties exit promptly upon write error
Pádraig Brady [Tue, 11 Jul 2023 12:28:53 +0000 (13:28 +0100)] 
tests: ensure utilties exit promptly upon write error

* tests/local.mk: Reference the new test.
* tests/misc/write-errors.sh: A new test to ensure utilities
exit promptly upon writing to /dev/full.

2 years agocksum: improve problematic_chars function
Jim Meyering [Fri, 14 Jul 2023 05:29:52 +0000 (22:29 -0700)] 
cksum: improve problematic_chars function

* src/digest.c (problematic_chars): Implement using strcspn,
and traversing S only once, rather than once per escaped byte.

2 years agomaint: give a new function the "pure" attribute
Pádraig Brady [Wed, 12 Jul 2023 19:34:47 +0000 (20:34 +0100)] 
maint: give a new function the "pure" attribute

* src/digest.c (problematic_chars): This recently introduced
function does not modify state so is pure, even though GCC 13.1 at least
did not warn about that attribute being appropriate.

2 years agocksum: escape filenames with a leading '\' in --check status
Pádraig Brady [Sat, 1 Jul 2023 16:01:18 +0000 (17:01 +0100)] 
cksum: escape filenames with a leading '\' in --check status

* src/digest.c (digest_check): Also escape in the case that the
file name contains '\'.
* tests/cksum/md5sum-bsd.sh: Add a test case.
* doc/coreutils.texi (md5um invocation): Clarify escaping operation.
* NEWS: Mention the bug fix.
Fixes https://bugs.gnu.org/64392

2 years agocksum: support transparent emulation of older utils
Pádraig Brady [Sat, 8 Jul 2023 14:14:12 +0000 (15:14 +0100)] 
cksum: support transparent emulation of older utils

Support -b, --binary, and -t, --text
to allow full emulation of older utilities with:
  exec cksum -a $algo --untagged "$@"
Note this would diverge from OpenBSD's support of cksum -b.

* src/digest.c: Change -b to mean --binary, not --base64 in all cases.
Accept -b and -t in all cases.  Keep --binary and --text undocumented
for cksum.
* tests/cksum/cksum-base64.pl: s/-b/--base64/.
* tests/cksum/cksum-a.sh: Ensure cksum supports -b and -t appropriately.
* NEWS: Mention the change in behavior.

2 years agomaint: avoid static analysis failure for ignored dup2 return
Pádraig Brady [Sat, 8 Jul 2023 12:42:51 +0000 (13:42 +0100)] 
maint: avoid static analysis failure for ignored dup2 return

* src/sort.c: We're ignoring failures from these calls,
so do so explicitly to avoid static analysis issues
as reported by coverity.

2 years agotests: mktemp -t: $TMPDIR has higher priority than -p
Sylvestre Ledru [Mon, 3 Jul 2023 21:37:11 +0000 (23:37 +0200)] 
tests: mktemp -t: $TMPDIR has higher priority than -p

* tests/misc/mktemp.pl: Ensure that with -t,
$TMPDIR has precedence over -p.

2 years agomaint: update .gitignore
Paul Eggert [Sat, 1 Jul 2023 18:31:41 +0000 (11:31 -0700)] 
maint: update .gitignore

Add some newly-created Gnulib files,
plus some bootstrap temporaries.

2 years agostty: fix untranslated diagnostics
Paul Eggert [Sat, 1 Jul 2023 18:31:41 +0000 (11:31 -0700)] 
stty: fix untranslated diagnostics

* src/stty.c (set_speed): Translate diagnostics.

2 years agomaint: sync bootstrap from Gnulib
Paul Eggert [Sat, 1 Jul 2023 18:31:41 +0000 (11:31 -0700)] 
maint: sync bootstrap from Gnulib

* bootstrap: Copy from gnulib/build-aux/bootstrap.

2 years agomaint: prefer ckd_add to INT_ADD_WRAPV etc
Paul Eggert [Sat, 1 Jul 2023 18:31:41 +0000 (11:31 -0700)] 
maint: prefer ckd_add to INT_ADD_WRAPV etc

* bootstrap.conf (gnulib_modules): Add stdckdint.
Also, in C source code, prefer C23 macros like ckd_add
to their Gnulib near-equivalents like INT_ADD_WRAPV.
Include <stdckdint.h> as needed.

2 years agowho: don’t crash if clock gyrates
Paul Eggert [Sat, 1 Jul 2023 18:31:41 +0000 (11:31 -0700)] 
who: don’t crash if clock gyrates

* src/who.c (idle_string): Avoid signed integer overflow
if the superuser messes with the clock in bizarre ways.
Remove an ‘assume’ that wasn’t correct under this scenario.

2 years agodf: omit GCC 5 ‘assume’s
Paul Eggert [Sat, 1 Jul 2023 18:31:41 +0000 (11:31 -0700)] 
df: omit GCC 5 ‘assume’s

* src/df.c (main):
* src/shred.c (dopass):
Omit ‘assumes’ needed to pacify GCC 5 but not needed with GCC 13.

2 years agomaint: pacify GCC bug#109613 better
Paul Eggert [Sat, 1 Jul 2023 18:31:40 +0000 (11:31 -0700)] 
maint: pacify GCC bug#109613 better

* src/cut.c (cut_file):
* src/nl.c (nl_file): Pacify GCC Bug#109613 in a better way, by
narrowing the coverage of the ‘assume’ so that bugs in the
no-longer-covered part are not masked.

2 years agomaint: stop pacifying Parfait
Paul Eggert [Sat, 1 Jul 2023 18:31:40 +0000 (11:31 -0700)] 
maint: stop pacifying Parfait

* src/fmt.c (get_paragraph):
* src/stty.c (display_changed, display_all): Omit calls to
‘assume’ that are present only to pacify false positives by Parfait
<https://labs.oracle.com/pls/apex/f?p=94065:12:17236785746387:13>,
which went in-house in 2012 and never came back.

2 years agobuild: update gnulib submodule to latest
Paul Eggert [Sat, 1 Jul 2023 18:31:40 +0000 (11:31 -0700)] 
build: update gnulib submodule to latest

2 years agomaint: go back to using ‘error’
Paul Eggert [Sat, 1 Jul 2023 18:31:40 +0000 (11:31 -0700)] 
maint: go back to using ‘error’

Now that Gnulib’s ‘error’ module does proper static checking
for not returning, we need no longer use the ‘die’ macro.
This makes code easier to read for people that are used to ‘error’.
* cfg.mk (error_fns, exclude_file_name_regexp): Remove ‘die’.
(sc_die_EXIT_FAILURE): Remove.
* src/die.h: Remove.  All includes removed.  All calls to ‘die’
changed back to calls to ‘error’.
* src/install.c (get_ids): Use quoteaf (problem found with
make syntax-check).
* src/system.h: Include error.h, since some of our macros call ‘error’.
Stop including error.h elsewhere.

2 years agomaint: improve static and dynamic checking
Paul Eggert [Sat, 1 Jul 2023 18:31:40 +0000 (11:31 -0700)] 
maint: improve static and dynamic checking

This modernizes the source code somewhat, to take advantage
of advances in GCC over the years, and Gnulib’s ‘assure’ module.
Include assure.h in files that now need it.
Do not include assert.h directly; it’s no longer needed.
* bootstrap.conf (gnulib_modules): Add ‘assure’.
* gl/lib/randread.c (randread_error):
* src/chmod.c (describe_change):
* src/chown-core.c (describe_change):
* src/cp.c (decode_preserve_arg):
* src/head.c (diagnose_copy_fd_failure):
* src/ls.c (parse_ls_color):
* src/od.c (decode_one_format):
* src/split.c (main):
* src/test.c (binary_operator, posixtest):
Prefer affirm to abort, since it has better diagnostics in the
normal case and better performance with -DNDEBUG.
* gl/lib/xdectoint.c, src/die.h: Include stddef.h, for unreachable.
* gl/lib/xdectoint.c: Do not include verify.h; no longer needed.
* gl/lib/xdectoint.c (__xnumtoint):
* src/die.h (die):
Prefer C23 unreachable () to assume (false).
* gl/lib/xfts.c (xfts_open):
* src/basenc.c (base32hex_encode):
* src/copy.c (abandon_move, copy_internal, valid_options):
* src/cut.c (cut_fields):
* src/df.c (alloc_field, decode_output_arg, get_dev):
* src/du.c (process_file, main):
* src/echo.c (usage):
* src/factor.c (udiv_qrnnd, mod2, gcd2_odd, factor_insert_large)
(mulredc2, factor_using_pollard_rho, isqrt2, div_smallq)
(factor_using_squfof):
* src/iopoll.c (iopoll_internal, fwrite_wait):
* src/join.c (add_field):
* src/ls.c (dev_ino_pop, main, gobble_file, sort_files):
* src/mv.c (do_move):
* src/od.c (decode_format_string, read_block, dump, main):
* src/remove.c (rm):
* src/rm.c (main):
* src/sort.c (stream_open):
* src/split.c (next_file_name, lines_chunk_split):
* src/stdbuf.c (main):
* src/stty.c (set_speed):
* src/tac-pipe.c (line_ptr_decrement, line_ptr_increment):
* src/touch.c (touch):
* src/tr.c (find_bracketed_repeat, get_next)
(validate_case_classes, get_spec_stats, string2_extend, main):
* src/tsort.c (search_item, tsort):
* src/wc.c (main):
Prefer affirm to assert, as it allows for better static
checking when compiling with -DNDEBUG.
* src/chown-core.c (change_file_owner):
* src/df.c (get_field_list):
* src/expr.c (printv, null, tostring, toarith, eval2):
* src/ls.c (time_type_to_statx, calc_req_mask, get_funky_string)
(print_long_format):
* src/numfmt.c (simple_strtod_fatal):
* src/od.c (decode_one_format):
* src/stty.c (mode_type_flag):
* src/tail.c (xlseek):
* src/tr.c (is_char_class_member, get_next, get_spec_stats)
(string2_extend):
Prefer unreachable () to abort () or assert (false) when merely
pacifying the compiler, e.g., in a switch statement on an enum
where all cases are covered.
* src/copy.c (valid_options): Now returns void; the bool was useless.
Caller no longer needs to assert.
* src/csplit.c (find_line):
* src/expand-common.c (next_file):
* src/shred.c (incname):
* src/sort.c (main):
* src/tr.c (append_normal_char, append_range, append_char_class)
(append_repeated_char, append_equiv_class):
* src/tsort.c (search_item):
Omit assert, since the hardware will check for us.
* src/df.c (header_mode): Now the enum type it should have been.
* src/du.c (process_file):
* src/ls.c (assert_matching_dev_ino):
* src/tail.c (valid_file_spec):
* src/tr.c (validate_case_classes):
Mark defns with MAYBE_UNUSED if they’re not used when -DNDEBUG.
* src/factor.c (prime_p, prime2_p, mp_prime_p): Now ATTRIBUTE_PURE.
Prefer affirm to error+abort.  No need to translate this diagnostic.
* src/fmt.c (get_paragraph):
* src/stty.c (display_changed, display_all, sane_mode):
* src/who.c (idle_string):
Prefer assume to assert, since the goal is merely pacification
and assert doesn’t pacify anyway if -DNDEBUG is used.
* src/join.c (decode_field_spec):
Omit unreachable abort.
* src/ls.c (assert_matching_dev_ino, main):
* src/tr.c (get_next):
Prefer assure to assert, since the check is relatively expensive
and won’t help static analysis.
* src/ls.c (main):
Prefer static_assert to assert of a constant expression.
(format_inode): Redo to make it clear that buflen doesn’t matter,
and that buf must have a certain number of bytes.  All callers changed.
This pacifies -Wformat-overflow.
* src/od.c (decode_one_format):
Omit an assert that tested for obviously undefined behavior,
as the compiler could optimize it away anyway.
* src/od.c (decode_one_format, decode_format_string):
Prefer ATTRIBUTE_NONNULL to runtime checking.
* src/stat.c: Do not include <stddef.h> since system.h does that now.
* src/sync.c (sync_arg):
Prefer unreachable () to assert (true), which was a typo.
* src/system.h: Include stddef.h, for unreachable.
* src/tail.c (xlseek): Simplify by relying on ‘error’ to exit.

2 years agomaint: fix indenting in previous change
Paul Eggert [Sat, 1 Jul 2023 18:31:40 +0000 (11:31 -0700)] 
maint: fix indenting in previous change

* src/ptx.c: Adjust to fit into 80 columns.

2 years agomaint: prefer C23-style nullptr
Paul Eggert [Thu, 29 Jun 2023 22:27:21 +0000 (15:27 -0700)] 
maint: prefer C23-style nullptr

* bootstrap.conf (gnulib_modules): Add nullptr.
In code, prefer nullptr to NULL where either will do.

2 years agobuild: ensure that makeinfo ≥ 6.8 checks the @menu structure
Bruno Haible [Thu, 22 Jun 2023 21:59:11 +0000 (23:59 +0200)] 
build: ensure that makeinfo ≥ 6.8 checks the @menu structure

See <https://lists.gnu.org/r/bug-texinfo/2023-06/msg00015.html>.

* doc/local.mk (MAKEINFO): New variable.
* cfg.mk (_makefile_at_at_check_exceptions): Update.

2 years agob2sum: fix UAR with --check with malformed checksum lines
Pádraig Brady [Thu, 22 Jun 2023 20:33:58 +0000 (21:33 +0100)] 
b2sum: fix UAR with --check with malformed checksum lines

* src/digest.c (split_3): Reinstate the check for whitespace after the
digest portion of the line, so that we exit early before inspecting
the file name which would be outside the passed buffer in the case
where the input does not contain a newline.
* tests/cksum/b2sum.sh: Add a test case.
* NEWS: Mention the bug fix.
* THANKS.in: Add Frank Busse who has reported multiple bugs using KLEE.
Fixes https://bugs.gnu.org/64229

2 years agomaint: update GCC bug number in comment
Paul Eggert [Wed, 21 Jun 2023 07:08:21 +0000 (00:08 -0700)] 
maint: update GCC bug number in comment

2 years agodoc: mention fix for bug#64123
Paul Eggert [Tue, 20 Jun 2023 06:23:39 +0000 (23:23 -0700)] 
doc: mention fix for bug#64123

2 years agobuild: update gnulib submodule to latest
Paul Eggert [Mon, 19 Jun 2023 21:17:32 +0000 (14:17 -0700)] 
build: update gnulib submodule to latest

2 years agotests: move tests to a directory per utility
Sylvestre Ledru [Sun, 11 Jun 2023 09:55:56 +0000 (11:55 +0200)] 
tests: move tests to a directory per utility

* cfg.mk: Adjust syntax check exclusion paths.
* tests/local.mk: Adjust for renamed tests.

2 years agodoc: mention cksum error fix with cpu feature checks changes
Pádraig Brady [Wed, 14 Jun 2023 23:53:54 +0000 (00:53 +0100)] 
doc: mention cksum error fix with cpu feature checks changes

* NEWS: Mention the error message to aid those searching
for solutions to the issue, and mention cksum also
as that was confirmed to fix the error with the adjusted
cpu feature detection, as discussed at https://bugs.debian.org/1037264
* src/cksum.c: Cleanup syntax-check failure from previous commit.

2 years agocksum,wc: clean up hw capability checking
Paul Eggert [Wed, 14 Jun 2023 21:52:37 +0000 (14:52 -0700)] 
cksum,wc: clean up hw capability checking

* src/cksum.c (cksum_pclmul) [!CRCTAB && !USE_PCLMUL_CRC32]:
Remove macro.
(cksum_fp): No longer file-scope.
(pclmul_supported): Define only if USE_PCLMUL_CRC32.
This omits the debug output "using generic hardware support"
for simplicity and consistency with wc’s output.
(crc_sum_stream) [!USE_PCLMUL_32]: No need for static function pointer.
* src/wc.c (wc_lines_p) [USE_AVX2_WC_LINECOUNT]: No longer file-scope.
(wc) [USE_AVX2_WC_LINECOUNT]: Check for avx2 support at most once,
which was surely the code’s original intent.
(wc) [!USE_AVX2_WC_LINECOUNT]: No need for static function pointer.

2 years agocksum,wc: don’t include <cpuid.h>
Paul Eggert [Wed, 14 Jun 2023 21:18:42 +0000 (14:18 -0700)] 
cksum,wc: don’t include <cpuid.h>

* src/cksum.c [!CRCTAB && USE_PCLMUL_CRC32]:
* src/wc.c [USE_AVX2_WC_LINECOUNT]:
Don’t include <cpuid.h>; no longer needed.

2 years agocksum: fix bug in check for cksum_pclmul
Paul Eggert [Wed, 14 Jun 2023 21:13:35 +0000 (14:13 -0700)] 
cksum: fix bug in check for cksum_pclmul

This fixes a typo in the previous patch.
Problem reported by Pádraig Brady <https://bugs.gnu.org/64058#11>.
* src/cksum.c (pclmul_supported): Also require AVX support
to use cksum_pclmul.

2 years agowc: port to kernels that disable XSAVE YMM
Paul Eggert [Wed, 14 Jun 2023 04:10:24 +0000 (21:10 -0700)] 
wc: port to kernels that disable XSAVE YMM

Problem reported by Dave Hansen <https://bugs.gnu.org/64058>.
Apply similar change to cksum and pclmul, too.
* NEWS: Mention wc fix.
* configure.ac (cpuid_exists, get_cpuid_count_exists):
Remove.  All uses removed, since we no longer use __get_cpuid or
__get_cpuid_count.
(pclmul_intrinsic_exists, avx2_intrinsic_exists): Set to no if
__builtin_cpu_supports calls cannot be compiled.
(HAVE_PCLMUL_INTRINSIC, HAVE_AVX2_INTRINSIC): Remove; unused.
Simplify surrounding code because of this.
* src/cksum.c (pclmul_supported):
* src/wc.c (avx2_supported):
Use __builtin_cpu_supports instead of doing it by hand.
Simplify surrounding code because of this.

2 years agodircolors: update list of backup file extensions
Ville Skyttä [Mon, 12 Jun 2023 20:27:37 +0000 (23:27 +0300)] 
dircolors: update list of backup file extensions

* src/dircolors.hin: Sort backup section by extension.
Treat .dpkg-new and .dpkg-tmp as backup files.
Treat .crdownload (Chromium based browsers' partial download)
as a backup file.

2 years agodd: fix parsing of numbers with more than two multipliers
Pádraig Brady [Sat, 10 Jun 2023 13:18:00 +0000 (14:18 +0100)] 
dd: fix parsing of numbers with more than two multipliers

* src/dd.c (parse_integer): Use recursion to support more than two
multipliers.  Also protect suffix[-1] access to ensure we don't
inspect before the passed string.
* tests/dd/bytes.sh: Add test cases.
* doc/coreutils.texi (dd invocation): Note the support for specifying
many multipliers in a number.
* NEWS: Mention the bug fix.
Fixes https://bugs.debian.org/1037275

2 years agobuild: update gnulib submodule to latest
Pádraig Brady [Fri, 9 Jun 2023 10:14:51 +0000 (11:14 +0100)] 
build: update gnulib submodule to latest

* gnulib: Update to latest.
* po/POTFILES.in: Remove recent sc_po_check workaround.
* tests/misc/date-debug.sh: Adjust as per spelling fix.

2 years agodoc: od --strings: clarify operation
Pádraig Brady [Thu, 8 Jun 2023 09:58:10 +0000 (10:58 +0100)] 
doc: od --strings: clarify operation

* doc/coreutils.texi (od invocation): Remove mention of ASCII,
as all printable characters in unibyte locales are output.
* src/od.c (usage): Clarify that only NUL terminated strings
are displayed, and that it's printable chars, not only graphic chars
that are output. I.e., spaces are output also if part of the string.
Reported at https://bugs.ddebian.org/1037217

2 years agomaint: ls.c: update stale comment for previous commit
Pádraig Brady [Wed, 7 Jun 2023 20:51:47 +0000 (21:51 +0100)] 
maint: ls.c: update stale comment for previous commit

* src/ls.c (gobble_file): Update comment to correspond with
the changes in the previous commit.

2 years agols: display command line symlinks that return ELOOP
Pádraig Brady [Wed, 7 Jun 2023 12:42:36 +0000 (13:42 +0100)] 
ls: display command line symlinks that return ELOOP

* src/ls.c (gobble_file): Ensure we lstat() a symlink
specified on the command line, if we receive ELOOP from stat().
* tests/ls/symlink-loop.sh: Add a new test.
* tests/local.mk: Reference the new test.
* NEWS: Mention the bug fix.
Fixes https://bugs.gnu.org/63931

2 years agols: use more standard symlink traversal
Pádraig Brady [Wed, 7 Jun 2023 11:32:46 +0000 (12:32 +0100)] 
ls: use more standard symlink traversal

* src/ls.c (gobble_file): stat() symlinks directly,
rather than their targets.  This will be more consistent
with how symlinks are generally accessed.
(make_link_name): Remove no longer used function.
Addresses https://bugs.gnu.org/63931

2 years agodoc: reference COPYING from README
Pádraig Brady [Wed, 7 Jun 2023 14:11:13 +0000 (15:11 +0100)] 
doc: reference COPYING from README

* README: Reference COPYING as per the GNU coding standards,
and soon to be enforced with a syntax-check from gnulib.

2 years agomaint: avoid syntax-check failure
Pádraig Brady [Tue, 6 Jun 2023 10:33:20 +0000 (11:33 +0100)] 
maint: avoid syntax-check failure

* po/POTFILES.in: Add lib/propername.h due to new comments
that trigger sc_po_check.

2 years agodoc: NEWS: mention the more defensive copy_file_range avoidance
Pádraig Brady [Tue, 6 Jun 2023 10:12:28 +0000 (11:12 +0100)] 
doc: NEWS: mention the more defensive copy_file_range avoidance

* NEWS: Mention the improvement in reinstating runtime avoidance
of copy_file_range(), that came with the last gnulib update,
picking up gnulib commit fb034b35.

2 years agobuild: update gnulib submodule to latest
Paul Eggert [Tue, 6 Jun 2023 05:38:20 +0000 (22:38 -0700)] 
build: update gnulib submodule to latest

2 years agomaint: use consistent make variable interpolation syntax
Pádraig Brady [Thu, 1 Jun 2023 12:19:24 +0000 (13:19 +0100)] 
maint: use consistent make variable interpolation syntax

* cfg.mk: Prefer $() interpolation over ${}
lest the reader is confused as to whether shell interpolation,
i.e. $${} was intended.