]> git.ipfire.org Git - thirdparty/rsync.git/blame - NEWS.md
Change args to maybe-make-man.
[thirdparty/rsync.git] / NEWS.md
CommitLineData
203b3d01
WD
1<a name="3.2.4"></a>
2
3# NEWS for rsync 3.2.4 (UNRELEASED)
4
5## Changes in this version:
6
1b9308b7
WD
7### OUTPUT CHANGES:
8
9 - A long-standing bug was preventing rsync from figuring out the current
10 locale's decimal point character, which made rsync always output numbers
11 using the "C" locale. Since this is now fixed in 3.2.4, a script that
12 parses rsync's decimal numbers (e.g. from the verbose footer) should be sure
13 to setup the environment in a way that the output continues to be in the C
14 locale. For instance, one of the following should work fine:
15
16 ```shell
17 export LC_ALL=C.UTF-8
18 ```
19
20 or maybe:
21
22 ```shell
23 if [ "${LC_ALL:-}" ]; then
24 export LANG="$LC_ALL"
25 export LC_CTYPE="$LC_ALL"
26 unset LC_ALL
27 fi
28 export LC_NUMERIC=C.UTF-8
29 ```
30
203b3d01
WD
31### BUG FIXES:
32
16c8b05f
WD
33 - Fixed a bug with `--inplace` + `--sparse` where the destination file could
34 get reconstructed with bogus data. This bug can be worked-around in older
35 rsync versions by also specifying `--no-W -M--no-W`. When running 3.2.4 or
36 newer for your copy, rsync now sends `--no-W` to the remote rsync in such a
37 scenario (just in case the remote rsync is a version with this bug).
38
b774dbc1 39 - Fixed a bug with `--mkpath` if a single-file copy specifies an existing
a79d9b22
WD
40 destination dir with a non-existing destination filename.
41
b774dbc1 42 - Fixed `--update -vv` to output "is uptodate" instead of "is newer" messages
fd6839b7
WD
43 for files that are being skipped due to an identical modify time. (This
44 was a new output quirk in 3.2.3.)
45
9cd85b84
WD
46 - When doing an append transfer, the sending side's file must not get shorter
47 or it is skipped. Fixes a crash that could occur when the size changes to 0
48 in the middle of the send negotiations.
49
d2a97a7a
WD
50 - When dealing with a special file in an alt-dest hierarchy, rsync now checks
51 the non-permissions mode bits to ensure that the 2 special files are really
52 the same.
53
16c8b05f
WD
54 - Fixed a bug where `--delay-updates` with stale partial data could cause a
55 file to fail to update.
56
57 - Fixed a few places that would output an INFO message with `--info=NAME` that
58 should only have been output given `--verbose` or `--itemize-changes`.
59
a79d9b22
WD
60 - Avoid a weird failure if you run a local copy with a (useless) `--rsh`
61 option that contains a `V`.
62
63### ENHANCEMENTS:
64
203b3d01
WD
65 - Use openssl's `-verify_hostname` option in the rsync-ssl script.
66
740ed11a
WD
67 - Added extra info to the "FILENAME exists" output of `--ignore-existing` when
68 `--info=skip2` is used. The skip message becomes "FILENAME exists (INFO)"
58f464f4 69 where the INFO is one of "type change", "sum change" (requires `-c`), "file
16c8b05f
WD
70 change" (based on the quick check), "attr change", or "uptodate". Prior
71 versions only supported `--info=skip1`.
72
73 - Added the `--fsync` option (promoted from the patches repo).
74
75 - Reduced memory usage for an incremental transfer that has a bunch of small
1b9308b7 76 directories.
16c8b05f 77
be3d6c0f
WD
78 - The rsync daemon can now handle a client address with an implied "%scope"
79 suffix.
80
7f8cf771 81 - Added support for `--atimes` on macOS and fixed using using it without `-t`.
78b5bc66 82
16c8b05f
WD
83 - Rsync can now update the xattrs on a read-only file when your user can
84 temporarily add user-write permission to the file. (It always worked for a
85 root transfer.)
86
be3d6c0f
WD
87 - Rsync can now work around an `--inplace` update of a file that is being
88 refused due to the Linux fs.protected_regular sysctl setting.
89
90 - When `--chown`, `--usermap`, or `--groupmap` is used, rsync now implies
91 the appropriate `--owner` and/or `--group` option.
92
e4669b81
WD
93 - Added the `--info=NONREG` setting to control if rsync should warn about
94 non-regular files in the transfer. This is enabled by default (keeping the
95 behavior the same as before), so specifying `--info=nonreg0` can be used to
96 turn the warnings off.
97
16c8b05f
WD
98 - More ASM optimizations from Shark64.
99
72adf49b
WD
100 - Transformed rrsync into a python script with improvements: security has been
101 beefed up; the known rsync options were updated to include recent additions;
102 rrsync rejects `-L` (`--copy-links`) by default to make it harder to exploit
103 any out-of-subdir symlinks; a new rrsync option of `-munge` tells rrsync to
104 always enable the `--munge-links` rsync option on the server side; a new
105 rrsync option of `-no-del` disables all `--remove*` and `--delete*` rsync
106 options on the server side; the log format has been tweaked slightly to add
107 seconds to the timestamp and output the command executed as a tuple; an
108 rrsync.1 manpage is now created.
16c8b05f
WD
109
110 - Work around a glibc bug where lchmod() breaks in a chroot w/o /proc mounted.
740ed11a 111
15bc7ded
WD
112 - Some manpage improvements.
113
a79d9b22
WD
114### PACKAGING RELATED:
115
7f8cf771 116 - Give configure the `--with-rrsync` option if you want `make install` to
72adf49b
WD
117 install the (now python3) rrsync script and its (new) man page.
118
119 - If the rrsync script is installed, make its package depend on python3 and
120 (suggested but not required) the python3 braceexpand lib.
121
a79d9b22
WD
122 - When creating a package from a non-release version (w/o a git checkout), the
123 packager can elect to create git-version.h and define RSYNC_GITVER to the
124 string they want `--version` to output. (The file is still auto-generated
125 using the output of `git describe` when building inside a non-shallow git
126 checkout, though.)
127
16c8b05f
WD
128 - Improved the IPv6 determination in configure.
129
1b9308b7 130 - Made SIMD & ASM configure default to "no" on non-Linux hosts due to various
16c8b05f
WD
131 reports of problems on NetBSD & macOS hosts. These tests were also tweaked
132 to support a host_cpu of amd64 in addition to x86_64.
133
a79d9b22
WD
134 - Fixed configure to not fail at the SIMD check when cross-compiling.
135
16c8b05f
WD
136 - Compile the C files with `-pedantic-errors` when possible so that we get
137 warned about an overflowed static initialization (among other things).
138
a79d9b22 139 - Added a SECURITY.md file.
203b3d01 140
15bc7ded
WD
141### DEVELOPER RELATED:
142
143 - Made it easier to write rsync tests that diff the output while also checking
144 the status code, and used the idiom to improve the existing tests.
145
16c8b05f
WD
146 - The packaging scripts & related python lib got some minor enhancements.
147
148### INTERNAL
149
150 - Use setenv() instead of putenv() when it is available.
151
152 - Improve the logic in compat.c so that we don't need to try to remember to
153 sprinkle `!local_server` exceptions throughout the protocol logic.
154
155 - One more C99 Flexible Array improvement (started in the last release).
156
203b3d01 157------------------------------------------------------------------------------
87b5d233
WD
158<a name="3.2.3"></a>
159
e94bad1c 160# NEWS for rsync 3.2.3 (6 Aug 2020)
87b5d233
WD
161
162## Changes in this version:
163
164### BUG FIXES:
165
fb6fabc1
WD
166 - Fixed a bug in the xattr code that was freeing the wrong object when trying
167 to cleanup the xattr list.
168
38a521de
WD
169 - Fixed a bug in the xattr code that was not leaving room for the "rsync."
170 prefix in some instances where it needed to be added.
171
20660249 172 - Restored the ability to use `--bwlimit=0` to specify no bandwidth limit. (It
38a521de 173 was accidentally broken in 3.2.2.)
f92a5182 174
b774dbc1 175 - Fixed a bug when combining `--delete-missing-args` with `--no-implied-dirs` &
96be713f
WD
176 `-R` where rsync might create the destination path of a missing arg. The
177 code also avoids some superfluous warnings for nested paths of removed args.
178
20660249
WD
179 - Fixed an issue where hard-linked devices could cause the rdev_major value to
180 get out of sync between the sender and the receiver, which could cause a
181 device to get created with the wrong major value in its major,minor pair.
182
f6967eca
WD
183 - Rsync now complains about a missing `--temp-dir` before starting any file
184 transfers.
185
e1e546d6
WD
186 - A completely empty source arg is now a fatal error. This doesn't change
187 the handling of implied dot-dir args such as "localhost:" and such.
188
87b5d233
WD
189### ENHANCEMENTS:
190
38a521de 191 - Allow `--max-alloc=0` to specify no limit to the alloc sanity check.
7e47855d 192
7e07a325 193 - Allow `--block-size=SIZE` to specify the size using units (e.g. "100K").
66ca4fc9 194
7e07a325
WD
195 - The name of the id-0 user & group are now sent to the receiver along with
196 the other user/group names in the transfer (instead of assuming that both
197 sides have the same id-0 names).
7e47855d 198
af531cf7
WD
199 - Added the `--stop-after=MINS` and `--stop-at=DATE_TIME` options (with the
200 `--time-limit=MINS` option accepted as an alias for `--stop-after`). This
201 is an enhanced version of the time-limit patch from the patches repo.
202
7e07a325
WD
203 - Added the `name converter` daemon parameter to make it easier to convert
204 user & group names inside a chrooted daemon module. This is based on the
205 nameconverter patch with some improvements, including a tweak to the request
206 protocol (so if you used this patch in the past, be sure to update your
96be713f 207 converter script to use newlines instead of null chars).
7e07a325 208
c3cf174e
WD
209 - Added `--crtimes` (`-N`) option for preserving the file's create time (I
210 believe that this is macOS only at the moment).
974f49e2 211
01742c07
WD
212 - Added `--mkpath` option to tell rsync that it should create a non-existing
213 path component of the destination arg.
214
21ecc833
WD
215 - Added `--stderr=errors|all|client` to replace the `--msgs2stderr` and
216 `--no-msgs2stderr` options (which are still accepted). The default use of
217 stderr was changed to be `--stderr=errors` where all the processes that have
218 stderr available output directly to stderr, which should help error messages
219 get to the user more quickly, especially when doing a push (which includes
220 local copying). This also allows rsync to exit quickly when a receiver
221 failure occurs, since rsync doesn't need to try to keep the connection alive
222 long enough for the fatal error to go from the receiver to the generator to
223 the sender. The old default can be requested via `--stderr=client`. Also
224 changed is that a non-default stderr mode is conveyed to the remote rsync
225 (using the older option names) instead of requiring the user to use
226 `--remote-option` (`-M`) to tell the remote rsync what to do.
0a255771 227
2f130496 228 - Added the ability to specify "@netgroup" names to the `hosts allow` and
38a521de
WD
229 `hosts deny` daemon parameters. This is a finalized version of the
230 netgroup-auth patch from the patches repo.
231
1b9308b7 232 - Rsync can now hard-link symlinks on FreeBSD due to it making use of the
14c4656f
WD
233 linkat() function when it is available.
234
0e814e95
WD
235 - Output file+line info on out-of-memory & overflow errors while also avoiding
236 the output of alternate build-dir path info that is not useful to the user.
237
f43412f1 238 - Change configure to know that Cygwin supports Linux xattrs.
c3cf174e 239
4c4fc746 240 - Improved the testsuite on FreeBSD & Cygwin.
2f130496 241
f92a5182 242 - Added some compatibility code for HPE NonStop platforms.
7e47855d 243
a5a9f268
WD
244 - Improved the INSTALL.md info.
245
14c4656f
WD
246 - Added a few more suffixes to the default skip-compress list.
247
b6aa9c5c
WD
248 - Improved configure's error handling to notify about several issues at once
249 instead of one by one (for the newest optional features).
250
7e47855d
WD
251### INTERNAL:
252
0e814e95
WD
253 - Use a simpler overflow check idiom in a few spots.
254
f92a5182 255 - Use a C99 Flexible Array for a trailing variable-size filename in a struct
38a521de 256 (with a fallback to the old 1-char string kluge for older compilers).
87b5d233
WD
257
258------------------------------------------------------------------------------
d15cfef9
WD
259<a name="3.2.2"></a>
260
194cee67 261# NEWS for rsync 3.2.2 (4 Jul 2020)
d15cfef9 262
d640d78f 263## Changes in this version:
d15cfef9
WD
264
265### BUG FIXES:
266
317beebe
WD
267 - Avoid a crash when a daemon module enables `transfer logging` without
268 setting a `log format` value.
269
fe2ef556 270 - Fixed installing rsync-ssl script from an alternate build dir.
d15cfef9 271
76064b1b
WD
272 - Fixed the updating of configure.sh from an alternate build dir.
273
d15cfef9
WD
274 - Apple requires the asm function name to begin with an underscore.
275
20660249 276 - Avoid a test failure in the daemon test when `--atimes` is disabled.
d15cfef9
WD
277
278### ENHANCEMENTS:
279
61971acb
WD
280 - Allow the server side to restrict checksum & compression choices via the
281 same environment variables the client uses. The env vars can be divided
282 into "client list & server list" by the "`&`" char or the same list can
283 apply to both.
d15cfef9 284
f805d1a7 285 - Simplify how the negotiation environment variables apply when interacting
e285f8f9 286 with an older rsync and also when a list contains only invalid names.
d15cfef9 287
89827e49
WD
288 - Do not allow a negotiated checksum or compression choice of "none" unless
289 the user authorized it via an environment variable or command-line option.
290
11eb67ee
WD
291 - Added the `--max-alloc=SIZE` option to be able to override the memory
292 allocator's sanity-check limit. It defaults to 1G (as before) but the error
293 message when exceeding it specifically mentions the new option so that you
294 can differentiate an out-of-memory error from a failure of this limit. It
295 also allows you to specify the value via the RSYNC_MAX_ALLOC environment
296 variable.
297
565cde84
WD
298 - Add the "open atime" daemon parameter to allow a daemon to always enable or
299 disable the use of O_NOATIME (the default is to let the user control it).
300
ce12142c 301 - The default systemd config was changed to remove the `ProtectHome=on`
544b3d8b
WD
302 setting since rsync is often used to serve files in /home and /root and this
303 seemed a bit too strict. Feel free to use `systemctl edit rsync` to add
304 that restriction (or maybe `ProtectHome=read-only`), if you like. See the
305 3.2.0 NEWS for the other restrictions that were added compared to 3.1.3.
ce12142c 306
11eb67ee
WD
307 - The memory allocation functions now automatically check for a failure and
308 die when out of memory. This eliminated some caller-side check-and-die
309 code and added some missing sanity-checking of allocations.
d15cfef9 310
feb2fff8
WD
311 - Put optimizations into their own list in the `--version` output.
312
11eb67ee
WD
313 - Improved the man page a bit more.
314
f805d1a7
WD
315### PACKAGING RELATED:
316
317 - Prepared the checksum code for an upcoming xxHash release that provides new
8df76691
WD
318 XXH3 (64-bit) & XXH128 (128-bit) checksum routines. These will not be
319 compiled into rsync until the xxhash v0.8.0 include files are installed on
320 the build host, and that release is a few weeks away at the time this was
321 written. So, if it's now the future and you have packaged and installed
322 xxhash-0.8.0-devel, a fresh rebuild of rsync 3.2.2 will give you the new
323 checksum routines. Just make sure that the new rsync package depends on
324 xxhash >= 0.8.0.
f805d1a7 325
7039d146
WD
326### DEVELOPER RELATED:
327
328 - Moved the version number out of configure.ac into its own version.h file so
329 that we don't need to reconfigure just because the version number changes.
330
7d30490e
WD
331 - Moved the daemon parameter list into daemon-parm.txt so that an awk script
332 can create the interrelated structs and accessors that loadparm.c needs.
333
d15cfef9 334------------------------------------------------------------------------------
b51b0b32 335<a name="3.2.1"></a>
87bca719 336
a8fc8fc2 337# NEWS for rsync 3.2.1 (22 Jun 2020)
bcb0a24a 338
d640d78f 339## Changes in this version:
bcb0a24a
WD
340
341### BUG FIXES:
342
246d117d
WD
343 - Fixed a potential build issue with the MD5 assembly-language code by
344 removing some non-portable directives.
f8c6f9f4
WD
345
346 - Use the preprocessor with the asm file to ensure that if the code is
68c45836 347 unneeded, it doesn't get built.
bcb0a24a 348
f4e6fe54 349 - Avoid the stack getting set to executable when including the asm code.
bcb0a24a 350
3f776f58
WD
351 - Some improvements in the SIMD configure testing to try to avoid build
352 issues, such as avoiding a clang++ core dump when `-g` is combined with
353 `-O2`. Note that clang++ is quite buggy in this area, and it does still
354 crash for some folks, so just use `--disable-simd` if you need to avoid
246d117d 355 their buggy compiler (since the configure test is apparently not finding
300fd305 356 all the compilers that will to crash and burn).
bcb0a24a 357
fe2ef556 358 - Fixed an issue in the md2man script when building from an alternate dir.
bb484a79 359
785cb938 360 - Disable `--atimes` on macOS (it apparently just ignores the atime change).
2e1b46db 361
bcb0a24a
WD
362### ENHANCEMENTS:
363
30945523
WD
364 - The use of `--backup-dir=STR` now implies `--backup`.
365
366 - Added `--zl=NUM` as a short-hand for `--compress-level=NUM`.
367
e16b2275 368 - Added `--early-input=FILE` option that allows the client to send some
f6df3708 369 data to a daemon's (optional) "early exec" script on its stdin.
e16b2275 370
246d117d 371 - Mention atimes in the capabilities list that `--version` outputs.
dfa34b47
WD
372
373 - Mention either "default protect-args" or "optional protect-args" in the
374 `--version` capabilities depending on how rsync was configured.
375
300fd305 376 - Some info on optimizations is now elided from the `--version` capabilities
246d117d
WD
377 since they aren't really user-facing capabilities. You can still see the
378 info (plus the status of a couple extra optimizations) by repeating the
dfa34b47 379 `--version` option (e.g. `-VV`).
bcb0a24a 380
b51b0b32
WD
381 - Updated various URLs to be https instead of http.
382
383 - Some documentation improvements.
f4e6fe54
WD
384
385### PACKAGING RELATED:
386
785cb938 387 - If you had to use `--disable-simd` for 3.2.0, you might want to try removing
246d117d
WD
388 that and see if it will succeed or auto-disable. Some buggy clang++
389 compilers are still not auto disabled, though.
f4e6fe54
WD
390
391 - The MD5 asm code is now under its own configure flag (not shared with the
392 SIMD setting), so if you have any issues compiling it, re-run configure with
393 `--disable-asm`.
394
87bca719
WD
395 - Merged the OLDNEWS.md file into NEWS.md.
396
bcb0a24a 397------------------------------------------------------------------------------
87bca719 398<a name="3.2.0"></a>
128139c6
WD
399
400# NEWS for rsync 3.2.0 (19 Jun 2020)
401
d640d78f 402## Changes in this version:
128139c6
WD
403
404### BUG FIXES:
405
406 - Avoid a potential out-of-bounds read in daemon mode if argc can be made to
407 become 0.
408
409 - Fix the default list of skip-compress files for non-daemon transfers.
410
411 - Fix xattr filter rules losing an 'x' attribute in a non-local transfer.
412
413 - Avoid an error when a check for a potential fuzzy file happens to reference
414 a directory.
415
416 - Make the atomic-rsync helper script have a more consistent error-exit.
417
300fd305
WD
418 - Make sure that a signal handler's use of exit_cleanup() calls `_exit()`
419 instead of exit().
128139c6
WD
420
421 - Various zlib fixes, including security fixes for CVE-2016-9843,
422 CVE-2016-9842, CVE-2016-9841, and CVE-2016-9840.
423
424 - Fixed an issue with `--remove-source-files` not removing a source symlink
425 when combined with `--copy-links`.
426
427 - Fixed a bug where the daemon would fail to write early fatal error messages
428 to the client, such as refused or unknown command-line options.
429
430 - Fixed the block-size validation logic when dealing with older protocols.
431
432 - Some rrsync fixes and enhancements to handle the latest options.
433
434 - Fixed a problem with the `--link-dest`|`--copy-dest` code when `--xattrs`
435 was specified along with multiple alternate-destination directories (it
436 could possibly choose a bad file match while trying to find a better xattr
437 match).
438
439 - Fixed a couple bugs in the handling of files with the `--sparse` option.
440
f6df3708 441 - Fixed a bug in the writing of the batch.sh file (w/`--write-batch`) when the
128139c6
WD
442 source & destination args were not last on the command-line.
443
444 - Avoid a hang when an overabundance of messages clogs up all the I/O buffers.
445
446 - Fixed a mismatch in the RSYNC_PID values put into the environment of
447 `pre-xfer exec` and a `post-xfer exec`.
448
449 - Fixed a crash in the `--iconv` code.
450
451 - Fixed a rare crash in the popt_unalias() code.
452
453### ENHANCEMENTS:
454
544b3d8b
WD
455 - The default systemd config was made stricter by default. For instance,
456 `ProtectHome=on` (which hides content in /root and /home/USER dirs),
457 `ProtectSystem=full` (which makes /usr, /boot, & /etc dirs read-only), and
458 `PrivateDevices=on` (which hides devices). You can override any of these
459 using the standard `systemctl edit rsync` and add one or more directives
460 under a `[Service]` heading (and restart the rsync service).
461
128139c6
WD
462 - Various checksum enhancements, including the optional use of openssl's MD4 &
463 MD5 checksum algorithms, some x86-64 optimizations for the rolling checksum,
464 some x86-64 optimizations for the (non-openssl) MD5 checksum, the addition
1bdf68b9 465 of xxHash checksum support, and a negotiation heuristic that ensures that it
128139c6
WD
466 is easier to add new checksum algorithms in the future. The environment
467 variable `RSYNC_CHECKSUM_LIST` can be used to customize the preference order
468 of the negotiation, or use `--checksum-choice` (`--cc`) to force a choice.
469
470 - Various compression enhancements, including the addition of zstd and lz4
471 compression algorithms and a negotiation heuristic that picks the best
472 compression option supported by both sides. The environment variable
473 `RSYNC_COMPRESS_LIST` can be used to customize the preference order of the
474 negotiation, or use `--compress-choice` (`--zc`) to force a choice.
475
785cb938 476 - Added a `--debug=NSTR` option that outputs details of the new negotiation
128139c6
WD
477 strings (for checksums and compression). The first level just outputs the
478 result of each negotiation on the client, level 2 outputs the values of the
479 strings that were sent to and received from the server, and level 3 outputs
480 all those values on the server side too (when the server was given the debug
481 option).
482
785cb938 483 - The `--debug=OPTS` command-line option is no longer auto-forwarded to the
128139c6
WD
484 remote rsync which allows for the client and server to have different levels
485 of debug specified. This also allows for newer debug options to be
785cb938 486 specified, such as using `--debug=NSTR` to see the negotiated hash result,
128139c6 487 without having the command fail if the server version is too old to handle
f6df3708 488 that debug item. Use `-M--debug=OPTS` to send the options to the remote side.
128139c6
WD
489
490 - Added the `--atimes` option based on the long-standing patch (just with some
491 fixes that the patch has been needing).
492
493 - Added `--open-noatime` option to open files using `O_NOATIME`.
494
495 - Added the `--write-devices` option based on the long-standing patch.
496
497 - Added openssl & preliminary gnutls support to the rsync-ssl script, which is
498 now installed by default. This was unified with the old stunnel-rsync
499 helper script to simplify packaging. Note that the script accepts the use
785cb938
WD
500 of `--type=gnutls` for gnutls testing, but does not look for gnutls-cli on
501 the path yet. The use of `--type=gnutls` will not work right until
502 gnutls-cli no longer drops data.
128139c6
WD
503
504 - Rsync was enhanced to set the `RSYNC_PORT` environment variable when running
505 a daemon-over-rsh script. Its value is the user-specified port number (set
506 via `--port` or an rsync:// URL) or 0 if the user didn't override the port.
507
508 - Added the `proxy protocol` daemon parameter that allows your rsyncd to know
509 the real remote IP when it is setup behind a proxy.
510
511 - Added negated matching to the daemon's `refuse options` setting by using
512 match strings that start with a `!` (such as `!compress*`). This lets you
513 refuse all options except for a particular approved list, for example. It
514 also lets rsync refuse certain options by default (such as `write-devices`)
515 while allowing the config to override that, as desired.
516
517 - Added the `early exec` daemon parameter that runs a script before the
518 transfer parameters are known, allowing some early setup based on module
519 name.
520
521 - Added status output in response to a signal (via both SIGINFO & SIGVTALRM).
522
523 - Added `--copy-as=USER` option to give some extra security to root-run rsync
524 commands into/from untrusted directories (such as backups and restores).
525
526 - When resuming the transfer of a file in the `--partial-dir`, rsync will now
527 update that partial file in-place instead of creating yet another tmp file
528 copy. This requires both sender & receiver to be at least v3.2.0.
529
530 - Added support for `RSYNC_SHELL` & `RSYNC_NO_XFER_EXEC` environment variables
531 that affect the early, pre-xfer, and post-xfer exec rsync daemon parameters.
532
533 - Optimize the `--fuzzy --fuzzy` heuristic to avoid the fuzzy directory scan
534 until all other basis-file options are exhausted (such as `--link-dest`).
535
536 - Have the daemon log include the normal-exit sent/received stats when the
537 transfer exited with an error when possible (i.e. if it is the sender).
538
539 - The daemon now locks its pid file (when configured to use one) so that it
540 will not fail to start when the file exists but no daemon is running.
541
542 - Various man page improvements, including some html representations (that
543 aren't installed by default).
544
785cb938 545 - Made `-V` the short option for `--version` and improved its information.
128139c6 546
785cb938
WD
547 - Pass the `-4` or `-6` option to the ssh command, making it easier to type
548 than `--rsh='ssh -4'` (or the `-6` equivalent).
128139c6
WD
549
550 - Added example config for rsyncd SSL proxy configs to rsyncd.conf.
551
552 - More errors messages now mention if the error is coming from the sender or
553 the receiver.
554
555### PACKAGING RELATED:
556
d495e343 557 - Add installed bash script: /usr/bin/rsync-ssl
128139c6
WD
558
559 - Add installed man page: /usr/man/man1/rsync-ssl.1
560
87bca719 561 - Tweak auxiliary doc file names, such as: README.md, INSTALL.md, & NEWS.md.
128139c6
WD
562
563 - The rsync-ssl script wants to run openssl or stunnel4, so consider adding a
564 dependency for one of those options (though it's probably fine to just let
565 it complain about being unable to find the program and let the user decide
566 if they want to install one or the other).
567
568 - If you packaged rsync + rsync-ssl + rsync-ssl-daemon as separate packages,
569 the rsync-ssl package is now gone (rsync-ssl should be considered to be
570 mainstream now that Samba requires SSL for its rsync daemon).
571
572 - Add _build_ dependency for liblz4-dev, libxxhash-dev, libzstd-dev, and
573 libssl-dev. These development libraries will give rsync extra compression
574 algorithms, extra checksum algorithms, and allow use of openssl's crypto
575 lib for (potentially) faster MD4/MD5 checksums.
576
577 - Add _build_ dependency for g++ or clang++ on x86_64 systems to enable the
578 SIMD checksum optimizations.
579
580 - Add _build_ dependency for _either_ python3-cmarkcfm or python3-commonmark
581 to allow for patching of man pages or building a git release. This is not
582 required for a release-tar build, since it comes with pre-built man pages.
583 Note that cmarkcfm is faster than commonmark, but they generate the same
584 data. The commonmark dependency is easiest to install since it's native
785cb938
WD
585 python, and can even be installed via `pip3 install --user commonmark` if
586 you want to just install it for the build user.
128139c6
WD
587
588 - Remove yodl _build_ dependency (if it was even listed before).
589
590### DEVELOPER RELATED:
591
592 - Silenced some annoying warnings about major() & minor() by improving an
593 autoconf include-file check.
594
595 - Converted the man pages from yodl to markdown. They are now processed via a
596 simple python3 script using the cmarkgfm **or** commonmark library. This
d495e343 597 should make it easier to package rsync, since yodl is rather obscure.
128139c6
WD
598
599 - Improved some configure checks to work better with strict C99 compilers.
600
601 - Some perl building/packaging scripts were recoded into awk and python3.
602
603 - Some defines in byteorder.h were changed into static inline functions that
604 will help to ensure that the args don't get evaluated multiple times on
605 "careful alignment" hosts.
606
607 - Some code typos were fixed (as pointed out by a Fossies run).
608
609------------------------------------------------------------------------------
87bca719
WD
610<a name="3.1.3"></a>
611
612# NEWS for rsync 3.1.3 (28 Jan 2018)
613
d640d78f 614## Changes in this version:
87bca719
WD
615
616### SECURITY FIXES:
617
618 - Fixed a buffer overrun in the protocol's handling of xattr names and ensure
619 that the received name is null terminated.
620
621 - Fix an issue with `--protect-args` where the user could specify the arg in the
622 protected-arg list and short-circuit some of the arg-sanitizing code.
623
624### BUG FIXES:
625
626 - Don't output about a new backup dir without appropriate info verbosity.
627
628 - Fixed some issues with the sort functions in support/rsyncstats script.
629
630 - Added a way to specify daemon config lists (e.g. users, groups, etc) that
631 contain spaces (see `auth users` in the latest rsyncd.conf manpage).
632
633 - If a backup fails (e.g. full disk) rsync exits with an error.
634
635 - Fixed a problem with a doubled `--fuzzy` option combined with `--link-dest`.
636
637 - Avoid invalid output in the summary if either the start or end time had an
638 error.
639
640 - We don't allow a popt alias to affect the `--daemon` or `--server` options.
641
642 - Fix daemon exclude code to disallow attribute changes in addition to
643 disallowing transfers.
644
645 - Don't force nanoseconds to match if a non-transferred, non-checksummed file
f43412f1 646 only passed the quick-check w/o comparing nanoseconds.
87bca719
WD
647
648### ENHANCEMENTS:
649
650 - Added the ability for rsync to compare nanosecond times in its file-check
651 comparisons, and added support nanosecond times on Mac OS X.
652
653 - Added a short-option (`-@`) for `--modify-window`.
654
655 - Added the `--checksum-choice=NAME[,NAME]` option to choose the checksum
656 algorithms.
657
658 - Added hashing of xattr names (with using `-X`) to improve the handling of
659 files with large numbers of xattrs.
660
661 - Added a way to filter xattr names using include/exclude/filter rules (see
662 the `--xattrs` option in the manpage for details).
663
664 - Added `daemon chroot|uid|gid` to the daemon config (in addition to the old
665 chroot|uid|gid settings that affect the daemon's transfer process).
666
667 - Added `syslog tag` to the daemon configuration.
668
669 - Some manpage improvements.
670
671### DEVELOPER RELATED:
672
673 - Tweak the `make` output when yodl isn't around to create the man pages.
674
675 - Changed an obsolete autoconf compile macro.
676
677 - Support newer yodl versions when converting man pages.
678
679------------------------------------------------------------------------------
680<a name="3.1.2"></a>
681
682# NEWS for rsync 3.1.2 (21 Dec 2015)
683
d640d78f 684## Changes in this version:
87bca719
WD
685
686### SECURITY FIXES:
687
688 - Make sure that all transferred files use only path names from inside the
689 transfer. This makes it impossible for a malicious sender to try to make the
690 receiver use an unsafe destination path for a transferred file, such as a
691 just-sent symlink.
692
693### BUG FIXES:
694
695 - Change the checksum seed order in the per-block checksums. This prevents
696 someone from trying to create checksum blocks that match in sum but not
697 content.
698
699 - Fixed a with the per-dir filter files (using `-FF`) that could trigger an
700 assert failure.
701
702 - Only skip `set_modtime()` on a transferred file if the time is exactly
703 right.
704
705 - Don't create an empty backup dir for a transferred file that doesn't exist
706 yet.
707
708 - Fixed a bug where `--link-dest` and `--xattrs` could cause rsync to exit if
709 a filename had a matching dir of the same name in the alt-dest area.
710
711 - Allow more than 32 group IDs per user in the daemon's gid=LIST config.
712
713 - Fix the logging of %b & %c via `--log-file` (daemon logging was already
714 correct, as was `--out-format='%b/%c'`).
715
716 - Fix erroneous acceptance of `--info=5` & `--debug=5` (an empty flag name is
717 not valid).
718
719### ENHANCEMENTS:
720
721 - Added `(DRY RUN)` info to the `--debug=exit` output line.
722
723 - Use usleep() for our msleep() function if it is available.
724
725 - Added a few extra long-option names to rrsync script, which will make
726 BackupPC happier.
727
f43412f1 728 - Made configure choose to use Linux xattrs on NetBSD (rather than not
87bca719
WD
729 supporting xattrs).
730
731 - Added `-wo` (write-only) option to rrsync support script.
732
733 - Misc. manpage tweaks.
734
735### DEVELOPER RELATED:
736
737 - Fixed a bug with the Makefile's use of `INSTALL_STRIP`.
738
739 - Improve a test in the suite that could get an erroneous timestamp error.
740
741 - Tweaks for newer versions of git in the packaging tools.
742
743 - Improved the m4 generation rules and some autoconf idioms.
744
745------------------------------------------------------------------------------
746<a name="3.1.1"></a>
747
748# NEWS for rsync 3.1.1 (22 Jun 2014)
749
d640d78f 750## Changes in this version:
87bca719
WD
751
752### BUG FIXES:
753
754 - If the receiver gets bogus filenames from the sender (an unexpected leading
755 slash or a `..` infix dir), exit with an error. This prevents a malicious
756 sender from trying to inject filenames that would affect an area outside the
757 destination directories.
758
759 - Fixed a failure to remove the partial-transfer temp file when interrupted
760 (and rsync is not saving the partial files).
761
762 - Changed the chown/group/xattr-set order to avoid losing some security-
763 related xattr info (that would get cleared by a chown).
764
765 - Fixed a bug in the xattr-finding code that could make a non-root-run
766 receiver not able to find some xattr numbers.
767
768 - Fixed a bug in the early daemon protocol where a timeout failed to be
769 honored (e.g. if the remote side fails to send us the initial protocol
770 greeting).
771
772 - Fixed unintended inclusion of commas in file numbers in the daemon log.
773
774 - We once again send the 'f' sub-flag (of `-e`) to the server side so it knows
775 that we can handle incremental-recursion directory errors properly in older
776 protocols.
777
778 - Fixed an issue with too-aggressive keep-alive messages causing a problem for
779 older rsync versions early in the transfer.
780
781 - Fixed an incorrect message about backup-directory-creation when using
782 `--dry-run` and the backup dir is not an absolute path.
783
784 - Fixed a bug where a failed deletion and/or a failed sender-side removal
785 would not affect the exit code.
786
787 - Fixed a bug that caused a failure when combining `--delete-missing-args`
788 with `--xattrs` and/or `--acls`.
789
790 - Fixed a strange `dir_depth` assertion error that was caused by empty-dir
791 removals and/or duplicate files in the transfer.
792
793 - Fixed a problem with `--info=progress2`'s output stats where rsync would
794 only update the stats at the end of each file's transfer. It now uses the
795 data that is flowing for the current file, making the stats more accurate
796 and less jumpy.
797
798 - Fixed an itemize bug that affected the combo of `--link-dest`, `-X`, and
799 `-n`.
800
801 - Fixed a problem with delete messages not appearing in the log file when the
802 user didn't use `--verbose`.
803
804 - Improve chunked xattr reading for OS X.
805
806 - Removed an attempted hard-link xattr optimization that was causing a
807 transfer failure. This removal is flagged in the compatibility code, so if a
808 better fix can be discovered, we have a way to flip it on again.
809
810 - Fixed a bug when the receiver is not configured to be able to hard link
811 symlimks/devices/special-file items but the sender sent some of these items
812 flagged as hard-linked.
813
814 - We now generate a better error if the buffer overflows in `do_mknod()`.
815
816 - Fixed a problem reading more than 16 ACLs on some OSes.
817
818 - Fixed the reading of the secrets file to avoid an infinite wait when the
819 username is missing.
820
821 - Fixed a parsing problem in the `--usermap`/`--groupmap` options when using
822 MIN-MAX numbers.
823
824 - Switched Cygwin back to using socketpair `pipes` to try to speed it up.
825
826 - Added knowledge of a few new options to rrsync.
827
828### ENHANCEMENTS:
829
830 - Tweaked the temp-file naming when `--temp-dir=DIR` is used: the temp-file
831 names will not get a '.' prepended.
832
833 - Added support for a new-compression idiom that does not compress all the
834 matching data in a transfer. This can help rsync to use less cpu when a
835 transfer has a lot of matching data, and also makes rsync compatible with a
836 non-bundled zlib. See the `--new-compress` and `--old-compress` options in
837 the manpage.
838
839 - Added the support/rsync-no-vanished wrapper script.
840
841 - Made configure more prominently mention when we failed to find yodl (in case
842 the user wants to be able to generate manpages from `*.yo` files).
843
844 - Have manpage mention how a daemon's max-verbosity setting affects info and
845 debug options. Also added more clarification on backslash removals for
846 excludes that contain wildcards.
847
848 - Have configure check if for the attr lib (for getxattr) for those systems
849 that need to link against it explicitly.
850
851 - Change the early dir-creation logic to only use that idiom in an
852 inc-recursive copy that is preserving directory times. e.g. using
853 `--omit-dir-times` will avoid these early directories being created.
854
855 - Fix a bug in `cmp_time()` that would return a wrong result if the 2 times
856 differed by an amount greater than what a `time_t` can hold.
857
858### DEVELOPER RELATED:
859
860 - We now include an example systemd file (in packaging/systemd).
861
862 - Tweaked configure to make sure that any intended use of the included popt
863 and/or zlib code is put early in the CFLAGS.
864
865------------------------------------------------------------------------------
866<a name="3.1.0"></a>
867
868# NEWS for rsync 3.1.0 (28 Sep 2013)
869
d640d78f
WD
870## Changes in this version:
871
872### PROTOCOL NUMBER:
87bca719 873
d640d78f 874 - The protocol number was changed to 31.
87bca719
WD
875
876### OUTPUT CHANGES:
877
878 - Output numbers in 3-digit groups by default (e.g. 1,234,567). See the
879 `--human-readable` option for a way to turn it off. See also the daemon's
880 `log format` parameter and related command-line options (including
881 `--out-format`) for a modifier that can be used to request digit-grouping or
882 human-readable output in log escapes. (Note that log output is unchanged by
883 default.)
884
885 - The `--list-only` option is now affected by the `--human-readable` setting.
886 It will display digit groupings by default, and unit suffixes if higher
887 levels of readability are requested. Also, the column width for the size
888 output has increased from 11 to 14 characters when human readability is
889 enabled. Use `--no-h` to get the old-style output and column size.
890
891 - The output of the `--progress` option has changed: the string `xfer` was
892 shortened to `xfr`, and the string `to-check` was shortened to `to-chk`,
893 both designed to make room for the (by default) wider display of file size
894 numbers without making the total line-length longer. Also, when incremental
895 recursion is enabled, the string `ir-chk` will be used instead of `to-chk`
896 up until the incremental-recursion scan is done, letting you know that the
897 value to check and the total value will still be increasing as new files are
898 found.
899
900 - Enhanced the `--stats` output: 1) to mention how many files were created
901 (protocol >= 28), 2) to mention how many files were deleted (a new line for
902 protocol 31, but only output when `--delete` is in effect), and 3) to follow
903 the file-count, created-count, and deleted-count with a subcount list that
904 shows the counts by type. The wording of the transferred count has also
905 changed so that it is clearer that it is only a count of regular files.
906
907### BUG FIXES:
908
909 - Fixed a bug in the iconv code when EINVAL or EILSEQ is returned with a full
910 output buffer.
911
1b9308b7 912 - Fixed some rare bugs in `--iconv` processing that might cause a multi-byte
87bca719
WD
913 character to get translated incorrectly.
914
915 - Fixed a bogus `vanished file` error if some files were specified with `./`
916 prefixes and others were not.
917
918 - Fixed a bug in `--sparse` where an extra gap could get inserted after a
919 partial write.
920
921 - Changed the way `--progress` overwrites its prior output in order to make it
922 nearly impossible for the progress to get overwritten by an error.
923
924 - Improved the propagation of abnormal-exit error messages. This should help
925 the client side to receive errors from the server when it is exiting
926 abnormally, and should also avoid dying with an `connection unexpectedly
927 closed` exit when the closed connection is really expected.
928
929 - The sender now checks each file it plans to remove to ensure that it hasn't
930 changed from the first stat's info. This helps to avoid losing file data
931 when the user is not using the option in a safe manner.
932
933 - Fixed a data-duplication bug in the compress option that made compression
934 less efficient. This improves protocol 31 onward, while behaving in a
935 compatible (buggy) manner with older rsync protocols.
936
937 - When creating a temp-file, rsync is now a bit smarter about it dot-char
938 choices, which can fix a problem on OS X with names that start with `..`.
939
940 - Rsync now sets a cleanup flag for `--inplace` and `--append` transfers that
941 will flush the write buffer if the transfer aborts. This ensures that more
942 received data gets written out to the disk on an aborted transfer (which is
943 quite helpful on a slow, flaky connection).
944
945 - The reads that `map_ptr()` now does are aligned on 1K boundaries. This helps
946 some filesystems and/or files that don't like unaligned reads.
947
948 - Fix an issue in the msleep() function if time jumps backwards.
949
950 - Fix daemon-server module-name splitting bug where an arg would get split
951 even if `--protect-args` was used.
952
953### ENHANCEMENTS:
954
955 - Added the `--remote-option=OPT` (`-M OPT`) command-line option that is
956 useful for things like sending a remote `--log-file=FILE` or `--fake-super`
957 option.
958
959 - Added the `--info=FLAGS` and `--debug=FLAGS` options to allow finer-grained
960 control over what is output. Added an extra type of `--progress` output
961 using `--info=progress2`.
962
963 - The `--msgs2stderr` option can help with debugging rsync by allowing the
964 debug messages to get output to stderr rather than travel via the socket
965 protocol.
966
967 - Added the `--delete-missing-args` and `--ignore-missing-args` options to
968 either delete or ignore user-specified files on the receiver that are
969 missing on the sender (normally the absence of user-specified files
970 generates an error).
971
972 - Added a `T` (terabyte) category to the `--human-readable` size suffixes.
973
974 - Added the `--usermap`/`--groupmap`/`--chown` options for manipulating file
975 ownership during the copy.
976
977 - Added the `%C` escape to the log-output handling, which will output the MD5
978 checksum of any transferred file, or all files if `--checksum` was specified
979 (when protocol 30 or above is in effect).
980
981 - Added the `reverse lookup` parameter to the rsync daemon config file to
982 allow reverse-DNS lookups to be disabled.
983
984 - Added a forward-DNS lookup for the daemon's hosts allow/deny config. Can be
985 disabled via `forward lookup` parameter (defaults to enabled).
986
987 - Added a way for more than one group to be specified in the daemon's config
988 file, including a way to specify that you want all of the specified user's
989 groups without having to name them. Also changed the daemon to complain
990 about an inability to set explicitly-specified uid/gid values, even when not
991 run by a super-user.
992
993 - The daemon now tries to send the user the error messages from the pre-xfer
994 exec script when it fails.
995
996 - Improved the use of alt-dest options into an existing hierarchy of files: If
997 a match is found in an alt-dir, it takes precedence over an existing file.
998 (We'll need to wait for a future version before attribute-changes on
999 otherwise unchanged files are safe when using an existing hierarchy.)
1000
1001 - Added per-user authorization options and group-authorization support to the
1002 daemon's `auth users` parameter.
1003
1004 - Added a way to reference environment variables in a daemon's config file
1005 (using %VAR% references).
1006
1007 - When replacing a non-dir with a symlink/hard-link/device/special-file, the
1008 update should now be done in an atomic manner.
1009
1010 - Avoid re-sending xattr info for hard-linked files w/the same xattrs
1011 (protocol 31).
1012
1013 - The backup code was improved to use better logic maintaining the backup
1014 directory hierarchy. Also, when a file is being backed up, rsync tries to
1015 hard-link it into place so that the upcoming replacement of the destination
1016 file will be atomic (for the normal, non-inplace logic).
1017
44cc1489 1018 - Added the ability to synchronize nanosecond modified times.
87bca719
WD
1019
1020 - Added a few more default suffixes for the `dont compress` settings.
1021
1022 - Added the checking of the `RSYNC_PROTECT_ARGS` environment variable to allow
1023 the default for the `--protect-args` command-line option to be overridden.
1024
1025 - Added the `--preallocate` command-line option.
1026
1027 - Allow `--password-file=-` to read the password from stdin (filename `-`).
1028
1029 - Rsync now comes packaged with an rsync-ssl helper script that can be used to
1030 contact a remote rsync daemon using a piped-stunnel command. It also
1031 includes an stunnel config file to run the server side to support ssl daemon
1032 connections. See the packaging/lsb/rsync.spec file for one way to package
1033 the resulting files. (Suggestions for how to make this even easier to
1034 install & use are welcomed.)
1035
1036 - Improved the speed of some `--inplace` updates when there are lots of
1037 identical checksum blocks that end up being unusable.
1038
1039 - Added the `--outbuf=N|L|B` option for choosing the output buffering.
1040
1041 - Repeating the `--fuzzy` option now causes the code to look for fuzzy matches
1042 inside alt-dest directories too.
1043
1044 - The `--chmod` option now supports numeric modes, e.g. `--chmod=644,D755`
1045
1046 - Added some Solaris xattr code.
1047
1048 - Made an rsync daemon (the listening process) exit with a 0 status when it
1049 was signaled to die. This helps launchd.
1050
1051 - Improved the `RSYNC_*` environment variables for the pre-xfer exec script:
1052 when a daemon is sent multiple request args, they are now joined into a
1053 single return value (separated by spaces) so that the `RSYNC_REQUEST`
1054 environment variable is accurate for any `pre-xfer exec`. The values in
1055 `RSYNC_ARG#` vars are no longer truncated at the `.` arg (prior to the
1056 request dirs/files), so that all the requested values are also listed
1057 (separately) in `RSYNC_ARG#` variables.
1058
1059### EXTRAS:
1060
1061 - Added an `instant-rsyncd` script to the support directory, which makes it
1062 easy to configure a simple rsync daemon in the current directory.
1063
1064 - Added the `mapfrom` and `mapto` scripts to the support directory, which
1065 makes it easier to do user/group mapping in a local transfer based on
1066 passwd/group files from another machine.
1067
1068 - There's a new, improved version of the lsh script in the support dir: it's
1069 written in perl and supports `-u` without resorting to using sudo (when run
1070 as root). The old shell version is now named lsh.sh.
1071
1072 - There is a helper script named rsync-slash-strip in the support directory
1073 for anyone that wants to change the way rsync handles args with trailing
1074 slashes. (e.g. arg/ would get stripped to arg while arg/. would turn into
1075 arg/).
1076
1077### INTERNAL:
1078
1079 - The I/O code was rewritten to be simpler and do bigger buffered reads over
1080 the socket. The I/O between the receiver and the generator was changed to be
1081 standard multiplexed-I/O (like that over the socket).
1082
1083 - The sender tries to use any dead time while the generator is looking for
1084 files to transfer in order to do sender-side directory scanning in a more
1085 parallel manner.
1086
1087 - A daemon can now inform a client about a daemon-configured timeout value so
1088 that the client can assist in the keep-alive activity (protocol 31).
1089
f43412f1 1090 - The filter code received some refactoring to make it more extendable, to
87bca719
WD
1091 read better, and do better sanity checking.
1092
1093 - Really big numbers are now output using our own big-num routine rather than
1094 casting them to a double and using a %.0f conversion.
1095
1096 - The `pool_alloc` library has received some minor improvements in alignment
1097 handling.
1098
1099 - Added `init_stat_x()` function to avoid duplication of acl/xattr init code.
1100
1101 - The included zlib was upgraded from 1.2.3 to 1.2.8.
1102
1103 - Rsync can now be compiled to use an unmodified zlib library instead of the
1104 tweaked one that is included with rsync. This will eventually become the
1105 default, at which point we'll start the countdown to removing the included
1106 zlib. Until then, feel free to configure using:
1107
1108 ./configure `--with-included-zlib=no`
1109
1110### DEVELOPER RELATED:
1111
1112 - Added more conditional debug output.
1113
f43412f1 1114 - Fixed some build issues for Android and Minix.
87bca719
WD
1115
1116------------------------------------------------------------------------------
1117<a name="3.0.9"></a>
1118
1119# NEWS for rsync 3.0.9 (23 Sep 2011)
1120
d640d78f 1121## Changes in this version:
87bca719
WD
1122
1123### BUG FIXES:
1124
1125 - Fix a crash bug in checksum scanning when `--inplace` is used.
1126
1127 - Fix a hang if a hard-linked file cannot be opened by the sender (e.g. if it
1128 has no read permission).
1129
1130 - Fix preservation of a symlink's system xattrs (e.g. selinux) on Linux.
1131
1132 - Fix a memory leak in the xattr code.
1133
1134 - Fixed a bug with `--delete-excluded` when a filter merge file has a rule
1135 that specifies a receiver-only side restriction.
1136
1137 - Fix a bug with the modifying of unwritable directories.
1138
1139 - Fix `--fake-super`'s interaction with `--link-dest` same-file comparisons.
1140
1141 - Fix the updating of the `curr_dir` buffer to avoid a duplicate slash.
1142
1143 - Fix the directory permissions on an implied dot-dir when using `--relative`
1144 (e.g. /outside/path/././send/path).
1145
1146 - Fixed some too-long sleeping instances when using `--bwlimit`.
1147
1148 - Fixed when symlink ownership difference-checking gets compiled into
1149 `unchanged_attrs()`.
1150
1151 - Improved the socket-error reporting when multiple protocols fail.
1152
1153 - Fixed a case where a socket error could reference just-freed memory.
1154
1155 - Failing to use a password file that was specified on the command-line is now
1156 a fatal error.
1157
1158 - Fix the non-root updating of directories that don't have the read and/or
1159 execute permission.
1160
1161 - Make daemon-excluded file errors more error-like.
1162
1163 - Fix a compilation issue on older C compilers (due to a misplaced var
1164 declaration).
1165
f43412f1 1166 - Make configure avoid finding socketpair on Cygwin.
87bca719
WD
1167
1168 - Avoid trying to reference `SO_BROADCAST` if the OS doesn't support it.
1169
1170 - Fix some issues with the post-processing of the man pages.
1171
1172 - Fixed the user home-dir handling in the support/lsh script.
1173
1174 - Some minor manpage improvements.
1175
1176------------------------------------------------------------------------------
1177<a name="3.0.8"></a>
1178
1179# NEWS for rsync 3.0.8 (26 Mar 2011)
1180
d640d78f 1181## Changes in this version:
87bca719
WD
1182
1183### BUG FIXES:
1184
1185 - Fixed two buffer-overflow issues: one where a directory path that is exactly
1186 MAXPATHLEN was not handled correctly, and one handling a `--backup-dir` that
1187 is extra extra large.
1188
1189 - Fixed a data-corruption issue when preserving hard-links without preserving
1190 file ownership, and doing deletions either before or during the transfer
1191 (CVE-2011-1097). This fixes some assert errors in the hard-linking code, and
1192 some potential failed checksums (via `-c`) that should have matched.
1193
1194 - Fixed a potential crash when an rsync daemon has a filter/exclude list and
1195 the transfer is using ACLs or xattrs.
1196
1197 - Fixed a hang if a really large file is being processed by an rsync that
1198 can't handle 64-bit numbers. Rsync will now complain about the file being
1199 too big and skip it.
1200
1201 - For devices and special files, we now avoid gathering useless ACL and/or
1202 xattr information for files that aren't being copied. (The un-copied files
1203 are still put into the file list, but there's no need to gather data that is
1204 not going to be used.) This ensures that if the user uses `--no-D`, that
1205 rsync can't possibly complain about being unable to gather extended
1206 information from special files that are in the file list (but not in the
1207 transfer).
1208
1209 - Properly handle requesting remote filenames that start with a dash. This
1210 avoids a potential error where a filename could be interpreted as a (usually
1211 invalid) option.
1212
1213 - Fixed a bug in the comparing of upper-case letters in file suffixes for
1214 `--skip-compress`.
1215
1216 - If an rsync daemon has a module configured without a path setting, rsync
1217 will now disallow access to that module.
1218
1219 - If the destination arg is an empty string, it will be treated as a reference
1220 to the current directory (as 2.x used to do).
1221
1222 - If rsync was compiled with a newer time-setting function (such as lutimes),
1223 rsync will fall-back to an older function (such as utimes) on a system where
1224 the newer function is not around. This helps to make the rsync binary more
1225 portable in mixed-OS-release situations.
1226
1227 - Fixed a batch-file writing bug that would not write out the full set of
1228 compatibility flags that the transfer was using. This fixes a potential
1229 protocol problem for a batch file that contains a sender-side I/O error: it
1230 would have been sent in a way that the batch-reader wasn't expecting.
1231
1232 - Some improvements to the hard-linking code to ensure that device-number
1233 hashing is working right, and to supply more information if the hard-link
1234 code fails.
1235
1236 - The `--inplace` code was improved to not search for an impossible checksum
1237 position. The quadruple-verbose chunk[N] message will now mention when an
1238 inplace chunk was handled by a seek rather than a read+write.
1239
1240 - Improved ACL mask handling, e.g. for Solaris.
1241
1242 - Fixed a bug that prevented `--numeric-ids` from disabling the translation of
1243 user/group IDs for ACLs.
1244
1245 - Fixed an issue where an xattr and/or ACL transfer that used an alt-dest
1246 option (e.g. `--link-dest`) could output an error trying to itemize the
1247 changes against the alt-dest directory's xattr/ACL info but was instead
1248 trying to access the not-yet-existing new destination directory.
1249
1250 - Improved xattr system-error messages to mention the full path to the file.
1251
1252 - The `--link-dest` checking for identical symlinks now avoids considering
1253 attribute differences that cannot be changed on the receiver.
1254
1255 - Avoid trying to read/write xattrs on certain file types for certain OSes.
1256 Improved configure to set `NO_SYMLINK_XATTRS`, `NO_DEVICE_XATTRS`, and/or
1257 `NO_SPECIAL_XATTRS` defines in config.h.
1258
1259 - Improved the unsafe-symlink errors messages.
1260
1261 - Fixed a bug setting xattrs on new files that aren't user writable.
1262
1263 - Avoid re-setting xattrs on a hard-linked file w/the same xattrs.
1264
1265 - Fixed a bug with `--fake-super` when copying files and dirs that aren't user
1266 writable.
1267
1268 - Fixed a bug where a sparse file could have its last sparse block turned into
1269 a real block when rsync sets the file size (requires ftruncate).
1270
1271 - If a temp-file name is too long, rsync now avoids truncating the name in the
1272 middle of adjacent high-bit characters. This prevents a potential filename
1273 error if the filesystem doesn't allow a name to contain an invalid
1274 multi-byte sequence.
1275
1276 - If a muli-protocol socket connection fails (i.e., when contacting a daemon),
1277 we now report all the failures, not just the last one. This avoids losing a
1278 relevant error (e.g. an IPv4 connection-refused error) that happened before
1279 the final error (e.g. an IPv6 protocol-not-supported error).
1280
1281 - Generate a transfer error if we try to call chown with a `-1` for a uid or a
1282 gid (which is not settable).
1283
1284 - Fixed the working of `--force` when used with `--one-file-system`.
1285
1286 - Fix the popt arg parsing so that an option that doesn't take an arg will
1287 reject an attempt to supply one (can configure `--with-included-popt` if
1288 your system's popt library doesn't yet have this fix).
1289
1290 - A couple minor option tweaks to the support/rrsync script, and also some
1291 regex changes that make vim highlighting happier.
1292
1293 - Fixed some issues in the support/mnt-excl script.
1294
1295 - Various manpage improvements.
1296
1297### ENHANCEMENTS:
1298
1299 - Added `.hg/` to the default cvs excludes (see `-C` & `--cvs-exclude`).
1300
1301### DEVELOPER RELATED:
1302
1303 - Use lchmod() whenever it is available (not just on symlinks).
1304
1305 - A couple fixes to the `socketpair_tcp()` routine.
1306
1307 - Updated the helper scripts in the packaging subdirectory.
1308
1309 - Renamed configure.in to configure.ac.
1310
1311 - Fixed configure's checking for iconv routines for newer OS X versions.
1312
1313 - Fixed the testsuite/xattrs.test script on OS X.
1314
1315------------------------------------------------------------------------------
1316<a name="3.0.7"></a>
1317
1318# NEWS for rsync 3.0.7 (31 Dec 2009)
1319
d640d78f 1320## Changes in this version:
87bca719
WD
1321
1322### BUG FIXES:
1323
1324 - Fixed a bogus free when using `--xattrs` with `--backup`.
1325
1326 - Avoid an error when `--dry-run` was trying to stat a prior hard-link file
1327 that hasn't really been created.
1328
1329 - Fixed a problem with `--compress` (`-z`) where the receiving side could
7f8cf771 1330 return the error "`inflate (token) returned -5`".
87bca719
WD
1331
1332 - Fixed a bug where `--delete-during` could delete in a directory before it
1333 noticed that the sending side sent an I/O error for that directory (both
1334 sides of the transfer must be at least 3.0.7).
1335
1336 - Improved `--skip-compress`'s error handling of bad character-sets and got
1337 rid of a lingering debug fprintf().
1338
1339 - Fixed the daemon's conveyance of `io_error` value from the sender.
1340
1341 - An rsync daemon use seteuid() (when available) if it used setuid().
1342
1343 - Get the permissions right on a `--fake-super` transferred directory that
1344 needs more owner permissions to emulate root behavior.
1345
1346 - An absolute-path filter rule (i.e. with a '/' modifier) no longer loses its
1347 modifier when sending the filter rules to the remote rsync.
1348
7f8cf771 1349 - Improved the "`--delete does not work without -r or -d`" message.
87bca719
WD
1350
1351 - Improved rsync's handling of `--timeout` to avoid a weird timeout case where
1352 the sender could timeout even though it has recently written data to the
1353 socket (but hasn't read data recently, due to the writing).
1354
1355 - Some misc manpage improvements.
1356
1357 - Fixed the chmod-temp-dir testsuite on a system without /var/tmp.
1358
1359 - Make sure that a timeout specified in the daemon's config is used as a
1360 maximum timeout value when the user also specifies a timeout.
1361
1362 - Improved the error-exit reporting when rsync gets an error trying to cleanup
1363 after an error: the initial error is reported.
1364
f43412f1 1365 - Improved configure's detection of IPv6 for Solaris and Cygwin.
87bca719
WD
1366
1367 - The AIX sysacls routines will now return ENOSYS if ENOTSUP is missing.
1368
1369 - Made our (only used if missing) getaddrinfo() routine use `inet_pton()`
1370 (which we also provide) instead of `inet_aton()`.
1371
1372 - The exit-related debug messages now mention the program's role so it is
1373 clear who output what message.
1374
1375### DEVELOPER RELATED:
1376
1377 - Got rid of type-punned compiler warnings output by newer gcc versions.
1378
1379 - The Makefile now ensures that proto.h will be rebuilt if config.h changes.
1380
f43412f1 1381 - The testsuite no longer uses `id -u`, so it works better on Solaris.
87bca719
WD
1382
1383------------------------------------------------------------------------------
1384<a name="3.0.6"></a>
1385
1386# NEWS for rsync 3.0.6 (8 May 2009)
1387
d640d78f 1388## Changes in this version:
87bca719
WD
1389
1390### BUG FIXES:
1391
1392 - Fixed a `--read-batch` hang when rsync is reading a batch file that was
1393 created from an incremental-recursion transfer.
1394
1395 - Fixed the daemon's socket code to handle the simultaneous arrival of
1396 multiple connections.
1397
1398 - Fix `--safe-links`/`--copy-unsafe-links` to properly handle symlinks that
1399 have consecutive slashes in the value.
1400
1401 - Fixed the parsing of an `[IPv6_LITERAL_ADDR]` when a USER@ is prefixed.
1402
1403 - The sender now skips a (bogus) symlink that has a 0-length value, which
1404 avoids a transfer error in the receiver.
1405
1406 - Fixed a case where the sender could die with a tag-0 error if there was an
1407 I/O during the sending of the file list.
1408
1409 - Fixed the rrsync script to avoid a server-side problem when `-e` is at the
1410 start of the short options.
1411
1412 - Fixed a problem where a vanished directory could turn into an exit code 23
1413 instead of the proper exit code 24.
1414
1415 - Fixed the `--iconv` conversion of symlinks when doing a local copy.
1416
1417 - Fixed a problem where `--one-file-system` was not stopping deletions on the
1418 receiving side when a mount-point directory did not match a directory in the
1419 transfer.
1420
1421 - Fixed the dropping of an ACL mask when no named ACL values were present.
1422
1423 - Fixed an ACL/xattr corruption issue where the `--backup` option could cause
1424 rsync to associate the wrong ACL/xattr information with received files.
1425
1426 - Fixed the use of `--xattrs` with `--only-write-batch`.
1427
1428 - Fixed the use of `--dry-run` with `--read-batch`.
1429
1430 - Fixed configure's erroneous use of target.
1431
1432 - Fixed configure's `--disable-debug` option.
1433
1434 - Fixed a run-time issue for systems that can't find `iconv_open()` by adding
1435 the `--disable-iconv-open` configure option.
1436
1437 - Complain and die if the user tries to combine `--remove-source-files` (or
1438 the deprecated `--remove-sent-files`) with `--read-batch`.
1439
1440 - Fixed an failure transferring special files from Solaris to Linux.
1441
1442------------------------------------------------------------------------------
1443<a name="3.0.5"></a>
1444
1445# NEWS for rsync 3.0.5 (28 Dec 2008)
1446
d640d78f 1447## Changes in this version:
87bca719
WD
1448
1449### BUG FIXES:
1450
1451 - Initialize xattr data in a couple spots in the hlink code, which avoids a
1452 crash when the xattr pointer's memory happens to start out non-zero. Also
1453 fixed the itemizing of an alt-dest file's xattrs when hard-linking.
1454
1455 - Don't send a bogus `-` option to an older server if there were no short
1456 options specified.
1457
1458 - Fixed skipping of unneeded updates in a batch file when incremental
1459 recursion is active. Added a test for this. Made batch-mode handle `redo`
1460 files properly (and without hanging).
1461
1462 - Fix the %P logfile escape when the daemon logs from inside a chroot.
1463
1464 - Fixed the use of `-s` (`--protect-args`) when used with a remote source or
1465 destination that had an empty path (e.g. `host:`). Also fixed a problem when
1466 `-s` was used when accessing a daemon via a remote-shell.
1467
1468 - Fixed the use of a dot-dir path (e.g. foo/./bar) inside a `--files-from`
1469 file when the root of the transfer isn't the current directory.
1470
1471 - Fixed a bug with `-K --delete` removing symlinks to directories when
1472 incremental recursion is active.
1473
1474 - Fixed a hard to trigger hang when using `--remove-source-files`.
1475
1476 - Got rid of an annoying delay when accessing a daemon via a remote-shell.
1477
1478 - Properly ignore (superfluous) source args on a `--read-batch` command.
1479
1480 - Improved the manpage's description of the `*` wildcard to remove the
1481 confusing `non-empty` qualifier.
1482
1483 - Fixed reverse lookups in the compatibility-library version of getnameinfo().
1484
1485 - Fixed a bug when using `--sparse` on a sparse file that has over 2GB of
1486 consecutive sparse data.
1487
1488 - Avoid a hang when using at least 3 `--verbose` options on a transfer with a
1489 client sender (which includes local copying).
1490
1491 - Fixed a problem with `--delete-delay` reporting an error when it was ready
1492 to remove a directory that was now gone.
1493
1494 - Got rid of a bunch of `warn_unused_result` compiler warnings.
1495
1496 - If an ftruncate() on a received file fails, it now causes a partial-
1497 transfer warning.
1498
1499 - Allow a path with a leading `//` to be preserved (CYGWIN only).
1500
1501### ENHANCEMENTS:
1502
1503 - Made the support/atomic-rsync script able to perform a fully atomic update
1504 of the copied hierarchy when the destination is setup using a particular
1505 symlink idiom.
1506
1507------------------------------------------------------------------------------
1508<a name="3.0.4"></a>
1509
1510# NEWS for rsync 3.0.4 (6 Sep 2008)
1511
d640d78f 1512## Changes in this version:
87bca719
WD
1513
1514### BUG FIXES:
1515
1516 - Fixed a bug in the hard-linking code where it would sometimes try to
1517 allocate 0 bytes of memory (which fails on some OSes, such as AIX).
1518
1519 - Fixed the hard-linking of files from a device that has a device number of 0
1520 (which seems to be a common device number on NetBSD).
1521
1522 - Fixed the handling of a `--partial-dir` that cannot be created. This
1523 particularly impacts the `--delay-updates` option (since the files cannot be
1524 delayed without a partial-dir), and was potentially destructive if the
1525 `--remove-source-files` was also specified.
1526
1527 - Fixed a couple issues in the `--fake-super` handling of xattrs when the
1528 destination files have root-level attributes (e.g. selinux values) that a
1529 non-root copy can't affect.
1530
1531 - Improved the keep-alive check in the generator to fire consistently in
1532 incremental-recursion mode when `--timeout` is enabled.
1533
1534 - The `--iconv` option now converts the content of a symlink too, instead of
1535 leaving it in the wrong character-set (requires 3.0.4 on both sides of the
1536 transfer).
1537
1538 - When using `--iconv`, if a filename fails to convert on the receiving side,
1539 this no longer makes deletions in the root-dir of the transfer fail silently
1540 (the user now gets a warning about deletions being disabled due to IO error
1541 as long as `--ignore-errors` was not specified).
1542
1543 - When using `--iconv`, if a server-side receiver can't convert a filename,
1544 the error message sent back to the client no longer mangles the name with
1545 the wrong charset conversion.
1546
1547 - Fixed a potential alignment issue in the IRIX ACL code when allocating the
1548 initial `struct acl` object. Also, cast mallocs to avoid warnings.
1549
1550 - Changed some errors that were going to stdout to go to stderr.
1551
1552 - Made `human_num()` and `human_dnum()` able to output a negative number
1553 (rather than outputting a cryptic string of punctuation).
1554
1555### ENHANCEMENTS:
1556
1557 - Rsync will avoid sending an `-e` option to the server if an older protocol
1558 is requested (and thus the option would not be useful). This lets the user
1559 specify the `--protocol=29` option to access an overly-restrictive server
1560 that is rejecting the protocol-30 use of `-e` to the server.
1561
1562 - Improved the message output for an `RERR_PARTIAL` exit.
1563
1564### DEVELOPER RELATED:
1565
1566 - The Makefile will not halt for just a timestamp change on the Makefile or
1567 the configure files, only for actual changes in content.
1568
1569 - Changed some commands in the testsuite's xattrs.test that called `rsync`
1570 instead of `$RSYNC`.
1571
1572 - Enhanced the release scripts to be able to handle a branch release and to do
1573 even more consistency checks on the files.
1574
1575------------------------------------------------------------------------------
1576<a name="3.0.3"></a>
1577
1578# NEWS for rsync 3.0.3 (29 Jun 2008)
1579
d640d78f 1580## Changes in this version:
87bca719
WD
1581
1582### BUG FIXES:
1583
1584 - Fixed a wildcard matching problem in the daemon when a module has `use
1585 chroot` enabled.
1586
1587 - Fixed a crash bug in the hard-link code.
1588
1589 - Fixed the sending of xattr directory information when the code finds a
1590 `--link-dest` or `--copy-dest` directory with unchanged xattrs -- the
1591 destination directory now gets these unchanged xattrs properly applied.
1592
1593 - Fixed an xattr-sending glitch that could cause an `Internal abbrev` error.
1594
1595 - Fixed the combination of `--xattrs` and `--backup`.
1596
f43412f1 1597 - The generator no longer allows a '.' dir to be excluded by a daemon-exclude
87bca719
WD
1598 rule.
1599
1600 - Fixed deletion handling when copying a single, empty directory (with no
1601 files) to a differently named, non-existent directory.
1602
1603 - Fixed the conversion of spaces into dashes in the %M log escape.
1604
1605 - Fixed several places in the code that were not returning the right errno
1606 when a function failed.
1607
1608 - Fixed the backing up of a device or special file into a backup dir.
1609
1610 - Moved the setting of the socket options prior to the connect().
1611
1612 - If rsync exits in the middle of a `--progress` output, it now outputs a
1613 newline to help prevent the progress line from being overwritten.
1614
1615 - Fixed a problem with how a destination path with a trailing slash or a
1616 trailing dot-dir was compared against the daemon excludes.
1617
1618 - Fixed the sending of large (size > 16GB) files when talking to an older
1619 rsync (protocols < 30): we now use a compatible block size limit.
1620
1621 - If a file's length is so huge that we overflow a checksum buffer count (i.e.
1622 several hundred TB), warn the user and avoid sending an invalid checksum
1623 struct over the wire.
1624
1625 - If a source arg is excluded, `--relative` no longer adds the excluded arg's
1626 implied dirs to the transfer. This fix also made the exclude check happen in
1627 the better place in the sending code.
1628
1629 - Use the `overflow_exit()` function for overflows, not `out_of_memory()`.
1630
1631 - Improved the code to better handle a system that has only 32-bit file
1632 offsets.
1633
1634### ENHANCEMENTS:
1635
1636 - The rsyncd.conf manpage now consistently refers to the parameters in the
1637 daemon config file as `parameters`.
1638
1639 - The description of the `--inplace` option was improved.
1640
1641### EXTRAS:
1642
1643 - Added a new script in the support directory, deny-rsync, which allows an
1644 admin to (temporarily) replace the rsync command with a script that sends an
1645 error message to the remote client via the rsync protocol.
1646
1647### DEVELOPER RELATED:
1648
1649 - Fixed a testcase failure if the tests are run as root and made some
1650 compatibility improvements.
1651
1652 - Improved the daemon tests, including checking module comments, the listing
1653 of files, and the ensuring that daemon excludes can't affect a dot-dir arg.
1654
1655 - Improved some build rules for those that build in a separate directory from
1656 the source, including better install rules for the man pages, and the fixing
1657 of a proto.h-tstamp rule that could make the binaries get rebuild without
1658 cause.
1659
7f8cf771
WD
1660 - Improved the testsuite to work around a problem with some utilities (e.g.
1661 `cp -p` & `touch -r`) rounding sub-second timestamps.
87bca719
WD
1662
1663 - Ensure that the early patches don't cause any generated-file hunks to
1664 bleed-over into patches that follow.
1665
1666------------------------------------------------------------------------------
1667<a name="3.0.2"></a>
1668
1669# NEWS for rsync 3.0.2 (8 Apr 2008)
1670
d640d78f 1671## Changes in this version:
87bca719
WD
1672
1673### BUG FIXES:
1674
1675 - Fixed a potential buffer overflow in the xattr code.
1676
1677### ENHANCEMENTS:
1678
1679 - None.
1680
1681### DEVELOPER RELATED:
1682
1683 - The RPM spec file was improved to install more useful files.
1684
1685 - A few developer-oriented scripts were moved from the support dir to the
1686 packaging dir.
1687
1688------------------------------------------------------------------------------
1689<a name="3.0.1"></a>
1690
1691# NEWS for rsync 3.0.1 (3 Apr 2008)
1692
d640d78f 1693## Changes in this version:
87bca719
WD
1694
1695### NOTABLE CHANGES IN BEHAVIOR:
1696
1697 - Added the 'c'-flag to the itemizing of non-regular files so that the
1698 itemized output doesn't get hidden if there were no attribute changes, and
1699 also so that the itemizing of a `--copy-links` run will distinguish between
1700 copying an identical non-regular file and the creation of a revised version
1701 with a new value (e.g. a changed symlink referent, a new device number,
1702 etc.).
1703
1704### BUG FIXES:
1705
1706 - Fixed a crash bug when a single-use rsync daemon (via remote shell) was run
1707 without specifying a `--config=FILE` option.
1708
1709 - Fixed a crash when backing up a directory that has a default ACL.
1710
1711 - Fixed a bug in the handling of xattr values that could cause rsync to not
1712 think that a file's extended attributes are up-to-date.
1713
1714 - Fixed the working of `--fake-super` with `--link-dest` and `--xattrs`.
1715
1716 - Fixed a hang when combining `--dry-run` with `--remove-source-files`.
1717
1718 - Fixed a bug with `--iconv`'s handling of files that cannot be converted: a
1719 failed name can no longer cause a transfer failure.
1720
1721 - Fixed the building of the rounding.h file on systems that need custom
1722 CPPFLAGS to be used. Also improved the error reporting if the building of
1723 rounding.h fails.
1724
1725 - Fixed the use of the `--protect-args` (`-s`) option when talking to a
1726 daemon.
1727
1728 - Fixed the `--ignore-existing` option's protection of files on the receiver
1729 that are non-regular files on the sender (e.g. if a symlink or a dir on the
1730 sender is trying to replace a file on the receiver). The reverse protection
1731 (protecting a dir/symlink/device from being replaced by a file) was already
1732 working.
1733
1734 - Fixed an assert failure if `--hard-links` is combined with an option that
1735 can skip a file in a set of hard-linked files (i.e. `--ignore-existing`,
1736 `--append`, etc.), without skipping all the files in the set.
1737
1738 - Avoid setting the modify time on a directory that already has the right
1739 modify time set. This avoids tweaking the dir's ctime.
1740
1741 - Improved the daemon-exclude handling to do a better job of applying the
1742 exclude rules to path entries. It also sends the user an error just as if
1743 the files were actually missing (instead of silently ignoring the user's
1744 args), and avoids sending the user the filter-action messages for these
1745 non-user-initiated rules.
1746
1747 - Fixed some glitches with the dry-run code's missing-directory handling,
1748 including a problem when combined with `--fuzzy`.
1749
1750 - Fixed some glitches with the skipped-directory handling.
1751
1752 - Fixed the 'T'-flag itemizing of symlinks when `--time` isn't preserved.
1753
1754 - Fixed a glitch in the itemizing of permissions with the `-E` option.
1755
1756 - The `--append` option's restricting of transfers to those that add data no
f43412f1 1757 longer prevents the updating of non-content changes to otherwise up-to-date
87bca719
WD
1758 files (i.e. those with the same content but differing permissions,
1759 ownership, xattrs, etc.).
1760
1761 - Don't allow `--fake-super` to be specified with `-XX` (double `--xattrs`)
1762 because the options conflict. If a daemon has `fake super` enabled, it
1763 automatically downgrades a `-XX` request to `-X`.
1764
1765 - Fixed a couple bugs in the parsing of daemon-config excludes that could make
1766 a floating exclude rule get treated as matching an absolute path.
1767
1768 - A daemon doesn't try to auto-refuse the `iconv` option if iconv-support
1769 wasn't compiled in to the daemon (avoiding a warning in the logs).
1770
1771 - Fixed the inclusion of per-dir merge files from implied dirs.
1772
1773 - Fixed the support/rrsync script to work with the latest options that rsync
1774 sends (including its flag-specifying use of `-e` to the server).
1775
1776### ENHANCEMENTS:
1777
1778 - Added the `--old-dirs` (`--old-d`) option to make it easier for a user to
1779 ask for file-listings with older rsync versions (this is easier than having
1780 to type `-r --exclude='/*/*'` manually).
1781
1782 - When getting an error while asking an older rsync daemon for a file listing,
1783 rsync will try to notice if the error is a rejection of the `--dirs` (`-d`)
1784 option and let the user know how to work around the issue.
1785
1786 - Added a few more `--no-OPTION` overrides.
1787
1788 - Improved the documentation of the `--append` option.
1789
1790 - Improved the documentation of the filter/exclude/include daemon parameters.
1791
1792### INTERNAL:
1793
1794 - Fixed a couple minor bugs in the included popt library (ones which I sent to
1795 the official popt project for inclusion in the 1.14 release).
1796
1797 - Fixed a stat() call that should have been `do_stat()` so that the proper
1798 normal/64-bit stat() function gets called. (Was in an area that should not
1799 have caused problems, though.)
1800
1801 - Changed the file-glob code to do a directory scan without using the `glob`
1802 and `glob.h`. This lets us do the globbing with less memory churn, and also
1803 avoid adding daemon-excluded items to the returned args.
1804
1805### DEVELOPER RELATED:
1806
1807 - The configure script tries to get the user's compiler to not warn about
1808 unused function parameters if the build is not including one or more of the
1809 ACL/xattrs/iconv features.
1810
1811 - The configure script now has better checks for figuring out if the included
1812 popt code should be used or not.
1813
1814 - Fixed two testsuite glitches: avoid a failure if someone's `cd` command
1815 outputs the current directory when cd-ing to a relative path, and made the
1816 itemized test query how rsync was built to determine if it should expect
1817 hard-linked symlinks or not.
1818
1819 - Updated the testsuite to verify that various bug fixes remain fixed.
1820
1821 - The RPM spec file was updated to have: (1) comments for how to use the
1822 rsync-patch tar file, and (2) an /etc/xinetd.d/rsync file.
1823
1824 - Updated the build scripts to work with a revised FTP directory structure.
1825
1826------------------------------------------------------------------------------
1827<a name="3.0.0"></a>
1828
1829# NEWS for rsync 3.0.0 (1 Mar 2008)
1830
d640d78f
WD
1831## Changes in this version:
1832
1833### PROTOCOL NUMBER:
87bca719 1834
d640d78f 1835 - The protocol number was changed to 30.
87bca719
WD
1836
1837### NOTABLE CHANGES IN BEHAVIOR:
1838
1839 - The handling of implied directories when using `--relative` has changed to
1840 send them as directories (e.g. no implied dir is ever sent as a symlink).
1841 This avoids unexpected behavior and should not adversely affect most people.
1842 If you're one of those rare individuals who relied upon having an implied
1843 dir be duplicated as a symlink, you should specify the transfer of the
1844 symlink and the transfer of the referent directory as separate args. (See
1845 also `--keep-dirlinks` and `--no-implied-dirs`.) Also, exclude rules no
1846 longer have a partial effect on implied dirs.
1847
1848 - Requesting a remote file-listing without specifying `-r` (`--recursive`) now
1849 sends the `-d` (`--dirs`) option to the remote rsync rather than sending
1850 `-r` along with an extra exclude of `/*/*`. If the remote rsync does not
1851 understand the `-d` option (i.e. it is 2.6.3 or older), you will need to
1852 either turn off `-d` (`--no-d`), or specify `-r --exclude='/*/*'` manually.
1853
1854 - In `--dry-run` mode, the last line of the verbose summary text is output
1855 with a "(DRY RUN)" suffix to help remind you that no updates were made.
1856 Similarly, `--only-write-batch` outputs `(BATCH ONLY)`.
1857
1858 - A writable rsync daemon with `use chroot` disabled now defaults to a
1859 symlink-munging behavior designed to make symlinks safer while also allowing
1860 absolute symlinks to be stored and retrieved. This also has the effect of
1861 making symlinks unusable while they're in the daemon's hierarchy. See the
1862 daemon's `munge symlinks` parameter for details.
1863
1864 - Starting up an extra copy of an rsync daemon will not clobber the pidfile
1865 for the running daemon -- if the pidfile exists, the new daemon will exit
1866 with an error. This means that your wrapper script that starts the rsync
1867 daemon should be made to handle lock-breaking (if you want any automatic
1868 breaking of locks to be done).
1869
1870### BUG FIXES:
1871
1872 - A daemon with `use chroot = no` and excluded items listed in the daemon
1873 config file now properly checks an absolute-path arg specified for these
1874 options: `--compare-dest`, `--link-dest`, `--copy-dest`, `--partial-dir`,
1875 `--backup-dir`, `--temp-dir`, and `--files-from`.
1876
1877 - A daemon can now be told to disable all user- and group-name translation on
1878 a per-module basis. This avoids a potential problem with a writable daemon
1879 module that has `use chroot` enabled -- if precautions weren't taken, a user
1880 could try to add a missing library and get rsync to use it. This makes rsync
f43412f1 1881 safer by default, and more configurable when id-translation is not desired.
87bca719
WD
1882 See the daemon's `numeric ids` parameter for full details.
1883
1884 - A chroot daemon can now indicate which part of its path should affect the
1885 chroot call, and which part should become an inside-chroot path for the
1886 module. This allows you to have outside-the-transfer paths (such as for
1887 libraries) even when you enable chroot protection. The idiom used in the
1888 rsyncd.conf file is: `path = /chroot/dirs/./dirs/inside`
1889
1890 - If a file's data arrived successfully on the receiving side but the rename
1891 of the temporary file to the destination file failed AND the
1892 `--remove-source-files` (or the deprecated `--remove-sent-files`) option was
1893 specified, rsync no longer erroneously removes the associated source file.
1894
1895 - Fixed the output of `-ii` when combined with one of the `--*-dest` options:
1896 it now itemizes all the items, not just the changed ones.
1897
1898 - Made the output of all file types consistent when using a `--*-dest` option.
1899 Prior versions would output too many creation events for matching items.
1900
1901 - The code that waits for a child pid now handles being interrupted by a
1902 signal. This fixes a problem with the pre-xfer exec function not being able
1903 to get the exit status from the script.
1904
1905 - A negated filter rule (i.e. with a '!' modifier) no longer loses the
1906 negation when sending the filter rules to the remote rsync.
1907
1908 - Fixed a problem with the `--out-format` (aka `--log-format`) option %f: it
1909 no longer outputs superfluous directory info for a non-daemon rsync.
1910
1911 - Fixed a problem with `-vv` (double `--verbose`) and `--stats` when `pushing`
1912 files (which includes local copies). Version 2.6.9 would complete the copy,
1913 but exit with an error when the receiver output its memory stats.
1914
1915 - If `--password-file` is used on a non-daemon transfer, rsync now complains
1916 and exits. This should help users figure out that they can't use this option
1917 to control a remote shell's password prompt.
1918
1919 - Make sure that directory permissions of a newly-created destination
1920 directory are handled right when `--perms` is left off.
1921
1922 - The itemized output of a newly-created destination directory is now output
1923 as a creation event, not a change event.
1924
1925 - Improved `--hard-link` so that more corner cases are handled correctly when
1926 combined with options such as `--link-dest` and/or `--ignore-existing`.
1927
1928 - The `--append` option no longer updates a file that has the same size.
1929
1930 - Fixed a bug when combining `--backup` and `--backup-dir` with `--inplace`:
1931 any missing backup directories are now created.
1932
1933 - Fixed a bug when using `--backup` and `--inplace` with `--whole-file` or
1934 `--read-batch`: backup files are actually created now.
1935
1936 - The daemon pidfile is checked and created sooner in the startup sequence.
1937
1938 - If a daemon module's `path` value is not an absolute pathname, the code now
1939 makes it absolute internally (making it work properly).
1940
1941 - Ensure that a temporary file always has owner-write permission while we are
1942 writing to it. This avoids problems with some network filesystems when
1943 transferring read-only files.
1944
1945 - Any errors output about password-file reading no longer cause an error at
1946 the end of the run about a partial transfer.
1947
1948 - The `--read-batch` option for protocol 30 now ensures that several more
1949 options are set correctly for the current batch file: `--iconv`, `--acls`,
1950 `--xattrs`, `--inplace`, `--append`, and `--append-verify`.
1951
1952 - Using `--only-write-batch` to a daemon receiver now works properly (older
1953 versions would update some files while writing the batch).
1954
1955 - Avoid outputting a "file has vanished" message when the file is a broken
1956 symlink and `--copy-unsafe-links` or `--copy-dirlinks` is used (the code
1957 already handled this for `--copy-links`).
1958
1959 - Fixed the combination of `--only-write-batch` and `--dry-run`.
1960
1961 - Fixed rsync's ability to remove files that are not writable by the file's
1962 owner when rsync is running as the same user.
1963
1964 - When transferring large files, the sender's hashtable of checksums is kept
1965 at a more reasonable state of fullness (no more than 80% full) so that the
1966 scanning of the hashtable will not bog down as the number of blocks
1967 increases.
1968
1969### ENHANCEMENTS:
1970
1971 - A new incremental-recursion algorithm is now used when rsync is talking to
1972 another 3.x version. This starts the transfer going more quickly (before all
1973 the files have been found), and requires much less memory. See the
1974 `--recursive` option in the manpage for some restrictions.
1975
1976 - Lowered memory use in the non-incremental-recursion algorithm for typical
1977 option values (usually saving from 21-29 bytes per file).
1978
1979 - The default `--delete` algorithm is now `--delete-during` when talking to a
1980 3.x rsync. This is a faster scan than using `--delete-before` (which is the
1981 default when talking to older rsync versions), and is compatible with the
1982 new incremental recursion mode.
1983
1984 - Rsync now allows multiple remote-source args to be specified rather than
1985 having to rely on a special space-splitting side-effect of the remote-
1986 shell. Additional remote args must specify the same host or an empty one
1987 (e.g. empty: `:file1` or `::module/file2`). For example, this means that
1988 local use of brace expansion now works: `rsync -av host:dir/{f1,f2} .`
1989
1990 - Added the `--protect-args` (`-s`) option, that tells rsync to send most of
1991 the command-line args at the start of the transfer rather than as args to
1992 the remote-shell command. This protects them from space-splitting, and only
1993 interprets basic wildcard special shell characters (`*?[`).
1994
1995 - Added the `--delete-delay` option, which is a more efficient way to delete
1996 files at the end of the transfer without needing a separate delete pass.
1997
1998 - Added the `--acls` (`-A`) option to preserve Access Control Lists. This is
1999 an improved version of the prior patch that was available, and it even
2000 supports OS X ACLs. If you need to have backward compatibility with old,
2001 ACL-patched versions of rsync, apply the acls.diff file from the patches
2002 dir.
2003
2004 - Added the `--xattrs` (`-X`) option to preserve extended attributes. This is
2005 an improved version of the prior patch that was available, and it even
2006 supports OS X xattrs (which includes their resource fork data). If you need
2007 to have backward compatibility with old, xattr-patched versions of rsync,
2008 apply the xattrs.diff file from the patches dir.
2009
2010 - Added the `--fake-super` option that allows a non-super user to preserve all
2011 attributes of a file by using a special extended-attribute idiom. It even
2012 supports the storing of foreign ACL data on your backup server. There is
2013 also an analogous `fake super` parameter for an rsync daemon.
2014
2015 - Added the `--iconv` option, which allows rsync to convert filenames from one
2016 character-set to another during the transfer. The default is to make this
2017 feature available as long as your system has `iconv_open()`. If compilation
2018 fails, specify `--disable-iconv` to configure, and then rebuild. If you want
2019 rsync to perform character-set conversions by default, you can specify
2020 `--enable-iconv=CONVERT_STRING` with the default value for the `--iconv`
2021 option that you wish to use. For example, `--enable-iconv=.` is a good
2022 choice. See the rsync manpage for an explanation of the `--iconv` option's
2023 settings.
2024
2025 - A new daemon config parameter, `charset`, lets you control the character-
2026 set that is used during an `--iconv` transfer to/from a daemon module. You
2027 can also set your daemon to refuse `no-iconv` if you want to force the
2028 client to use an `--iconv` transfer (requiring an rsync 3.x client).
2029
2030 - Added the `--skip-compress=LIST` option to override the default list of file
2031 suffixes that will not be compressed when using `--compress` (`-z`).
2032
2033 - The daemon's default for `dont compress` was extended to include: `*.7z`
2034 `*.mp[34]` `*.mov` `*.avi` `*.ogg` `*.jpg` `*.jpeg` and the name-matching routine was also
2035 optimized to run more quickly.
2036
2037 - The `--max-delete` option now outputs a warning if it skipped any file
2038 deletions, including a count of how many deletions were skipped. (Older
2039 versions just silently stopped deleting things.)
2040
2041 - You may specify `--max-delete=0` to a 3.0.0 client to request that it warn
2042 about extraneous files without deleting anything. If you're not sure what
2043 version the client is, you can use the less-obvious `--max-delete=-1`, as
2044 both old and new versions will treat that as the same request (though older
2045 versions don't warn).
2046
2047 - The `--hard-link` option now uses less memory on both the sending and
2048 receiving side for all protocol versions. For protocol 30, the use of a
2049 hashtable on the sending side allows us to more efficiently convey to the
2050 receiver what files are linked together. This reduces the amount of data
2051 sent over the socket by a considerable margin (rather than adding more
2052 data), and limits the in-memory storage of the device+inode information to
2053 just the sending side for the new protocol 30, or to the receiving side when
2054 speaking an older protocol (note that older rsync versions kept the
2055 device+inode information on both sides).
2056
2057 - The filter rules now support a perishable (`p`) modifier that marks rules
2058 that should not have an effect in a directory that is being deleted. e.g.
2059 `-f '-p .svn/'` would only affect `live` .svn directories.
2060
2061 - Rsync checks all the alternate-destination args for validity (e.g.
2062 `--link-dest`). This lets the user know when they specified a directory that
2063 does not exist.
2064
2065 - If we get an ENOSYS error setting the time on a symlink, we don't complain
2066 about it anymore (for those systems that even support the setting of the
2067 modify-time on a symlink).
2068
2069 - Protocol 30 now uses MD5 checksums instead of MD4.
2070
2071 - Changed the `--append` option to not checksum the existing data in the
2072 destination file, which speeds up file appending.
2073
2074 - Added the `--append-verify` option, which works like the older `--append`
2075 option (verifying the existing data in the destination file). For
2076 compatibility with older rsync versions, any use of `--append` that is
2077 talking protocol 29 or older will revert to the `--append-verify` method.
2078
2079 - Added the `--contimeout=SECONDS` option that lets the user specify a
2080 connection timeout for rsync daemon access.
2081
2082 - Documented and extended the support for the `RSYNC_CONNECT_PROG` variable
2083 that can be used to enhance the client side of a daemon connection.
2084
2085 - Improved the dashes and double-quotes in the nroff manpage output.
2086
2087 - Rsync now supports a lot more `--no-OPTION` override options.
2088
2089### INTERNAL:
2090
f43412f1 2091 - The file-list sorting algorithm now uses a sort that keeps any same-named
87bca719
WD
2092 items in the same order as they were specified. This allows rsync to always
2093 ensure that the first of the duplicates is the one that will be included in
2094 the copy. The new sort is also faster than the glibc version of qsort() and
2095 mergesort().
2096
2097 - Rsync now supports the transfer of 64-bit timestamps (`time_t` values).
2098
2099 - Made the file-deletion code use a little less stack when recursing through a
2100 directory hierarchy of extraneous files.
2101
2102 - Fixed a build problem with older (2.x) versions of gcc.
2103
2104 - Added some isType() functions that make dealing with signed characters
2105 easier without forcing variables via casts.
2106
2107 - Changed strcat/strcpy/sprintf function calls to use safer versions.
2108
2109 - Upgraded the included popt version to 1.10.2 and improved its use of
2110 string-handling functions.
2111
2112 - Added missing prototypes for compatibility functions from the lib dir.
2113
2114 - Configure determines if iconv() has a const arg, allowing us to avoid a
2115 compiler warning.
2116
2117 - Made the sending of some numbers more efficient for protocol 30.
2118
2119 - Make sure that a daemon process doesn't mind if the client was weird and
2120 omitted the `--server` option.
2121
2122 - There are more internal logging categories available in protocol 30 than the
2123 age-old FINFO and FERROR, including `FERROR_XFER` and FWARN. These new
2124 categories allow some errors and warnings to go to stderr without causing an
2125 erroneous end-of-run warning about some files not being able to be
2126 transferred.
2127
2128 - Improved the use of `const` on pointers.
2129
2130 - Improved J.W.'s `pool_alloc` routines to add a way of incrementally freeing
2131 older sections of a pool's memory.
2132
2133 - The getaddrinfo.c compatibility code in the `lib` dir was replaced with some
2134 new code (derived from samba, derived from PostgreSQL) that has a better
2135 license than the old code.
2136
2137### DEVELOPER RELATED:
2138
2139 - Rsync is now licensed under the GPLv3 or later.
2140
2141 - Rsync is now being maintained in a `git` repository instead of CVS (though
2142 the old CVS repository still exists for historical access). Several
2143 maintenance scripts were updated to work with git.
2144
2145 - Generated files are no longer committed into the source repository. The
2146 autoconf and autoheader commands are now automatically run during the normal
2147 use of `configure` and `make`. The latest dev versions of all generated
2148 files can also be copied from the samba.org web site (see the prepare-source
2149 script's fetch option).
2150
2151 - The `patches` directory of diff files is now built from branches in the
2152 rsync git repository (branch patch/FOO creates file patches/FOO.diff). This
2153 directory is now distributed in a separate separate tar file named
2154 rsync-patches-VERSION.tar.gz instead of the main rsync-VERSION.tar.gz.
2155
2156 - The proto.h file is now built using a simple perl script rather than a
2157 complex awk script, which proved to be more widely compatible.
2158
2159 - When running the tests, we now put our per-test temp dirs into a sub-
2160 directory named testtmp (which is created, if missing). This allows someone
2161 to symlink the testtmp directory to another filesystem (which is useful if
2162 the build dir's filesystem does not support ACLs and xattrs, but another
2163 filesystem does).
2164
2165 - Rsync now has a way of handling protocol-version changes during the
2166 development of a new protocol version. This causes any out-of-sync versions
2167 to speak an older protocol rather than fail in a cryptic manner. This
2168 addition makes it safer to deploy a pre-release version that may interact
2169 with the public. This new exchange of sub-version info does not interfere
2170 with the `{MIN,MAX}_PROTOCOL_VERSION` checking algorithm (which does not
2171 have enough range to allow the main protocol number to be incremented for
2172 every minor tweak in that happens during development).
2173
2174 - The csprotocol.txt file was updated to mention the daemon protocol change in
2175 the 3.0.0 release.
2176
2177------------------------------------------------------------------------------
2178<a name="2.6.9"></a>
2179
2180# NEWS for rsync 2.6.9 (6 Nov 2006)
2181
d640d78f 2182## Changes in this version:
87bca719
WD
2183
2184### BUG FIXES:
2185
2186 - If rsync is interrupted via a handled signal (such as SIGINT), it will once
2187 again clean-up its temp file from the destination dir.
2188
2189 - Fixed an overzealous sanitizing bug in the handling of the `--link-dest`,
2190 `--copy-dest`, and `--compare-dest` options to a daemon without chroot: if
2191 the copy's destination dir is deeper than the top of the module's path,
2192 these options now accept a safe number of parent-dir (../) references (since
2193 these options are relative to the destination dir). The old code incorrectly
2194 chopped off all `../` prefixes for these options, no matter how deep the
2195 destination directory was in the module's hierarchy.
2196
2197 - Fixed a bug where a deferred info/error/log message could get sent directly
2198 to the sender instead of being handled by rwrite() in the generator. This
2199 fixes an `unexpected tag 3` fatal error, and should also fix a potential
2200 problem where a deferred info/error message from the receiver might bypass
2201 the log file and get sent only to the client process. (These problems could
2202 only affect an rsync daemon that was receiving files.)
2203
2204 - Fixed a bug when `--inplace` was combined with a `--*-dest` option and we
2205 update a file's data using an alternate basis file. The code now notices
2206 that it needs to copy the matching data from the basis file instead of
2207 (wrongly) assuming that it was already present in the file.
2208
2209 - Fixed a bug where using `--dry-run` with a `--*-dest` option with a path
2210 relative to a directory that does not yet exist: the affected option gets
2211 its proper path value so that the output of the dry-run is right.
2212
2213 - Fixed a bug in the %f logfile escape when receiving files: the destination
2214 path is now included in the output (e.g. you can now tell when a user
2215 specifies a subdir inside a module).
2216
2217 - If the receiving side fails to create a directory, it will now skip trying
2218 to update everything that is inside that directory.
2219
2220 - If `--link-dest` is specified with `--checksum` but without `--times`, rsync
2221 will now allow a hard-link to be created to a matching link-dest file even
2222 when the file's modify-time doesn't match the server's file.
2223
2224 - The daemon now calls more timezone-using functions prior to doing a chroot.
2225 This should help some C libraries to generate proper timestamps from inside
2226 a chrooted daemon (and to not try to access /etc/timezone over and over
2227 again).
2228
2229 - Fixed a bug in the handling of an absolute `--partial-dir=ABS_PATH` option:
2230 it now deletes an alternate basis file from the partial-dir that was used to
2231 successfully update a destination file.
2232
2233 - Fixed a bug in the handling of `--delete-excluded` when using a per-dir
2234 merge file: the merge file is now honored on the receiving side, and only
2235 its unqualified include/exclude commands are ignored (just as is done for
2236 global include/excludes).
2237
2238 - Fixed a recent bug where `--delete` was not working when transferring from
2239 the root (/) of the filesystem with `--relative` enabled.
2240
2241 - Fixed a recent bug where an `--exclude='*'` could affect the root (/) of the
2242 filesystem with `--relative` enabled.
2243
2244 - When `--inplace` creates a file, it is now created with owner read/write
2245 permissions (0600) instead of no permissions at all. This avoids a problem
2246 continuing a transfer that was interrupted (since `--inplace` will not
2247 update a file that has no write permissions).
2248
2249 - If either `--remove-source-files` or `--remove-sent-files` is enabled and we
2250 are unable to remove the source file, rsync now outputs an error.
2251
2252 - Fixed a bug in the daemon's `incoming chmod` rule: newly-created directories
2253 no longer get the 'F' (file) rules applied to them.
2254
2255 - Fixed an infinite loop bug when a filter rule was rejected due to being
2256 overly long.
2257
2258 - When the server receives a `--partial-dir` option from the client, it no
2259 longer runs the client-side code that adds an assumed filter rule (since the
2260 client will be sending us the rules in the usual manner, and they may have
2261 chosen to override the auto-added rule).
2262
2263### ENHANCEMENTS:
2264
2265 - Added the `--log-file=FILE` and `--log-file-format=FORMAT` options. These
2266 can be used to tell any rsync to output what it is doing to a log file.
2267 They work with a client rsync, a non-daemon server rsync (see the man page
2268 for instructions), and also allows the overriding of rsyncd.conf settings
2269 when starting a daemon.
2270
2271 - The `--log-format` option was renamed to be `--out-format` to avoid
2272 confusing it with affecting the log-file output. (The old option remains as
2273 an alias for the new to preserve backward compatibility.)
2274
2275 - Made `log file` and `syslog facility` settable on a per-module basis in the
2276 daemon's config file.
2277
2278 - Added the `--remove-source-files` option as a replacement for the (now
2279 deprecated) `--remove-sent-files` option. This new option removes all
2280 non-dirs from the source directories, even if the file was already
2281 up-to-date. This fixes a problem where interrupting an rsync that was using
2282 `--remove-sent-files` and restarting it could leave behind a file that the
2283 earlier rsync synchronized, but didn't get to remove. (The deprecated
2284 `--remove-sent-files` is still understood for now, and still behaves in the
2285 same way as before.)
2286
2287 - Added the option `--no-motd` to suppress the message-of-the-day output from
2288 a daemon when doing a copy. (See the manpage for a caveat.)
2289
2290 - Added a new environment variable to the pre-/post-xfer exec commands (in the
2291 daemon's config file): `RSYNC_PID`. This value will be the same in both the
2292 pre- and post-xfer commands, so it can be used as a unique ID if the
2293 pre-xfer command wants to cache some arg/request info for the post-xfer
2294 command.
2295
2296### INTERNAL:
2297
2298 - Did a code audit using IBM's code-checker program and made several changes,
2299 including: replacing most of the strcpy() and sprintf() calls with
2300 strlcpy(), snprintf(), and memcpy(), adding a 0-value to an enum that had
2301 been intermingling a literal 0 with the defined enum values, silencing some
2302 uninitialized memory checks, marking some functions with a `noreturn`
2303 attribute, and changing an `if` that could never succeed on some platforms
2304 into a pre-processor directive that conditionally compiles the code.
2305
2306 - Fixed a potential bug in `f_name_cmp()` when both the args are a top-level
2307 `.` dir (which doesn't happen in normal operations).
2308
2309 - Changed `exit_cleanup()` so that it can never return instead of exit. The
2310 old code might return if it found the `exit_cleanup()` function was being
2311 called recursively. The new code is segmented so that any recursive calls
2312 move on to the next step of the exit-processing.
2313
2314 - The macro WIFEXITED(stat) will now be defined if the OS didn't already
2315 define it.
2316
2317### DEVELOPER RELATED:
2318
2319 - The acls.diff and xattrs.diff patches have received a bunch of work to make
2320 them much closer to being acceptable in the main distribution. The xattrs
2321 patch also has some preliminary Mac OS X and FreeBSD compatibility code that
2322 various system types to exchange extended file-attributes.
2323
2324 - A new diff in the patches dir, fake-root.diff, allows rsync to maintain a
2325 backup hierarchy with full owner, group, and device info without actually
2326 running as root. It does this using a special extended attribute, so it
2327 depends on xattrs.diff (which depends on acls.diff).
2328
2329 - The rsync.yo and rsyncd.conf.yo files have been updated to work better with
2330 the latest yodl 2.x releases.
2331
2332 - Updated config.guess and config.sub to their 2006-07-02 versions.
2333
2334 - Updated various files to include the latest FSF address and to have
2335 consistent opening comments.
2336
2337------------------------------------------------------------------------------
2338<a name="2.6.8"></a>
2339
2340# NEWS for rsync 2.6.8 (22 Apr 2006)
2341
d640d78f 2342## Changes in this version:
87bca719
WD
2343
2344### BUG FIXES:
2345
2346 - Fixed a bug in the exclude code where an anchored exclude without any
2347 wildcards fails to match an absolute source arg, but only when `--relative`
2348 is in effect.
2349
2350 - Improved the I/O code for the generator to fix a potential hang when the
2351 receiver gets an EOF on the socket but the generator's select() call never
2352 indicates that the socket is writable for it to be notified about the EOF.
2353 (This can happen when using stunnel).
2354
2355 - Fixed a problem with the file-reading code where a failed read (such as that
2356 caused by a bad sector) would not advance the file's read-position beyond
2357 the failed read's data.
2358
2359 - Fixed a logging bug where the `log file` directive was not being honored in
2360 a single-use daemon (one spawned by a remote-shell connection or by init).
2361
2362 - If rsync cannot honor the `--delete` option, we output an error and exit
2363 instead of silently ignoring the option.
2364
2365 - Fixed a bug in the `--link-dest` code that prevented special files (such as
2366 fifos) from being linked.
2367
2368 - The ability to hard-link symlinks and special files is now determined at
2369 configure time instead of at runtime. This fixes a bug with `--link-dest`
2370 creating a hard-link to a symlink's referent on a BSD system.
2371
2372### ENHANCEMENTS:
2373
2374 - In daemon mode, if rsync fails to bind to the requested port, the error(s)
2375 returned by socket() and/or bind() are now logged.
2376
2377 - When we output a fatal error, we now output the version of rsync in the
2378 message.
2379
2380 - Improved the documentation for the `--owner` and `--group` options.
2381
2382 - The rsyncstats script in `support` has an improved line-parsing regex that
2383 is easier to read and also makes it to parse syslog-generated lines.
2384
2385 - A new script in `support`: file-attr-restore, can be used to restore the
2386 attributes of a file-set (the permissions, ownership, and group info) taken
2387 from the cached output of a `find ARG... -ls` command.
2388
2389### DEVELOPER RELATED:
2390
2391 - Removed the unused function `write_int_named()`, the unused variable
2392 `io_read_phase`, and the rarely used variable `io_write_phase`. This also
2393 elides the confusing 'phase "unknown"' part of one error message.
2394
2395 - Removed two unused configure checks and two related (also unused)
2396 compatibility functions.
2397
2398 - The xattrs.diff patch received a security fix that prevents a potential
2399 buffer overflow in the `receive_xattr()` code.
2400
2401 - The acls.diff patch has been improved quite a bit, with more to come.
2402
2403 - A new patch was added: log-file.diff. This contains an early version of a
2404 future option, `--log-file=FILE`, that will allow any rsync to log its
2405 actions to a file (something that only a daemon supports at present).
2406
2407------------------------------------------------------------------------------
2408<a name="2.6.7"></a>
2409
2410# NEWS for rsync 2.6.7 (11 Mar 2006)
2411
d640d78f 2412## Changes in this version:
87bca719
WD
2413
2414### OUTPUT CHANGES:
2415
2416 - The letter 'D' in the itemized output was being used for both devices
2417 (character or block) as well as other special files (such as fifos and named
2418 sockets). This has changed to separate non-device special files under the
2419 'S' designation (e.g. `cS+++++++ path/fifo`). See also the `--specials`
2420 option, below.
2421
2422 - The way rsync escapes unreadable characters has changed. First, rsync now
1b9308b7 2423 has support for recognizing valid multi-byte character sequences in your
87bca719
WD
2424 current locale, allowing it to escape fewer characters than before for a
2425 locale such as UTF-8. Second, it now uses an escape idiom of `\#123`, which
2426 is the literal string `\#` followed by exactly 3 octal digits. Rsync no
2427 longer doubles a backslash character in a filename (e.g. it used to output
2428 `foo\\bar` when copying `foo\bar`) -- now it only escapes a backslash that
2429 is followed by a hash-sign and 3 digits (0-9) (e.g. it will output
2430 `foo\#134#789` when copying `foo\#789`). See also the `--8-bit-output`
2431 (`-8`) option, mentioned below.
2432
2433 Script writers: the local rsync is the one that outputs escaped names, so if
2434 you need to support unescaping of filenames for older rsyncs, I'd suggest
2435 that you parse the output of `rsync --version` and only use the old
2436 unescaping rules for 2.6.5 and 2.6.6.
2437
2438### BUG FIXES:
2439
2440 - Fixed a really old bug that caused `--checksum` (`-c`) to checksum all the
2441 files encountered during the delete scan (ouch).
2442
2443 - Fixed a potential hang in a remote generator: when the receiver gets a
2444 read-error on the socket, it now signals the generator about this so that
2445 the generator does not try to send any of the terminating error messages to
2446 the client (avoiding a potential hang in some setups).
2447
2448 - Made hard-links work with symlinks and devices again.
2449
2450 - If the sender gets an early EOF reading a source file, we propagate this
2451 error to the receiver so that it can discard the file and try requesting it
2452 again (which is the existing behavior for other kinds of read errors).
2453
2454 - If a device-file/special-file changes permissions, rsync now updates the
2455 permissions without recreating the file.
2456
2457 - If the user specifies a remote-host for both the source and destination, we
2458 now output a syntax error rather than trying to open the destination
2459 hostspec as a filename.
2460
2461 - When `--inplace` creates a new destination file, rsync now creates it with
2462 permissions 0600 instead of 0000 -- this makes restarting possible when the
2463 transfer gets interrupted in the middle of sending a new file.
2464
2465 - Reject the combination of `--inplace` and `--sparse` since the sparse-output
2466 algorithm doesn't work when overwriting existing data.
2467
2468 - Fixed the directory name in the error that is output when `pop_dir()` fails.
2469
2470 - Really fixed the parsing of a `!` entry in .cvsignore files this time.
2471
2472 - If the generator gets a stat() error on a file, output it (this used to
2473 require at least `-vv` for the error to be seen).
2474
2475 - If waitpid() fails or the child rsync didn't exit cleanly, we now handle the
2476 exit status properly and generate a better error.
2477
2478 - Fixed some glitches in the double-verbose output when using `--copy-dest`,
2479 `--link-dest`, or `--compare-dest`. Also improved how the verbose output
2480 handles hard-links (within the transfer) that had an up-to-date alternate
2481 `dest` file, and copied files (via `--copy-dest`).
2482
2483 - Fixed the matching of the dont-compress items (e.g. `*.gz`) against files
2484 that have a path component containing a slash.
2485
2486 - If the code reading a filter/exclude file gets an EINTR error, rsync now
2487 clears the error flag on the file handle so it can keep on reading.
2488
2489 - If `--relative` is active, the sending side cleans up trailing `/` or `/.`
2490 suffixes to avoid triggering a bug in older rsync versions. Also, we now
2491 reject a `..` dir if it would be sent as a relative dir.
2492
2493 - If a non-directory is in the way of a directory and rsync is run with
2494 `--dry-run` and `--delete`, rsync no longer complains about not being able
2495 to opendir() the not-yet present directory.
2496
2497 - When `--list-only` is used and a non-existent local destination dir was also
2498 specified as a destination, rsync no longer generates a warning about being
2499 unable to create the missing directory.
2500
2501 - Fixed some problems with `--relative --no-implied-dirs` when the destination
2502 directory did not yet exist: we can now create a symlink or device when it
2503 is the first thing in the missing dir, and `--fuzzy` no longer complains
2504 about being unable to open the missing dir.
2505
2506 - Fixed a bug where the `--copy-links` option would not affect implied
2507 directories without `--copy-unsafe-links` (see `--relative`).
2508
2509 - Got rid of the need for `--force` to be used in some circumstances with
2510 `--delete-after` (making it consistent with
2511 `--delete-before`/`--delete-during`).
2512
2513 - Rsync now ignores the SIGXFSZ signal, just in case your OS sends this when a
2514 file is too large (rsync handles the write error).
2515
2516 - Fixed a bug in the Proxy-Authorization header's base64-encoded value: it was
2517 not properly padded with trailing '=' chars. This only affects a user that
2518 need to use a password-authenticated proxy for an outgoing daemon-rsync
2519 connection.
2520
2521 - If we're transferring an empty directory to a new name, rsync no longer
2522 forces `S_IWUSR` if it wasn't already set, nor does it accidentally leave it
2523 set.
2524
2525 - Fixed a bug in the debug output (`-vvvvv`) that could mention the wrong
2526 checksum for the current file offset.
2527
f43412f1 2528 - Rsync no longer allows a single directory to be copied over a non-directory
87bca719
WD
2529 destination arg.
2530
2531### ENHANCEMENTS:
2532
2533 - Added the `--append` option that makes rsync append data onto files that are
2534 longer on the source than the destination (this includes new files).
2535
2536 - Added the `--min-size=SIZE` option to exclude small files from the transfer.
2537
2538 - Added the `--compress-level` option to allow you to set how aggressive
2539 rsync's compression should be (this option implies `--compress`).
2540
2541 - Enhanced the parsing of the SIZE value for `--min-size` and `--max-size` to
2542 allow easy entry of multiples of 1000 (instead of just multiples of 1024)
2543 and off-by-one values too (e.g. `--max-size=8mb-1`).
2544
2545 - Added the `--8-bit-output` (`-8`) option, which tells rsync to avoid
2546 escaping high-bit characters that it thinks are unreadable in the current
2547 locale.
2548
2549 - The new option `--human-readable` (`-h`) changes the output of `--progress`,
2550 `--stats`, and the end-of-run summary to be easier to read. If repeated, the
2551 units become powers of 1024 instead of powers of 1000. (The old meaning of
2552 `-h`, as a shorthand for `--help`, still works as long as you just use it on
2553 its own, as in `rsync -h`.)
2554
2555 - If lutimes() and/or lchmod() are around, use them to allow the preservation
2556 of attributes on symlinks.
2557
2558 - The `--link-dest` option now affects symlinks and devices (when possible).
2559
2560 - Added two config items to the rsyncd.conf parsing: `pre-xfer exec` and
2561 `post-xfer exec`. These allow a command to be specified on a per-module
2562 basis that will be run before and/or after a daemon-mode transfer. (See the
2563 man page for a list of the environment variables that are set with
2564 information about the transfer.)
2565
2566 - When using the `--relative` option, you can now insert a dot dir in the
2567 source path to indicate where the replication of the source dirs should
2568 start. For example, if you specify a source path of
2569 rsync://host/module/foo/bar/./baz/dir with `-R`, rsync will now only
2570 replicate the `baz/dir` part of the source path (note: a trailing dot dir is
2571 unaffected unless it also has a trailing slash).
2572
2573 - Added some new `--no-FOO` options that make it easier to override unwanted
2574 implied or default options. For example, `-a --no-o` (aka `--archive
2575 --no-owner`) can be used to turn off the preservation of file ownership that
2576 is implied by `-a`.
2577
2578 - Added the `--chmod=MODE` option that allows the destination permissions to
2579 be changed from the source permissions. E.g. `--chmod=g+w,o-rwx`
2580
2581 - Added the `incoming chmod` and `outgoing chmod` daemon options that allow a
2582 module to specify what permissions changes should be applied to all files
2583 copied to and from the daemon.
2584
2585 - Allow the `--temp-dir` option to be specified when starting a daemon, which
2586 sets the default temporary directory for incoming files.
2587
2588 - If `--delete` is combined with `--dirs` without `--recursive`, rsync will
2589 now delete in any directory whose content is being synchronized.
2590
2591 - If `--backup` is combined with `--delete` without `--backup-dir` (and
2592 without `--delete-excluded`), we add a `protect` filter-rule to ensure that
2593 files with the backup suffix are not deleted.
2594
2595 - The file-count stats that are output by `--progress` were improved to better
2596 indicate what the numbers mean. For instance, the output: `(xfer#5,
2597 to-check=8383/9999)` indicates that this was the fifth file to be
2598 transferred, and we still need to check 8383 more files out of a total of
2599 9999.
2600
2601 - The include/exclude code now allows a `dir/***` directive (with 3 trailing
2602 stars) to match both the dir itself as well as all the content below the dir
2603 (`dir/**` would not match the dir).
2604
2605 - Added the `--prune-empty-dirs` (`-m`) option that makes the receiving rsync
2606 discard empty chains of directories from the file-list. This makes it easier
2607 to selectively copy files from a source hierarchy and end up with just the
2608 directories needed to hold the resulting files.
2609
2610 - If the `--itemize-changes` (`-i`) option is repeated, rsync now includes
2611 unchanged files in the itemized output (similar to `-vv`, but without all
2612 the other verbose messages that can get in the way). Of course, the client
2613 must be version 2.6.7 for this to work, but the remote rsync only needs to
2614 be 2.6.7 if you're pushing files.
2615
2616 - Added the `--specials` option to tell rsync to copy non-device special files
2617 (which rsync now attempts even as a normal user). The `--devices` option now
2618 requests the copying of just devices (character and block). The `-D` option
2619 still requests both (e.g. `--devices` and `--specials`), `-a` still implies
2620 `-D`, and non-root users still get a silent downgrade that omits device
2621 copying.
2622
2623 - Added the `--super` option to make the receiver always attempt super-user
2624 activities. This is useful for systems that allow things such as devices to
2625 be created or ownership to be set without being UID 0, and is also useful
2626 for someone who wants to ensure that errors will be output if the receiving
2627 rsync isn't being run as root.
2628
2629 - Added the `--sockopts` option for those few who want to customize the TCP
2630 options used to contact a daemon rsync.
2631
2632 - Added a way for the `--temp-dir` option to be combined with a partial-dir
2633 setting that lets rsync avoid non-atomic updates (for those times when
2634 `--temp-dir` is not being used because space is tight).
2635
2636 - A new support script, files-to-excludes, will transform a list of files into
2637 a set of include/exclude directives that will copy those files.
2638
2639 - A new option, `--executability` (`-E`) can be used to preserve just the
2640 execute bit on files, for those times when using the `--perms` option is not
2641 desired.
2642
2643 - The daemon now logs each connection and also each module-list request that
2644 it receives.
2645
2646 - New log-format options: %M (modtime), %U (uid), %G (gid), and %B (permission
2647 bits, e.g. `rwxr-xrwt`).
2648
2649 - The `--dry-run` option no longer forces the enabling of `--verbose`.
2650
2651 - The `--remove-sent-files` option now does a better job of incrementally
2652 removing the sent files on the sending side (older versions tended to clump
2653 up all the removals at the end).
2654
2655 - A daemon now supersedes its minimal SIGCHLD handler with the standard
2656 PID-remembering version after forking. This ensures that the generator can
2657 get the child-exit status from the receiver.
2658
2659 - Use of the `--bwlimit` option no longer interferes with the remote rsync
2660 sending error messages about invalid/refused options.
2661
2662 - Rsync no longer returns a usage error when used with one local source arg
2663 and no destination: this now implies the `--list-only` option, just like the
2664 comparable situation with a remote source arg.
2665
2666 - Added the `--copy-dirlinks` option, a more limited version of
2667 `--copy-links`.
2668
2669 - Various documentation improvements, including: a better synopsis, some
2670 improved examples, a better discussion of the presence and absence of
2671 `--perms` (including how it interacts with the new `--executability` and
2672 `--chmod` options), an extended discussion of `--temp-dir`, an improved
2673 discussion of `--partial-dir`, a better description of rsync's pattern
2674 matching characters, an improved `--no-implied-dirs` section, and the
2675 documenting of what the `--stats` option outputs.
2676
2677 - Various new and updated diffs in the patches dir, including: acls.diff,
2678 xattrs.diff, atimes.diff, detect-renamed.diff, and slp.diff.
2679
2680### INTERNAL:
2681
2682 - We now use sigaction() and sigprocmask() if possible, and fall back on
2683 signal() if not. Using sigprocmask() ensures that rsync enables all the
2684 signals that it needs, just in case it was started in a masked state.
2685
2686 - Some buffer sizes were expanded a bit, particularly on systems where
f43412f1 2687 MAXPATHLEN is overly small (e.g. Cygwin).
87bca719
WD
2688
2689 - If `io_printf()` tries to format more data than fits in the buffer, exit
2690 with an error instead of transmitting a truncated buffer.
2691
2692 - If a `va_copy` macro is defined, lib/snprintf.c will use it when defining
2693 the `VA_COPY` macro.
2694
2695 - Reduced the amount of stack memory needed for each level of directory
2696 recursion by nearly MAXPATHLEN bytes.
2697
2698 - The wildmatch function was extended to allow an array of strings to be
2699 supplied as the string to match. This allows the exclude code to do less
2700 string copying.
2701
2702 - Got rid of the `safe_fname()` function (and all the myriad calls) and
2703 replaced it with a new function in the log.c code that filters all the
2704 output going to the terminal.
2705
2706 - Unified the `f_name()` and the `f_name_to()` functions.
2707
2708 - Improved the hash-table code the sender uses to handle checksums to make it
2709 use slightly less memory and run just a little faster.
2710
2711### DEVELOPER RELATED:
2712
2713 - The diffs in the patches dir now require `patch -p1 <DIFF` instead of the
2714 previous `-p0`. Also, the version included in the release tar now affect
2715 generated files (e.g. configure, rsync.1, proto.h, etc.), so it is no longer
2716 necessary to run autoconf and/or yodl unless you're applying a patch that
2717 was checked out from CVS.
2718
2719 - Several diffs in the patches dir now use the proper `--enable-FOO` configure
2720 option instead of `--with-FOO` to turn on the inclusion of the newly patched
2721 feature.
2722
2723 - There is a new script, `prepare-source` than can be used to update the
2724 various generated files (proto.h, configure, etc.) even before configure has
2725 created the Makefile (this is mainly useful when patching the source with a
2726 patch that doesn't affect generated files).
2727
2728 - The testsuite now sets HOME so that it won't be affected by a file such as
2729 ~/.popt.
2730
2731------------------------------------------------------------------------------
2732<a name="2.6.6"></a>
2733
2734# NEWS for rsync 2.6.6 (28 Jul 2005)
2735
d640d78f 2736## Changes in this version:
87bca719
WD
2737
2738### SECURITY FIXES:
2739
2740 - The zlib code was upgraded to version 1.2.3 in order to make it more secure.
2741 While the widely-publicized security problem in zlib 1.2.2 did not affect
2742 rsync, another security problem surfaced that affects rsync's zlib 1.1.4.
2743
2744### BUG FIXES:
2745
2746 - The setting of `flist->high` in `clean_flist()` was wrong for an empty list.
2747 This could cause `flist_find()` to crash in certain rare circumstances (e.g.
2748 if just the right directory setup was around when `--fuzzy` was combined
2749 with `--link-dest`).
2750
2751 - The outputting of hard-linked files when verbosity was > 1 was not right:
2752 (1) Without `-i` it would output the name of each hard-linked file as though
2753 it had been changed; it now outputs a `is hard linked` message for the file.
2754 (2) With `-i` it would output all dots for the unchanged attributes of a
2755 hard-link; it now changes those dots to spaces, as is done for other totally
2756 unchanged items.
2757
2758 - When backing up a changed symlink or device, get rid of any old backup item
2759 so that we don't get an `already exists` error.
2760
f43412f1 2761 - A couple places that were comparing a local and a remote modification-time
87bca719
WD
2762 were not honoring the `--modify-window` option.
2763
2764 - Fixed a bug where the 'p' (permissions) itemized-changes flag might get set
2765 too often (if some non-significant mode bits differed).
2766
2767 - Fixed a really old, minor bug that could cause rsync to warn about being
2768 unable to mkdir() a path that ends in `/.` because it just created the
2769 directory (required `--relative`, `--no-implied-dirs`, a source path that
2770 ended in either a trailing slash or a trailing `/.`, and a non-existing
2771 destination dir to tickle the bug in a recent version).
2772
2773### ENHANCEMENTS:
2774
2775 - Made the `max verbosity` setting in the rsyncd.conf file settable on a
2776 per-module basis (which now matches the documentation).
2777
2778 - The support/rrsync script has been upgraded to verify the args of options
2779 that take args (instead of rejecting any such options). The script was also
2780 changed to try to be more secure and to fix a problem in the parsing of a
2781 pull operation that has multiple sources.
2782
2783 - Improved the documentation that explains the difference between a normal
2784 daemon transfer and a daemon-over remote-shell transfer.
2785
2786 - Some of the diffs supplied in the patches dir were fixed and/or improved.
2787
2788### BUILD CHANGES:
2789
2790 - Made configure define `NOBODY_USER` (currently hard-wired to `nobody`) and
2791 `NOBODY_GROUP` (set to either `nobody` or `nogroup` depending on what we
2792 find in the /etc/group file).
2793
2794 - Added a test to the test suite, itemized.test, that tests the output of `-i`
2795 (log-format w/%i) and some double-verbose messages.
2796
2797------------------------------------------------------------------------------
2798<a name="2.6.5"></a>
2799
2800# NEWS for rsync 2.6.5 (1 Jun 2005)
2801
d640d78f 2802## Changes in this version:
87bca719
WD
2803
2804### OUTPUT CHANGES:
2805
f43412f1 2806 - Non-printable chars in filenames are now output using backslash-escaped
87bca719
WD
2807 characters rather than '?'s. Any non-printable character is output using 3
2808 digits of octal (e.g. `\n` -> `\012`), and a backslash is now output as
2809 `\\`. Rsync also uses your locale setting, which can make it treat fewer
2810 high-bit characters as non-printable.
2811
2812 - If rsync received an empty file-list when pulling files, it would output a
2813 `nothing to do` message and exit with a 0 (success) exit status, even if the
2814 remote rsync returned an error (it did not do this under the same conditions
2815 when pushing files). This was changed to make the pulling behavior the same
2816 as the pushing behavior: we now do the normal end-of-run outputting
2817 (depending on options) and exit with the appropriate exit status.
2818
2819### BUG FIXES:
2820
2821 - A crash bug was fixed when a daemon had its `path` set to `/`, did not have
2822 chroot enabled, and used some anchored excludes in the rsyncd.conf file.
2823
2824 - Fixed a bug in the transfer of a single file when `-H` is specified (rsync
2825 would either infinite loop or perhaps crash).
2826
2827 - Fixed a case where the generator might try (and fail) to tweak the
2828 write-permissions of a read-only directory in list-only mode (this only
2829 caused an annoying warning message).
2830
2831 - If `--compare-dest` or `--link-dest` uses a locally-copied file as the basis
2832 for an updated version, log this better when `--verbose` or `-i` is in
2833 effect.
2834
2835 - Fixed the accidental disabling of `--backup` during the `--delete-after`
2836 processing.
2837
2838 - Restored the ability to use the `--address` option in client mode (in
2839 addition to its use in daemon mode).
2840
2841 - Make sure that some temporary progress information from the delete
2842 processing does not get left on the screen when it is followed by a newline.
2843
2844 - When `--existing` skips a directory with extra verbosity, refer to it as a
2845 `directory`, not a `file`.
2846
2847 - When transferring a single file to a different-named file, any generator
2848 messages that are source-file related no longer refer to the file by the
2849 destination filename.
2850
2851 - Fixed a bug where hard-linking a group of files might fail if the generator
2852 hasn't created a needed destination directory yet.
2853
2854 - Fixed a bug where a hard-linked group of files that is newly-linked to a
2855 file in a `--link-dest` dir doesn't link the files from the rest of the
2856 cluster.
2857
2858 - When deleting files with the `--one-file-system` (`-x`) option set, rsync no
2859 longer tries to remove files from inside a mount-point on the receiving
2860 side. Also, we don't complain about being unable to remove the mount-point
2861 dir.
2862
2863 - Fixed a compatibility problem when using `--cvs-ignore` (`-C`) and sending
2864 files to an older rsync without using `--delete`.
2865
2866 - Make sure that a `- !` or `+ !` include/exclude pattern does not trigger the
2867 list-clearing action that is reserved for `!`.
2868
2869 - Avoid a timeout in the generator when the sender/receiver aren't handling
2870 the generator's checksum output quickly enough.
2871
2872 - Fixed the omission of some directories in the delete processing when
2873 `--relative` (`-R`) was combined with a source path that had a trailing
2874 slash.
2875
2876 - Fixed a case where rsync would erroneously delete some files and then
2877 re-transfer them when the options `--relative` (`-R`) and `--recursive`
2878 (`-r`) were both enabled (along with `--delete`) and a source path had a
2879 trailing slash.
2880
2881 - Make sure that `--max-size` doesn't affect a device or a symlink.
2882
2883 - Make sure that a system with a really small MAXPATHLEN does not cause the
2884 buffers in `readfd_unbuffered()` to be too small to receive normal messages.
2885 (This mainly affected Cygwin.)
2886
2887 - If a source pathname ends with a filename of `..`, treat it as if `../` had
2888 been specified (so that we don't copy files to the parent dir of the
2889 destination).
2890
2891 - If `--delete` is combined with a file-listing rsync command (i.e. no
2892 transfer is happening), avoid outputting a warning that we couldn't delete
2893 anything.
2894
2895 - If `--stats` is specified with `--delete-after`, ensure that all the
2896 `deleting` messages are output before the statistics.
2897
2898 - Improved one `if` in the deletion code that was only checking errno for
2899 ENOTEMPTY when it should have also been checking for EEXIST (for
2900 compatibility with OS variations).
2901
2902### ENHANCEMENTS:
2903
2904 - Added the `--only-write-batch=FILE` option that may be used (instead of
2905 `--write-batch=FILE`) to create a batch file without doing any actual
2906 updating of the destination. This allows you to divert all the file-updating
2907 data away from a slow data link (as long as you are pushing the data to the
2908 remote server when creating the batch).
2909
2910 - When the generator is taking a long time to fill up its output buffer (e.g.
2911 if the transferred files are few, small, or missing), it now periodically
2912 flushes the output buffer so that the sender/receiver can get started on the
2913 files sooner rather than later.
2914
2915 - Improved the keep-alive code to handle a long silence between the sender and
2916 the receiver that can occur when the sender is receiving the checksum data
2917 for a large file.
2918
2919 - Improved the auth-errors that are logged by the daemon to include some
2920 information on why the authorization failed: wrong user, password mismatch,
2921 etc. (The client-visible message is unchanged!)
2922
2923 - Improved the client's handling of an `@ERROR` from a daemon so that it does
2924 not complain about an unexpectedly closed socket (since we really did expect
2925 the socket to close).
2926
2927 - If the daemon can't open the log-file specified in rsyncd.conf, fall back to
2928 using syslog and log an appropriate warning. This is better than what was
2929 typically a totally silent (and fatal) failure (since a daemon is not
2930 usually run with the `--no-detach` option that was necessary to see the
2931 error on stderr).
2932
2933 - The man pages now consistently refer to an rsync daemon as a `daemon`
2934 instead of a `server` (to distinguish it from the server process in a
2935 non-daemon transfer).
2936
2937 - Made a small change to the rrsync script (restricted rsync -- in the support
2938 dir) to make a read-only server reject all `--remove-*` options when sending
2939 files (to future-proof it against the possibility of other similar options
2940 being added at some point).
2941
2942### INTERNAL:
2943
2944 - Rsync now calls `setlocale(LC_CTYPE, "")`. This enables isprint() to better
2945 discern which filename characters need to be escaped in messages (which
2946 should result in fewer escaped characters in some locales).
2947
2948 - Improved the naming of the log-file open/reopen/close functions.
2949
2950 - Removed some protocol-compatibility code that was only needed to help
2951 someone running a pre-release of 2.6.4.
2952
2953### BUILD CHANGES:
2954
2955 - Added configure option `--disable-locale` to disable any use of setlocale()
2956 in the binary.
2957
2958 - Fixed a bug in the `SUPPORT{,_HARD}_LINKS` #defines which prevented rsync
2959 from being built without symlink or hard-link support.
2960
2961 - Only #define `HAVE_REMSH` if it is going to be set to 1.
2962
2963 - Configure now disables the use of mkstemp() under HP-UX (since they refuse
2964 to fix its broken handling of large files).
2965
2966 - Configure now explicitly checks for the lseek64() function so that the code
2967 can use `HAVE_LSEEK64` instead of inferring lseek64()'s presence based on
2968 the presence of the `off64_t` type.
2969
2970 - Configure no longer mentions the change in the default remote-shell (from
2971 rsh to ssh) that occurred for the 2.6.0 release.
2972
2973 - Some minor enhancements to the test scripts.
2974
2975 - Added a few new `*.diff` files to the patches dir, including a patch that
2976 enables the optional copying of extended attributes.
2977
2978------------------------------------------------------------------------------
2979<a name="2.6.4"></a>
2980
2981# NEWS for rsync 2.6.4 (30 March 2005)
2982
d640d78f 2983## Changes in this version:
87bca719 2984
d640d78f
WD
2985### PROTOCOL NUMBER:
2986
2987 - The protocol number was changed to 29.
87bca719
WD
2988
2989### OUTPUT CHANGES:
2990
2991 - When rsync deletes a directory and outputs a verbose message about it, it
2992 now appends a trailing slash to the name instead of (only sometimes)
2993 outputting a preceding "directory " string.
2994
2995 - The `--stats` output will contain file-list time-statistics if both sides
2996 are 2.6.4, or if the local side is 2.6.4 and the files are being pushed
2997 (since the stats come from the sending side). (Requires protocol 29 for a
2998 pull.)
2999
3000 - The `%o` (operation) log-format escape now has a third value (besides `send`
3001 and `recv`): `del.` (with trailing dot to make it 4 chars). This changes
3002 the way deletions are logged in the daemon's log file.
3003
3004 - When the `--log-format` option is combined with `--verbose`, rsync now
3005 avoids outputting the name of the file twice in most circumstances. As long
3006 as the `--log-format` item does not refer to any post-transfer items (such
3007 as %b or %c), the `--log-format` message is output prior to the transfer, so
3008 `--verbose` is now the equivalent of a `--log-format` of '%n%L' (which
3009 outputs the name and any link info). If the log output must occur after the
3010 transfer to be complete, the only time the name is also output prior to the
3011 transfer is when `--progress` was specified (so that the name will precede
3012 the progress stats, and the full `--log-format` output will come after).
3013
3014 - Non-printable characters in filenames are replaced with a '?' to avoid
3015 corrupting the screen or generating empty lines in the output.
3016
3017### BUG FIXES:
3018
3019 - Restore the list-clearing behavior of `!` in a .cvsignore file (2.6.3 was
3020 only treating it as a special token in an rsync include/exclude file).
3021
3022 - The combination of `--verbose` and `--dry-run` now mentions the full list of
3023 changes that would be output without `--dry-run`.
3024
3025 - Avoid a mkdir warning when removing a directory in the destination that
3026 already exists in the `--backup-dir`.
3027
f43412f1 3028 - An OS that has a binary mode for its files (such as Cygwin) needed
87bca719 3029 `setmode(fd, O_BINARY)` called on the temp-file we opened with mkstemp().
f43412f1 3030 (Fix derived from Cygwin's 2.6.3 rsync package.)
87bca719
WD
3031
3032 - Fixed a potential hang when verbosity is high, the client side is the
3033 sender, and the file-list is large.
3034
3035 - Fixed a potential protocol-corrupting bug where the generator could merge a
3036 message from the receiver into the middle of a multiplexed packet of data if
3037 only part of that data had been written out to the socket when the message
3038 from the generator arrived.
3039
3040 - We now check if the OS doesn't support using mknod() for creating FIFOs and
3041 sockets, and compile-in some compatibility code using mkfifo() and socket()
3042 when necessary.
3043
3044 - Fixed an off-by-one error in the handling of `--max-delete=N`. Also, if the
3045 `--max-delete` limit is exceeded during a run, we now output a warning about
3046 this at the end of the run and exit with a new error code (25).
3047
3048 - One place in the code wasn't checking if fork() failed.
3049
3050 - The `ignore nonreadable` daemon parameter used to erroneously affect
3051 readable symlinks that pointed to a non-existent file.
3052
3053 - If the OS does not have lchown() and a chown() of a symlink will affect the
3054 referent of a symlink (as it should), we no longer try to set the user and
3055 group of a symlink.
3056
3057 - The generator now properly runs the hard-link loop and the dir-time
3058 rewriting loop after we're sure that the redo phase is complete.
3059
3060 - When `--backup` was specified with `--partial-dir=DIR`, where DIR is a
3061 relative path, the backup code was erroneously trying to backup a file that
3062 was put into the partial-dir.
3063
3064 - If a file gets resent in a single transfer and the `--backup` option is
3065 enabled along with `--inplace`, rsync no longer performs a duplicate backup
3066 (it used to overwrite the first backup with the failed file).
3067
3068 - One call to `flush_write_file()` was not being checked for an error.
3069
3070 - The `--no-relative` option was not being sent from the client to a server
3071 sender.
3072
3073 - If an rsync daemon specified `dont compress = ...` for a file and the client
3074 tried to specify `--compress`, the libz code was not handling a compression
3075 level of 0 properly. This could cause a transfer failure if the block-size
3076 for a file was large enough (e.g. rsync might have exited with an error for
3077 large files).
3078
3079 - Fixed a bug that would sometimes surface when using `--compress` and sending
3080 a file with a block-size larger than 64K (either manually specified, or
3081 computed due to the file being really large). Prior versions of rsync would
3082 sometimes fail to decompress the data properly, and thus the transferred
3083 file would fail its verification.
3084
3085 - If a daemon can't open the specified log file (i.e. syslog is not being
3086 used), die without crashing. We also output an error about the failure on
3087 stderr (which will only be seen if `--no-detach` was specified) and exit
3088 with a new error code (6).
3089
3090 - A local transfer no longer duplicates all its include/exclude options (since
3091 the forked process already has a copy of the exclude list, there's no need
3092 to send them a set of duplicates).
3093
3094 - The output of the items that are being updated by the generator (dirs,
3095 symlinks, devices) is now intermingled in the proper order with the output
3096 from the items that the receiver is updating (regular files) when pulling.
3097 This misordering was particularly bad when `--progress` was specified.
3098 (Requires protocol 29.)
3099
3100 - When `--timeout` is specified, lulls that occur in the transfer while the
3101 generator is doing work that does not generate socket traffic (looking for
3102 changed files, deleting files, doing directory-time touch-ups, etc.) will
3103 cause a new keep-alive packet to be sent that should keep the transfer going
3104 as long as the generator continues to make progress. (Requires protocol 29.)
3105
3106 - The stat size of a device is not added to the total file size of the items
3107 in the transfer (the size might be undefined on some OSes).
3108
3109 - Fixed a problem with refused-option messages sometimes not making it back to
3110 the client side when a remote `--files-from` was in effect and the daemon
3111 was the receiver.
3112
3113 - The `--compare-dest` option was not updating a file that differed in (the
3114 preserved) attributes from the version in the compare-dest DIR.
3115
3116 - When rsync is copying files into a write-protected directory, fixed the
3117 change-report output for the directory so that we don't report an identical
3118 directory as changed.
3119
3120### ENHANCEMENTS:
3121
3122 - Rsync now supports popt's option aliases, which means that you can use
3123 /etc/popt and/or ~/.popt to create your own option aliases.
3124
3125 - Added the `--delete-during` (`--del`) option which will delete files from
3126 the receiving side incrementally as each directory in the transfer is being
3127 processed. This makes it more efficient than the default,
3128 before-the-transfer behavior, which is now also available as
3129 `--delete-before` (and is still the default `--delete-WHEN` option that will
3130 be chosen if `--delete` or `--delete-excluded` is specified without a
3131 `--delete-WHEN` choice). All the `--del*` options infer `--delete`, so an
3132 rsync daemon that refuses `delete` will still refuse to allow any
3133 file-deleting options (including the new `--remove-sent-files` option).
3134
3135 - All the `--delete-WHEN` options are now more memory efficient: Previously an
3136 duplicate set of file-list objects was created on the receiving side for the
3137 entire destination hierarchy. The new algorithm only creates one directory
3138 of objects at a time (for files inside the transfer).
3139
3140 - Added the `--copy-dest` option, which works like `--link-dest` except that
3141 it locally copies identical files instead of hard-linking them.
3142
3143 - Added support for specifying multiple `--compare-dest`, `--copy-dest`, or
3144 `--link-dest` options, but only of a single type. (Promoted from the patches
3145 dir and enhanced.) (Requires protocol 29.)
3146
3147 - Added the `--max-size` option. (Promoted from the patches dir.)
3148
3149 - The daemon-mode options are now separated from the normal rsync options so
3150 that they can't be mixed together. This makes it impossible to start a
3151 daemon that has improper default option values (which could cause problems
3152 when a client connects, such as hanging or crashing).
3153
3154 - The `--bwlimit` option may now be used in combination with `--daemon` to
3155 specify both a default value for the daemon side and a value that cannot be
3156 exceeded by a user-specified `--bwlimit` option.
3157
3158 - Added the `port` parameter to the rsyncd.conf file. (Promoted from the
3159 patches dir.) Also added `address`. The command-line options take precedence
3160 over a config-file option, as expected.
3161
3162 - In `_exit_cleanup()`: when we are exiting with a partially-received file, we
3163 now flush any data in the write-cache before closing the partial file.
3164
3165 - The `--inplace` support was enhanced to work with `--compare-dest`,
3166 `--link-dest`, and (the new) `--copy-dest` options. (Requires protocol 29.)
3167
3168 - Added the `--dirs` (`-d`) option for an easier way to copy directories
3169 without recursion. Any directories that are encountered are created on the
3170 destination. Specifying a directory with a trailing slash copies its
3171 immediate contents to the destination.
3172
3173 - The `--files-from` option now implies `--dirs` (`-d`).
3174
3175 - Added the `--list-only` option, which is mainly a way for the client to put
3176 the server into listing mode without needing to resort to any internal
3177 option kluges (e.g. the age-old use of `-r --exclude='/*/*'` for a
3178 non-recursive listing). This option is used automatically (behind the
3179 scenes) when a modern rsync speaks to a modern daemon, but may also be
3180 specified manually if you want to force the use of the `--list-only` option
3181 over a remote-shell connection.
3182
3183 - Added the `--omit-dir-times` (`-O`) option, which will avoid updating the
3184 modified time for directories when `--times` was specified. This option will
3185 avoid an extra pass through the file-list at the end of the transfer (to
3186 tweak all the directory times), which may provide an appreciable speedup for
3187 a really large transfer. (Promoted from the patches dir.)
3188
3189 - Added the `--filter` (`-f`) option and its helper option, `-F`. Filter rules
3190 are an extension to the existing include/exclude handling that also supports
3191 nested filter files as well as per-directory filter files (like .cvsignore,
3192 but with full filter-rule parsing). This new option was chosen in order to
3193 ensure that all existing include/exclude processing remained 100% compatible
3194 with older versions. Protocol 29 is needed for full filter-rule support, but
3195 backward-compatible rules work with earlier protocol versions. (Promoted
3196 from the patches dir and enhanced.)
3197
3198 - Added the `--delay-updates` option that puts all updated files into a
3199 temporary directory (by default `.~tmp~`, but settable via the
3200 `--partial-dir=DIR` option) until the end of the transfer. This makes the
3201 updates a little more atomic for a large transfer.
3202
3203 - If rsync is put into the background, any output from `--progress` is
3204 reduced.
3205
3206 - Documented the `max verbosity` setting for rsyncd.conf. (This setting was
3207 added a couple releases ago, but left undocumented.)
3208
3209 - The sender and the generator now double-check the file-list index they are
3210 given, and refuse to try to do a file transfer on a non-file index (since
3211 that would indicate that something had gone very wrong).
3212
3213 - Added the `--itemize-changes` (`-i`) option, which is a way to output a more
3214 detailed list of what files changed and in what way. The effect is the same
3215 as specifying a `--log-format` of `%i %n%L` (see both the rsync and
3216 rsyncd.conf manpages). Works with `--dry-run` too.
3217
3218 - Added the `--fuzzy` (`-y`) option, which attempts to find a basis file for a
3219 file that is being created from scratch. The current algorithm only looks in
3220 the destination directory for the created file, but it does attempt to find
3221 a match based on size/mod-time (in case the file was renamed with no other
3222 changes) as well as based on a fuzzy name-matching algorithm. This option
3223 requires protocol 29 because it needs the new file-sorting order. (Promoted
3224 from patches dir and enhanced.) (Requires protocol 29.)
3225
3226 - Added the `--remove-sent-files` option, which lets you move files between
3227 systems.
3228
3229 - The hostname in HOST:PATH or HOST::PATH may now be an IPv6 literal enclosed
3230 in '[' and ']' (e.g. `[::1]`). (We already allowed IPv6 literals in the
3231 rsync://HOST:PORT/PATH format.)
3232
3233 - When rsync recurses to build the file list, it no longer keeps open one or
3234 more directory handles from the dir's parent dirs.
3235
3236 - When building under windows, the default for `--daemon` is now to avoid
3237 detaching, requiring the new `--detach` option to force rsync to detach.
3238
3239 - The `--dry-run` option can now be combined with either `--write-batch` or
3240 `--read-batch`, allowing you to run a do-nothing test command to see what
3241 would happen without `--dry-run`.
3242
3243 - The daemon's `read only` config item now sets an internal `read_only`
3244 variable that makes extra sure that no write/delete calls on the read-only
3245 side can succeed.
3246
3247 - The log-format % escapes can now have a numeric field width in between the %
3248 and the escape letter (e.g. `%-40n %08p`).
3249
3250 - Improved the option descriptions in the `--help` text.
3251
3252### SUPPORT FILES:
3253
3254 - Added atomic-rsync to the support dir: a perl script that will transfer some
3255 files using rsync, and then move the updated files into place all at once at
3256 the end of the transfer. Only works when pulling, and uses `--link-dest` and
3257 a parallel hierarchy of files to effect its update.
3258
3259 - Added mnt-excl to the support dir: a perl script that takes the /proc/mounts
3260 file and translates it into a set of excludes that will exclude all mount
3261 points (even mapped mounts to the same disk). The excludes are made relative
3262 to the specified source dir and properly anchored.
3263
3264 - Added savetransfer.c to the support dir: a C program that can make a copy of
3265 all the data that flows over the wire. This lets you test for data
3266 corruption (by saving the data on both the sending side and the receiving
3267 side) and provides one way to debug a protocol error.
3268
3269 - Added rrsync to the support dir: this is an updated version of Joe Smith's
3270 restricted rsync perl script. This helps to ensure that only certain rsync
3271 commands can be run by an ssh invocation.
3272
3273### INTERNAL:
3274
3275 - Added better checking of the checksum-header values that come over the
3276 socket.
3277
3278 - Merged a variety of file-deleting functions into a single function so that
3279 it is easier to maintain.
3280
3281 - Improved the type of some variables (particularly blocksize vars) for
3282 consistency and proper size.
3283
3284 - Got rid of the uint64 type (which we didn't need).
3285
3286 - Use a slightly more compatible set of core #include directives.
3287
3288 - Defined int32 in a way that ensures that the build dies if we can't find a
3289 variable with at least 32 bits.
3290
3291### PROTOCOL DIFFERENCES FOR VERSION 29:
3292
3293 - A 16-bit flag-word is transmitted after every file-list index. This
3294 indicates what is changing between the sender and the receiver. The
3295 generator now transmits an index and a flag-word to indicate when dirs and
3296 symlinks have changed (instead of producing a message), which makes the
3297 outputting of the information more consistent and less prone to screen
3298 corruption (because the local receiver/sender is now outputting all the
3299 file-change info messages).
3300
3301 - If a file is being hard-linked, the `ITEM_XNAME_FOLLOWS` bit is enabled in
3302 the flag-word and the name of the file that was linked immediately follows
3303 in vstring format (see below).
3304
3305 - If a file is being transferred with an alternate-basis file, the
3306 `ITEM_BASIS_TYPE_FOLLOWS` bit is enabled in the flag-word and a single byte
3307 follows, indicating what type of basis file was chosen. If that indicates
3308 that a fuzzy-match was selected, the `ITEM_XNAME_FOLLOWS` bit is set in the
3309 flag-word and the name of the match in vstring format follows the basis
3310 byte. A vstring is a variable length string that has its size written prior
3311 to the string, and no terminating null. If the string is from 1-127 bytes,
3312 the length is a single byte. If it is from 128-32767 bytes, the length is
3313 written as ((len >> 8) | 0x80) followed by (len % 0x100).
3314
3315 - The sending of exclude names is done using filter-rule syntax. This means
3316 that all names have a prefixed rule indicator, even excludes (which used to
3317 be sent as a bare pattern, when possible). The `-C` option will include the
3318 per-dir .cvsignore merge file in the list of filter rules so it is
3319 positioned correctly (unlike in some older transfer scenarios).
3320
3321 - Rsync sorts the filename list in a different way: it sorts the subdir names
3322 after the non-subdir names for each dir's contents, and it always puts a
3323 dir's contents immediately after the dir's name in the list. (Previously an
3324 item named `foo.txt` would sort in between directory `foo/` and `foo/bar`.)
3325
3326 - When talking to a protocol 29 rsync daemon, a list-only request is able to
3327 note this before the options are sent over the wire and the new
3328 `--list-only` option is included in the options.
3329
3330 - When the `--stats` bytes are sent over the wire (or stored in a batch), they
3331 now include two elapsed-time values: one for how long it took to build the
3332 file-list, and one for how long it took to send it over the wire (each
3333 expressed in thousandths of a second).
3334
3335 - When `--delete-excluded` is specified with some filter rules (AKA excludes),
3336 a client sender will now initiate a send of the rules to the receiver (older
3337 protocols used to omit the sending of excludes in this situation since there
3338 were no receiver-specific rules that survived `--delete-excluded` back
3339 then). Note that, as with all the filter-list sending, only items that are
3340 significant to the other side will actually be sent over the wire, so the
3341 filter-rule list that is sent in this scenario is often empty.
3342
3343 - An index equal to the file-list count is sent as a keep-alive packet from
3344 the generator to the sender, which then forwards it on to the receiver. This
3345 normally invalid index is only a valid keep-alive packet if the 16-bit
3346 flag-word that follows it contains a single bit (`ITEM_IS_NEW`, which is
3347 normally an illegal flag to appear alone).
3348
3349 - A protocol-29 batch file includes a bit for the setting of the `--dirs`
3350 option and for the setting of the `--compress` option. Also, the shell
3351 script created by `--write-batch` will use the `--filter` option instead of
3352 `--exclude-from` to capture any filter rules.
3353
3354### BUILD CHANGES:
3355
3356 - Handle an operating system that use mkdev() in place of makedev().
3357
3358 - Improved configure to better handle cross-compiling.
3359
3360------------------------------------------------------------------------------
3361<a name="2.6.3"></a>
3362
3363# NEWS for rsync 2.6.3 (30 Sep 2004)
3364
d640d78f 3365## Changes in this version:
87bca719
WD
3366
3367### SECURITY FIXES:
3368
3369 - A bug in the `sanitize_path` routine (which affects a non-chrooted rsync
3370 daemon) could allow a user to craft a pathname that would get transformed
3371 into an absolute path for certain options (but not for file-transfer names).
3372 If you're running an rsync daemon with chroot disabled, **please upgrade**,
3373 ESPECIALLY if the user privs you run rsync under is anything above `nobody`.
3374
3375 OUTPUT CHANGES (ATTN: those using a script to parse the verbose output):
3376
3377 - Please note that the 2-line footer (output when verbose) now uses the term
3378 `sent` instead of `wrote` and `received` instead of `read`. If you are not
3379 parsing the numeric values out of this footer, a script would be better off
3380 using the empty line prior to the footer as the indicator that the verbose
3381 output is over.
3382
3383 - The output from the `--stats` option was similarly affected to change
3384 `written` to `sent` and `read` to `received`.
3385
3386 - Rsync ensures that a filename that contains a newline gets mentioned with
3387 each newline transformed into a question mark (which prevents a filename
3388 from causing an empty line to be output).
3389
3390 - The `backed up ...` message that is output when at least 2 `--verbose`
3391 options are specified is now the same both with and without the
3392 `--backup-dir` option.
3393
3394### BUG FIXES:
3395
3396 - Fixed a crash bug that might appear when `--delete` was used and multiple
3397 source directories were specified.
3398
3399 - Fixed a 32-bit truncation of the file length when generating the checksums.
3400
3401 - The `--backup` code no longer attempts to create some directories over and
3402 over again (generating warnings along the way).
3403
3404 - Fixed a bug in the reading of the secrets file (by the daemon) and the
3405 password file (by the client): the files no longer need to be terminated by
3406 a newline for their content to be read in.
3407
3408 - If a file has a read error on the sending side or the reconstructed data
3409 doesn't match the expected checksum (perhaps due to the basis file changing
3410 during the transfer), the receiver will no longer retain the resulting file
3411 unless the `--partial` option was specified. (Note: for the read-error
3412 detection to work, neither side can be older than 2.6.3 -- older receivers
3413 will always retain the file, and older senders don't tell the receiver that
3414 the file had a read error.)
3415
3416 - If a file gets resent in a single transfer and the `--backup` option is
3417 enabled, rsync no longer performs a duplicate backup (it used to overwrite
3418 the original file in the backup area).
3419
3420 - Files specified in the daemon's `exclude` or `exclude from` config items are
3421 now excluded from being uploaded (assuming that the module allows uploading
3422 at all) in addition to the old download exclusion.
3423
3424 - Got rid of a potential hang in the receiver when near the end of a phase.
3425
3426 - When using `--backup` without a `--backup-dir`, rsync no longer preserves
3427 the modify time on directories. This avoids confusing NFS.
3428
3429 - When `--copy-links` (`-L`) is specified, we now output a separate error for
3430 a symlink that has no referent instead of claiming that a file `vanished`.
3431
3432 - The `--copy-links` (`-L`) option no longer has the side-effect of telling
3433 the receiving side to follow symlinks. See the `--keep-dirlinks` option
3434 (mentioned below) for a way to specify that behavior.
3435
3436 - Error messages from the daemon server's option-parsing (such as refused
3437 options) are now successfully transferred back to the client (the server
3438 used to fail to send the message because the socket wasn't in the right
3439 state for the message to get through).
3440
3441 - Most transfer errors that occur during a daemon transfer are now returned to
3442 the user in addition to being logged (some messages are intended to be
3443 daemon-only and are not affected by this).
3444
3445 - Fixed a bug in the daemon authentication code when using one of the
3446 batch-processing options.
3447
3448 - We try to work around some buggy IPv6 implementations that fail to implement
3449 `IPV6_V6ONLY`. This should fix the `address in use` error that some daemons
3450 get when running on an OS with a buggy IPv6 implementation. Also, if the new
3451 code gets this error, we might suggest that the user specify `--ipv4` or
3452 `--ipv6` (if we think it will help).
3453
3454 - When the remote rsync dies, make a better effort to recover any error
3455 messages it may have sent before dying (the local rsync used to just die
3456 with a socket-write error).
3457
3458 - When using `--delete` and a `--backup-dir` that contains files that are
3459 hard-linked to their destination equivalents, rsync now makes sure that
3460 removed files really get removed (avoids a really weird rename() behavior).
3461
3462 - Avoid a bogus run-time complaint about a lack of 64-bit integers when the
3463 int64 type is defined as an `off_t` and it actually has 64-bits.
3464
3465 - Added a configure check for open64() without mkstemp64() so that we can
3466 avoid using mkstemp() when such a combination is encountered. This bypasses
3467 a problem writing out large temp files on OSes such as AIX and HP-UX.
3468
3469 - Fixed an age-old crash problem with `--read-batch` on a local copy (rsync
3470 was improperly assuming `--whole-file` for the local copy).
3471
3472 - When `--dry-run` (`-n`) is used and the destination directory does not
3473 exist, rsync now produces a correct report of files that would be sent
3474 instead of dying with a chdir() error.
3475
3476 - Fixed a bug that could cause a slow-to-connect rsync daemon to die with an
3477 error instead of waiting for the connection to finish.
3478
3479 - Fixed an ssh interaction that could cause output to be lost when the user
3480 chose to combine the output of rsync's stdout and stderr (e.g. using the
3481 `2>&1`).
3482
3483 - Fixed an option-parsing bug when `--files-from` got passed to a daemon.
3484
3485### ENHANCEMENTS:
3486
3487 - Added the `--partial-dir=DIR` option that lets you specify where to
f43412f1 3488 (temporarily) put a partially transferred file (instead of overwriting the
87bca719
WD
3489 destination file). E.g. `--partial-dir=.rsync-partial` Also added support
3490 for the `RSYNC_PARTIAL_DIR` environment variable that, when found,
3491 transforms a regular `--partial` option (such as the convenient `-P` option)
3492 into one that also specifies a directory.
3493
3494 - Added `--keep-dirlinks` (`-K`), which allows you to symlink a directory onto
3495 another partition on the receiving side and have rsync treat it as matching
3496 a normal directory from the sender.
3497
3498 - Added the `--inplace` option that tells rsync to write each destination file
3499 without using a temporary file. The matching of existing data in the
3500 destination file can be severely limited by this, but there are also cases
3501 where this is more efficient (such as appending data). Use only when needed
3502 (see the man page for more details).
3503
3504 - Added the `write only` option for the daemon's config file.
3505
3506 - Added long-option names for `-4` and `-6` (namely `--ipv4` and `--ipv6`) and
3507 documented all these options in the man page.
3508
3509 - Improved the handling of the `--bwlimit` option so that it's less bursty,
3510 more accurate, and works properly over a larger range of values.
3511
3512 - The rsync daemon-over-ssh code now looks for `SSH_CONNECTION` and
3513 `SSH2_CLIENT` in addition to `SSH_CLIENT` to figure out the IP address.
3514
3515 - Added the `--checksum-seed=N` option for advanced users.
3516
3517 - Batch writing/reading has a brand-new implementation that is simpler, fixes
3518 a few weird problems with the old code (such as no longer sprinkling the
3519 batch files into different dirs or even onto different systems), and is much
3520 less intrusive into the code (making it easier to maintain for the future).
3521 The new code generates just one data file instead of three, which makes it
3522 possible to read the batch on stdin via a remote shell. Also, the old
3523 requirement of forcing the same fixed checksum-seed for all batch processing
3524 has been removed.
3525
3526 - If an rsync daemon has a module set with `list = no` (which hides its
3527 presence in the list of available modules), a user that fails to
3528 authenticate gets the same `unknown module` error that they would get if the
3529 module were actually unknown (while still logging the real error to the
3530 daemon's log file). This prevents fishing for module names.
3531
3532 - The daemon's `refuse options` config item now allows you to match option
3533 names using wildcards and/or the single-letter option names.
3534
3535 - Each transferred file now gets its permissions and modified-time updated
3536 before the temp-file gets moved into place. Previously, the finished file
3537 would have a very brief window where its permissions disallowed all group
3538 and world access.
3539
3540 - Added the ability to parse a literal IPv6 address in an `rsync:` URL (e.g.
3541 rsync://[2001:638:500:101::21]:873/module/dir).
3542
3543 - The daemon's wildcard expanding code can now handle more than 1000 filenames
3544 (it's now limited by memory instead of having a hard-wired limit).
3545
3546### INTERNAL:
3547
3548 - Some cleanup in the exclude code has saved some per-exclude memory and made
3549 the code easier to maintain.
3550
3551 - Improved the argv-overflow checking for a remote command that has a lot of
3552 args.
3553
3554 - Use rsyserr() in the various places that were still calling rprintf() with
3555 strerror() as an arg.
3556
3557 - If an rsync daemon is listening on multiple sockets (to handle both IPv4 and
3558 IPv6 to a single port), we now close all the unneeded file handles after we
3559 accept a connection (we used to close just one of them).
3560
3561 - Optimized the handling of larger block sizes (rsync used to slow to a crawl
3562 if the block size got too large).
3563
3564 - Optimized away a loop in `hash_search()`.
3565
3566 - Some improvements to the `sanitize_path()` and `clean_fname()` functions
3567 makes them more efficient and produce better results (while still being
3568 compatible with the file-name cleaning that gets done on both sides when
3569 sending the file-list).
3570
3571 - Got rid of `alloc_sanitize_path()` after adding a destination-buffer arg to
3572 `sanitize_path()` made it possible to put all the former's functionality
3573 into the latter.
3574
3575 - The file-list that is output when at least 4 verbose options are specified
3576 reports the uid value on the sender even when rsync is not running as root
3577 (since we might be sending to a root receiver).
3578
3579### BUILD CHANGES:
3580
3581 - Added a `gen` target to rebuild most of the generated files, including
3582 configure, config.h.in, the man pages, and proto.h.
3583
3584 - If `make proto` doesn't find some changes in the prototypes, the proto.h
3585 file is left untouched (its time-stamp used to always be updated).
3586
f6df3708
WD
3587 - The variable `$STRIP` (that is optionally set by the install-strip target's
3588 rule) was changed to `$INSTALL_STRIP` because some systems have `$STRIP`
87bca719
WD
3589 already set in the environment.
3590
3591 - Fixed a build problem when `SUPPORT_HARD_LINKS` isn't defined.
3592
3593 - When cross-compiling, the gettimeofday() function is now assumed to be a
3594 modern version that takes two-args (since we can't test it).
3595
3596### DEVELOPER RELATED:
3597
3598 - The scripts in the testsuite dir were cleaned up a bit and a few new tests
3599 added.
3600
3601 - Some new diffs were added to the patches dir, and some accepted ones were
3602 removed.
3603
3604------------------------------------------------------------------------------
3605<a name="2.6.2"></a>
3606
3607# NEWS for rsync 2.6.2 (30 Apr 2004)
3608
d640d78f 3609## Changes in this version:
87bca719
WD
3610
3611### BUG FIXES:
3612
3613 - Fixed a major bug in the sorting of the filenames when `--relative` is used
3614 for some sources (just sources such as `/` and `/*` were affected). This fix
3615 ensures that we ask for the right file-list item when requesting changes
3616 from the sender.
3617
3618 - Rsync now checks the return value of the close() function to better report
3619 disk-full problems on an NFS file system.
3620
3621 - Restored the old daemon-server behavior of logging error messages rather
3622 than returning them to the user. (A better long-term fix will be sought in
3623 the future.)
3624
3625 - An obscure uninitialized-variable bug was fixed in the uid/gid code. (This
3626 bug probably had no ill effects.)
3627
3628### BUILD CHANGES:
3629
3630 - Got rid of the configure check for sys/sysctl.h (it wasn't used and was
3631 causing a problem on some systems). Also improved the
3632 broken-largefile-locking test to try to avoid failure due to an NFS
3633 build-dir.
3634
3635 - Fixed a compile problem on systems that don't define `AI_NUMERICHOST`.
3636
3637 - Fixed a compile problem in the popt source for compilers that don't support
3638 `__attribute__`.
3639
3640### DEVELOPER RELATED:
3641
3642 - Improved the testsuite's `merge` test to work on OSF1.
3643
3644 - Two new diffs were added to the patches dir.
3645
3646------------------------------------------------------------------------------
3647<a name="2.6.1"></a>
3648
3649# NEWS for rsync 2.6.1 (26 Apr 2004)
3650
d640d78f
WD
3651## Changes in this version:
3652
3653### PROTOCOL NUMBER:
87bca719 3654
d640d78f 3655 - The protocol number was changed to 28.
87bca719
WD
3656
3657### SECURITY FIXES:
3658
3659 - Paths sent to an rsync daemon are more thoroughly sanitized when chroot is
3660 not used. If you're running a non-read-only rsync daemon with chroot
3661 disabled, **please upgrade**, ESPECIALLY if the user privs you run rsync
3662 under is anything above `nobody`.
3663
3664### ENHANCEMENTS:
3665
3666 - Lower memory use, more optimal transfer of data over the socket, and lower
3667 CPU usage (see the INTERNAL section for details).
3668
3669 - The `RSYNC_PROXY` environment variable can now contain a `USER:PASS@` prefix
3670 before the `HOST:PORT` information. (Bardur Arantsson)
3671
3672 - The `--progress` output now mentions how far along in the transfer we are,
3673 including both a count of files transferred and a percentage of the total
3674 file-count that we've processed. It also shows better
3675 current-rate-of-transfer and remaining-transfer-time values.
3676
f43412f1 3677 - Documentation changes now attempt to describe some often misunderstood
87bca719
WD
3678 features more clearly.
3679
3680### BUG FIXES:
3681
3682 - When `-x` (`--one-file-system`) is combined with `-L` (`--copy-links`) or
3683 `--copy-unsafe-links,` no symlinked files are skipped, even if the referent
3684 file is on a different filesystem.
3685
3686 - The `--link-dest` code now works properly for a non-root user when (1) the
3687 UIDs of the source and destination differ and `-o` was specified, or (2)
3688 when the group of the source can't be used on the destination and `-g` was
3689 specified.
3690
3691 - Fixed a bug in the handling of `-H` (hard-links) that might cause the
3692 expanded PATH/NAME value of the current item to get overwritten (due to an
3693 expanded-name caching bug).
3694
3695 - We now reset the `new data has been sent` flag at the start of each file we
3696 send. This makes sure that an interrupted transfer with the `--partial`
3697 option set doesn't keep a shorter temp file than the current basis file when
3698 no new data has been transferred over the wire for that file.
3699
3700 - Fixed a byte-order problem in `--batch-mode` on big-endian machines. (Jay
3701 Fenlason)
3702
3703 - When using `--cvs-exclude`, the exclude items we get from a per-directory's
3704 .cvsignore file once again only affect that one directory (not all following
3705 directories too). The items are also now properly word-split and parsed
3706 without any +/- prefix parsing.
3707
3708 - When specifying the USER@HOST: prefix for a file, the USER part can now
3709 contain an '@', if needed (i.e. the last '@' is used to find the HOST, not
3710 the first).
3711
3712 - Fixed some bugs in the handling of group IDs for non-root users: (1) It
3713 properly handles a group that the sender didn't have a name for (it would
3714 previously skip changing the group on any files in that group). (2) If
3715 `--numeric-ids` is used, rsync no longer attempts to set groups that the
3716 user doesn't have the permission to set.
3717
3718 - Fixed the `refuse options` setting in the rsyncd.conf file.
3719
f43412f1 3720 - Improved the `-x` (`--one-file-system`) flag's handling of any mount-point
87bca719 3721 directories we encounter. It is both more optimal (in that it no longer does
f43412f1 3722 a useless scan of the contents of the mount-point dirs) and also fixes a
87bca719
WD
3723 bug where a remapped mount of the original filesystem could get discovered
3724 in a subdir we should be ignoring.
3725
3726 - Rsync no longer discards a double-slash at the start of a filename when
3727 trying to open the file. It also no longer constructs names that start with
3728 a double slash (unless the user supplied them).
3729
3730 - Path-specifying options to a daemon should now work the same with or without
3731 chroot turned on. Previously, such a option (such as `--link-dest`) would
3732 get its absolute path munged into a relative one if chroot was not on,
3733 making that setting fairly useless. Rsync now transforms the path into one
3734 that is based on the module's base dir when chroot is not enabled.
3735
3736 - Fixed a compatibility problem interacting with older rsync versions that
3737 might send us an empty `--suffix` value without telling us that
3738 `--backup-dir` was specified.
3739
3740 - The `hosts allow` option for a daemon-over-remote-shell process now has
3741 improved support for IPv6 addresses and a fix for systems that have a length
3742 field in their socket structs.
3743
3744 - Fixed the ability to request an empty backup `--suffix` when sending files
3745 to an rsync daemon.
3746
3747 - Fixed an option-parsing bug when `--files-from` was sent to a server sender.
3748
3749### INTERNAL:
3750
3751 - Most of the I/O is now buffered, which results in a pretty large speedup
3752 when running under MS Windows. (Craig Barratt)
3753
3754 - Optimizations to the name-handling/comparing code have made some significant
3755 reductions in user-CPU time for large file sets.
3756
3757 - Some cleanup of the variable types make the code more consistent.
3758
3759 - Reduced memory requirements of hard link preservation. (J.W. Schultz)
3760
3761 - Implemented a new algorithm for hard-link handling that speeds up the code
3762 significantly. (J.W. Schultz and Wayne Davison)
3763
3764 - The `--hard-link` option now uses the first existing file in the group of
3765 linked files as the basis for the transfer. This prevents the sub-optimal
3766 transfer of a file's data when a new hardlink is added on the sending side
3767 and it sorts alphabetically earlier in the list than the files that are
3768 already present on the receiving side.
3769
3770 - Dropped support for protocol versions less than 20 (2.3.0 released 15 Mar
3771 1999) and activated warnings for protocols less than 25 (2.5.0 released 23
3772 Aug 2001). (Wayne Davison and J.W. Schultz, severally)
3773
3774 - More optimal data transmission for `--hard-links` (protocol 28).
3775
3776 - More optimal data transmission for `--checksum` (protocol 28).
3777
3778 - Less memory is used when `--checksum` is specified.
3779
3780 - Less memory is used in the file list (a per-file savings).
3781
3782 - The generator is now better about not modifying the file list during the
3783 transfer in order to avoid a copy-on-write memory bifurcation (on systems
3784 where fork() uses shared memory). Previously, rsync's shared memory would
3785 slowly become unshared, resulting in real memory usage nearly doubling on
3786 the receiving side by the end of the transfer. Now, as long as permissions
3787 are being preserved, the shared memory should remain that way for the entire
3788 transfer.
3789
3790 - Changed hardlink info and `file_struct` + strings to use allocation pools.
3791 This reduces memory use for large file-sets and permits freeing memory to
3792 the OS. (J.W. Schultz)
3793
3794 - The 2 pipes used between the receiver and generator processes (which are
3795 forked on the same machine) were reduced to 1 pipe and the protocol improved
3796 so that (1) it is now impossible to have the `redo` pipe fill up and hang
3797 rsync, and (2) trailing messages from the receiver don't get lost on their
3798 way through the generator over to the sender (which mainly affected
3799 hard-link messages and verbose `--stats` output).
3800
3801 - Improved the internal uid/gid code to be more portable and a little more
3802 optimized.
3803
3804 - The device numbers sent when using `--devices` are now sent as separate
3805 major/minor values with 32-bit accuracy (protocol 28). Previously, the
3806 copied devices were sent as a single 32-bit number. This will make
3807 inter-operation of 64-bit binaries more compatible with their 32-bit
3808 brethren (with both ends of the connection are using protocol 28). Note that
3809 optimizations in the binary protocol for sending the device numbers often
3810 results in fewer bytes being used than before, even though more precision is
3811 now available.
3812
3813 - Some cleanup of the exclude/include structures and its code made things
3814 clearer (internally), simpler, and more efficient.
3815
3816 - The reading & writing of the file-list in batch-mode is now handled by the
3817 same code that sends & receives the list over the wire. This makes it much
3818 easier to maintain. (Note that the batch code is still considered to be
3819 experimental.)
3820
3821### BUILD CHANGES:
3822
3823 - The configure script now accepts `--with-rsyncd-conf=PATH` to override the
3824 default value of the /etc/rsyncd.conf file.
3825
3826 - Fixed configure bug when running `./configure --disable-ipv6`.
3827
3828 - Fixed compilation problem on Tru64 Unix (having to do with `sockaddr.sa_len`
3829 and `sockaddr.sin_len`).
3830
3831### DEVELOPER RELATED:
3832
3833 - Fixed `make test` bug when build dir is not the source dir.
3834
3835 - Added a couple extra diffs in the `patches` dir, removed the ones that got
3836 applied, and rebuilt the rest.
3837
3838------------------------------------------------------------------------------
3839<a name="2.6.0"></a>
3840
3841# NEWS for rsync 2.6.0 (1 Jan 2004)
3842
d640d78f 3843## Changes in this version:
87bca719 3844
d640d78f
WD
3845### PROTOCOL NUMBER:
3846
3847 - The protocol number was changed to 27. The maximum accepted protocol number
3848 was increased from 30 to 40.
87bca719
WD
3849
3850### ENHANCEMENTS:
3851
3852 - `ssh` is now the default remote shell for rsync. If you want to change this,
3853 configure like this: `./configure --with-rsh=rsh`.
3854
3855 - Added `--files-from`, `--no-relative`, `--no-implied-dirs`, and `--from0`.
3856 Note that `--from0` affects the line-ending character for all the files read
3857 by the `--*-from` options. (Wayne Davison)
3858
3859 - Length of csum2 is now per-file starting with protocol version
3860 27. (J.W. Schultz)
3861
3862 - Per-file dynamic block size is now sqrt(file length). The per-file checksum
3863 size is determined according to an algorithm provided by Donovan Baarda
3864 which reduces the probability of rsync algorithm corrupting data and falling
3865 back using the whole md4 checksums. (J.W. Schultz, Donovan Baarda)
3866
3867 - The `--stats` option no longer includes the (debug) malloc summary unless
3868 the verbose option was specified at least twice.
3869
3870 - Added a new error/warning code for when files vanish from the sending side.
3871 Made vanished source files not interfere with the file-deletion pass when
3872 `--delete-after` was specified.
3873
3874 - Various trailing-info sections are now preceded by a newline.
3875
3876### BUG FIXES:
3877
3878 - Fixed several exclude/include matching bugs when using wild-cards. This has
3879 a several user-visible effects, all of which make the matching more
3880 consistent and intuitive. This should hopefully not cause anyone problems
3881 since it makes the matching work more like what people are expecting. (Wayne
3882 Davison)
3883
3884 - A pattern with a `**` no longer causes a `*` to match slashes. For example,
3885 with `/*/foo/**`, `foo` must be 2 levels deep. [If your string has BOTH `*`
3886 and `**` wildcards, changing the `*` wildcards to `**` will provide the old
3887 behavior in all versions.]
3888
3889 - `**/foo` now matches at the base of the transfer (like /foo does). [Use
3890 `/**/foo` to get the old behavior in all versions.]
3891
3892 - A non-anchored wildcard term floats to match beyond the base of the
3893 transfer. E.g. `CVS/R*` matches at the end of the path, just like the
3894 non-wildcard term `CVS/Root` does. [Use `/CVS/R*` to get the old behavior in
3895 all versions.]
3896
3897 - Including a `**` in the match term causes it to be matched against the
3898 entire path, not just the name portion, even if there aren't any interior
3899 slashes in the term. E.g. `foo**bar` would exclude `/path/foo-bar` (just
3900 like before) as well as `/foo-path/baz-bar` (unlike before). [Use `foo*bar`
3901 to get the old behavior in all versions.]
3902
3903 - The exclude list specified in the daemon's config file is now properly
3904 applied to the pulled items no matter how deep the user's file-args are in
3905 the source tree. (Wayne Davison)
3906
3907 - For protocol version >= 27, `mdfour_tail()` is called when the block size
3908 (including `checksum_seed`) is a multiple of 64. Previously it was not
3909 called, giving the wrong MD4 checksum. (Craig Barratt)
3910
3911 - For protocol version >= 27, a 64 bit bit counter is used in mdfour.c as
3912 required by the RFC. Previously only a 32 bit bit counter was used, causing
3913 incorrect MD4 file checksums for file sizes >= 512MB - 4. (Craig Barratt)
3914
3915 - Fixed a crash bug when interacting with older rsync versions and multiple
3916 files of the same name are destined for the same dir. (Wayne Davison)
3917
3918 - Keep tmp names from overflowing MAXPATHLEN.
3919
3920 - Make `--link-dest` honor the absence of `-p`, `-o`, and `-g`.
3921
3922 - Made rsync treat a trailing slash in the destination in a more consistent
3923 manner.
3924
3925 - Fixed file I/O error detection. (John Van Essen)
3926
3927 - Fixed bogus `malformed address {hostname}` message in rsyncd log when
3928 checking IP address against hostnames from `hosts allow` and `hosts deny`
3929 parameters in config file.
3930
3931 - Print heap statistics when verbose >= 2 instead of when >= 1.
3932
3933 - Fixed a compression (`-z`) bug when syncing a mostly-matching file that
3934 contains already-compressed data. (Yasuoka Masahiko and Wayne Davison)
3935
3936 - Fixed a bug in the `--backup` code that could cause deleted files to not get
3937 backed up.
3938
3939 - When the backup code makes new directories, create them with mode 0700
3940 instead of 0755 (since the directory permissions in the backup tree are not
3941 yet copied from the main tree).
3942
3943 - Call setgroups() in a more portable manner.
3944
3945 - Improved file-related error messages to better indicate exactly what
3946 pathname failed. (Wayne Davison)
3947
3948 - Fixed some bugs in the handling of `--delete` and `--exclude` when using the
3949 `--relative` (`-R`) option. (Wayne Davison)
3950
3951 - Fixed bug that prevented regular files from replacing special files and
3952 caused a directory in `--link-dest` or `--compare-dest` to block the
3953 creation of a file with the same path. A directory still cannot be replaced
3954 by a regular file unless `--delete` specified. (J.W. Schultz)
3955
3956 - Detect and report when open or opendir succeed but read and readdir fail
3957 caused by network filesystem issues and truncated files. (David Norwood,
3958 Michael Brown, J.W. Schultz)
3959
3960 - Added a fix that should give ssh time to restore the tty settings if the
3961 user presses Ctrl-C at an ssh password prompt.
3962
3963### INTERNAL:
3964
3965 - Eliminated vestigial support for old versions that we stopped supporting.
3966 (J.W. Schultz)
3967
3968 - Simplified some of the option-parsing code. (Wayne Davison)
3969
3970 - Some cleanup made to the exclude code, as well as some new defines added to
3971 enhance readability. (Wayne Davison)
3972
3973 - Changed the protocol-version code so that it can interact at a lower
3974 protocol level than the maximum supported by both sides. Added an
3975 undocumented option, `--protocol=N`, to force the value we advertise to the
3976 other side (primarily for testing purposes). (Wayne Davison)
3977
3978------------------------------------------------------------------------------
3979<a name="2.5.7"></a>
3980
3981# NEWS for rsync 2.5.7 (4 Dec 2003)
3982
d640d78f 3983## Changes in this version:
87bca719
WD
3984
3985### SECURITY FIXES:
3986
3987 - Fix buffer handling bugs. (Andrew Tridgell, Martin Pool, Paul Russell,
3988 Andrea Barisani)
3989
3990------------------------------------------------------------------------------
3991<a name="2.5.6"></a>
3992
3993# NEWS for rsync 2.5.6, aka "the dwd-between-jobs release" (26 Jan 2003)
3994
d640d78f 3995## Changes in this version:
87bca719
WD
3996
3997### ENHANCEMENTS:
3998
3999 - The `--delete-after` option now implies `--delete`. (Wayne Davison)
4000
4001 - The `--suffix` option can now be used with `--backup-dir`. (Michael
4002 Zimmerman)
4003
4004 - Combining `::` syntax with the `--rsh`/`-e` option now uses the specified
4005 remote-shell as a transport to talk to a (newly-spawned) server-daemon. This
4006 allows someone to use daemon features, such as modules, over a secure
4007 protocol, such as ssh. (JD Paul)
4008
4009 - The rsync:// syntax for daemon connections is now accepted in the
4010 destination field.
4011
4012 - If the file name given to `--include-from` or `--exclude-from` is `-`, rsync
4013 will read from standard input. (J.W. Schultz)
4014
4015 - New option `--link-dest` which is like `--compare-dest` except that
4016 unchanged files are hard-linked in to the destination directory. (J.W.
4017 Schultz)
4018
4019 - Don't report an error if an excluded file disappears during an rsync run.
4020 (Eugene Chupriyanov and Bo Kersey)
4021
4022 - Added .svn to `--cvs-exclude` list to support subversion. (Jon Middleton)
4023
4024 - Properly support IPv6 addresses in the rsyncd.conf `hosts allow` and `hosts
4025 deny` fields. (Hideaki Yoshifuji)
4026
4027 - Changed exclude file handling to permit DOS or MAC style line terminations.
4028 (J.W. Schultz)
4029
4030 - Ignore errors from chmod when `-p`/`-a`/`--preserve-perms` is not set.
4031 (Dave Dykstra)
4032
4033### BUG FIXES:
4034
4035 - Fix `forward name lookup failed` errors on AIX 4.3.3. (John L. Allen, Martin
4036 Pool)
4037
4038 - Generate each file's rolling-checksum data as we send it, not in a separate
4039 (memory-eating) pass before hand. This prevents timeout errors on really
4040 large files. (Stefan Nehlsen)
4041
4042 - Fix compilation on Tru64. (Albert Chin, Zoong Pham)
4043
4044 - Better handling of some client-server errors. (Martin Pool)
4045
4046 - Fixed a crash that would occur when sending a list of files that contains a
4047 duplicate name (if it sorts to the end of the file list) and using
4048 `--delete`. (Wayne Davison)
4049
4050 - Fixed the file-name duplicate-removal code when dealing with multiple dups
4051 in a row. (Wayne Davison)
4052
4053 - Fixed a bug that caused rsync to lose the exit status of its child processes
4054 and sometimes return an exit code of 0 instead of showing an error. (David
4055 R. Staples, Dave Dykstra)
4056
4057 - Fixed bug in `--copy-unsafe-links` that caused it to be completely broken.
4058 (Dave Dykstra)
4059
4060 - Prevent infinite recursion in cleanup code under certain circumstances.
4061 (Sviatoslav Sviridov and Marc Espie)
4062
4063 - Fixed a bug that prevented rsync from creating intervening directories when
4064 `--relative-paths`/`-R` is set. (Craig Barratt)
4065
4066 - Prevent `Connection reset by peer` messages from Cygwin. (Randy O'Meara)
4067
4068### INTERNAL:
4069
4070 - Many code cleanups and improved internal documentation. (Martin Pool, Nelson
4071 Beebe)
4072
4073 - Portability fixes. (Dave Dykstra and Wayne Davison)
4074
4075 - More test cases. (Martin Pool)
4076
4077 - Some test-case fixes. (Brian Poole, Wayne Davison)
4078
4079 - Updated included popt to the latest vendor drop, version 1.6.4. (Jos
4080 Backus)
4081
4082 - Updated config.guess and config.sub to latest versions; this means rsync
4083 should build on more platforms. (Paul Green)
4084
4085------------------------------------------------------------------------------
4086<a name="2.5.5"></a>
4087
4088# NEWS for rsync 2.5.5, aka Snowy River (2 Apr 2002)
4089
d640d78f 4090## Changes in this version:
87bca719
WD
4091
4092### ENHANCEMENTS:
4093
4094 - With `--progress`, when a transfer is complete show the time taken;
4095 otherwise show expected time to complete. (Cameron Simpson)
4096
4097 - Make `make install-strip` works properly, and `make install` accepts a
4098 DESTDIR variable for help in building binary packages. (Peter
4099 Breitenlohner, Greg Louis)
4100
4101 - If configured with `--enable-maintainer-mode`, then on receipt of a fatal
4102 signal rsync will try to open an xterm running gdb, similarly to Samba's
4103 `panic action` or GNOME's bug-buddy. (Martin Pool)
4104
4105### BUG FIXES:
4106
4107 - Fix situation where failure to fork (e.g. because out of process slots)
4108 would cause rsync to kill all processes owned by the current user. Yes,
4109 really! (Paul Haas, Martin Pool)
4110
4111 - Fix test suite on Solaris. (Jos Backus, Martin Pool)
4112
4113 - Fix minor memory leak in socket code. (Dave Dykstra, Martin Pool.)
4114
4115 - Fix `--whole-file` problem that caused it to be the default even for remote
4116 connections. (Martin Pool, Frank Schulz)
4117
4118 - Work around bug in Mac OS X mkdir(2), which cannot handle trailing slashes.
4119 <http://www.opensource.apple.com/bugs/X/BSD%20Kernel/2734739.html> (Martin
4120 Pool)
4121
4122 - Improved network error handling. (Greg A. Woods)
4123
4124------------------------------------------------------------------------------
4125<a name="2.5.4"></a>
4126
4127# NEWS for rsync 2.5.4, aka "Imitation lizard skin" (13 Mar 2002)
4128
d640d78f 4129## Changes in this version:
87bca719
WD
4130
4131### BUG FIXES:
4132
4133 - Additional fix for zlib double-free bug. (Martin Pool, Andrew Tridgell) (CVE
4134 CAN-2002-0059)
4135
4136### ENHANCEMENTS:
4137
4138 - Merge in changes from zlib 1.1.3 to zlib 1.1.4. (Jos Backus) (Note that
4139 rsync still uses a custom version of zlib; you can not just link against a
4140 system library. See zlib/README.rsync)
4141
4142 - Additional test cases for `--compress`. (Martin Pool)
4143
4144------------------------------------------------------------------------------
4145<a name="2.5.3"></a>
4146
4147# NEWS for rsync 2.5.3, aka "Happy 26" (11 Mar 2002)
4148
d640d78f 4149## Changes in this version:
87bca719
WD
4150
4151### SECURITY FIXES:
4152
4153 - Make sure that supplementary groups are removed from a server
4154 process after changing uid and gid. (Ethan Benson) (Debian bug
4155 #132272, CVE CAN-2002-0080)
4156
4157### BUG FIXES:
4158
4159 - Fix zlib double-free bug. (Owen Taylor, Mark J Cox) (CVE CAN-2002-0059)
4160
4161 - Fixed problem that in many cases caused the error message unexpected read
4162 size of 0 in `map_ptr` and resulted in the wrong data being copied.
4163
4164 - Fixed compilation errors on some systems caused by the use of `unsigned
4165 int64` in rsync.h.
4166
4167 - Fixed problem on systems such as Sunos4 that do not support realloc on a
4168 NULL pointer; error was 'out of memory in "flist_expand"'.
4169
4170 - Fix for rsync server processes hanging around after the client unexpectedly
4171 disconnects. (Colin Walters) (Debian bug #128632)
4172
4173 - Cope with BSD systems on which mkdir() will not accept a trailing slash.
4174
4175### ENHANCEMENTS:
4176
4177 - Merge in changes from zlib 1.1.2 to zlib 1.1.3. (Note that rsync still uses
4178 a custom version of zlib; you can not just link against a system library.
4179 See zlib/README.rsync)
4180
4181 - Command to initiate connections is only shown with `-vv`, rather than `-v`
4182 as in 2.5.2. Output from plain `-v` is more similar to what was historically
4183 used so as not to break scripts that try to parse the output.
4184
4185 - Added `--no-whole-file` and `--no-blocking-io` options (Dave Dykstra)
4186
4187 - Made the `--write-batch` and `--read-batch` options actually work and added
4188 documentation in the man page (Jos Backus)
4189
4190 - If the daemon is unable to fork a child to accept a connection, print an
4191 error message. (Colin Walters)
4192
4193------------------------------------------------------------------------------
4194<a name="2.5.2"></a>
4195
4196# NEWS for rsync 2.5.2 (26 Jan 2002)
4197
d640d78f 4198## Changes in this version:
87bca719
WD
4199
4200### SECURITY FIXES:
4201
4202 - Signedness security patch from Sebastian Krahmer <krahmer@suse.de> -- in
4203 some cases we were not sufficiently careful about reading integers from the
4204 network.
4205
d640d78f
WD
4206### PROTOCOL NUMBER:
4207
4208 - The protocol number was changed to 26.
4209
87bca719
WD
4210### BUG FIXES:
4211
4212 - Fix possible string mangling in log files.
4213
4214 - Fix for setting local address of outgoing sockets.
4215
4216 - Better handling of hardlinks and devices on platforms with 64-bit `dev_t` or
4217 `ino_t`.
4218
4219 - Name resolution on machines supporting IPv6 is improved.
4220
4221 - Fix for device nodes. (dann frazier) (Debian #129135)
4222
4223### ENHANCEMENTS:
4224
4225 - With `-v`, rsync now shows the command used to initiate an ssh/rsh
4226 connection.
4227
4228 - `--statistics` now shows memory heap usage on platforms that support
4229 mallinfo().
4230
4231 - "The Ted T'so school of program optimization": make progress visible and
4232 people will think it's faster. (With `--progress`, rsync will show you how
4233 many files it has seen as it builds the `file_list`, giving some indication
4234 that it has not hung.)
4235
4236 - Improvements to batch mode support. This is still experimental but testing
4237 would be welcome. (Jos Backus)
4238
4239 - New `--ignore-existing` option, patch previously distributed with Vipul's
4240 Razor. (Debian #124286)
4241
4242------------------------------------------------------------------------------
4243<a name="2.5.1"></a>
4244
4245# NEWS for rsync 2.5.1 (3 Jan 2002)
4246
d640d78f 4247## Changes in this version:
87bca719
WD
4248
4249### BUG FIXES:
4250
4251 - Fix for segfault in `--daemon` mode configuration parser. (Paul Mackerras)
4252
4253 - Correct `string<->address` parsing for both IPv4 and 6. (YOSHIFUJI Hideaki,
4254 SUMIKAWA Munechika and Jun-ichiro `itojun` Hagino)
4255
4256 - Various fixes for IPv6 support. (Dave Dykstra)
4257
4258 - rsync.1 typo fix. (Matt Kraai)
4259
4260 - Test suite typo fixes. (Tom Schmidt)
4261
4262 - rsync.1 grammar and clarity improvements. (Edward Welbourne)
4263
4264 - Correction to ./configure tests for `inet_ntop`. (Jeff Garzik)
4265
4266### ENHANCEMENTS:
4267
4268 - `--progress` and `-P` now show estimated data transfer rate (in a multiple
4269 of bytes/s) and estimated time to completion. (Rik Faith)
4270
4271 - `--no-detach` option, required to run as a W32 service and also useful when
4272 running on Unix under daemontools, AIX's SRC, or a debugger. (Max Bowsher,
4273 Jos Backus)
4274
4275 - Clearer error messages for some conditions.
4276
4277------------------------------------------------------------------------------
4278<a name="2.5.0"></a>
4279
4280# NEWS for rsync 2.5.0 (30 Nov 2001)
4281
d640d78f
WD
4282## Changes in this version:
4283
4284### PROTOCOL NUMBER:
87bca719 4285
d640d78f 4286 - The protocol number was changed to 25.
87bca719
WD
4287
4288### ANNOUNCEMENTS:
4289
4290 - Martin Pool <mbp@samba.org> is now a co-maintainer.
4291
4292### NEW FEATURES:
4293
4294 - Support for LSB-compliant packaging <http://www.linuxbase.org/>
4295
4296 - Shell wildcards are allowed in `auth users` lines.
4297
4298 - Merged UNC rsync+ patch to support creation of standalone patch sets. By
4299 Bert J. Dempsey and Debra Weiss, updated by Jos Backus.
4300 <http://www.ils.unc.edu/i2dsi/unc_rsync+.html>
4301
4302 - IPv6 support based on a patch from KAME.net, on systems including modern
4303 versions of Linux, Solaris, and HP-UX. Also includes IPv6 compatibility
4304 functions for old OSs by the Internet Software Consortium, Paul Vixie, the
4305 OpenSSH portability project, and OpenBSD.
4306
4307### ENHANCEMENTS:
4308
4309 - Include/exclude cluestick: with `-vv`, print out whether files are included
4310 or excluded and why.
4311
4312 - Many error messages have more friendly explanations and more details.
4313
4314 - Manual page improvements plus scanty protocol documentation.
4315
4316 - When running as `--daemon` in the background and using a `log file`
4317 rsyncd.conf directive, close the log file every time it is open when going
4318 to sleep on the socket. This allows the log file to get cleaned out by
4319 another process.
4320
4321 - Change to using libpopt rather than getopt for processing options. This
4322 makes the code cleaner and the behaviour more consistent across platforms.
4323 popt is included and built if not installed on the platform.
4324
4325 - More details in `--version`, including note about whether 64-bit files,
4326 symlinks and hardlinks are supported.
4327
4328 - MD4 code may use less CPU cycles.
4329
4330 - Use mkstemp on systems where it is secure. If we use mktemp, explain that we
4331 do it in a secure way.
4332
4333 - `--whole-file` is the default when source and target are on the local
4334 machine.
4335
4336### BUG FIXES:
4337
4338 - Fix for various bugs causing rsync to hang.
4339
4340 - Attempt to fix Large File Summit support on AIX.
4341
4342 - Attempt to fix error handling lockup bug.
4343
4344 - Give a non-0 exit code if **any** of the files we have been asked to
4345 transfer fail to transfer.
4346
4347 - For log messages containing ridiculously long strings that might overflow a
4348 buffer rsync no longer aborts, but rather prints an ellipsis at the end of
4349 the string. (Patch from Ed Santiago.)
4350
4351### PLATFORMS:
4352
4353 - Improved support for UNICOS (tested on Cray T3E and Cray SV1)
4354
4355 - autoconf2.52 (or later) is now required to rebuild the autoconf scripts. It
4356 is not required to simply build rsync.
4357
4358 - Platforms thought to work in this release:
4359
4360 - Cray SV1 UNICOS 10.0.0.8 cc
4361 - Debian Linux 2.2 UltraSparc gcc
4362 - Debian Linux testing/unstable ARM gcc
4363 - FreeBSD 3.3-RELEASE i386 cc
4364 - FreeBSD 4.1.1-RELEASE i386 cc
4365 - FreeBSD 4.3-STABLE i386 cc
4366 - HP PA-RISC HP-UX 10.20 gcc
4367 - HP PA-RISC HP-UX 11.11 cc
4368 - IRIX 6.5 MIPS cc
4369 - IRIX 6.5 MIPS gcc
7f8cf771 4370 - Mac OS X PPC (`--disable-ipv6`) cc
87bca719
WD
4371 - NetBSD 1.5 i386 gcc
4372 - NetBSD Current i386 cc
4373 - OpenBSD 2.5 Sparc gcc
4374 - OpenBSD 2.9 i386 cc
4375 - OpenBSD Current i386 cc
4376 - RedHat 6.2 i386 gcc
4377 - RedHat 6.2 i386 insure++
4378 - RedHat 7.0 i386 gcc
4379 - RedHat 7.1 i386 (Kernel 2.4.10) gcc
4380 - Slackware 8.0 i686 (Kernel 2.4.10)
4381 - Solaris 8 UltraSparc cc
4382 - Solaris 8 UltraSparc gcc
4383 - Solaris 8 i386 gcc
4384 - SuSE 7.1 i386 gcc2.95.2
4385 - SuSE 7.1 ppc gcc2.95.2
4386 - i386-pc-sco3.2v5.0.5 cc
4387 - i386-pc-sco3.2v5.0.5 gcc
4388 - powerpc-ibm-aix4.3.3.0 cc
4389 - i686-unknown-sysv5UnixWare7.1.0 gcc
4390 - i686-unknown-sysv5UnixWare7.1.0 cc
4391
4392### TESTING:
4393
4394 - The existing test.sh script by Phil Hands has been merged into a
4395 test framework that works from both `make check` and the Samba
4396 build farm.
4397
4398------------------------------------------------------------------------------
4399
4400## Partial Protocol History
4401
4402| RELEASE DATE | VER. | DATE OF COMMIT\* | PROTOCOL |
4403|--------------|--------|------------------|-------------|
203b3d01 4404| ?? Sep 2020 | 3.2.4 | | 31 |
e94bad1c 4405| 06 Aug 2020 | 3.2.3 | | 31 |
194cee67 4406| 04 Jul 2020 | 3.2.2 | | 31 |
a8fc8fc2 4407| 22 Jun 2020 | 3.2.1 | | 31 |
87bca719
WD
4408| 19 Jun 2020 | 3.2.0 | | 31 |
4409| 28 Jan 2018 | 3.1.3 | | 31 |
4410| 21 Dec 2015 | 3.1.2 | | 31 |
4411| 22 Jun 2014 | 3.1.1 | | 31 |
4412| 28 Sep 2013 | 3.1.0 | 31 Aug 2008 | 31 |
4413| 23 Sep 2011 | 3.0.9 | | 30 |
4414| 26 Mar 2011 | 3.0.8 | | 30 |
4415| 31 Dec 2009 | 3.0.7 | | 30 |
4416| 08 May 2009 | 3.0.6 | | 30 |
4417| 28 Dec 2008 | 3.0.5 | | 30 |
4418| 06 Sep 2008 | 3.0.4 | | 30 |
4419| 29 Jun 2008 | 3.0.3 | | 30 |
4420| 08 Apr 2008 | 3.0.2 | | 30 |
4421| 03 Apr 2008 | 3.0.1 | | 30 |
4422| 01 Mar 2008 | 3.0.0 | 11 Nov 2006 | 30 |
4423| 06 Nov 2006 | 2.6.9 | | 29 |
4424| 22 Apr 2006 | 2.6.8 | | 29 |
4425| 11 Mar 2006 | 2.6.7 | | 29 |
4426| 28 Jul 2005 | 2.6.6 | | 29 |
4427| 01 Jun 2005 | 2.6.5 | | 29 |
4428| 30 Mar 2005 | 2.6.4 | 17 Jan 2005 | 29 |
4429| 30 Sep 2004 | 2.6.3 | | 28 |
4430| 30 Apr 2004 | 2.6.2 | | 28 |
4431| 26 Apr 2004 | 2.6.1 | 08 Jan 2004 | 28 |
4432| 01 Jan 2004 | 2.6.0 | 10 Apr 2003 | 27 (MAX=40) |
4433| 04 Dec 2003 | 2.5.7 | | 26 |
4434| 26 Jan 2003 | 2.5.6 | | 26 |
4435| 02 Apr 2002 | 2.5.5 | | 26 |
4436| 13 Mar 2002 | 2.5.4 | | 26 |
4437| 11 Mar 2002 | 2.5.3 | | 26 |
4438| 26 Jan 2002 | 2.5.2 | 11 Jan 2002 | 26 |
4439| 03 Jan 2002 | 2.5.1 | | 25 |
4440| 30 Nov 2001 | 2.5.0 | 23 Aug 2001 | 25 |
4441| 06 Sep 2000 | 2.4.6 | | 24 |
4442| 19 Aug 2000 | 2.4.5 | | 24 |
4443| 29 Jul 2000 | 2.4.4 | | 24 |
4444| 09 Apr 2000 | 2.4.3 | | 24 |
4445| 30 Mar 2000 | 2.4.2 | | 24 |
4446| 30 Jan 2000 | 2.4.1 | 29 Jan 2000 | 24 |
4447| 29 Jan 2000 | 2.4.0 | 28 Jan 2000 | 23 |
4448| 25 Jan 2000 | 2.3.3 | 23 Jan 2000 | 22 |
4449| 08 Nov 1999 | 2.3.2 | 26 Jun 1999 | 21 |
4450| 06 Apr 1999 | 2.3.1 | | 20 |
4451| 15 Mar 1999 | 2.3.0 | 15 Mar 1999 | 20 |
4452| 25 Nov 1998 | 2.2.1 | | 19 |
4453| 03 Nov 1998 | 2.2.0 | | 19 |
4454| 09 Sep 1998 | 2.1.1 | | 19 |
4455| 20 Jul 1998 | 2.1.0 | | 19 |
4456| 17 Jul 1998 | 2.0.19 | | 19 |
4457| 18 Jun 1998 | 2.0.17 | | 19 |
4458| 01 Jun 1998 | 2.0.16 | | 19 |
4459| 27 May 1998 | 2.0.13 | 27 May 1998 | 19 |
4460| 26 May 1998 | 2.0.12 | | 18 |
4461| 22 May 1998 | 2.0.11 | | 18 |
4462| 18 May 1998 | 2.0.9 | 18 May 1998 | 18 |
4463| 17 May 1998 | 2.0.8 | | 17 |
4464| 15 May 1998 | 2.0.1 | | 17 |
4465| 14 May 1998 | 2.0.0 | | 17 |
4466| 17 Apr 1998 | 1.7.4 | | 17 |
4467| 13 Apr 1998 | 1.7.3 | | 17 |
4468| 05 Apr 1998 | 1.7.2 | | 17 |
4469| 26 Mar 1998 | 1.7.1 | | 17 |
4470| 26 Mar 1998 | 1.7.0 | 26 Mar 1998 | 17 (MAX=30) |
4471| 13 Jan 1998 | 1.6.9 | 13 Jan 1998 | 15 (MAX=20) |
4472
4473\* DATE OF COMMIT is the date the protocol change was committed to version
4474control.
a2b630c0
WD
4475
4476@USE_GFM_PARSER@