]> git.ipfire.org Git - thirdparty/rsync.git/blame - NEWS.md
More tweaks for Actions.
[thirdparty/rsync.git] / NEWS.md
CommitLineData
56a039b0
WD
1# NEWS for rsync 3.3.1 (UNRELEASED)
2
3## Changes in this version:
4
5### BUG FIXES:
6
7- Fixed the included popt to avoid a memory error on modern gcc versions.
8
9### INTERNAL:
10
11 - Updated included popt to version 1.19.
12
13------------------------------------------------------------------------------
14
6c8ca91c 15# NEWS for rsync 3.3.0 (6 Apr 2024)
273dced2
WD
16
17## Changes in this version:
18
19### BUG FIXES:
20
21- Fixed a bug with `--sparse --inplace` where a trailing gap in the source
22 file would not clear out the trailing data in the destination file.
23
24- Fixed an buffer overflow in the checksum2 code if SHA1 is being used for
25 the checksum2 algorithm.
26
abc3c746
WD
27- Fixed an issue when rsync is compiled using `_FORTIFY_SOURCE` so that the
28 extra tests don't complain about a strlcpy() limit value (which was too
29 large, even though it wasn't possible for the larger value to cause an
30 overflow).
31
273dced2
WD
32- Add a backtick to the list of characters that the filename quoting needs to
33 escape using backslashes.
34
79fda353
WD
35- Fixed a string-comparison issue in the internal handling of `--progress` (a
36 locale such as tr_TR.utf-8 needed the internal triggering of `--info` options
37 to use upper-case flag names to ensure that they match).
86f41650 38
273dced2
WD
39- Make sure that a local transfer marks the sender side as trusted.
40
41- Change the argv handling to work with a newer popt library -- one that likes
42 to free more data than it used to.
43
44- Rsync now calls `OpenSSL_add_all_algorithms()` when compiled against an older
45 openssl library.
46
47- Fixed a problem in the daemon auth for older protocols (29 and before) if the
79fda353 48 openssl library is being used to compute MD4 checksums.
273dced2
WD
49
50- Fixed `rsync -VV` on Cygwin -- it needed a flush of stdout.
51
6f3c5ecc
WD
52- Fixed an old stats bug that counted devices as symlinks.
53
273dced2
WD
54### ENHANCEMENTS:
55
56- Enhanced rrsync with the `-no-overwrite` option that allows you to ensure
57 that existing files on your restricted but writable directory can't be
58 modified.
59
60- Enhanced the manpages to mark links with .UR & .UE. If your nroff doesn't
61 support these idioms, touch the file `.md2man-force` in the source directory
62 so that `md-convert` gets called with the `--force-link-text` option, and
63 that should ensure that your manpages are still readable even with the
64 ignored markup.
65
66- Some manpage improvements on the handling of [global] modules.
67
68- Changed the mapfrom & mapto perl scripts (in the support dir) into a single
69 python script named idmap. Converted a couple more perl scripts into python.
70
abc3c746
WD
71- Changed the mnt-excl perl script (in the support dir) into a python script.
72
cd769934
WD
73### DEVELOPER RELATED:
74
75 - Updated config.guess (timestamp 2023-01-01) and config.sub (timestamp
76 2023-01-21).
77
273dced2
WD
78------------------------------------------------------------------------------
79
6b5ae825 80# NEWS for rsync 3.2.7 (20 Oct 2022)
bafe73dd
WD
81
82## Changes in this version:
83
84### BUG FIXES:
85
f9e29dfb
WD
86- Fixed the client-side validating of the remote sender's filtering behavior.
87
88- More fixes for the "unrequested file-list name" name, including a copy of
89 "/" with `--relative` enabled and a copy with a lot of related paths with
90 `--relative` enabled (often derived from a `--files-from` list).
51dae12c 91
8449539a 92- When rsync gets an unpack error on an ACL, mention the filename.
bafe73dd 93
f9e29dfb 94- Avoid over-setting sanitize_paths when a daemon is serving "/" (even if
97e02bf2
WD
95 "use chroot" is false).
96
7e2711bb
WD
97### ENHANCEMENTS:
98
99- Added negotiated daemon-auth support that allows a stronger checksum digest
4d44bf12
WD
100 to be used to validate a user's login to the daemon. Added SHA512, SHA256,
101 and SHA1 digests to MD5 & MD4. These new digests are at the highest priority
102 in the new daemon-auth negotiation list.
ae16850d 103
4d44bf12
WD
104- Added support for the SHA1 digest in file checksums. While this tends to be
105 overkill, it is available if someone really needs it. This overly-long
106 checksum is at the lowest priority in the normal checksum negotiation list.
76c4fa8b
WD
107 See [`--checksum-choice`](rsync.1#opt) (`--cc`) and the `RSYNC_CHECKSUM_LIST`
108 environment var for how to customize this.
8449539a 109
4d44bf12 110- Improved the xattr hash table to use a 64-bit key without slowing down the
3b719d1d 111 key's computation. This should make extra sure that a hash collision doesn't
4d44bf12 112 happen.
7e2711bb 113
0efa63f2 114- If the `--version` option is repeated (e.g. `-VV`) then the information is
3b719d1d 115 output in a (still readable) JSON format. Client side only.
0efa63f2
WD
116
117- The script `support/json-rsync-version` is available to get the JSON style
17502886
WD
118 version output from any rsync. The script accepts either text on stdin
119 **or** an arg that specifies an rsync executable to run with a doubled
120 `--version` option. If the text we get isn't already in JSON format, it is
4d44bf12 121 converted. Newer rsync versions will provide more complete json info than
3b719d1d
WD
122 older rsync versions. Various tweaks are made to keep the flag names
123 consistent across versions.
0efa63f2 124
76c4fa8b
WD
125- The [`use chroot`](rsyncd.conf.5#) daemon parameter now defaults to "unset"
126 so that rsync can use chroot when it works and a sanitized copy when chroot
127 is not supported (e.g., for a non-root daemon). Explicitly setting the
128 parameter to true or false (on or off) behaves the same way as before.
97e02bf2 129
f9e29dfb
WD
130- The `--fuzzy` option was optimized a bit to try to cut down on the amount of
131 computations when considering a big pool of files. The simple heuristic from
86f41650 132 Kenneth Finnegan resulted in about a 2x speedup.
f9e29dfb 133
76c4fa8b
WD
134- If rsync is forced to use protocol 29 or before (perhaps due to talking to an
135 rsync before 3.0.0), the modify time of a file is limited to 4-bytes. Rsync
136 now interprets this value as an unsigned integer so that a current year past
137 2038 can continue to be represented. This does mean that years prior to 1970
138 cannot be represented in an older protocol, but this trade-off seems like the
139 right choice given that (1) 2038 is very rapidly approaching, and (2) newer
140 protocols support a much wider range of old and new dates.
141
142- The rsync client now treats an empty destination arg as an error, just like
143 it does for an empty source arg. This doesn't affect a `host:` arg (which is
144 treated the same as `host:.`) since the arg is not completely empty. The use
145 of [`--old-args`](rsync.1#opt) (including via `RSYNC_OLD_ARGS`) allows the
146 prior behavior of treating an empty destination arg as a ".".
147
7e2711bb
WD
148### PACKAGING RELATED:
149
150- The checksum code now uses openssl's EVP methods, which gets rid of various
151 deprecation warnings and makes it easy to support more digest methods. On
152 newer systems, the MD4 digest is marked as legacy in the openssl code, which
4d44bf12 153 makes openssl refuse to support it via EVP. You can choose to ignore this
11bd2a4f 154 and allow rsync's MD4 code to be used for older rsync connections (when
4d44bf12
WD
155 talking to an rsync prior to 3.0.0) or you can choose to configure rsync to
156 tell openssl to enable legacy algorithms (see below).
7e2711bb 157
8449539a
WD
158- A simple openssl config file is supplied that can be installed for rsync to
159 use. If you install packaging/openssl-rsync.cnf to a public spot (such as
160 `/etc/ssl/openssl-rsync.cnf`) and then run configure with the option
161 `--with-openssl-conf=/path/name.cnf`, this will cause rsync to export the
162 configured path in the OPENSSL_CONF environment variable (when the variable
163 is not already set). This will enable openssl's MD4 code for rsync to use.
7e2711bb 164
97e02bf2 165- The packager may wish to include an explicit "use chroot = true" in the top
4d44bf12
WD
166 section of their supplied /etc/rsyncd.conf file if the daemon is being
167 installed to run as the root user (though rsync should behave the same even
168 with the value unset, a little extra paranoia doesn't hurt).
97e02bf2 169
f9e29dfb
WD
170- I've noticed that some packagers haven't installed support/nameconvert for
171 users to use in their chrooted rsync configs. Even if it is not installed
172 as an executable script (to avoid a python3 dependency) it would be good to
173 install it with the other rsync-related support scripts.
174
4d44bf12
WD
175- It would be good to add support/json-rsync-version to the list of installed
176 support scripts.
177
bafe73dd
WD
178------------------------------------------------------------------------------
179
db5bfe67 180# NEWS for rsync 3.2.6 (9 Sep 2022)
5a4116e5
WD
181
182## Changes in this version:
183
184### BUG FIXES:
185
cc861cf8
WD
186- More path-cleaning improvements in the file-list validation code to avoid
187 rejecting of valid args.
5a4116e5 188
cc861cf8
WD
189- A file-list validation fix for a [`--files-from`](rsync.1#opt) file that ends
190 without a line-terminating character.
706bff91 191
5183c0d6 192- Added a safety check that prevents the sender from removing destination files
cc861cf8
WD
193 when a local copy using [`--remove-source-files`](rsync.1#opt) has some files
194 that are shared between the sending & receiving hierarchies, including the
195 case where the source dir & destination dir are identical.
5183c0d6 196
5a4116e5 197- Fixed a bug in the internal MD4 checksum code that could cause the digest
2895b65f
WD
198 to be sporadically incorrect (the openssl version was/is fine).
199
cc861cf8
WD
200- A minor tweak to rrsync added "copy-devices" to the list of known args, but
201 left it disabled by default.
202
0a09df2c
WD
203### ENHANCEMENTS:
204
44d47276 205- Rename `--protect-args` to [`--secluded-args`](rsync.1#opt) to make it
0a09df2c
WD
206 clearer how it differs from the default backslash-escaped arg-protecting
207 behavior of rsync. The old option names are still accepted. The
208 environment-variable override did not change its name.
209
2895b65f
WD
210### PACKAGING RELATED:
211
0a09df2c
WD
212- The configure option `--with-protected-args` was renamed to
213 `--with-secluded-args`. This option makes `--secluded-args` the default
214 rsync behavior instead of using backslash escaping for protecting args.
215
2895b65f
WD
216- The mkgitver script now makes sure that a `.git` dir/file is in the top-level
217 source dir before calling `git describe`. It also runs a basic check on the
218 version value. This should avoid using an unrelated git description for
219 rsync's version.
5a4116e5 220
706bff91
WD
221### DEVELOPER RELATED:
222
223- The configure script no longer sets the -pedantic-errors CFLAG (which it
224 used to try to do only for gcc).
225
706bff91
WD
226- The name_num_obj struct was modified to allow its dynamic name_num_item list
227 to be initialized in a better way.
228
5a4116e5
WD
229------------------------------------------------------------------------------
230
5fcf20ee 231# NEWS for rsync 3.2.5 (14 Aug 2022)
517b9d91
WD
232
233## Changes in this version:
234
43f70b96
WD
235### SECURITY FIXES:
236
237- Added some file-list safety checking that helps to ensure that a rogue
238 sending rsync can't add unrequested top-level names and/or include recursive
da5c72da 239 names that should have been excluded by the sender. These extra safety
29558884 240 checks only require the receiver rsync to be updated. When dealing with an
da5c72da
WD
241 untrusted sending host, it is safest to copy into a dedicated destination
242 directory for the remote content (i.e. don't copy into a destination
243 directory that contains files that aren't from the remote host unless you
244 trust the remote host). Fixes CVE-2022-29154.
43f70b96 245
6cafc1f8
WD
246 - A fix for CVE-2022-37434 in the bundled zlib (buffer overflow issue).
247
517b9d91
WD
248### BUG FIXES:
249
cff8f044
WD
250- Fixed the handling of filenames specified with backslash-quoted wildcards
251 when the default remote-arg-escaping is enabled.
252
43f70b96
WD
253- Fixed the configure check for signed char that was causing a host that
254 defaults to unsigned characters to generate bogus rolling checksums. This
255 made rsync send mostly literal data for a copy instead of finding matching
6cafc1f8
WD
256 data in the receiver's basis file (for a file that contains high-bit
257 characters).
43f70b96 258
29558884 259- Lots of manpage improvements, including an attempt to better describe how
da5c72da
WD
260 include/exclude filters work.
261
fc72d2b7
WD
262- If rsync is compiled with an xxhash 0.8 library and then moved to a system
263 with a dynamically linked xxhash 0.7 library, we now detect this and disable
264 the XX3 hashes (since these routines didn't stabilize until 0.8).
265
cff8f044
WD
266### ENHANCEMENTS:
267
268- The [`--trust-sender`](rsync.1#opt) option was added as a way to bypass the
269 extra file-list safety checking (should that be required).
270
43f70b96
WD
271### PACKAGING RELATED:
272
2f1d1d5c
WD
273- A note to those wanting to patch older rsync versions: the changes in this
274 release requires the quoted argument change from 3.2.4. Then, you'll want
275 every single code change from 3.2.5 since there is no fluff in this release.
276
43f70b96
WD
277- The build date that goes into the manpages is now based on the developer's
278 release date, not on the build's local-timezone interpretation of the date.
279
280### DEVELOPER RELATED:
281
da5c72da
WD
282- Configure now defaults GETGROUPS_T to gid_t when cross compiling.
283
43f70b96
WD
284- Configure now looks for the bsd/string.h include file in order to fix the
285 build on a host that has strlcpy() in the main libc but not defined in the
286 main string.h file.
517b9d91
WD
287
288------------------------------------------------------------------------------
289
0ac7ebce 290# NEWS for rsync 3.2.4 (15 Apr 2022)
203b3d01
WD
291
292## Changes in this version:
293
6b8db0f6
WD
294### BEHAVIOR CHANGES:
295
296 - A new form of arg protection was added that works similarly to the older
0a09df2c 297 `--protect-args` ([`-s`](rsync.1#opt)) option but in a way that avoids
d07272d6 298 breaking things like rrsync (the restricted rsync script): rsync now uses
c69dc7a5
WD
299 backslash escaping for sending "shell-active" characters to the remote shell
300 (such as `$(){}<>#&` and others). This includes spaces, so fetching a remote
301 file via a quoted filename value now works by default without any extra
302 quoting:
6b8db0f6
WD
303
304 ```shell
305 rsync -aiv host:'a simple file.pdf' .
306 ```
307
308 Wildcards are not escaped in filename args, but they are escaped in options
d07272d6 309 like the [`--suffix`](rsync.1#opt) and [`--usermap`](rsync.1#opt) values.
74028965
WD
310
311 If a script depends on the old arg behavior (perhaps because it quotes or
312 protects the args already, or perhaps because it expects arg splitting),
313 there are two easy ways to get things going with a modern rsync: either
314 `export RSYNC_OLD_ARGS=1` in the script's environment (perhaps in the script
315 itself) or add the option [`--old-args`](rsync.1#opt) to the rsync commands
316 that are run. See also the [ADVANCED USAGE](rsync.1#) section of rsync's
317 manpage for how to use a more modern arg style.
1b9308b7
WD
318
319 - A long-standing bug was preventing rsync from figuring out the current
320 locale's decimal point character, which made rsync always output numbers
321 using the "C" locale. Since this is now fixed in 3.2.4, a script that
85c56b26
WD
322 parses rsync's decimal numbers (e.g. from the verbose footer) may want to
323 setup the environment in a way that the output continues to be in the C
1b9308b7
WD
324 locale. For instance, one of the following should work fine:
325
326 ```shell
327 export LC_ALL=C.UTF-8
328 ```
329
c11467af 330 or if iconv translations are needed:
1b9308b7
WD
331
332 ```shell
333 if [ "${LC_ALL:-}" ]; then
334 export LANG="$LC_ALL"
335 export LC_CTYPE="$LC_ALL"
336 unset LC_ALL
337 fi
338 export LC_NUMERIC=C.UTF-8
339 ```
340
85c56b26
WD
341### SECURITY FIXES:
342
343 - A fix for CVE-2018-25032 in the bundled zlib (memory corruption issue).
344
203b3d01
WD
345### BUG FIXES:
346
d07272d6
WD
347 - Fixed a bug with [`--inplace`](rsync.1#opt) + [`--sparse`](rsync.1#opt) (and
348 a lack of [`--whole-file`](rsync.1#opt)) where the destination file could
349 get reconstructed with bogus data. Since the bug can also be avoided by
350 using (the seemingly redundant) [`--no-W`](rsync.1#opt) on the receiving
351 side, the latest rsync will now send `--no-W` to a remote receiver when this
352 option combination occurs. If your client rsync is not new enough to do
353 this for you (or if you're just paranoid), you can manually specify `--no-W
354 -M--no-W` (when not using [`--whole-file`](rsync.1#opt)) to make sure the
ee9199b5 355 bug is avoided.
16c8b05f 356
d07272d6
WD
357 - Fixed a bug with [`--mkpath`](rsync.1#opt) if a single-file copy specifies
358 an existing destination dir with a non-existing destination filename.
a79d9b22 359
b774dbc1 360 - Fixed `--update -vv` to output "is uptodate" instead of "is newer" messages
d07272d6
WD
361 for files that are being skipped due to an identical modify time. (This was
362 a new output quirk in 3.2.3.)
fd6839b7 363
9cd85b84
WD
364 - When doing an append transfer, the sending side's file must not get shorter
365 or it is skipped. Fixes a crash that could occur when the size changes to 0
366 in the middle of the send negotiations.
367
d07272d6
WD
368 - When dealing with special files (see [`--specials`](rsync.1#opt)) in an
369 alt-dest hierarchy, rsync now checks the non-permission mode bits to ensure
370 that the 2 special files are really the same before hard-linking them
371 together.
d2a97a7a 372
d07272d6
WD
373 - Fixed a bug where [`--delay-updates`](rsync.1#opt) with stale partial data
374 could cause a file to fail to update.
16c8b05f 375
d07272d6
WD
376 - Fixed a few places that would output an INFO message with
377 [`--info=NAME`](rsync.1#opt) that should only have been output given
378 [`--verbose`](rsync.1#opt) or [`--itemize-changes`](rsync.1#opt).
16c8b05f 379
d07272d6
WD
380 - Avoid a weird failure if you run a local copy with a (useless)
381 [`--rsh`](rsync.1#opt) option that contains a `V` in the command.
a79d9b22 382
c11467af
WD
383 - Fixed a long-standing compression bug where the compression level of the
384 first file transferred affected the level for all future files. Also, the
ee9199b5
WD
385 per-file compression skipping has apparently never worked, so it is now
386 documented as being ineffective.
387
8977815f
WD
388 - Fixed a truncate error when a `--write-devices` copy wrote a file onto a
389 device that was shorter than the device.
390
391 - Made `--write-devices` support both `--checksum` and `--no-whole-file` when
392 copying to a device.
393
d07272d6
WD
394 - Improved how the [`--stop-at`](rsync.1#opt), [`--stop-after`](rsync.1#opt),
395 and (the deprecated) [`--time-limit`](rsync.1#opt) options check to see if
396 the allowed time is over, which should make rsync exit more consistently.
c11467af 397
d07272d6
WD
398 - Tweak --progress to display "`??:??:??`" when the time-remaining value is so
399 large as to be meaningless.
8c4ceb3b 400
142aba00
WD
401 - Silence some chmod warnings about symlinks when it looks like we have a
402 function to set their permissions but they can't really be set.
403
85c56b26
WD
404 - Fixed a potential issue in git-set-file-times when handling commits with
405 high-bit characters in the description & when handling a description that
ea38f34d 406 might mimic the git raw-commit deliniators. (See the support dir.)
85c56b26
WD
407
408 - The bundled systemd/rsync.service file now includes `Restart=on-failure`.
409
a79d9b22
WD
410### ENHANCEMENTS:
411
203b3d01
WD
412 - Use openssl's `-verify_hostname` option in the rsync-ssl script.
413
d07272d6
WD
414 - Added extra info to the "FILENAME exists" output of
415 [`--ignore-existing`](rsync.1#opt) when [`--info=skip2`](rsync.1#opt) is
416 used. The skip message becomes "FILENAME exists (INFO)" where the INFO is
417 one of "type change", "sum change" (requires [`--checksum`](rsync.1#opt)),
418 "file change" (based on the quick check), "attr change", or "uptodate".
419 Prior versions only supported `--info=skip1`.
16c8b05f 420
d07272d6 421 - Added the [`--fsync`](rsync.1#opt) option (promoted from the patches repo).
16c8b05f 422
8aa46511
WD
423 - Added the [`--copy-devices`](rsync.1#opt) option. Compared to the
424 historical version from the rsync-patches repo, this version: properly
425 handles `--checksum`; fixes a truncation bug when doing an `--inplace` copy
426 onto a longer file; fixes several bugs in the `--itemize` output; and only
427 the sending side needs the enhanced rsync for the copy to work.
428
16c8b05f 429 - Reduced memory usage for an incremental transfer that has a bunch of small
1b9308b7 430 directories.
16c8b05f 431
be3d6c0f
WD
432 - The rsync daemon can now handle a client address with an implied "%scope"
433 suffix.
434
d07272d6
WD
435 - Added support for [`--atimes`](rsync.1#opt) on macOS and fixed a bug where
436 it wouldn't work without [`--times`](rsync.1#opt).
78b5bc66 437
16c8b05f
WD
438 - Rsync can now update the xattrs on a read-only file when your user can
439 temporarily add user-write permission to the file. (It always worked for a
440 root transfer.)
441
d07272d6
WD
442 - Rsync can now work around an [`--inplace`](rsync.1#opt) update of a file
443 that is being refused due to the Linux fs.protected_regular sysctl setting.
be3d6c0f 444
d07272d6 445 - When [`--chown`](rsync.1#opt), [`--usermap`](rsync.1#opt), or
85c56b26 446 [`--groupmap`](rsync.1#opt) is specified, rsync now makes sure that the
d07272d6
WD
447 appropriate [`--owner`](rsync.1#opt) and/or [`--group`](rsync.1#opt) options
448 are enabled.
be3d6c0f 449
d07272d6
WD
450 - Added the [`--info=NONREG`](rsync.1#opt) setting to control if rsync should
451 warn about non-regular files in the transfer. This is enabled by default
452 (keeping the behavior the same as before), so specifying `--info=nonreg0`
453 can be used to turn the warnings off.
e4669b81 454
b81a5095
WD
455 - An optional asm optimization for the rolling checksum from Shark64. Enable
456 it with `./configure --enable-roll-asm`.
16c8b05f 457
81f71f6f
WD
458 - Using `--debug=FILTER` now outputs a caution message if a filter rule
459 has trailing whitespace.
460
c9832790 461 - Transformed rrsync into a python script with improvements:
e07f8fb8
WD
462 - Security has been beefed up.
463 - The known rsync options were updated to include recent additions.
d07272d6
WD
464 - Make rrsync reject [`--copy-links`](rsync.1#opt) (`-L`),
465 [`--copy-dirlinks`](rsync.1#opt) (`-k`), &
466 [`--keep-dirlinks`](rsync.1#opt) (`-K`) by default to make it harder to
e07f8fb8 467 exploit any out-of-subdir symlinks.
d07272d6
WD
468 - A new rrsync option of [`-munge`](rrsync.1#opt) tells rrsync to always
469 enable rsync's [`--munge-links`](rsync.1#opt) option on the server side.
470 - A new rrsync option of [`-no-lock`](rrsync.1#opt) disables a new
471 single-use locking idiom that is the default when [`-ro`](rrsync.1#opt) is
472 not used (useful with [`-munge`](rrsync.1#opt)).
473 - A new rrsync option of [`-no-del`](rrsync.1#opt) disables all `--remove*`
474 and `--delete*` rsync options on the server side.
e07f8fb8
WD
475 - The log format has been tweaked slightly to add seconds to the timestamp
476 and to output the command executed as a tuple (making the args clearer).
96ed4b47 477 - An rrsync.1 manpage was added (in the support dir with rrsync).
16c8b05f 478
c9832790
WD
479 - Added options to the lsh script to facilitate rrsync testing. (See the
480 support dir.)
13cfe640 481
c9832790
WD
482 - Transformed the atomic-rsync script into a python script and added the
483 ability to ignore one or more non-zero exit codes. By default, it now
484 ignores code 24, the file-vanished exit code. (See the support dir.)
13cfe640 485
c9832790 486 - Transformed the munge-symlinks script into python. (See the support dir.)
13cfe640 487
c9832790
WD
488 - Improved the rsync-no-vanished script to not join stdout & stderr together.
489 (See the support dir.)
13cfe640 490
16c8b05f 491 - Work around a glibc bug where lchmod() breaks in a chroot w/o /proc mounted.
740ed11a 492
4adfdaaf
WD
493 - Try to support a client that sent a remote rsync a wacko stderr file handle
494 (such as an older File::RsyncP perl library used by BackupPC).
495
96ed4b47 496 - Lots of manpage improvements, including better HTML versions.
15bc7ded 497
a79d9b22
WD
498### PACKAGING RELATED:
499
7f8cf771 500 - Give configure the `--with-rrsync` option if you want `make install` to
96ed4b47 501 install the (now python3) rrsync script and its new manpage.
72adf49b 502
ee9199b5
WD
503 - If the rrsync script is installed, its package should be changed to depend
504 on python3 and the (suggested but not mandatory) python3 braceexpand lib.
72adf49b 505
a79d9b22
WD
506 - When creating a package from a non-release version (w/o a git checkout), the
507 packager can elect to create git-version.h and define RSYNC_GITVER to the
508 string they want `--version` to output. (The file is still auto-generated
509 using the output of `git describe` when building inside a non-shallow git
510 checkout, though.)
511
b81a5095
WD
512 - Renamed configure's `--enable-simd` option to `--enable-roll-simd` and added
513 the option `--enable-roll-asm` to use the new asm version of the code. Both
514 are x86_64/amd64 only.
515
516 - Renamed configure's `--enable-asm` option to `--enable-md5-asm` to avoid
517 confusion with the asm option for the rolling checksum. It is also honored
518 even when openssl crypto is in use. This allows: normal MD4 & MD5, normal
85c56b26
WD
519 MD4 + asm MD5, openssl MD4 & MD5, or openssl MD4 + asm MD5 depending on the
520 configure options selected.
16c8b05f 521
b81a5095
WD
522 - Made SIMD & asm configure checks default to "no" on non-Linux hosts due to
523 various reports of problems on NetBSD & macOS hosts. These were also
524 tweaked to allow enabling the feature on a host_cpu of amd64 (was only
525 allowed on x86_64 before).
16c8b05f 526
a79d9b22
WD
527 - Fixed configure to not fail at the SIMD check when cross-compiling.
528
b81a5095
WD
529 - Improved the IPv6 determination in configure.
530
ee9199b5
WD
531 - Compile the C files with `-pedantic-errors` (when possible) so that we will
532 get warned if a static initialization overflows in the future (among other
533 things).
16c8b05f 534
85c56b26
WD
535 - When linking with an external zlib, rsync renames its `read_buf()` function
536 to `read_buf_()` to avoid a symbol clash on an unpatched zlib.
537
a79d9b22 538 - Added a SECURITY.md file.
203b3d01 539
15bc7ded
WD
540### DEVELOPER RELATED:
541
542 - Made it easier to write rsync tests that diff the output while also checking
ee9199b5
WD
543 the status code, and used the idiom to improve the existing tests. (See the
544 `checkdiff` and `checkdiff2` idioms in the `testsuite/*.test` files.
15bc7ded 545
16c8b05f
WD
546 - The packaging scripts & related python lib got some minor enhancements.
547
548### INTERNAL
549
550 - Use setenv() instead of putenv() when it is available.
551
552 - Improve the logic in compat.c so that we don't need to try to remember to
553 sprinkle `!local_server` exceptions throughout the protocol logic.
554
ee9199b5
WD
555 - One more C99 Flexible Array improvement (started in the last release) and
556 make use of the C99 `%zd` format string when printing size_t values (when
557 possible).
558
559 - Use mallinfo2() instead of mallinfo(), when available.
560
203b3d01 561------------------------------------------------------------------------------
87b5d233 562
e94bad1c 563# NEWS for rsync 3.2.3 (6 Aug 2020)
87b5d233
WD
564
565## Changes in this version:
566
567### BUG FIXES:
568
fb6fabc1
WD
569 - Fixed a bug in the xattr code that was freeing the wrong object when trying
570 to cleanup the xattr list.
571
38a521de
WD
572 - Fixed a bug in the xattr code that was not leaving room for the "rsync."
573 prefix in some instances where it needed to be added.
574
d07272d6
WD
575 - Restored the ability to use [`--bwlimit=0`](rsync.1#opt) to specify no
576 bandwidth limit. (It was accidentally broken in 3.2.2.)
f92a5182 577
d07272d6
WD
578 - Fixed a bug when combining [`--delete-missing-args`](rsync.1#opt) with
579 [`--no-implied-dirs`](rsync.1#opt) & [`-R`](rsync.1#opt) where rsync might
580 create the destination path of a missing arg. The code also avoids some
581 superfluous warnings for nested paths of removed args.
96be713f 582
20660249
WD
583 - Fixed an issue where hard-linked devices could cause the rdev_major value to
584 get out of sync between the sender and the receiver, which could cause a
585 device to get created with the wrong major value in its major,minor pair.
586
d07272d6
WD
587 - Rsync now complains about a missing [`--temp-dir`](rsync.1#opt) before
588 starting any file transfers.
f6967eca 589
e1e546d6
WD
590 - A completely empty source arg is now a fatal error. This doesn't change
591 the handling of implied dot-dir args such as "localhost:" and such.
592
87b5d233
WD
593### ENHANCEMENTS:
594
d07272d6
WD
595 - Allow [`--max-alloc=0`](rsync.1#opt) to specify no limit to the alloc sanity
596 check.
7e47855d 597
d07272d6
WD
598 - Allow [`--block-size=SIZE`](rsync.1#opt) to specify the size using units
599 (e.g. "100K").
66ca4fc9 600
7e07a325
WD
601 - The name of the id-0 user & group are now sent to the receiver along with
602 the other user/group names in the transfer (instead of assuming that both
603 sides have the same id-0 names).
7e47855d 604
d07272d6
WD
605 - Added the [`--stop-after`](rsync.1#opt) and [`--stop-at`](rsync.1#opt)
606 options (with a [`--time-limit`](rsync.1#opt) alias for `--stop-after`).
607 This is an enhanced version of the time-limit patch from the patches repo.
608
609 - Added the [`name converter`](rsyncd.conf.5#opt) daemon parameter to make it
610 easier to convert user & group names inside a chrooted daemon module. This
611 is based on the nameconverter patch with some improvements, including a
612 tweak to the request protocol (so if you used this patch in the past, be
613 sure to update your converter script to use newlines instead of null chars).
614
615 - Added [`--crtimes`](rsync.1#opt) (`-N`) option for preserving the file's
616 create time (I believe that this is macOS only at the moment).
617
618 - Added [`--mkpath`](rsync.1#opt) option to tell rsync that it should create a
619 non-existing path component of the destination arg.
620
621 - Added [`--stderr=errors|all|client`](rsync.1#opt) to replace the
622 `--msgs2stderr` and `--no-msgs2stderr` options (which are still accepted).
623 The default use of stderr was changed to be `--stderr=errors` where all the
624 processes that have stderr available output directly to stderr, which should
625 help error messages get to the user more quickly, especially when doing a
626 push (which includes local copying). This also allows rsync to exit quickly
627 when a receiver failure occurs, since rsync doesn't need to try to keep the
628 connection alive long enough for the fatal error to go from the receiver to
629 the generator to the sender. The old default can be requested via
630 `--stderr=client`. Also changed is that a non-default stderr mode is
631 conveyed to the remote rsync (using the older option names) instead of
632 requiring the user to use [`--remote-option`](rsync.1#opt) (`-M`) to tell
633 the remote rsync what to do.
634
635 - Added the ability to specify "@netgroup" names to the [`hosts
636 allow`](rsyncd.conf.5#opt) and [`hosts deny`](rsyncd.conf.5#opt) daemon
637 parameters. This is a finalized version of the netgroup-auth patch from the
638 patches repo.
38a521de 639
1b9308b7 640 - Rsync can now hard-link symlinks on FreeBSD due to it making use of the
14c4656f
WD
641 linkat() function when it is available.
642
0e814e95
WD
643 - Output file+line info on out-of-memory & overflow errors while also avoiding
644 the output of alternate build-dir path info that is not useful to the user.
645
f43412f1 646 - Change configure to know that Cygwin supports Linux xattrs.
c3cf174e 647
4c4fc746 648 - Improved the testsuite on FreeBSD & Cygwin.
2f130496 649
f92a5182 650 - Added some compatibility code for HPE NonStop platforms.
7e47855d 651
a5a9f268
WD
652 - Improved the INSTALL.md info.
653
14c4656f
WD
654 - Added a few more suffixes to the default skip-compress list.
655
b6aa9c5c
WD
656 - Improved configure's error handling to notify about several issues at once
657 instead of one by one (for the newest optional features).
658
7e47855d
WD
659### INTERNAL:
660
0e814e95
WD
661 - Use a simpler overflow check idiom in a few spots.
662
f92a5182 663 - Use a C99 Flexible Array for a trailing variable-size filename in a struct
38a521de 664 (with a fallback to the old 1-char string kluge for older compilers).
87b5d233
WD
665
666------------------------------------------------------------------------------
d15cfef9 667
194cee67 668# NEWS for rsync 3.2.2 (4 Jul 2020)
d15cfef9 669
d640d78f 670## Changes in this version:
d15cfef9
WD
671
672### BUG FIXES:
673
317beebe
WD
674 - Avoid a crash when a daemon module enables `transfer logging` without
675 setting a `log format` value.
676
fe2ef556 677 - Fixed installing rsync-ssl script from an alternate build dir.
d15cfef9 678
76064b1b
WD
679 - Fixed the updating of configure.sh from an alternate build dir.
680
d15cfef9
WD
681 - Apple requires the asm function name to begin with an underscore.
682
20660249 683 - Avoid a test failure in the daemon test when `--atimes` is disabled.
d15cfef9
WD
684
685### ENHANCEMENTS:
686
61971acb
WD
687 - Allow the server side to restrict checksum & compression choices via the
688 same environment variables the client uses. The env vars can be divided
689 into "client list & server list" by the "`&`" char or the same list can
690 apply to both.
d15cfef9 691
f805d1a7 692 - Simplify how the negotiation environment variables apply when interacting
e285f8f9 693 with an older rsync and also when a list contains only invalid names.
d15cfef9 694
89827e49
WD
695 - Do not allow a negotiated checksum or compression choice of "none" unless
696 the user authorized it via an environment variable or command-line option.
697
11eb67ee
WD
698 - Added the `--max-alloc=SIZE` option to be able to override the memory
699 allocator's sanity-check limit. It defaults to 1G (as before) but the error
700 message when exceeding it specifically mentions the new option so that you
701 can differentiate an out-of-memory error from a failure of this limit. It
702 also allows you to specify the value via the RSYNC_MAX_ALLOC environment
703 variable.
704
565cde84
WD
705 - Add the "open atime" daemon parameter to allow a daemon to always enable or
706 disable the use of O_NOATIME (the default is to let the user control it).
707
ce12142c 708 - The default systemd config was changed to remove the `ProtectHome=on`
544b3d8b
WD
709 setting since rsync is often used to serve files in /home and /root and this
710 seemed a bit too strict. Feel free to use `systemctl edit rsync` to add
711 that restriction (or maybe `ProtectHome=read-only`), if you like. See the
712 3.2.0 NEWS for the other restrictions that were added compared to 3.1.3.
ce12142c 713
11eb67ee
WD
714 - The memory allocation functions now automatically check for a failure and
715 die when out of memory. This eliminated some caller-side check-and-die
716 code and added some missing sanity-checking of allocations.
d15cfef9 717
feb2fff8
WD
718 - Put optimizations into their own list in the `--version` output.
719
96ed4b47 720 - Improved the manpage a bit more.
11eb67ee 721
f805d1a7
WD
722### PACKAGING RELATED:
723
724 - Prepared the checksum code for an upcoming xxHash release that provides new
8df76691
WD
725 XXH3 (64-bit) & XXH128 (128-bit) checksum routines. These will not be
726 compiled into rsync until the xxhash v0.8.0 include files are installed on
727 the build host, and that release is a few weeks away at the time this was
728 written. So, if it's now the future and you have packaged and installed
729 xxhash-0.8.0-devel, a fresh rebuild of rsync 3.2.2 will give you the new
730 checksum routines. Just make sure that the new rsync package depends on
731 xxhash >= 0.8.0.
f805d1a7 732
7039d146
WD
733### DEVELOPER RELATED:
734
735 - Moved the version number out of configure.ac into its own version.h file so
736 that we don't need to reconfigure just because the version number changes.
737
7d30490e
WD
738 - Moved the daemon parameter list into daemon-parm.txt so that an awk script
739 can create the interrelated structs and accessors that loadparm.c needs.
740
d15cfef9 741------------------------------------------------------------------------------
87bca719 742
a8fc8fc2 743# NEWS for rsync 3.2.1 (22 Jun 2020)
bcb0a24a 744
d640d78f 745## Changes in this version:
bcb0a24a
WD
746
747### BUG FIXES:
748
246d117d
WD
749 - Fixed a potential build issue with the MD5 assembly-language code by
750 removing some non-portable directives.
f8c6f9f4
WD
751
752 - Use the preprocessor with the asm file to ensure that if the code is
68c45836 753 unneeded, it doesn't get built.
bcb0a24a 754
f4e6fe54 755 - Avoid the stack getting set to executable when including the asm code.
bcb0a24a 756
3f776f58
WD
757 - Some improvements in the SIMD configure testing to try to avoid build
758 issues, such as avoiding a clang++ core dump when `-g` is combined with
759 `-O2`. Note that clang++ is quite buggy in this area, and it does still
760 crash for some folks, so just use `--disable-simd` if you need to avoid
246d117d 761 their buggy compiler (since the configure test is apparently not finding
300fd305 762 all the compilers that will to crash and burn).
bcb0a24a 763
fe2ef556 764 - Fixed an issue in the md2man script when building from an alternate dir.
bb484a79 765
785cb938 766 - Disable `--atimes` on macOS (it apparently just ignores the atime change).
2e1b46db 767
bcb0a24a
WD
768### ENHANCEMENTS:
769
30945523
WD
770 - The use of `--backup-dir=STR` now implies `--backup`.
771
772 - Added `--zl=NUM` as a short-hand for `--compress-level=NUM`.
773
e16b2275 774 - Added `--early-input=FILE` option that allows the client to send some
f6df3708 775 data to a daemon's (optional) "early exec" script on its stdin.
e16b2275 776
246d117d 777 - Mention atimes in the capabilities list that `--version` outputs.
dfa34b47
WD
778
779 - Mention either "default protect-args" or "optional protect-args" in the
780 `--version` capabilities depending on how rsync was configured.
781
300fd305 782 - Some info on optimizations is now elided from the `--version` capabilities
246d117d
WD
783 since they aren't really user-facing capabilities. You can still see the
784 info (plus the status of a couple extra optimizations) by repeating the
dfa34b47 785 `--version` option (e.g. `-VV`).
bcb0a24a 786
b51b0b32
WD
787 - Updated various URLs to be https instead of http.
788
789 - Some documentation improvements.
f4e6fe54
WD
790
791### PACKAGING RELATED:
792
785cb938 793 - If you had to use `--disable-simd` for 3.2.0, you might want to try removing
246d117d
WD
794 that and see if it will succeed or auto-disable. Some buggy clang++
795 compilers are still not auto disabled, though.
f4e6fe54
WD
796
797 - The MD5 asm code is now under its own configure flag (not shared with the
798 SIMD setting), so if you have any issues compiling it, re-run configure with
799 `--disable-asm`.
800
87bca719
WD
801 - Merged the OLDNEWS.md file into NEWS.md.
802
bcb0a24a 803------------------------------------------------------------------------------
128139c6
WD
804
805# NEWS for rsync 3.2.0 (19 Jun 2020)
806
d640d78f 807## Changes in this version:
128139c6
WD
808
809### BUG FIXES:
810
811 - Avoid a potential out-of-bounds read in daemon mode if argc can be made to
812 become 0.
813
814 - Fix the default list of skip-compress files for non-daemon transfers.
815
816 - Fix xattr filter rules losing an 'x' attribute in a non-local transfer.
817
818 - Avoid an error when a check for a potential fuzzy file happens to reference
819 a directory.
820
821 - Make the atomic-rsync helper script have a more consistent error-exit.
822
300fd305
WD
823 - Make sure that a signal handler's use of exit_cleanup() calls `_exit()`
824 instead of exit().
128139c6
WD
825
826 - Various zlib fixes, including security fixes for CVE-2016-9843,
827 CVE-2016-9842, CVE-2016-9841, and CVE-2016-9840.
828
829 - Fixed an issue with `--remove-source-files` not removing a source symlink
830 when combined with `--copy-links`.
831
832 - Fixed a bug where the daemon would fail to write early fatal error messages
833 to the client, such as refused or unknown command-line options.
834
835 - Fixed the block-size validation logic when dealing with older protocols.
836
837 - Some rrsync fixes and enhancements to handle the latest options.
838
839 - Fixed a problem with the `--link-dest`|`--copy-dest` code when `--xattrs`
840 was specified along with multiple alternate-destination directories (it
841 could possibly choose a bad file match while trying to find a better xattr
842 match).
843
844 - Fixed a couple bugs in the handling of files with the `--sparse` option.
845
f6df3708 846 - Fixed a bug in the writing of the batch.sh file (w/`--write-batch`) when the
128139c6
WD
847 source & destination args were not last on the command-line.
848
849 - Avoid a hang when an overabundance of messages clogs up all the I/O buffers.
850
851 - Fixed a mismatch in the RSYNC_PID values put into the environment of
852 `pre-xfer exec` and a `post-xfer exec`.
853
854 - Fixed a crash in the `--iconv` code.
855
856 - Fixed a rare crash in the popt_unalias() code.
857
858### ENHANCEMENTS:
859
544b3d8b
WD
860 - The default systemd config was made stricter by default. For instance,
861 `ProtectHome=on` (which hides content in /root and /home/USER dirs),
862 `ProtectSystem=full` (which makes /usr, /boot, & /etc dirs read-only), and
863 `PrivateDevices=on` (which hides devices). You can override any of these
864 using the standard `systemctl edit rsync` and add one or more directives
865 under a `[Service]` heading (and restart the rsync service).
866
128139c6
WD
867 - Various checksum enhancements, including the optional use of openssl's MD4 &
868 MD5 checksum algorithms, some x86-64 optimizations for the rolling checksum,
869 some x86-64 optimizations for the (non-openssl) MD5 checksum, the addition
1bdf68b9 870 of xxHash checksum support, and a negotiation heuristic that ensures that it
128139c6
WD
871 is easier to add new checksum algorithms in the future. The environment
872 variable `RSYNC_CHECKSUM_LIST` can be used to customize the preference order
873 of the negotiation, or use `--checksum-choice` (`--cc`) to force a choice.
874
875 - Various compression enhancements, including the addition of zstd and lz4
876 compression algorithms and a negotiation heuristic that picks the best
877 compression option supported by both sides. The environment variable
878 `RSYNC_COMPRESS_LIST` can be used to customize the preference order of the
879 negotiation, or use `--compress-choice` (`--zc`) to force a choice.
880
785cb938 881 - Added a `--debug=NSTR` option that outputs details of the new negotiation
128139c6
WD
882 strings (for checksums and compression). The first level just outputs the
883 result of each negotiation on the client, level 2 outputs the values of the
884 strings that were sent to and received from the server, and level 3 outputs
885 all those values on the server side too (when the server was given the debug
886 option).
887
785cb938 888 - The `--debug=OPTS` command-line option is no longer auto-forwarded to the
128139c6
WD
889 remote rsync which allows for the client and server to have different levels
890 of debug specified. This also allows for newer debug options to be
785cb938 891 specified, such as using `--debug=NSTR` to see the negotiated hash result,
128139c6 892 without having the command fail if the server version is too old to handle
f6df3708 893 that debug item. Use `-M--debug=OPTS` to send the options to the remote side.
128139c6
WD
894
895 - Added the `--atimes` option based on the long-standing patch (just with some
896 fixes that the patch has been needing).
897
898 - Added `--open-noatime` option to open files using `O_NOATIME`.
899
900 - Added the `--write-devices` option based on the long-standing patch.
901
902 - Added openssl & preliminary gnutls support to the rsync-ssl script, which is
903 now installed by default. This was unified with the old stunnel-rsync
904 helper script to simplify packaging. Note that the script accepts the use
785cb938
WD
905 of `--type=gnutls` for gnutls testing, but does not look for gnutls-cli on
906 the path yet. The use of `--type=gnutls` will not work right until
907 gnutls-cli no longer drops data.
128139c6
WD
908
909 - Rsync was enhanced to set the `RSYNC_PORT` environment variable when running
910 a daemon-over-rsh script. Its value is the user-specified port number (set
911 via `--port` or an rsync:// URL) or 0 if the user didn't override the port.
912
913 - Added the `proxy protocol` daemon parameter that allows your rsyncd to know
914 the real remote IP when it is setup behind a proxy.
915
916 - Added negated matching to the daemon's `refuse options` setting by using
917 match strings that start with a `!` (such as `!compress*`). This lets you
918 refuse all options except for a particular approved list, for example. It
919 also lets rsync refuse certain options by default (such as `write-devices`)
920 while allowing the config to override that, as desired.
921
922 - Added the `early exec` daemon parameter that runs a script before the
923 transfer parameters are known, allowing some early setup based on module
924 name.
925
926 - Added status output in response to a signal (via both SIGINFO & SIGVTALRM).
927
928 - Added `--copy-as=USER` option to give some extra security to root-run rsync
929 commands into/from untrusted directories (such as backups and restores).
930
931 - When resuming the transfer of a file in the `--partial-dir`, rsync will now
932 update that partial file in-place instead of creating yet another tmp file
933 copy. This requires both sender & receiver to be at least v3.2.0.
934
935 - Added support for `RSYNC_SHELL` & `RSYNC_NO_XFER_EXEC` environment variables
936 that affect the early, pre-xfer, and post-xfer exec rsync daemon parameters.
937
938 - Optimize the `--fuzzy --fuzzy` heuristic to avoid the fuzzy directory scan
939 until all other basis-file options are exhausted (such as `--link-dest`).
940
941 - Have the daemon log include the normal-exit sent/received stats when the
942 transfer exited with an error when possible (i.e. if it is the sender).
943
944 - The daemon now locks its pid file (when configured to use one) so that it
945 will not fail to start when the file exists but no daemon is running.
946
96ed4b47 947 - Various manpage improvements, including some html representations (that
128139c6
WD
948 aren't installed by default).
949
785cb938 950 - Made `-V` the short option for `--version` and improved its information.
128139c6 951
785cb938
WD
952 - Pass the `-4` or `-6` option to the ssh command, making it easier to type
953 than `--rsh='ssh -4'` (or the `-6` equivalent).
128139c6
WD
954
955 - Added example config for rsyncd SSL proxy configs to rsyncd.conf.
956
957 - More errors messages now mention if the error is coming from the sender or
958 the receiver.
959
960### PACKAGING RELATED:
961
d495e343 962 - Add installed bash script: /usr/bin/rsync-ssl
128139c6 963
96ed4b47 964 - Add installed manpage: /usr/man/man1/rsync-ssl.1
128139c6 965
87bca719 966 - Tweak auxiliary doc file names, such as: README.md, INSTALL.md, & NEWS.md.
128139c6
WD
967
968 - The rsync-ssl script wants to run openssl or stunnel4, so consider adding a
969 dependency for one of those options (though it's probably fine to just let
970 it complain about being unable to find the program and let the user decide
971 if they want to install one or the other).
972
973 - If you packaged rsync + rsync-ssl + rsync-ssl-daemon as separate packages,
974 the rsync-ssl package is now gone (rsync-ssl should be considered to be
975 mainstream now that Samba requires SSL for its rsync daemon).
976
977 - Add _build_ dependency for liblz4-dev, libxxhash-dev, libzstd-dev, and
978 libssl-dev. These development libraries will give rsync extra compression
979 algorithms, extra checksum algorithms, and allow use of openssl's crypto
980 lib for (potentially) faster MD4/MD5 checksums.
981
982 - Add _build_ dependency for g++ or clang++ on x86_64 systems to enable the
983 SIMD checksum optimizations.
984
985 - Add _build_ dependency for _either_ python3-cmarkcfm or python3-commonmark
96ed4b47
WD
986 to allow for patching of manpages or building a git release. This is not
987 required for a release-tar build, since it comes with pre-built manpages.
128139c6
WD
988 Note that cmarkcfm is faster than commonmark, but they generate the same
989 data. The commonmark dependency is easiest to install since it's native
785cb938
WD
990 python, and can even be installed via `pip3 install --user commonmark` if
991 you want to just install it for the build user.
128139c6
WD
992
993 - Remove yodl _build_ dependency (if it was even listed before).
994
995### DEVELOPER RELATED:
996
997 - Silenced some annoying warnings about major() & minor() by improving an
998 autoconf include-file check.
999
96ed4b47 1000 - Converted the manpages from yodl to markdown. They are now processed via a
128139c6 1001 simple python3 script using the cmarkgfm **or** commonmark library. This
d495e343 1002 should make it easier to package rsync, since yodl is rather obscure.
128139c6
WD
1003
1004 - Improved some configure checks to work better with strict C99 compilers.
1005
1006 - Some perl building/packaging scripts were recoded into awk and python3.
1007
1008 - Some defines in byteorder.h were changed into static inline functions that
1009 will help to ensure that the args don't get evaluated multiple times on
1010 "careful alignment" hosts.
1011
1012 - Some code typos were fixed (as pointed out by a Fossies run).
1013
1014------------------------------------------------------------------------------
87bca719
WD
1015
1016# NEWS for rsync 3.1.3 (28 Jan 2018)
1017
d640d78f 1018## Changes in this version:
87bca719
WD
1019
1020### SECURITY FIXES:
1021
1022 - Fixed a buffer overrun in the protocol's handling of xattr names and ensure
1023 that the received name is null terminated.
1024
1025 - Fix an issue with `--protect-args` where the user could specify the arg in the
1026 protected-arg list and short-circuit some of the arg-sanitizing code.
1027
1028### BUG FIXES:
1029
1030 - Don't output about a new backup dir without appropriate info verbosity.
1031
ee9199b5
WD
1032 - Fixed some issues with the sort functions in the rsyncstats script (in the
1033 support dir).
87bca719
WD
1034
1035 - Added a way to specify daemon config lists (e.g. users, groups, etc) that
1036 contain spaces (see `auth users` in the latest rsyncd.conf manpage).
1037
1038 - If a backup fails (e.g. full disk) rsync exits with an error.
1039
1040 - Fixed a problem with a doubled `--fuzzy` option combined with `--link-dest`.
1041
1042 - Avoid invalid output in the summary if either the start or end time had an
1043 error.
1044
1045 - We don't allow a popt alias to affect the `--daemon` or `--server` options.
1046
1047 - Fix daemon exclude code to disallow attribute changes in addition to
1048 disallowing transfers.
1049
1050 - Don't force nanoseconds to match if a non-transferred, non-checksummed file
f43412f1 1051 only passed the quick-check w/o comparing nanoseconds.
87bca719
WD
1052
1053### ENHANCEMENTS:
1054
1055 - Added the ability for rsync to compare nanosecond times in its file-check
1056 comparisons, and added support nanosecond times on Mac OS X.
1057
1058 - Added a short-option (`-@`) for `--modify-window`.
1059
1060 - Added the `--checksum-choice=NAME[,NAME]` option to choose the checksum
1061 algorithms.
1062
1063 - Added hashing of xattr names (with using `-X`) to improve the handling of
1064 files with large numbers of xattrs.
1065
1066 - Added a way to filter xattr names using include/exclude/filter rules (see
1067 the `--xattrs` option in the manpage for details).
1068
1069 - Added `daemon chroot|uid|gid` to the daemon config (in addition to the old
1070 chroot|uid|gid settings that affect the daemon's transfer process).
1071
1072 - Added `syslog tag` to the daemon configuration.
1073
1074 - Some manpage improvements.
1075
1076### DEVELOPER RELATED:
1077
96ed4b47 1078 - Tweak the `make` output when yodl isn't around to create the manpages.
87bca719
WD
1079
1080 - Changed an obsolete autoconf compile macro.
1081
96ed4b47 1082 - Support newer yodl versions when converting manpages.
87bca719
WD
1083
1084------------------------------------------------------------------------------
87bca719
WD
1085
1086# NEWS for rsync 3.1.2 (21 Dec 2015)
1087
d640d78f 1088## Changes in this version:
87bca719
WD
1089
1090### SECURITY FIXES:
1091
1092 - Make sure that all transferred files use only path names from inside the
1093 transfer. This makes it impossible for a malicious sender to try to make the
1094 receiver use an unsafe destination path for a transferred file, such as a
1095 just-sent symlink.
1096
1097### BUG FIXES:
1098
1099 - Change the checksum seed order in the per-block checksums. This prevents
1100 someone from trying to create checksum blocks that match in sum but not
1101 content.
1102
1103 - Fixed a with the per-dir filter files (using `-FF`) that could trigger an
1104 assert failure.
1105
1106 - Only skip `set_modtime()` on a transferred file if the time is exactly
1107 right.
1108
1109 - Don't create an empty backup dir for a transferred file that doesn't exist
1110 yet.
1111
1112 - Fixed a bug where `--link-dest` and `--xattrs` could cause rsync to exit if
1113 a filename had a matching dir of the same name in the alt-dest area.
1114
1115 - Allow more than 32 group IDs per user in the daemon's gid=LIST config.
1116
1117 - Fix the logging of %b & %c via `--log-file` (daemon logging was already
1118 correct, as was `--out-format='%b/%c'`).
1119
1120 - Fix erroneous acceptance of `--info=5` & `--debug=5` (an empty flag name is
1121 not valid).
1122
1123### ENHANCEMENTS:
1124
1125 - Added `(DRY RUN)` info to the `--debug=exit` output line.
1126
1127 - Use usleep() for our msleep() function if it is available.
1128
1129 - Added a few extra long-option names to rrsync script, which will make
1130 BackupPC happier.
1131
f43412f1 1132 - Made configure choose to use Linux xattrs on NetBSD (rather than not
87bca719
WD
1133 supporting xattrs).
1134
1135 - Added `-wo` (write-only) option to rrsync support script.
1136
1137 - Misc. manpage tweaks.
1138
1139### DEVELOPER RELATED:
1140
1141 - Fixed a bug with the Makefile's use of `INSTALL_STRIP`.
1142
1143 - Improve a test in the suite that could get an erroneous timestamp error.
1144
1145 - Tweaks for newer versions of git in the packaging tools.
1146
1147 - Improved the m4 generation rules and some autoconf idioms.
1148
1149------------------------------------------------------------------------------
87bca719
WD
1150
1151# NEWS for rsync 3.1.1 (22 Jun 2014)
1152
d640d78f 1153## Changes in this version:
87bca719
WD
1154
1155### BUG FIXES:
1156
1157 - If the receiver gets bogus filenames from the sender (an unexpected leading
1158 slash or a `..` infix dir), exit with an error. This prevents a malicious
1159 sender from trying to inject filenames that would affect an area outside the
1160 destination directories.
1161
1162 - Fixed a failure to remove the partial-transfer temp file when interrupted
1163 (and rsync is not saving the partial files).
1164
1165 - Changed the chown/group/xattr-set order to avoid losing some security-
1166 related xattr info (that would get cleared by a chown).
1167
1168 - Fixed a bug in the xattr-finding code that could make a non-root-run
1169 receiver not able to find some xattr numbers.
1170
1171 - Fixed a bug in the early daemon protocol where a timeout failed to be
1172 honored (e.g. if the remote side fails to send us the initial protocol
1173 greeting).
1174
1175 - Fixed unintended inclusion of commas in file numbers in the daemon log.
1176
1177 - We once again send the 'f' sub-flag (of `-e`) to the server side so it knows
1178 that we can handle incremental-recursion directory errors properly in older
1179 protocols.
1180
1181 - Fixed an issue with too-aggressive keep-alive messages causing a problem for
1182 older rsync versions early in the transfer.
1183
1184 - Fixed an incorrect message about backup-directory-creation when using
1185 `--dry-run` and the backup dir is not an absolute path.
1186
1187 - Fixed a bug where a failed deletion and/or a failed sender-side removal
1188 would not affect the exit code.
1189
1190 - Fixed a bug that caused a failure when combining `--delete-missing-args`
1191 with `--xattrs` and/or `--acls`.
1192
1193 - Fixed a strange `dir_depth` assertion error that was caused by empty-dir
1194 removals and/or duplicate files in the transfer.
1195
1196 - Fixed a problem with `--info=progress2`'s output stats where rsync would
1197 only update the stats at the end of each file's transfer. It now uses the
1198 data that is flowing for the current file, making the stats more accurate
1199 and less jumpy.
1200
1201 - Fixed an itemize bug that affected the combo of `--link-dest`, `-X`, and
1202 `-n`.
1203
1204 - Fixed a problem with delete messages not appearing in the log file when the
1205 user didn't use `--verbose`.
1206
1207 - Improve chunked xattr reading for OS X.
1208
1209 - Removed an attempted hard-link xattr optimization that was causing a
1210 transfer failure. This removal is flagged in the compatibility code, so if a
1211 better fix can be discovered, we have a way to flip it on again.
1212
1213 - Fixed a bug when the receiver is not configured to be able to hard link
1214 symlimks/devices/special-file items but the sender sent some of these items
1215 flagged as hard-linked.
1216
1217 - We now generate a better error if the buffer overflows in `do_mknod()`.
1218
1219 - Fixed a problem reading more than 16 ACLs on some OSes.
1220
1221 - Fixed the reading of the secrets file to avoid an infinite wait when the
1222 username is missing.
1223
1224 - Fixed a parsing problem in the `--usermap`/`--groupmap` options when using
1225 MIN-MAX numbers.
1226
1227 - Switched Cygwin back to using socketpair `pipes` to try to speed it up.
1228
1229 - Added knowledge of a few new options to rrsync.
1230
1231### ENHANCEMENTS:
1232
1233 - Tweaked the temp-file naming when `--temp-dir=DIR` is used: the temp-file
1234 names will not get a '.' prepended.
1235
1236 - Added support for a new-compression idiom that does not compress all the
1237 matching data in a transfer. This can help rsync to use less cpu when a
1238 transfer has a lot of matching data, and also makes rsync compatible with a
1239 non-bundled zlib. See the `--new-compress` and `--old-compress` options in
1240 the manpage.
1241
c9832790 1242 - Added the rsync-no-vanished shell script. (See the support dir.)
87bca719
WD
1243
1244 - Made configure more prominently mention when we failed to find yodl (in case
1245 the user wants to be able to generate manpages from `*.yo` files).
1246
1247 - Have manpage mention how a daemon's max-verbosity setting affects info and
1248 debug options. Also added more clarification on backslash removals for
1249 excludes that contain wildcards.
1250
1251 - Have configure check if for the attr lib (for getxattr) for those systems
1252 that need to link against it explicitly.
1253
1254 - Change the early dir-creation logic to only use that idiom in an
1255 inc-recursive copy that is preserving directory times. e.g. using
1256 `--omit-dir-times` will avoid these early directories being created.
1257
1258 - Fix a bug in `cmp_time()` that would return a wrong result if the 2 times
1259 differed by an amount greater than what a `time_t` can hold.
1260
1261### DEVELOPER RELATED:
1262
1263 - We now include an example systemd file (in packaging/systemd).
1264
1265 - Tweaked configure to make sure that any intended use of the included popt
1266 and/or zlib code is put early in the CFLAGS.
1267
1268------------------------------------------------------------------------------
87bca719
WD
1269
1270# NEWS for rsync 3.1.0 (28 Sep 2013)
1271
d640d78f
WD
1272## Changes in this version:
1273
1274### PROTOCOL NUMBER:
87bca719 1275
d640d78f 1276 - The protocol number was changed to 31.
87bca719
WD
1277
1278### OUTPUT CHANGES:
1279
1280 - Output numbers in 3-digit groups by default (e.g. 1,234,567). See the
1281 `--human-readable` option for a way to turn it off. See also the daemon's
1282 `log format` parameter and related command-line options (including
1283 `--out-format`) for a modifier that can be used to request digit-grouping or
1284 human-readable output in log escapes. (Note that log output is unchanged by
1285 default.)
1286
1287 - The `--list-only` option is now affected by the `--human-readable` setting.
1288 It will display digit groupings by default, and unit suffixes if higher
1289 levels of readability are requested. Also, the column width for the size
1290 output has increased from 11 to 14 characters when human readability is
1291 enabled. Use `--no-h` to get the old-style output and column size.
1292
1293 - The output of the `--progress` option has changed: the string `xfer` was
1294 shortened to `xfr`, and the string `to-check` was shortened to `to-chk`,
1295 both designed to make room for the (by default) wider display of file size
1296 numbers without making the total line-length longer. Also, when incremental
1297 recursion is enabled, the string `ir-chk` will be used instead of `to-chk`
1298 up until the incremental-recursion scan is done, letting you know that the
1299 value to check and the total value will still be increasing as new files are
1300 found.
1301
1302 - Enhanced the `--stats` output: 1) to mention how many files were created
1303 (protocol >= 28), 2) to mention how many files were deleted (a new line for
1304 protocol 31, but only output when `--delete` is in effect), and 3) to follow
1305 the file-count, created-count, and deleted-count with a subcount list that
1306 shows the counts by type. The wording of the transferred count has also
1307 changed so that it is clearer that it is only a count of regular files.
1308
1309### BUG FIXES:
1310
1311 - Fixed a bug in the iconv code when EINVAL or EILSEQ is returned with a full
1312 output buffer.
1313
1b9308b7 1314 - Fixed some rare bugs in `--iconv` processing that might cause a multi-byte
87bca719
WD
1315 character to get translated incorrectly.
1316
1317 - Fixed a bogus `vanished file` error if some files were specified with `./`
1318 prefixes and others were not.
1319
1320 - Fixed a bug in `--sparse` where an extra gap could get inserted after a
1321 partial write.
1322
1323 - Changed the way `--progress` overwrites its prior output in order to make it
1324 nearly impossible for the progress to get overwritten by an error.
1325
1326 - Improved the propagation of abnormal-exit error messages. This should help
1327 the client side to receive errors from the server when it is exiting
1328 abnormally, and should also avoid dying with an `connection unexpectedly
1329 closed` exit when the closed connection is really expected.
1330
1331 - The sender now checks each file it plans to remove to ensure that it hasn't
1332 changed from the first stat's info. This helps to avoid losing file data
1333 when the user is not using the option in a safe manner.
1334
1335 - Fixed a data-duplication bug in the compress option that made compression
1336 less efficient. This improves protocol 31 onward, while behaving in a
1337 compatible (buggy) manner with older rsync protocols.
1338
1339 - When creating a temp-file, rsync is now a bit smarter about it dot-char
1340 choices, which can fix a problem on OS X with names that start with `..`.
1341
1342 - Rsync now sets a cleanup flag for `--inplace` and `--append` transfers that
1343 will flush the write buffer if the transfer aborts. This ensures that more
1344 received data gets written out to the disk on an aborted transfer (which is
1345 quite helpful on a slow, flaky connection).
1346
1347 - The reads that `map_ptr()` now does are aligned on 1K boundaries. This helps
1348 some filesystems and/or files that don't like unaligned reads.
1349
1350 - Fix an issue in the msleep() function if time jumps backwards.
1351
1352 - Fix daemon-server module-name splitting bug where an arg would get split
1353 even if `--protect-args` was used.
1354
1355### ENHANCEMENTS:
1356
1357 - Added the `--remote-option=OPT` (`-M OPT`) command-line option that is
1358 useful for things like sending a remote `--log-file=FILE` or `--fake-super`
1359 option.
1360
1361 - Added the `--info=FLAGS` and `--debug=FLAGS` options to allow finer-grained
1362 control over what is output. Added an extra type of `--progress` output
1363 using `--info=progress2`.
1364
1365 - The `--msgs2stderr` option can help with debugging rsync by allowing the
1366 debug messages to get output to stderr rather than travel via the socket
1367 protocol.
1368
1369 - Added the `--delete-missing-args` and `--ignore-missing-args` options to
1370 either delete or ignore user-specified files on the receiver that are
1371 missing on the sender (normally the absence of user-specified files
1372 generates an error).
1373
1374 - Added a `T` (terabyte) category to the `--human-readable` size suffixes.
1375
1376 - Added the `--usermap`/`--groupmap`/`--chown` options for manipulating file
1377 ownership during the copy.
1378
1379 - Added the `%C` escape to the log-output handling, which will output the MD5
1380 checksum of any transferred file, or all files if `--checksum` was specified
1381 (when protocol 30 or above is in effect).
1382
1383 - Added the `reverse lookup` parameter to the rsync daemon config file to
1384 allow reverse-DNS lookups to be disabled.
1385
1386 - Added a forward-DNS lookup for the daemon's hosts allow/deny config. Can be
1387 disabled via `forward lookup` parameter (defaults to enabled).
1388
1389 - Added a way for more than one group to be specified in the daemon's config
1390 file, including a way to specify that you want all of the specified user's
1391 groups without having to name them. Also changed the daemon to complain
1392 about an inability to set explicitly-specified uid/gid values, even when not
1393 run by a super-user.
1394
1395 - The daemon now tries to send the user the error messages from the pre-xfer
1396 exec script when it fails.
1397
1398 - Improved the use of alt-dest options into an existing hierarchy of files: If
1399 a match is found in an alt-dir, it takes precedence over an existing file.
1400 (We'll need to wait for a future version before attribute-changes on
1401 otherwise unchanged files are safe when using an existing hierarchy.)
1402
1403 - Added per-user authorization options and group-authorization support to the
1404 daemon's `auth users` parameter.
1405
1406 - Added a way to reference environment variables in a daemon's config file
1407 (using %VAR% references).
1408
1409 - When replacing a non-dir with a symlink/hard-link/device/special-file, the
1410 update should now be done in an atomic manner.
1411
1412 - Avoid re-sending xattr info for hard-linked files w/the same xattrs
1413 (protocol 31).
1414
1415 - The backup code was improved to use better logic maintaining the backup
1416 directory hierarchy. Also, when a file is being backed up, rsync tries to
1417 hard-link it into place so that the upcoming replacement of the destination
1418 file will be atomic (for the normal, non-inplace logic).
1419
44cc1489 1420 - Added the ability to synchronize nanosecond modified times.
87bca719
WD
1421
1422 - Added a few more default suffixes for the `dont compress` settings.
1423
1424 - Added the checking of the `RSYNC_PROTECT_ARGS` environment variable to allow
1425 the default for the `--protect-args` command-line option to be overridden.
1426
1427 - Added the `--preallocate` command-line option.
1428
1429 - Allow `--password-file=-` to read the password from stdin (filename `-`).
1430
1431 - Rsync now comes packaged with an rsync-ssl helper script that can be used to
1432 contact a remote rsync daemon using a piped-stunnel command. It also
1433 includes an stunnel config file to run the server side to support ssl daemon
1434 connections. See the packaging/lsb/rsync.spec file for one way to package
1435 the resulting files. (Suggestions for how to make this even easier to
1436 install & use are welcomed.)
1437
1438 - Improved the speed of some `--inplace` updates when there are lots of
1439 identical checksum blocks that end up being unusable.
1440
1441 - Added the `--outbuf=N|L|B` option for choosing the output buffering.
1442
1443 - Repeating the `--fuzzy` option now causes the code to look for fuzzy matches
1444 inside alt-dest directories too.
1445
1446 - The `--chmod` option now supports numeric modes, e.g. `--chmod=644,D755`
1447
1448 - Added some Solaris xattr code.
1449
1450 - Made an rsync daemon (the listening process) exit with a 0 status when it
1451 was signaled to die. This helps launchd.
1452
1453 - Improved the `RSYNC_*` environment variables for the pre-xfer exec script:
1454 when a daemon is sent multiple request args, they are now joined into a
1455 single return value (separated by spaces) so that the `RSYNC_REQUEST`
1456 environment variable is accurate for any `pre-xfer exec`. The values in
1457 `RSYNC_ARG#` vars are no longer truncated at the `.` arg (prior to the
1458 request dirs/files), so that all the requested values are also listed
1459 (separately) in `RSYNC_ARG#` variables.
1460
1461### EXTRAS:
1462
1463 - Added an `instant-rsyncd` script to the support directory, which makes it
1464 easy to configure a simple rsync daemon in the current directory.
1465
1466 - Added the `mapfrom` and `mapto` scripts to the support directory, which
1467 makes it easier to do user/group mapping in a local transfer based on
1468 passwd/group files from another machine.
1469
1470 - There's a new, improved version of the lsh script in the support dir: it's
1471 written in perl and supports `-u` without resorting to using sudo (when run
1472 as root). The old shell version is now named lsh.sh.
1473
1474 - There is a helper script named rsync-slash-strip in the support directory
1475 for anyone that wants to change the way rsync handles args with trailing
1476 slashes. (e.g. arg/ would get stripped to arg while arg/. would turn into
1477 arg/).
1478
1479### INTERNAL:
1480
1481 - The I/O code was rewritten to be simpler and do bigger buffered reads over
1482 the socket. The I/O between the receiver and the generator was changed to be
1483 standard multiplexed-I/O (like that over the socket).
1484
1485 - The sender tries to use any dead time while the generator is looking for
1486 files to transfer in order to do sender-side directory scanning in a more
1487 parallel manner.
1488
1489 - A daemon can now inform a client about a daemon-configured timeout value so
1490 that the client can assist in the keep-alive activity (protocol 31).
1491
f43412f1 1492 - The filter code received some refactoring to make it more extendable, to
87bca719
WD
1493 read better, and do better sanity checking.
1494
1495 - Really big numbers are now output using our own big-num routine rather than
1496 casting them to a double and using a %.0f conversion.
1497
1498 - The `pool_alloc` library has received some minor improvements in alignment
1499 handling.
1500
1501 - Added `init_stat_x()` function to avoid duplication of acl/xattr init code.
1502
1503 - The included zlib was upgraded from 1.2.3 to 1.2.8.
1504
1505 - Rsync can now be compiled to use an unmodified zlib library instead of the
1506 tweaked one that is included with rsync. This will eventually become the
1507 default, at which point we'll start the countdown to removing the included
1508 zlib. Until then, feel free to configure using:
1509
1510 ./configure `--with-included-zlib=no`
1511
1512### DEVELOPER RELATED:
1513
1514 - Added more conditional debug output.
1515
f43412f1 1516 - Fixed some build issues for Android and Minix.
87bca719
WD
1517
1518------------------------------------------------------------------------------
87bca719
WD
1519
1520# NEWS for rsync 3.0.9 (23 Sep 2011)
1521
d640d78f 1522## Changes in this version:
87bca719
WD
1523
1524### BUG FIXES:
1525
1526 - Fix a crash bug in checksum scanning when `--inplace` is used.
1527
1528 - Fix a hang if a hard-linked file cannot be opened by the sender (e.g. if it
1529 has no read permission).
1530
1531 - Fix preservation of a symlink's system xattrs (e.g. selinux) on Linux.
1532
1533 - Fix a memory leak in the xattr code.
1534
1535 - Fixed a bug with `--delete-excluded` when a filter merge file has a rule
1536 that specifies a receiver-only side restriction.
1537
1538 - Fix a bug with the modifying of unwritable directories.
1539
1540 - Fix `--fake-super`'s interaction with `--link-dest` same-file comparisons.
1541
1542 - Fix the updating of the `curr_dir` buffer to avoid a duplicate slash.
1543
1544 - Fix the directory permissions on an implied dot-dir when using `--relative`
1545 (e.g. /outside/path/././send/path).
1546
1547 - Fixed some too-long sleeping instances when using `--bwlimit`.
1548
1549 - Fixed when symlink ownership difference-checking gets compiled into
1550 `unchanged_attrs()`.
1551
1552 - Improved the socket-error reporting when multiple protocols fail.
1553
1554 - Fixed a case where a socket error could reference just-freed memory.
1555
1556 - Failing to use a password file that was specified on the command-line is now
1557 a fatal error.
1558
1559 - Fix the non-root updating of directories that don't have the read and/or
1560 execute permission.
1561
1562 - Make daemon-excluded file errors more error-like.
1563
1564 - Fix a compilation issue on older C compilers (due to a misplaced var
1565 declaration).
1566
f43412f1 1567 - Make configure avoid finding socketpair on Cygwin.
87bca719
WD
1568
1569 - Avoid trying to reference `SO_BROADCAST` if the OS doesn't support it.
1570
96ed4b47 1571 - Fix some issues with the post-processing of the manpages.
87bca719 1572
c9832790 1573 - Fixed the user home-dir handling in the lsh script. (See the support dir.)
87bca719
WD
1574
1575 - Some minor manpage improvements.
1576
1577------------------------------------------------------------------------------
87bca719
WD
1578
1579# NEWS for rsync 3.0.8 (26 Mar 2011)
1580
d640d78f 1581## Changes in this version:
87bca719
WD
1582
1583### BUG FIXES:
1584
1585 - Fixed two buffer-overflow issues: one where a directory path that is exactly
1586 MAXPATHLEN was not handled correctly, and one handling a `--backup-dir` that
1587 is extra extra large.
1588
1589 - Fixed a data-corruption issue when preserving hard-links without preserving
1590 file ownership, and doing deletions either before or during the transfer
1591 (CVE-2011-1097). This fixes some assert errors in the hard-linking code, and
1592 some potential failed checksums (via `-c`) that should have matched.
1593
1594 - Fixed a potential crash when an rsync daemon has a filter/exclude list and
1595 the transfer is using ACLs or xattrs.
1596
1597 - Fixed a hang if a really large file is being processed by an rsync that
1598 can't handle 64-bit numbers. Rsync will now complain about the file being
1599 too big and skip it.
1600
1601 - For devices and special files, we now avoid gathering useless ACL and/or
1602 xattr information for files that aren't being copied. (The un-copied files
1603 are still put into the file list, but there's no need to gather data that is
1604 not going to be used.) This ensures that if the user uses `--no-D`, that
1605 rsync can't possibly complain about being unable to gather extended
1606 information from special files that are in the file list (but not in the
1607 transfer).
1608
1609 - Properly handle requesting remote filenames that start with a dash. This
1610 avoids a potential error where a filename could be interpreted as a (usually
1611 invalid) option.
1612
1613 - Fixed a bug in the comparing of upper-case letters in file suffixes for
1614 `--skip-compress`.
1615
1616 - If an rsync daemon has a module configured without a path setting, rsync
1617 will now disallow access to that module.
1618
1619 - If the destination arg is an empty string, it will be treated as a reference
1620 to the current directory (as 2.x used to do).
1621
1622 - If rsync was compiled with a newer time-setting function (such as lutimes),
1623 rsync will fall-back to an older function (such as utimes) on a system where
1624 the newer function is not around. This helps to make the rsync binary more
1625 portable in mixed-OS-release situations.
1626
1627 - Fixed a batch-file writing bug that would not write out the full set of
1628 compatibility flags that the transfer was using. This fixes a potential
1629 protocol problem for a batch file that contains a sender-side I/O error: it
1630 would have been sent in a way that the batch-reader wasn't expecting.
1631
1632 - Some improvements to the hard-linking code to ensure that device-number
1633 hashing is working right, and to supply more information if the hard-link
1634 code fails.
1635
1636 - The `--inplace` code was improved to not search for an impossible checksum
1637 position. The quadruple-verbose chunk[N] message will now mention when an
1638 inplace chunk was handled by a seek rather than a read+write.
1639
1640 - Improved ACL mask handling, e.g. for Solaris.
1641
1642 - Fixed a bug that prevented `--numeric-ids` from disabling the translation of
1643 user/group IDs for ACLs.
1644
1645 - Fixed an issue where an xattr and/or ACL transfer that used an alt-dest
1646 option (e.g. `--link-dest`) could output an error trying to itemize the
1647 changes against the alt-dest directory's xattr/ACL info but was instead
1648 trying to access the not-yet-existing new destination directory.
1649
1650 - Improved xattr system-error messages to mention the full path to the file.
1651
1652 - The `--link-dest` checking for identical symlinks now avoids considering
1653 attribute differences that cannot be changed on the receiver.
1654
1655 - Avoid trying to read/write xattrs on certain file types for certain OSes.
1656 Improved configure to set `NO_SYMLINK_XATTRS`, `NO_DEVICE_XATTRS`, and/or
1657 `NO_SPECIAL_XATTRS` defines in config.h.
1658
1659 - Improved the unsafe-symlink errors messages.
1660
1661 - Fixed a bug setting xattrs on new files that aren't user writable.
1662
1663 - Avoid re-setting xattrs on a hard-linked file w/the same xattrs.
1664
1665 - Fixed a bug with `--fake-super` when copying files and dirs that aren't user
1666 writable.
1667
1668 - Fixed a bug where a sparse file could have its last sparse block turned into
1669 a real block when rsync sets the file size (requires ftruncate).
1670
1671 - If a temp-file name is too long, rsync now avoids truncating the name in the
1672 middle of adjacent high-bit characters. This prevents a potential filename
1673 error if the filesystem doesn't allow a name to contain an invalid
1674 multi-byte sequence.
1675
1676 - If a muli-protocol socket connection fails (i.e., when contacting a daemon),
1677 we now report all the failures, not just the last one. This avoids losing a
1678 relevant error (e.g. an IPv4 connection-refused error) that happened before
1679 the final error (e.g. an IPv6 protocol-not-supported error).
1680
1681 - Generate a transfer error if we try to call chown with a `-1` for a uid or a
1682 gid (which is not settable).
1683
1684 - Fixed the working of `--force` when used with `--one-file-system`.
1685
1686 - Fix the popt arg parsing so that an option that doesn't take an arg will
1687 reject an attempt to supply one (can configure `--with-included-popt` if
1688 your system's popt library doesn't yet have this fix).
1689
c9832790
WD
1690 - A couple minor option tweaks to the rrsync script, and also some regex
1691 changes that make vim highlighting happier. (See the support dir.)
87bca719 1692
c9832790 1693 - Fixed some issues in the mnt-excl script. (See the support dir.)
87bca719
WD
1694
1695 - Various manpage improvements.
1696
1697### ENHANCEMENTS:
1698
1699 - Added `.hg/` to the default cvs excludes (see `-C` & `--cvs-exclude`).
1700
1701### DEVELOPER RELATED:
1702
1703 - Use lchmod() whenever it is available (not just on symlinks).
1704
1705 - A couple fixes to the `socketpair_tcp()` routine.
1706
1707 - Updated the helper scripts in the packaging subdirectory.
1708
1709 - Renamed configure.in to configure.ac.
1710
1711 - Fixed configure's checking for iconv routines for newer OS X versions.
1712
1713 - Fixed the testsuite/xattrs.test script on OS X.
1714
1715------------------------------------------------------------------------------
87bca719
WD
1716
1717# NEWS for rsync 3.0.7 (31 Dec 2009)
1718
d640d78f 1719## Changes in this version:
87bca719
WD
1720
1721### BUG FIXES:
1722
1723 - Fixed a bogus free when using `--xattrs` with `--backup`.
1724
1725 - Avoid an error when `--dry-run` was trying to stat a prior hard-link file
1726 that hasn't really been created.
1727
1728 - Fixed a problem with `--compress` (`-z`) where the receiving side could
7f8cf771 1729 return the error "`inflate (token) returned -5`".
87bca719
WD
1730
1731 - Fixed a bug where `--delete-during` could delete in a directory before it
1732 noticed that the sending side sent an I/O error for that directory (both
1733 sides of the transfer must be at least 3.0.7).
1734
1735 - Improved `--skip-compress`'s error handling of bad character-sets and got
1736 rid of a lingering debug fprintf().
1737
1738 - Fixed the daemon's conveyance of `io_error` value from the sender.
1739
1740 - An rsync daemon use seteuid() (when available) if it used setuid().
1741
1742 - Get the permissions right on a `--fake-super` transferred directory that
1743 needs more owner permissions to emulate root behavior.
1744
1745 - An absolute-path filter rule (i.e. with a '/' modifier) no longer loses its
1746 modifier when sending the filter rules to the remote rsync.
1747
7f8cf771 1748 - Improved the "`--delete does not work without -r or -d`" message.
87bca719
WD
1749
1750 - Improved rsync's handling of `--timeout` to avoid a weird timeout case where
1751 the sender could timeout even though it has recently written data to the
1752 socket (but hasn't read data recently, due to the writing).
1753
1754 - Some misc manpage improvements.
1755
1756 - Fixed the chmod-temp-dir testsuite on a system without /var/tmp.
1757
1758 - Make sure that a timeout specified in the daemon's config is used as a
1759 maximum timeout value when the user also specifies a timeout.
1760
1761 - Improved the error-exit reporting when rsync gets an error trying to cleanup
1762 after an error: the initial error is reported.
1763
f43412f1 1764 - Improved configure's detection of IPv6 for Solaris and Cygwin.
87bca719
WD
1765
1766 - The AIX sysacls routines will now return ENOSYS if ENOTSUP is missing.
1767
1768 - Made our (only used if missing) getaddrinfo() routine use `inet_pton()`
1769 (which we also provide) instead of `inet_aton()`.
1770
1771 - The exit-related debug messages now mention the program's role so it is
1772 clear who output what message.
1773
1774### DEVELOPER RELATED:
1775
1776 - Got rid of type-punned compiler warnings output by newer gcc versions.
1777
1778 - The Makefile now ensures that proto.h will be rebuilt if config.h changes.
1779
f43412f1 1780 - The testsuite no longer uses `id -u`, so it works better on Solaris.
87bca719
WD
1781
1782------------------------------------------------------------------------------
87bca719
WD
1783
1784# NEWS for rsync 3.0.6 (8 May 2009)
1785
d640d78f 1786## Changes in this version:
87bca719
WD
1787
1788### BUG FIXES:
1789
1790 - Fixed a `--read-batch` hang when rsync is reading a batch file that was
1791 created from an incremental-recursion transfer.
1792
1793 - Fixed the daemon's socket code to handle the simultaneous arrival of
1794 multiple connections.
1795
1796 - Fix `--safe-links`/`--copy-unsafe-links` to properly handle symlinks that
1797 have consecutive slashes in the value.
1798
1799 - Fixed the parsing of an `[IPv6_LITERAL_ADDR]` when a USER@ is prefixed.
1800
1801 - The sender now skips a (bogus) symlink that has a 0-length value, which
1802 avoids a transfer error in the receiver.
1803
1804 - Fixed a case where the sender could die with a tag-0 error if there was an
1805 I/O during the sending of the file list.
1806
1807 - Fixed the rrsync script to avoid a server-side problem when `-e` is at the
1808 start of the short options.
1809
1810 - Fixed a problem where a vanished directory could turn into an exit code 23
1811 instead of the proper exit code 24.
1812
1813 - Fixed the `--iconv` conversion of symlinks when doing a local copy.
1814
1815 - Fixed a problem where `--one-file-system` was not stopping deletions on the
1816 receiving side when a mount-point directory did not match a directory in the
1817 transfer.
1818
1819 - Fixed the dropping of an ACL mask when no named ACL values were present.
1820
1821 - Fixed an ACL/xattr corruption issue where the `--backup` option could cause
1822 rsync to associate the wrong ACL/xattr information with received files.
1823
1824 - Fixed the use of `--xattrs` with `--only-write-batch`.
1825
1826 - Fixed the use of `--dry-run` with `--read-batch`.
1827
1828 - Fixed configure's erroneous use of target.
1829
1830 - Fixed configure's `--disable-debug` option.
1831
1832 - Fixed a run-time issue for systems that can't find `iconv_open()` by adding
1833 the `--disable-iconv-open` configure option.
1834
1835 - Complain and die if the user tries to combine `--remove-source-files` (or
1836 the deprecated `--remove-sent-files`) with `--read-batch`.
1837
1838 - Fixed an failure transferring special files from Solaris to Linux.
1839
1840------------------------------------------------------------------------------
87bca719
WD
1841
1842# NEWS for rsync 3.0.5 (28 Dec 2008)
1843
d640d78f 1844## Changes in this version:
87bca719
WD
1845
1846### BUG FIXES:
1847
1848 - Initialize xattr data in a couple spots in the hlink code, which avoids a
1849 crash when the xattr pointer's memory happens to start out non-zero. Also
1850 fixed the itemizing of an alt-dest file's xattrs when hard-linking.
1851
1852 - Don't send a bogus `-` option to an older server if there were no short
1853 options specified.
1854
1855 - Fixed skipping of unneeded updates in a batch file when incremental
1856 recursion is active. Added a test for this. Made batch-mode handle `redo`
1857 files properly (and without hanging).
1858
1859 - Fix the %P logfile escape when the daemon logs from inside a chroot.
1860
1861 - Fixed the use of `-s` (`--protect-args`) when used with a remote source or
1862 destination that had an empty path (e.g. `host:`). Also fixed a problem when
1863 `-s` was used when accessing a daemon via a remote-shell.
1864
1865 - Fixed the use of a dot-dir path (e.g. foo/./bar) inside a `--files-from`
1866 file when the root of the transfer isn't the current directory.
1867
1868 - Fixed a bug with `-K --delete` removing symlinks to directories when
1869 incremental recursion is active.
1870
1871 - Fixed a hard to trigger hang when using `--remove-source-files`.
1872
1873 - Got rid of an annoying delay when accessing a daemon via a remote-shell.
1874
1875 - Properly ignore (superfluous) source args on a `--read-batch` command.
1876
1877 - Improved the manpage's description of the `*` wildcard to remove the
1878 confusing `non-empty` qualifier.
1879
1880 - Fixed reverse lookups in the compatibility-library version of getnameinfo().
1881
1882 - Fixed a bug when using `--sparse` on a sparse file that has over 2GB of
1883 consecutive sparse data.
1884
1885 - Avoid a hang when using at least 3 `--verbose` options on a transfer with a
1886 client sender (which includes local copying).
1887
1888 - Fixed a problem with `--delete-delay` reporting an error when it was ready
1889 to remove a directory that was now gone.
1890
1891 - Got rid of a bunch of `warn_unused_result` compiler warnings.
1892
1893 - If an ftruncate() on a received file fails, it now causes a partial-
1894 transfer warning.
1895
1896 - Allow a path with a leading `//` to be preserved (CYGWIN only).
1897
1898### ENHANCEMENTS:
1899
c9832790
WD
1900 - Made the atomic-rsync script able to perform a fully atomic update of the
1901 copied hierarchy when the destination is setup using a particular symlink
1902 idiom. (See the support dir.)
87bca719
WD
1903
1904------------------------------------------------------------------------------
87bca719
WD
1905
1906# NEWS for rsync 3.0.4 (6 Sep 2008)
1907
d640d78f 1908## Changes in this version:
87bca719
WD
1909
1910### BUG FIXES:
1911
1912 - Fixed a bug in the hard-linking code where it would sometimes try to
1913 allocate 0 bytes of memory (which fails on some OSes, such as AIX).
1914
1915 - Fixed the hard-linking of files from a device that has a device number of 0
1916 (which seems to be a common device number on NetBSD).
1917
1918 - Fixed the handling of a `--partial-dir` that cannot be created. This
1919 particularly impacts the `--delay-updates` option (since the files cannot be
1920 delayed without a partial-dir), and was potentially destructive if the
1921 `--remove-source-files` was also specified.
1922
1923 - Fixed a couple issues in the `--fake-super` handling of xattrs when the
1924 destination files have root-level attributes (e.g. selinux values) that a
1925 non-root copy can't affect.
1926
1927 - Improved the keep-alive check in the generator to fire consistently in
1928 incremental-recursion mode when `--timeout` is enabled.
1929
1930 - The `--iconv` option now converts the content of a symlink too, instead of
1931 leaving it in the wrong character-set (requires 3.0.4 on both sides of the
1932 transfer).
1933
1934 - When using `--iconv`, if a filename fails to convert on the receiving side,
1935 this no longer makes deletions in the root-dir of the transfer fail silently
1936 (the user now gets a warning about deletions being disabled due to IO error
1937 as long as `--ignore-errors` was not specified).
1938
1939 - When using `--iconv`, if a server-side receiver can't convert a filename,
1940 the error message sent back to the client no longer mangles the name with
1941 the wrong charset conversion.
1942
1943 - Fixed a potential alignment issue in the IRIX ACL code when allocating the
1944 initial `struct acl` object. Also, cast mallocs to avoid warnings.
1945
1946 - Changed some errors that were going to stdout to go to stderr.
1947
1948 - Made `human_num()` and `human_dnum()` able to output a negative number
1949 (rather than outputting a cryptic string of punctuation).
1950
1951### ENHANCEMENTS:
1952
1953 - Rsync will avoid sending an `-e` option to the server if an older protocol
1954 is requested (and thus the option would not be useful). This lets the user
1955 specify the `--protocol=29` option to access an overly-restrictive server
1956 that is rejecting the protocol-30 use of `-e` to the server.
1957
1958 - Improved the message output for an `RERR_PARTIAL` exit.
1959
1960### DEVELOPER RELATED:
1961
1962 - The Makefile will not halt for just a timestamp change on the Makefile or
1963 the configure files, only for actual changes in content.
1964
1965 - Changed some commands in the testsuite's xattrs.test that called `rsync`
1966 instead of `$RSYNC`.
1967
1968 - Enhanced the release scripts to be able to handle a branch release and to do
1969 even more consistency checks on the files.
1970
1971------------------------------------------------------------------------------
87bca719
WD
1972
1973# NEWS for rsync 3.0.3 (29 Jun 2008)
1974
d640d78f 1975## Changes in this version:
87bca719
WD
1976
1977### BUG FIXES:
1978
1979 - Fixed a wildcard matching problem in the daemon when a module has `use
1980 chroot` enabled.
1981
1982 - Fixed a crash bug in the hard-link code.
1983
1984 - Fixed the sending of xattr directory information when the code finds a
1985 `--link-dest` or `--copy-dest` directory with unchanged xattrs -- the
1986 destination directory now gets these unchanged xattrs properly applied.
1987
1988 - Fixed an xattr-sending glitch that could cause an `Internal abbrev` error.
1989
1990 - Fixed the combination of `--xattrs` and `--backup`.
1991
f43412f1 1992 - The generator no longer allows a '.' dir to be excluded by a daemon-exclude
87bca719
WD
1993 rule.
1994
1995 - Fixed deletion handling when copying a single, empty directory (with no
1996 files) to a differently named, non-existent directory.
1997
1998 - Fixed the conversion of spaces into dashes in the %M log escape.
1999
2000 - Fixed several places in the code that were not returning the right errno
2001 when a function failed.
2002
2003 - Fixed the backing up of a device or special file into a backup dir.
2004
2005 - Moved the setting of the socket options prior to the connect().
2006
2007 - If rsync exits in the middle of a `--progress` output, it now outputs a
2008 newline to help prevent the progress line from being overwritten.
2009
2010 - Fixed a problem with how a destination path with a trailing slash or a
2011 trailing dot-dir was compared against the daemon excludes.
2012
2013 - Fixed the sending of large (size > 16GB) files when talking to an older
2014 rsync (protocols < 30): we now use a compatible block size limit.
2015
2016 - If a file's length is so huge that we overflow a checksum buffer count (i.e.
2017 several hundred TB), warn the user and avoid sending an invalid checksum
2018 struct over the wire.
2019
2020 - If a source arg is excluded, `--relative` no longer adds the excluded arg's
2021 implied dirs to the transfer. This fix also made the exclude check happen in
2022 the better place in the sending code.
2023
2024 - Use the `overflow_exit()` function for overflows, not `out_of_memory()`.
2025
2026 - Improved the code to better handle a system that has only 32-bit file
2027 offsets.
2028
2029### ENHANCEMENTS:
2030
2031 - The rsyncd.conf manpage now consistently refers to the parameters in the
2032 daemon config file as `parameters`.
2033
2034 - The description of the `--inplace` option was improved.
2035
2036### EXTRAS:
2037
2038 - Added a new script in the support directory, deny-rsync, which allows an
2039 admin to (temporarily) replace the rsync command with a script that sends an
2040 error message to the remote client via the rsync protocol.
2041
2042### DEVELOPER RELATED:
2043
2044 - Fixed a testcase failure if the tests are run as root and made some
2045 compatibility improvements.
2046
2047 - Improved the daemon tests, including checking module comments, the listing
2048 of files, and the ensuring that daemon excludes can't affect a dot-dir arg.
2049
2050 - Improved some build rules for those that build in a separate directory from
96ed4b47 2051 the source, including better install rules for the manpages, and the fixing
87bca719
WD
2052 of a proto.h-tstamp rule that could make the binaries get rebuild without
2053 cause.
2054
7f8cf771
WD
2055 - Improved the testsuite to work around a problem with some utilities (e.g.
2056 `cp -p` & `touch -r`) rounding sub-second timestamps.
87bca719
WD
2057
2058 - Ensure that the early patches don't cause any generated-file hunks to
2059 bleed-over into patches that follow.
2060
2061------------------------------------------------------------------------------
87bca719
WD
2062
2063# NEWS for rsync 3.0.2 (8 Apr 2008)
2064
d640d78f 2065## Changes in this version:
87bca719
WD
2066
2067### BUG FIXES:
2068
2069 - Fixed a potential buffer overflow in the xattr code.
2070
2071### ENHANCEMENTS:
2072
2073 - None.
2074
2075### DEVELOPER RELATED:
2076
2077 - The RPM spec file was improved to install more useful files.
2078
2079 - A few developer-oriented scripts were moved from the support dir to the
2080 packaging dir.
2081
2082------------------------------------------------------------------------------
87bca719
WD
2083
2084# NEWS for rsync 3.0.1 (3 Apr 2008)
2085
d640d78f 2086## Changes in this version:
87bca719
WD
2087
2088### NOTABLE CHANGES IN BEHAVIOR:
2089
2090 - Added the 'c'-flag to the itemizing of non-regular files so that the
2091 itemized output doesn't get hidden if there were no attribute changes, and
2092 also so that the itemizing of a `--copy-links` run will distinguish between
2093 copying an identical non-regular file and the creation of a revised version
2094 with a new value (e.g. a changed symlink referent, a new device number,
2095 etc.).
2096
2097### BUG FIXES:
2098
2099 - Fixed a crash bug when a single-use rsync daemon (via remote shell) was run
2100 without specifying a `--config=FILE` option.
2101
2102 - Fixed a crash when backing up a directory that has a default ACL.
2103
2104 - Fixed a bug in the handling of xattr values that could cause rsync to not
2105 think that a file's extended attributes are up-to-date.
2106
2107 - Fixed the working of `--fake-super` with `--link-dest` and `--xattrs`.
2108
2109 - Fixed a hang when combining `--dry-run` with `--remove-source-files`.
2110
2111 - Fixed a bug with `--iconv`'s handling of files that cannot be converted: a
2112 failed name can no longer cause a transfer failure.
2113
2114 - Fixed the building of the rounding.h file on systems that need custom
2115 CPPFLAGS to be used. Also improved the error reporting if the building of
2116 rounding.h fails.
2117
2118 - Fixed the use of the `--protect-args` (`-s`) option when talking to a
2119 daemon.
2120
2121 - Fixed the `--ignore-existing` option's protection of files on the receiver
2122 that are non-regular files on the sender (e.g. if a symlink or a dir on the
2123 sender is trying to replace a file on the receiver). The reverse protection
2124 (protecting a dir/symlink/device from being replaced by a file) was already
2125 working.
2126
2127 - Fixed an assert failure if `--hard-links` is combined with an option that
2128 can skip a file in a set of hard-linked files (i.e. `--ignore-existing`,
2129 `--append`, etc.), without skipping all the files in the set.
2130
2131 - Avoid setting the modify time on a directory that already has the right
2132 modify time set. This avoids tweaking the dir's ctime.
2133
2134 - Improved the daemon-exclude handling to do a better job of applying the
2135 exclude rules to path entries. It also sends the user an error just as if
2136 the files were actually missing (instead of silently ignoring the user's
2137 args), and avoids sending the user the filter-action messages for these
2138 non-user-initiated rules.
2139
2140 - Fixed some glitches with the dry-run code's missing-directory handling,
2141 including a problem when combined with `--fuzzy`.
2142
2143 - Fixed some glitches with the skipped-directory handling.
2144
2145 - Fixed the 'T'-flag itemizing of symlinks when `--time` isn't preserved.
2146
2147 - Fixed a glitch in the itemizing of permissions with the `-E` option.
2148
2149 - The `--append` option's restricting of transfers to those that add data no
f43412f1 2150 longer prevents the updating of non-content changes to otherwise up-to-date
87bca719
WD
2151 files (i.e. those with the same content but differing permissions,
2152 ownership, xattrs, etc.).
2153
2154 - Don't allow `--fake-super` to be specified with `-XX` (double `--xattrs`)
2155 because the options conflict. If a daemon has `fake super` enabled, it
2156 automatically downgrades a `-XX` request to `-X`.
2157
2158 - Fixed a couple bugs in the parsing of daemon-config excludes that could make
2159 a floating exclude rule get treated as matching an absolute path.
2160
2161 - A daemon doesn't try to auto-refuse the `iconv` option if iconv-support
2162 wasn't compiled in to the daemon (avoiding a warning in the logs).
2163
2164 - Fixed the inclusion of per-dir merge files from implied dirs.
2165
c9832790
WD
2166 - Fixed the rrsync script to work with the latest options that rsync sends,
2167 including its flag-specifying use of `-e` to the server. (See the support
2168 dir.)
87bca719
WD
2169
2170### ENHANCEMENTS:
2171
2172 - Added the `--old-dirs` (`--old-d`) option to make it easier for a user to
2173 ask for file-listings with older rsync versions (this is easier than having
2174 to type `-r --exclude='/*/*'` manually).
2175
2176 - When getting an error while asking an older rsync daemon for a file listing,
2177 rsync will try to notice if the error is a rejection of the `--dirs` (`-d`)
2178 option and let the user know how to work around the issue.
2179
2180 - Added a few more `--no-OPTION` overrides.
2181
2182 - Improved the documentation of the `--append` option.
2183
2184 - Improved the documentation of the filter/exclude/include daemon parameters.
2185
2186### INTERNAL:
2187
2188 - Fixed a couple minor bugs in the included popt library (ones which I sent to
2189 the official popt project for inclusion in the 1.14 release).
2190
2191 - Fixed a stat() call that should have been `do_stat()` so that the proper
2192 normal/64-bit stat() function gets called. (Was in an area that should not
2193 have caused problems, though.)
2194
2195 - Changed the file-glob code to do a directory scan without using the `glob`
2196 and `glob.h`. This lets us do the globbing with less memory churn, and also
2197 avoid adding daemon-excluded items to the returned args.
2198
2199### DEVELOPER RELATED:
2200
2201 - The configure script tries to get the user's compiler to not warn about
2202 unused function parameters if the build is not including one or more of the
2203 ACL/xattrs/iconv features.
2204
2205 - The configure script now has better checks for figuring out if the included
2206 popt code should be used or not.
2207
2208 - Fixed two testsuite glitches: avoid a failure if someone's `cd` command
2209 outputs the current directory when cd-ing to a relative path, and made the
2210 itemized test query how rsync was built to determine if it should expect
2211 hard-linked symlinks or not.
2212
2213 - Updated the testsuite to verify that various bug fixes remain fixed.
2214
2215 - The RPM spec file was updated to have: (1) comments for how to use the
2216 rsync-patch tar file, and (2) an /etc/xinetd.d/rsync file.
2217
2218 - Updated the build scripts to work with a revised FTP directory structure.
2219
2220------------------------------------------------------------------------------
87bca719
WD
2221
2222# NEWS for rsync 3.0.0 (1 Mar 2008)
2223
d640d78f
WD
2224## Changes in this version:
2225
2226### PROTOCOL NUMBER:
87bca719 2227
d640d78f 2228 - The protocol number was changed to 30.
87bca719
WD
2229
2230### NOTABLE CHANGES IN BEHAVIOR:
2231
2232 - The handling of implied directories when using `--relative` has changed to
2233 send them as directories (e.g. no implied dir is ever sent as a symlink).
2234 This avoids unexpected behavior and should not adversely affect most people.
2235 If you're one of those rare individuals who relied upon having an implied
2236 dir be duplicated as a symlink, you should specify the transfer of the
2237 symlink and the transfer of the referent directory as separate args. (See
2238 also `--keep-dirlinks` and `--no-implied-dirs`.) Also, exclude rules no
2239 longer have a partial effect on implied dirs.
2240
2241 - Requesting a remote file-listing without specifying `-r` (`--recursive`) now
2242 sends the `-d` (`--dirs`) option to the remote rsync rather than sending
2243 `-r` along with an extra exclude of `/*/*`. If the remote rsync does not
2244 understand the `-d` option (i.e. it is 2.6.3 or older), you will need to
2245 either turn off `-d` (`--no-d`), or specify `-r --exclude='/*/*'` manually.
2246
2247 - In `--dry-run` mode, the last line of the verbose summary text is output
2248 with a "(DRY RUN)" suffix to help remind you that no updates were made.
2249 Similarly, `--only-write-batch` outputs `(BATCH ONLY)`.
2250
2251 - A writable rsync daemon with `use chroot` disabled now defaults to a
2252 symlink-munging behavior designed to make symlinks safer while also allowing
2253 absolute symlinks to be stored and retrieved. This also has the effect of
2254 making symlinks unusable while they're in the daemon's hierarchy. See the
2255 daemon's `munge symlinks` parameter for details.
2256
2257 - Starting up an extra copy of an rsync daemon will not clobber the pidfile
2258 for the running daemon -- if the pidfile exists, the new daemon will exit
2259 with an error. This means that your wrapper script that starts the rsync
2260 daemon should be made to handle lock-breaking (if you want any automatic
2261 breaking of locks to be done).
2262
2263### BUG FIXES:
2264
2265 - A daemon with `use chroot = no` and excluded items listed in the daemon
2266 config file now properly checks an absolute-path arg specified for these
2267 options: `--compare-dest`, `--link-dest`, `--copy-dest`, `--partial-dir`,
2268 `--backup-dir`, `--temp-dir`, and `--files-from`.
2269
2270 - A daemon can now be told to disable all user- and group-name translation on
2271 a per-module basis. This avoids a potential problem with a writable daemon
2272 module that has `use chroot` enabled -- if precautions weren't taken, a user
2273 could try to add a missing library and get rsync to use it. This makes rsync
f43412f1 2274 safer by default, and more configurable when id-translation is not desired.
87bca719
WD
2275 See the daemon's `numeric ids` parameter for full details.
2276
2277 - A chroot daemon can now indicate which part of its path should affect the
2278 chroot call, and which part should become an inside-chroot path for the
2279 module. This allows you to have outside-the-transfer paths (such as for
2280 libraries) even when you enable chroot protection. The idiom used in the
2281 rsyncd.conf file is: `path = /chroot/dirs/./dirs/inside`
2282
2283 - If a file's data arrived successfully on the receiving side but the rename
2284 of the temporary file to the destination file failed AND the
2285 `--remove-source-files` (or the deprecated `--remove-sent-files`) option was
2286 specified, rsync no longer erroneously removes the associated source file.
2287
2288 - Fixed the output of `-ii` when combined with one of the `--*-dest` options:
2289 it now itemizes all the items, not just the changed ones.
2290
2291 - Made the output of all file types consistent when using a `--*-dest` option.
2292 Prior versions would output too many creation events for matching items.
2293
2294 - The code that waits for a child pid now handles being interrupted by a
2295 signal. This fixes a problem with the pre-xfer exec function not being able
2296 to get the exit status from the script.
2297
2298 - A negated filter rule (i.e. with a '!' modifier) no longer loses the
2299 negation when sending the filter rules to the remote rsync.
2300
2301 - Fixed a problem with the `--out-format` (aka `--log-format`) option %f: it
2302 no longer outputs superfluous directory info for a non-daemon rsync.
2303
2304 - Fixed a problem with `-vv` (double `--verbose`) and `--stats` when `pushing`
2305 files (which includes local copies). Version 2.6.9 would complete the copy,
2306 but exit with an error when the receiver output its memory stats.
2307
2308 - If `--password-file` is used on a non-daemon transfer, rsync now complains
2309 and exits. This should help users figure out that they can't use this option
2310 to control a remote shell's password prompt.
2311
2312 - Make sure that directory permissions of a newly-created destination
2313 directory are handled right when `--perms` is left off.
2314
2315 - The itemized output of a newly-created destination directory is now output
2316 as a creation event, not a change event.
2317
2318 - Improved `--hard-link` so that more corner cases are handled correctly when
2319 combined with options such as `--link-dest` and/or `--ignore-existing`.
2320
2321 - The `--append` option no longer updates a file that has the same size.
2322
2323 - Fixed a bug when combining `--backup` and `--backup-dir` with `--inplace`:
2324 any missing backup directories are now created.
2325
2326 - Fixed a bug when using `--backup` and `--inplace` with `--whole-file` or
2327 `--read-batch`: backup files are actually created now.
2328
2329 - The daemon pidfile is checked and created sooner in the startup sequence.
2330
2331 - If a daemon module's `path` value is not an absolute pathname, the code now
2332 makes it absolute internally (making it work properly).
2333
2334 - Ensure that a temporary file always has owner-write permission while we are
2335 writing to it. This avoids problems with some network filesystems when
2336 transferring read-only files.
2337
2338 - Any errors output about password-file reading no longer cause an error at
2339 the end of the run about a partial transfer.
2340
2341 - The `--read-batch` option for protocol 30 now ensures that several more
2342 options are set correctly for the current batch file: `--iconv`, `--acls`,
2343 `--xattrs`, `--inplace`, `--append`, and `--append-verify`.
2344
2345 - Using `--only-write-batch` to a daemon receiver now works properly (older
2346 versions would update some files while writing the batch).
2347
2348 - Avoid outputting a "file has vanished" message when the file is a broken
2349 symlink and `--copy-unsafe-links` or `--copy-dirlinks` is used (the code
2350 already handled this for `--copy-links`).
2351
2352 - Fixed the combination of `--only-write-batch` and `--dry-run`.
2353
2354 - Fixed rsync's ability to remove files that are not writable by the file's
2355 owner when rsync is running as the same user.
2356
2357 - When transferring large files, the sender's hashtable of checksums is kept
2358 at a more reasonable state of fullness (no more than 80% full) so that the
2359 scanning of the hashtable will not bog down as the number of blocks
2360 increases.
2361
2362### ENHANCEMENTS:
2363
2364 - A new incremental-recursion algorithm is now used when rsync is talking to
2365 another 3.x version. This starts the transfer going more quickly (before all
2366 the files have been found), and requires much less memory. See the
2367 `--recursive` option in the manpage for some restrictions.
2368
2369 - Lowered memory use in the non-incremental-recursion algorithm for typical
2370 option values (usually saving from 21-29 bytes per file).
2371
2372 - The default `--delete` algorithm is now `--delete-during` when talking to a
2373 3.x rsync. This is a faster scan than using `--delete-before` (which is the
2374 default when talking to older rsync versions), and is compatible with the
2375 new incremental recursion mode.
2376
2377 - Rsync now allows multiple remote-source args to be specified rather than
2378 having to rely on a special space-splitting side-effect of the remote-
2379 shell. Additional remote args must specify the same host or an empty one
2380 (e.g. empty: `:file1` or `::module/file2`). For example, this means that
2381 local use of brace expansion now works: `rsync -av host:dir/{f1,f2} .`
2382
2383 - Added the `--protect-args` (`-s`) option, that tells rsync to send most of
2384 the command-line args at the start of the transfer rather than as args to
2385 the remote-shell command. This protects them from space-splitting, and only
2386 interprets basic wildcard special shell characters (`*?[`).
2387
2388 - Added the `--delete-delay` option, which is a more efficient way to delete
2389 files at the end of the transfer without needing a separate delete pass.
2390
2391 - Added the `--acls` (`-A`) option to preserve Access Control Lists. This is
2392 an improved version of the prior patch that was available, and it even
2393 supports OS X ACLs. If you need to have backward compatibility with old,
2394 ACL-patched versions of rsync, apply the acls.diff file from the patches
2395 dir.
2396
2397 - Added the `--xattrs` (`-X`) option to preserve extended attributes. This is
2398 an improved version of the prior patch that was available, and it even
2399 supports OS X xattrs (which includes their resource fork data). If you need
2400 to have backward compatibility with old, xattr-patched versions of rsync,
2401 apply the xattrs.diff file from the patches dir.
2402
2403 - Added the `--fake-super` option that allows a non-super user to preserve all
2404 attributes of a file by using a special extended-attribute idiom. It even
2405 supports the storing of foreign ACL data on your backup server. There is
2406 also an analogous `fake super` parameter for an rsync daemon.
2407
2408 - Added the `--iconv` option, which allows rsync to convert filenames from one
2409 character-set to another during the transfer. The default is to make this
2410 feature available as long as your system has `iconv_open()`. If compilation
2411 fails, specify `--disable-iconv` to configure, and then rebuild. If you want
2412 rsync to perform character-set conversions by default, you can specify
2413 `--enable-iconv=CONVERT_STRING` with the default value for the `--iconv`
2414 option that you wish to use. For example, `--enable-iconv=.` is a good
2415 choice. See the rsync manpage for an explanation of the `--iconv` option's
2416 settings.
2417
2418 - A new daemon config parameter, `charset`, lets you control the character-
2419 set that is used during an `--iconv` transfer to/from a daemon module. You
2420 can also set your daemon to refuse `no-iconv` if you want to force the
2421 client to use an `--iconv` transfer (requiring an rsync 3.x client).
2422
2423 - Added the `--skip-compress=LIST` option to override the default list of file
2424 suffixes that will not be compressed when using `--compress` (`-z`).
2425
2426 - The daemon's default for `dont compress` was extended to include: `*.7z`
2427 `*.mp[34]` `*.mov` `*.avi` `*.ogg` `*.jpg` `*.jpeg` and the name-matching routine was also
2428 optimized to run more quickly.
2429
2430 - The `--max-delete` option now outputs a warning if it skipped any file
2431 deletions, including a count of how many deletions were skipped. (Older
2432 versions just silently stopped deleting things.)
2433
2434 - You may specify `--max-delete=0` to a 3.0.0 client to request that it warn
2435 about extraneous files without deleting anything. If you're not sure what
2436 version the client is, you can use the less-obvious `--max-delete=-1`, as
2437 both old and new versions will treat that as the same request (though older
2438 versions don't warn).
2439
2440 - The `--hard-link` option now uses less memory on both the sending and
2441 receiving side for all protocol versions. For protocol 30, the use of a
2442 hashtable on the sending side allows us to more efficiently convey to the
2443 receiver what files are linked together. This reduces the amount of data
2444 sent over the socket by a considerable margin (rather than adding more
2445 data), and limits the in-memory storage of the device+inode information to
2446 just the sending side for the new protocol 30, or to the receiving side when
2447 speaking an older protocol (note that older rsync versions kept the
2448 device+inode information on both sides).
2449
2450 - The filter rules now support a perishable (`p`) modifier that marks rules
2451 that should not have an effect in a directory that is being deleted. e.g.
2452 `-f '-p .svn/'` would only affect `live` .svn directories.
2453
2454 - Rsync checks all the alternate-destination args for validity (e.g.
2455 `--link-dest`). This lets the user know when they specified a directory that
2456 does not exist.
2457
2458 - If we get an ENOSYS error setting the time on a symlink, we don't complain
2459 about it anymore (for those systems that even support the setting of the
2460 modify-time on a symlink).
2461
2462 - Protocol 30 now uses MD5 checksums instead of MD4.
2463
2464 - Changed the `--append` option to not checksum the existing data in the
2465 destination file, which speeds up file appending.
2466
2467 - Added the `--append-verify` option, which works like the older `--append`
2468 option (verifying the existing data in the destination file). For
2469 compatibility with older rsync versions, any use of `--append` that is
2470 talking protocol 29 or older will revert to the `--append-verify` method.
2471
2472 - Added the `--contimeout=SECONDS` option that lets the user specify a
2473 connection timeout for rsync daemon access.
2474
2475 - Documented and extended the support for the `RSYNC_CONNECT_PROG` variable
2476 that can be used to enhance the client side of a daemon connection.
2477
2478 - Improved the dashes and double-quotes in the nroff manpage output.
2479
2480 - Rsync now supports a lot more `--no-OPTION` override options.
2481
2482### INTERNAL:
2483
f43412f1 2484 - The file-list sorting algorithm now uses a sort that keeps any same-named
87bca719
WD
2485 items in the same order as they were specified. This allows rsync to always
2486 ensure that the first of the duplicates is the one that will be included in
2487 the copy. The new sort is also faster than the glibc version of qsort() and
2488 mergesort().
2489
2490 - Rsync now supports the transfer of 64-bit timestamps (`time_t` values).
2491
2492 - Made the file-deletion code use a little less stack when recursing through a
2493 directory hierarchy of extraneous files.
2494
2495 - Fixed a build problem with older (2.x) versions of gcc.
2496
2497 - Added some isType() functions that make dealing with signed characters
2498 easier without forcing variables via casts.
2499
2500 - Changed strcat/strcpy/sprintf function calls to use safer versions.
2501
2502 - Upgraded the included popt version to 1.10.2 and improved its use of
2503 string-handling functions.
2504
2505 - Added missing prototypes for compatibility functions from the lib dir.
2506
2507 - Configure determines if iconv() has a const arg, allowing us to avoid a
2508 compiler warning.
2509
2510 - Made the sending of some numbers more efficient for protocol 30.
2511
2512 - Make sure that a daemon process doesn't mind if the client was weird and
2513 omitted the `--server` option.
2514
2515 - There are more internal logging categories available in protocol 30 than the
2516 age-old FINFO and FERROR, including `FERROR_XFER` and FWARN. These new
2517 categories allow some errors and warnings to go to stderr without causing an
2518 erroneous end-of-run warning about some files not being able to be
2519 transferred.
2520
2521 - Improved the use of `const` on pointers.
2522
2523 - Improved J.W.'s `pool_alloc` routines to add a way of incrementally freeing
2524 older sections of a pool's memory.
2525
2526 - The getaddrinfo.c compatibility code in the `lib` dir was replaced with some
2527 new code (derived from samba, derived from PostgreSQL) that has a better
2528 license than the old code.
2529
2530### DEVELOPER RELATED:
2531
2532 - Rsync is now licensed under the GPLv3 or later.
2533
2534 - Rsync is now being maintained in a `git` repository instead of CVS (though
2535 the old CVS repository still exists for historical access). Several
2536 maintenance scripts were updated to work with git.
2537
2538 - Generated files are no longer committed into the source repository. The
2539 autoconf and autoheader commands are now automatically run during the normal
2540 use of `configure` and `make`. The latest dev versions of all generated
2541 files can also be copied from the samba.org web site (see the prepare-source
2542 script's fetch option).
2543
2544 - The `patches` directory of diff files is now built from branches in the
2545 rsync git repository (branch patch/FOO creates file patches/FOO.diff). This
2546 directory is now distributed in a separate separate tar file named
2547 rsync-patches-VERSION.tar.gz instead of the main rsync-VERSION.tar.gz.
2548
2549 - The proto.h file is now built using a simple perl script rather than a
2550 complex awk script, which proved to be more widely compatible.
2551
2552 - When running the tests, we now put our per-test temp dirs into a sub-
2553 directory named testtmp (which is created, if missing). This allows someone
2554 to symlink the testtmp directory to another filesystem (which is useful if
2555 the build dir's filesystem does not support ACLs and xattrs, but another
2556 filesystem does).
2557
2558 - Rsync now has a way of handling protocol-version changes during the
2559 development of a new protocol version. This causes any out-of-sync versions
2560 to speak an older protocol rather than fail in a cryptic manner. This
2561 addition makes it safer to deploy a pre-release version that may interact
2562 with the public. This new exchange of sub-version info does not interfere
2563 with the `{MIN,MAX}_PROTOCOL_VERSION` checking algorithm (which does not
2564 have enough range to allow the main protocol number to be incremented for
2565 every minor tweak in that happens during development).
2566
2567 - The csprotocol.txt file was updated to mention the daemon protocol change in
2568 the 3.0.0 release.
2569
2570------------------------------------------------------------------------------
87bca719
WD
2571
2572# NEWS for rsync 2.6.9 (6 Nov 2006)
2573
d640d78f 2574## Changes in this version:
87bca719
WD
2575
2576### BUG FIXES:
2577
2578 - If rsync is interrupted via a handled signal (such as SIGINT), it will once
2579 again clean-up its temp file from the destination dir.
2580
2581 - Fixed an overzealous sanitizing bug in the handling of the `--link-dest`,
2582 `--copy-dest`, and `--compare-dest` options to a daemon without chroot: if
2583 the copy's destination dir is deeper than the top of the module's path,
2584 these options now accept a safe number of parent-dir (../) references (since
2585 these options are relative to the destination dir). The old code incorrectly
2586 chopped off all `../` prefixes for these options, no matter how deep the
2587 destination directory was in the module's hierarchy.
2588
2589 - Fixed a bug where a deferred info/error/log message could get sent directly
2590 to the sender instead of being handled by rwrite() in the generator. This
2591 fixes an `unexpected tag 3` fatal error, and should also fix a potential
2592 problem where a deferred info/error message from the receiver might bypass
2593 the log file and get sent only to the client process. (These problems could
2594 only affect an rsync daemon that was receiving files.)
2595
2596 - Fixed a bug when `--inplace` was combined with a `--*-dest` option and we
2597 update a file's data using an alternate basis file. The code now notices
2598 that it needs to copy the matching data from the basis file instead of
2599 (wrongly) assuming that it was already present in the file.
2600
2601 - Fixed a bug where using `--dry-run` with a `--*-dest` option with a path
2602 relative to a directory that does not yet exist: the affected option gets
2603 its proper path value so that the output of the dry-run is right.
2604
2605 - Fixed a bug in the %f logfile escape when receiving files: the destination
2606 path is now included in the output (e.g. you can now tell when a user
2607 specifies a subdir inside a module).
2608
2609 - If the receiving side fails to create a directory, it will now skip trying
2610 to update everything that is inside that directory.
2611
2612 - If `--link-dest` is specified with `--checksum` but without `--times`, rsync
2613 will now allow a hard-link to be created to a matching link-dest file even
2614 when the file's modify-time doesn't match the server's file.
2615
2616 - The daemon now calls more timezone-using functions prior to doing a chroot.
2617 This should help some C libraries to generate proper timestamps from inside
2618 a chrooted daemon (and to not try to access /etc/timezone over and over
2619 again).
2620
2621 - Fixed a bug in the handling of an absolute `--partial-dir=ABS_PATH` option:
2622 it now deletes an alternate basis file from the partial-dir that was used to
2623 successfully update a destination file.
2624
2625 - Fixed a bug in the handling of `--delete-excluded` when using a per-dir
2626 merge file: the merge file is now honored on the receiving side, and only
2627 its unqualified include/exclude commands are ignored (just as is done for
2628 global include/excludes).
2629
2630 - Fixed a recent bug where `--delete` was not working when transferring from
2631 the root (/) of the filesystem with `--relative` enabled.
2632
2633 - Fixed a recent bug where an `--exclude='*'` could affect the root (/) of the
2634 filesystem with `--relative` enabled.
2635
2636 - When `--inplace` creates a file, it is now created with owner read/write
2637 permissions (0600) instead of no permissions at all. This avoids a problem
2638 continuing a transfer that was interrupted (since `--inplace` will not
2639 update a file that has no write permissions).
2640
2641 - If either `--remove-source-files` or `--remove-sent-files` is enabled and we
2642 are unable to remove the source file, rsync now outputs an error.
2643
2644 - Fixed a bug in the daemon's `incoming chmod` rule: newly-created directories
2645 no longer get the 'F' (file) rules applied to them.
2646
2647 - Fixed an infinite loop bug when a filter rule was rejected due to being
2648 overly long.
2649
2650 - When the server receives a `--partial-dir` option from the client, it no
2651 longer runs the client-side code that adds an assumed filter rule (since the
2652 client will be sending us the rules in the usual manner, and they may have
2653 chosen to override the auto-added rule).
2654
2655### ENHANCEMENTS:
2656
2657 - Added the `--log-file=FILE` and `--log-file-format=FORMAT` options. These
2658 can be used to tell any rsync to output what it is doing to a log file.
96ed4b47 2659 They work with a client rsync, a non-daemon server rsync (see the manpage
87bca719
WD
2660 for instructions), and also allows the overriding of rsyncd.conf settings
2661 when starting a daemon.
2662
2663 - The `--log-format` option was renamed to be `--out-format` to avoid
2664 confusing it with affecting the log-file output. (The old option remains as
2665 an alias for the new to preserve backward compatibility.)
2666
2667 - Made `log file` and `syslog facility` settable on a per-module basis in the
2668 daemon's config file.
2669
2670 - Added the `--remove-source-files` option as a replacement for the (now
2671 deprecated) `--remove-sent-files` option. This new option removes all
2672 non-dirs from the source directories, even if the file was already
2673 up-to-date. This fixes a problem where interrupting an rsync that was using
2674 `--remove-sent-files` and restarting it could leave behind a file that the
2675 earlier rsync synchronized, but didn't get to remove. (The deprecated
2676 `--remove-sent-files` is still understood for now, and still behaves in the
2677 same way as before.)
2678
2679 - Added the option `--no-motd` to suppress the message-of-the-day output from
2680 a daemon when doing a copy. (See the manpage for a caveat.)
2681
2682 - Added a new environment variable to the pre-/post-xfer exec commands (in the
2683 daemon's config file): `RSYNC_PID`. This value will be the same in both the
2684 pre- and post-xfer commands, so it can be used as a unique ID if the
2685 pre-xfer command wants to cache some arg/request info for the post-xfer
2686 command.
2687
2688### INTERNAL:
2689
2690 - Did a code audit using IBM's code-checker program and made several changes,
2691 including: replacing most of the strcpy() and sprintf() calls with
2692 strlcpy(), snprintf(), and memcpy(), adding a 0-value to an enum that had
2693 been intermingling a literal 0 with the defined enum values, silencing some
2694 uninitialized memory checks, marking some functions with a `noreturn`
2695 attribute, and changing an `if` that could never succeed on some platforms
2696 into a pre-processor directive that conditionally compiles the code.
2697
2698 - Fixed a potential bug in `f_name_cmp()` when both the args are a top-level
2699 `.` dir (which doesn't happen in normal operations).
2700
2701 - Changed `exit_cleanup()` so that it can never return instead of exit. The
2702 old code might return if it found the `exit_cleanup()` function was being
2703 called recursively. The new code is segmented so that any recursive calls
2704 move on to the next step of the exit-processing.
2705
2706 - The macro WIFEXITED(stat) will now be defined if the OS didn't already
2707 define it.
2708
2709### DEVELOPER RELATED:
2710
2711 - The acls.diff and xattrs.diff patches have received a bunch of work to make
2712 them much closer to being acceptable in the main distribution. The xattrs
2713 patch also has some preliminary Mac OS X and FreeBSD compatibility code that
2714 various system types to exchange extended file-attributes.
2715
2716 - A new diff in the patches dir, fake-root.diff, allows rsync to maintain a
2717 backup hierarchy with full owner, group, and device info without actually
2718 running as root. It does this using a special extended attribute, so it
2719 depends on xattrs.diff (which depends on acls.diff).
2720
2721 - The rsync.yo and rsyncd.conf.yo files have been updated to work better with
2722 the latest yodl 2.x releases.
2723
2724 - Updated config.guess and config.sub to their 2006-07-02 versions.
2725
2726 - Updated various files to include the latest FSF address and to have
2727 consistent opening comments.
2728
2729------------------------------------------------------------------------------
87bca719
WD
2730
2731# NEWS for rsync 2.6.8 (22 Apr 2006)
2732
d640d78f 2733## Changes in this version:
87bca719
WD
2734
2735### BUG FIXES:
2736
2737 - Fixed a bug in the exclude code where an anchored exclude without any
2738 wildcards fails to match an absolute source arg, but only when `--relative`
2739 is in effect.
2740
2741 - Improved the I/O code for the generator to fix a potential hang when the
2742 receiver gets an EOF on the socket but the generator's select() call never
2743 indicates that the socket is writable for it to be notified about the EOF.
2744 (This can happen when using stunnel).
2745
2746 - Fixed a problem with the file-reading code where a failed read (such as that
2747 caused by a bad sector) would not advance the file's read-position beyond
2748 the failed read's data.
2749
2750 - Fixed a logging bug where the `log file` directive was not being honored in
2751 a single-use daemon (one spawned by a remote-shell connection or by init).
2752
2753 - If rsync cannot honor the `--delete` option, we output an error and exit
2754 instead of silently ignoring the option.
2755
2756 - Fixed a bug in the `--link-dest` code that prevented special files (such as
2757 fifos) from being linked.
2758
2759 - The ability to hard-link symlinks and special files is now determined at
2760 configure time instead of at runtime. This fixes a bug with `--link-dest`
2761 creating a hard-link to a symlink's referent on a BSD system.
2762
2763### ENHANCEMENTS:
2764
2765 - In daemon mode, if rsync fails to bind to the requested port, the error(s)
2766 returned by socket() and/or bind() are now logged.
2767
2768 - When we output a fatal error, we now output the version of rsync in the
2769 message.
2770
2771 - Improved the documentation for the `--owner` and `--group` options.
2772
2773 - The rsyncstats script in `support` has an improved line-parsing regex that
2774 is easier to read and also makes it to parse syslog-generated lines.
2775
2776 - A new script in `support`: file-attr-restore, can be used to restore the
2777 attributes of a file-set (the permissions, ownership, and group info) taken
2778 from the cached output of a `find ARG... -ls` command.
2779
2780### DEVELOPER RELATED:
2781
2782 - Removed the unused function `write_int_named()`, the unused variable
2783 `io_read_phase`, and the rarely used variable `io_write_phase`. This also
2784 elides the confusing 'phase "unknown"' part of one error message.
2785
2786 - Removed two unused configure checks and two related (also unused)
2787 compatibility functions.
2788
2789 - The xattrs.diff patch received a security fix that prevents a potential
2790 buffer overflow in the `receive_xattr()` code.
2791
2792 - The acls.diff patch has been improved quite a bit, with more to come.
2793
2794 - A new patch was added: log-file.diff. This contains an early version of a
2795 future option, `--log-file=FILE`, that will allow any rsync to log its
2796 actions to a file (something that only a daemon supports at present).
2797
2798------------------------------------------------------------------------------
87bca719
WD
2799
2800# NEWS for rsync 2.6.7 (11 Mar 2006)
2801
d640d78f 2802## Changes in this version:
87bca719
WD
2803
2804### OUTPUT CHANGES:
2805
2806 - The letter 'D' in the itemized output was being used for both devices
2807 (character or block) as well as other special files (such as fifos and named
2808 sockets). This has changed to separate non-device special files under the
2809 'S' designation (e.g. `cS+++++++ path/fifo`). See also the `--specials`
2810 option, below.
2811
2812 - The way rsync escapes unreadable characters has changed. First, rsync now
1b9308b7 2813 has support for recognizing valid multi-byte character sequences in your
87bca719
WD
2814 current locale, allowing it to escape fewer characters than before for a
2815 locale such as UTF-8. Second, it now uses an escape idiom of `\#123`, which
2816 is the literal string `\#` followed by exactly 3 octal digits. Rsync no
2817 longer doubles a backslash character in a filename (e.g. it used to output
2818 `foo\\bar` when copying `foo\bar`) -- now it only escapes a backslash that
2819 is followed by a hash-sign and 3 digits (0-9) (e.g. it will output
2820 `foo\#134#789` when copying `foo\#789`). See also the `--8-bit-output`
2821 (`-8`) option, mentioned below.
2822
2823 Script writers: the local rsync is the one that outputs escaped names, so if
2824 you need to support unescaping of filenames for older rsyncs, I'd suggest
2825 that you parse the output of `rsync --version` and only use the old
2826 unescaping rules for 2.6.5 and 2.6.6.
2827
2828### BUG FIXES:
2829
2830 - Fixed a really old bug that caused `--checksum` (`-c`) to checksum all the
2831 files encountered during the delete scan (ouch).
2832
2833 - Fixed a potential hang in a remote generator: when the receiver gets a
2834 read-error on the socket, it now signals the generator about this so that
2835 the generator does not try to send any of the terminating error messages to
2836 the client (avoiding a potential hang in some setups).
2837
2838 - Made hard-links work with symlinks and devices again.
2839
2840 - If the sender gets an early EOF reading a source file, we propagate this
2841 error to the receiver so that it can discard the file and try requesting it
2842 again (which is the existing behavior for other kinds of read errors).
2843
2844 - If a device-file/special-file changes permissions, rsync now updates the
2845 permissions without recreating the file.
2846
2847 - If the user specifies a remote-host for both the source and destination, we
2848 now output a syntax error rather than trying to open the destination
2849 hostspec as a filename.
2850
2851 - When `--inplace` creates a new destination file, rsync now creates it with
2852 permissions 0600 instead of 0000 -- this makes restarting possible when the
2853 transfer gets interrupted in the middle of sending a new file.
2854
2855 - Reject the combination of `--inplace` and `--sparse` since the sparse-output
2856 algorithm doesn't work when overwriting existing data.
2857
2858 - Fixed the directory name in the error that is output when `pop_dir()` fails.
2859
2860 - Really fixed the parsing of a `!` entry in .cvsignore files this time.
2861
2862 - If the generator gets a stat() error on a file, output it (this used to
2863 require at least `-vv` for the error to be seen).
2864
2865 - If waitpid() fails or the child rsync didn't exit cleanly, we now handle the
2866 exit status properly and generate a better error.
2867
2868 - Fixed some glitches in the double-verbose output when using `--copy-dest`,
2869 `--link-dest`, or `--compare-dest`. Also improved how the verbose output
2870 handles hard-links (within the transfer) that had an up-to-date alternate
2871 `dest` file, and copied files (via `--copy-dest`).
2872
2873 - Fixed the matching of the dont-compress items (e.g. `*.gz`) against files
2874 that have a path component containing a slash.
2875
2876 - If the code reading a filter/exclude file gets an EINTR error, rsync now
2877 clears the error flag on the file handle so it can keep on reading.
2878
2879 - If `--relative` is active, the sending side cleans up trailing `/` or `/.`
2880 suffixes to avoid triggering a bug in older rsync versions. Also, we now
2881 reject a `..` dir if it would be sent as a relative dir.
2882
2883 - If a non-directory is in the way of a directory and rsync is run with
2884 `--dry-run` and `--delete`, rsync no longer complains about not being able
2885 to opendir() the not-yet present directory.
2886
2887 - When `--list-only` is used and a non-existent local destination dir was also
2888 specified as a destination, rsync no longer generates a warning about being
2889 unable to create the missing directory.
2890
2891 - Fixed some problems with `--relative --no-implied-dirs` when the destination
2892 directory did not yet exist: we can now create a symlink or device when it
2893 is the first thing in the missing dir, and `--fuzzy` no longer complains
2894 about being unable to open the missing dir.
2895
2896 - Fixed a bug where the `--copy-links` option would not affect implied
2897 directories without `--copy-unsafe-links` (see `--relative`).
2898
2899 - Got rid of the need for `--force` to be used in some circumstances with
2900 `--delete-after` (making it consistent with
2901 `--delete-before`/`--delete-during`).
2902
2903 - Rsync now ignores the SIGXFSZ signal, just in case your OS sends this when a
2904 file is too large (rsync handles the write error).
2905
2906 - Fixed a bug in the Proxy-Authorization header's base64-encoded value: it was
2907 not properly padded with trailing '=' chars. This only affects a user that
2908 need to use a password-authenticated proxy for an outgoing daemon-rsync
2909 connection.
2910
2911 - If we're transferring an empty directory to a new name, rsync no longer
2912 forces `S_IWUSR` if it wasn't already set, nor does it accidentally leave it
2913 set.
2914
2915 - Fixed a bug in the debug output (`-vvvvv`) that could mention the wrong
2916 checksum for the current file offset.
2917
f43412f1 2918 - Rsync no longer allows a single directory to be copied over a non-directory
87bca719
WD
2919 destination arg.
2920
2921### ENHANCEMENTS:
2922
2923 - Added the `--append` option that makes rsync append data onto files that are
2924 longer on the source than the destination (this includes new files).
2925
2926 - Added the `--min-size=SIZE` option to exclude small files from the transfer.
2927
2928 - Added the `--compress-level` option to allow you to set how aggressive
2929 rsync's compression should be (this option implies `--compress`).
2930
2931 - Enhanced the parsing of the SIZE value for `--min-size` and `--max-size` to
2932 allow easy entry of multiples of 1000 (instead of just multiples of 1024)
2933 and off-by-one values too (e.g. `--max-size=8mb-1`).
2934
2935 - Added the `--8-bit-output` (`-8`) option, which tells rsync to avoid
2936 escaping high-bit characters that it thinks are unreadable in the current
2937 locale.
2938
2939 - The new option `--human-readable` (`-h`) changes the output of `--progress`,
2940 `--stats`, and the end-of-run summary to be easier to read. If repeated, the
2941 units become powers of 1024 instead of powers of 1000. (The old meaning of
2942 `-h`, as a shorthand for `--help`, still works as long as you just use it on
2943 its own, as in `rsync -h`.)
2944
2945 - If lutimes() and/or lchmod() are around, use them to allow the preservation
2946 of attributes on symlinks.
2947
2948 - The `--link-dest` option now affects symlinks and devices (when possible).
2949
2950 - Added two config items to the rsyncd.conf parsing: `pre-xfer exec` and
2951 `post-xfer exec`. These allow a command to be specified on a per-module
2952 basis that will be run before and/or after a daemon-mode transfer. (See the
96ed4b47 2953 manpage for a list of the environment variables that are set with
87bca719
WD
2954 information about the transfer.)
2955
2956 - When using the `--relative` option, you can now insert a dot dir in the
2957 source path to indicate where the replication of the source dirs should
2958 start. For example, if you specify a source path of
2959 rsync://host/module/foo/bar/./baz/dir with `-R`, rsync will now only
2960 replicate the `baz/dir` part of the source path (note: a trailing dot dir is
2961 unaffected unless it also has a trailing slash).
2962
2963 - Added some new `--no-FOO` options that make it easier to override unwanted
2964 implied or default options. For example, `-a --no-o` (aka `--archive
2965 --no-owner`) can be used to turn off the preservation of file ownership that
2966 is implied by `-a`.
2967
2968 - Added the `--chmod=MODE` option that allows the destination permissions to
2969 be changed from the source permissions. E.g. `--chmod=g+w,o-rwx`
2970
2971 - Added the `incoming chmod` and `outgoing chmod` daemon options that allow a
2972 module to specify what permissions changes should be applied to all files
2973 copied to and from the daemon.
2974
2975 - Allow the `--temp-dir` option to be specified when starting a daemon, which
2976 sets the default temporary directory for incoming files.
2977
2978 - If `--delete` is combined with `--dirs` without `--recursive`, rsync will
2979 now delete in any directory whose content is being synchronized.
2980
2981 - If `--backup` is combined with `--delete` without `--backup-dir` (and
2982 without `--delete-excluded`), we add a `protect` filter-rule to ensure that
2983 files with the backup suffix are not deleted.
2984
2985 - The file-count stats that are output by `--progress` were improved to better
2986 indicate what the numbers mean. For instance, the output: `(xfer#5,
2987 to-check=8383/9999)` indicates that this was the fifth file to be
2988 transferred, and we still need to check 8383 more files out of a total of
2989 9999.
2990
2991 - The include/exclude code now allows a `dir/***` directive (with 3 trailing
2992 stars) to match both the dir itself as well as all the content below the dir
2993 (`dir/**` would not match the dir).
2994
2995 - Added the `--prune-empty-dirs` (`-m`) option that makes the receiving rsync
2996 discard empty chains of directories from the file-list. This makes it easier
2997 to selectively copy files from a source hierarchy and end up with just the
2998 directories needed to hold the resulting files.
2999
3000 - If the `--itemize-changes` (`-i`) option is repeated, rsync now includes
3001 unchanged files in the itemized output (similar to `-vv`, but without all
3002 the other verbose messages that can get in the way). Of course, the client
3003 must be version 2.6.7 for this to work, but the remote rsync only needs to
3004 be 2.6.7 if you're pushing files.
3005
3006 - Added the `--specials` option to tell rsync to copy non-device special files
3007 (which rsync now attempts even as a normal user). The `--devices` option now
3008 requests the copying of just devices (character and block). The `-D` option
3009 still requests both (e.g. `--devices` and `--specials`), `-a` still implies
3010 `-D`, and non-root users still get a silent downgrade that omits device
3011 copying.
3012
3013 - Added the `--super` option to make the receiver always attempt super-user
3014 activities. This is useful for systems that allow things such as devices to
3015 be created or ownership to be set without being UID 0, and is also useful
3016 for someone who wants to ensure that errors will be output if the receiving
3017 rsync isn't being run as root.
3018
3019 - Added the `--sockopts` option for those few who want to customize the TCP
3020 options used to contact a daemon rsync.
3021
3022 - Added a way for the `--temp-dir` option to be combined with a partial-dir
3023 setting that lets rsync avoid non-atomic updates (for those times when
3024 `--temp-dir` is not being used because space is tight).
3025
3026 - A new support script, files-to-excludes, will transform a list of files into
3027 a set of include/exclude directives that will copy those files.
3028
3029 - A new option, `--executability` (`-E`) can be used to preserve just the
3030 execute bit on files, for those times when using the `--perms` option is not
3031 desired.
3032
3033 - The daemon now logs each connection and also each module-list request that
3034 it receives.
3035
3036 - New log-format options: %M (modtime), %U (uid), %G (gid), and %B (permission
3037 bits, e.g. `rwxr-xrwt`).
3038
3039 - The `--dry-run` option no longer forces the enabling of `--verbose`.
3040
3041 - The `--remove-sent-files` option now does a better job of incrementally
3042 removing the sent files on the sending side (older versions tended to clump
3043 up all the removals at the end).
3044
3045 - A daemon now supersedes its minimal SIGCHLD handler with the standard
3046 PID-remembering version after forking. This ensures that the generator can
3047 get the child-exit status from the receiver.
3048
3049 - Use of the `--bwlimit` option no longer interferes with the remote rsync
3050 sending error messages about invalid/refused options.
3051
3052 - Rsync no longer returns a usage error when used with one local source arg
3053 and no destination: this now implies the `--list-only` option, just like the
3054 comparable situation with a remote source arg.
3055
3056 - Added the `--copy-dirlinks` option, a more limited version of
3057 `--copy-links`.
3058
3059 - Various documentation improvements, including: a better synopsis, some
3060 improved examples, a better discussion of the presence and absence of
3061 `--perms` (including how it interacts with the new `--executability` and
3062 `--chmod` options), an extended discussion of `--temp-dir`, an improved
3063 discussion of `--partial-dir`, a better description of rsync's pattern
3064 matching characters, an improved `--no-implied-dirs` section, and the
3065 documenting of what the `--stats` option outputs.
3066
3067 - Various new and updated diffs in the patches dir, including: acls.diff,
3068 xattrs.diff, atimes.diff, detect-renamed.diff, and slp.diff.
3069
3070### INTERNAL:
3071
3072 - We now use sigaction() and sigprocmask() if possible, and fall back on
3073 signal() if not. Using sigprocmask() ensures that rsync enables all the
3074 signals that it needs, just in case it was started in a masked state.
3075
3076 - Some buffer sizes were expanded a bit, particularly on systems where
f43412f1 3077 MAXPATHLEN is overly small (e.g. Cygwin).
87bca719
WD
3078
3079 - If `io_printf()` tries to format more data than fits in the buffer, exit
3080 with an error instead of transmitting a truncated buffer.
3081
3082 - If a `va_copy` macro is defined, lib/snprintf.c will use it when defining
3083 the `VA_COPY` macro.
3084
3085 - Reduced the amount of stack memory needed for each level of directory
3086 recursion by nearly MAXPATHLEN bytes.
3087
3088 - The wildmatch function was extended to allow an array of strings to be
3089 supplied as the string to match. This allows the exclude code to do less
3090 string copying.
3091
3092 - Got rid of the `safe_fname()` function (and all the myriad calls) and
3093 replaced it with a new function in the log.c code that filters all the
3094 output going to the terminal.
3095
3096 - Unified the `f_name()` and the `f_name_to()` functions.
3097
3098 - Improved the hash-table code the sender uses to handle checksums to make it
3099 use slightly less memory and run just a little faster.
3100
3101### DEVELOPER RELATED:
3102
3103 - The diffs in the patches dir now require `patch -p1 <DIFF` instead of the
3104 previous `-p0`. Also, the version included in the release tar now affect
3105 generated files (e.g. configure, rsync.1, proto.h, etc.), so it is no longer
3106 necessary to run autoconf and/or yodl unless you're applying a patch that
3107 was checked out from CVS.
3108
3109 - Several diffs in the patches dir now use the proper `--enable-FOO` configure
3110 option instead of `--with-FOO` to turn on the inclusion of the newly patched
3111 feature.
3112
3113 - There is a new script, `prepare-source` than can be used to update the
3114 various generated files (proto.h, configure, etc.) even before configure has
3115 created the Makefile (this is mainly useful when patching the source with a
3116 patch that doesn't affect generated files).
3117
3118 - The testsuite now sets HOME so that it won't be affected by a file such as
3119 ~/.popt.
3120
3121------------------------------------------------------------------------------
87bca719
WD
3122
3123# NEWS for rsync 2.6.6 (28 Jul 2005)
3124
d640d78f 3125## Changes in this version:
87bca719
WD
3126
3127### SECURITY FIXES:
3128
3129 - The zlib code was upgraded to version 1.2.3 in order to make it more secure.
3130 While the widely-publicized security problem in zlib 1.2.2 did not affect
3131 rsync, another security problem surfaced that affects rsync's zlib 1.1.4.
3132
3133### BUG FIXES:
3134
3135 - The setting of `flist->high` in `clean_flist()` was wrong for an empty list.
3136 This could cause `flist_find()` to crash in certain rare circumstances (e.g.
3137 if just the right directory setup was around when `--fuzzy` was combined
3138 with `--link-dest`).
3139
3140 - The outputting of hard-linked files when verbosity was > 1 was not right:
3141 (1) Without `-i` it would output the name of each hard-linked file as though
3142 it had been changed; it now outputs a `is hard linked` message for the file.
3143 (2) With `-i` it would output all dots for the unchanged attributes of a
3144 hard-link; it now changes those dots to spaces, as is done for other totally
3145 unchanged items.
3146
3147 - When backing up a changed symlink or device, get rid of any old backup item
3148 so that we don't get an `already exists` error.
3149
f43412f1 3150 - A couple places that were comparing a local and a remote modification-time
87bca719
WD
3151 were not honoring the `--modify-window` option.
3152
3153 - Fixed a bug where the 'p' (permissions) itemized-changes flag might get set
3154 too often (if some non-significant mode bits differed).
3155
3156 - Fixed a really old, minor bug that could cause rsync to warn about being
3157 unable to mkdir() a path that ends in `/.` because it just created the
3158 directory (required `--relative`, `--no-implied-dirs`, a source path that
3159 ended in either a trailing slash or a trailing `/.`, and a non-existing
3160 destination dir to tickle the bug in a recent version).
3161
3162### ENHANCEMENTS:
3163
3164 - Made the `max verbosity` setting in the rsyncd.conf file settable on a
3165 per-module basis (which now matches the documentation).
3166
c9832790
WD
3167 - The rrsync script has been upgraded to verify the args of options that take
3168 args (instead of rejecting any such options). It was also changed to try to
3169 be more secure and to fix a problem in the parsing of a pull operation that
3170 has multiple source args. (See the support dir.)
87bca719
WD
3171
3172 - Improved the documentation that explains the difference between a normal
3173 daemon transfer and a daemon-over remote-shell transfer.
3174
3175 - Some of the diffs supplied in the patches dir were fixed and/or improved.
3176
3177### BUILD CHANGES:
3178
3179 - Made configure define `NOBODY_USER` (currently hard-wired to `nobody`) and
3180 `NOBODY_GROUP` (set to either `nobody` or `nogroup` depending on what we
3181 find in the /etc/group file).
3182
3183 - Added a test to the test suite, itemized.test, that tests the output of `-i`
3184 (log-format w/%i) and some double-verbose messages.
3185
3186------------------------------------------------------------------------------
87bca719
WD
3187
3188# NEWS for rsync 2.6.5 (1 Jun 2005)
3189
d640d78f 3190## Changes in this version:
87bca719
WD
3191
3192### OUTPUT CHANGES:
3193
f43412f1 3194 - Non-printable chars in filenames are now output using backslash-escaped
87bca719
WD
3195 characters rather than '?'s. Any non-printable character is output using 3
3196 digits of octal (e.g. `\n` -> `\012`), and a backslash is now output as
3197 `\\`. Rsync also uses your locale setting, which can make it treat fewer
3198 high-bit characters as non-printable.
3199
3200 - If rsync received an empty file-list when pulling files, it would output a
3201 `nothing to do` message and exit with a 0 (success) exit status, even if the
3202 remote rsync returned an error (it did not do this under the same conditions
3203 when pushing files). This was changed to make the pulling behavior the same
3204 as the pushing behavior: we now do the normal end-of-run outputting
3205 (depending on options) and exit with the appropriate exit status.
3206
3207### BUG FIXES:
3208
3209 - A crash bug was fixed when a daemon had its `path` set to `/`, did not have
3210 chroot enabled, and used some anchored excludes in the rsyncd.conf file.
3211
3212 - Fixed a bug in the transfer of a single file when `-H` is specified (rsync
3213 would either infinite loop or perhaps crash).
3214
3215 - Fixed a case where the generator might try (and fail) to tweak the
3216 write-permissions of a read-only directory in list-only mode (this only
3217 caused an annoying warning message).
3218
3219 - If `--compare-dest` or `--link-dest` uses a locally-copied file as the basis
3220 for an updated version, log this better when `--verbose` or `-i` is in
3221 effect.
3222
3223 - Fixed the accidental disabling of `--backup` during the `--delete-after`
3224 processing.
3225
3226 - Restored the ability to use the `--address` option in client mode (in
3227 addition to its use in daemon mode).
3228
3229 - Make sure that some temporary progress information from the delete
3230 processing does not get left on the screen when it is followed by a newline.
3231
3232 - When `--existing` skips a directory with extra verbosity, refer to it as a
3233 `directory`, not a `file`.
3234
3235 - When transferring a single file to a different-named file, any generator
3236 messages that are source-file related no longer refer to the file by the
3237 destination filename.
3238
3239 - Fixed a bug where hard-linking a group of files might fail if the generator
3240 hasn't created a needed destination directory yet.
3241
3242 - Fixed a bug where a hard-linked group of files that is newly-linked to a
3243 file in a `--link-dest` dir doesn't link the files from the rest of the
3244 cluster.
3245
3246 - When deleting files with the `--one-file-system` (`-x`) option set, rsync no
3247 longer tries to remove files from inside a mount-point on the receiving
3248 side. Also, we don't complain about being unable to remove the mount-point
3249 dir.
3250
3251 - Fixed a compatibility problem when using `--cvs-ignore` (`-C`) and sending
3252 files to an older rsync without using `--delete`.
3253
3254 - Make sure that a `- !` or `+ !` include/exclude pattern does not trigger the
3255 list-clearing action that is reserved for `!`.
3256
3257 - Avoid a timeout in the generator when the sender/receiver aren't handling
3258 the generator's checksum output quickly enough.
3259
3260 - Fixed the omission of some directories in the delete processing when
3261 `--relative` (`-R`) was combined with a source path that had a trailing
3262 slash.
3263
3264 - Fixed a case where rsync would erroneously delete some files and then
3265 re-transfer them when the options `--relative` (`-R`) and `--recursive`
3266 (`-r`) were both enabled (along with `--delete`) and a source path had a
3267 trailing slash.
3268
3269 - Make sure that `--max-size` doesn't affect a device or a symlink.
3270
3271 - Make sure that a system with a really small MAXPATHLEN does not cause the
3272 buffers in `readfd_unbuffered()` to be too small to receive normal messages.
3273 (This mainly affected Cygwin.)
3274
3275 - If a source pathname ends with a filename of `..`, treat it as if `../` had
3276 been specified (so that we don't copy files to the parent dir of the
3277 destination).
3278
3279 - If `--delete` is combined with a file-listing rsync command (i.e. no
3280 transfer is happening), avoid outputting a warning that we couldn't delete
3281 anything.
3282
3283 - If `--stats` is specified with `--delete-after`, ensure that all the
3284 `deleting` messages are output before the statistics.
3285
3286 - Improved one `if` in the deletion code that was only checking errno for
3287 ENOTEMPTY when it should have also been checking for EEXIST (for
3288 compatibility with OS variations).
3289
3290### ENHANCEMENTS:
3291
3292 - Added the `--only-write-batch=FILE` option that may be used (instead of
3293 `--write-batch=FILE`) to create a batch file without doing any actual
3294 updating of the destination. This allows you to divert all the file-updating
3295 data away from a slow data link (as long as you are pushing the data to the
3296 remote server when creating the batch).
3297
3298 - When the generator is taking a long time to fill up its output buffer (e.g.
3299 if the transferred files are few, small, or missing), it now periodically
3300 flushes the output buffer so that the sender/receiver can get started on the
3301 files sooner rather than later.
3302
3303 - Improved the keep-alive code to handle a long silence between the sender and
3304 the receiver that can occur when the sender is receiving the checksum data
3305 for a large file.
3306
3307 - Improved the auth-errors that are logged by the daemon to include some
3308 information on why the authorization failed: wrong user, password mismatch,
3309 etc. (The client-visible message is unchanged!)
3310
3311 - Improved the client's handling of an `@ERROR` from a daemon so that it does
3312 not complain about an unexpectedly closed socket (since we really did expect
3313 the socket to close).
3314
3315 - If the daemon can't open the log-file specified in rsyncd.conf, fall back to
3316 using syslog and log an appropriate warning. This is better than what was
3317 typically a totally silent (and fatal) failure (since a daemon is not
3318 usually run with the `--no-detach` option that was necessary to see the
3319 error on stderr).
3320
96ed4b47 3321 - The manpages now consistently refer to an rsync daemon as a `daemon`
87bca719
WD
3322 instead of a `server` (to distinguish it from the server process in a
3323 non-daemon transfer).
3324
3325 - Made a small change to the rrsync script (restricted rsync -- in the support
3326 dir) to make a read-only server reject all `--remove-*` options when sending
3327 files (to future-proof it against the possibility of other similar options
3328 being added at some point).
3329
3330### INTERNAL:
3331
3332 - Rsync now calls `setlocale(LC_CTYPE, "")`. This enables isprint() to better
3333 discern which filename characters need to be escaped in messages (which
3334 should result in fewer escaped characters in some locales).
3335
3336 - Improved the naming of the log-file open/reopen/close functions.
3337
3338 - Removed some protocol-compatibility code that was only needed to help
3339 someone running a pre-release of 2.6.4.
3340
3341### BUILD CHANGES:
3342
3343 - Added configure option `--disable-locale` to disable any use of setlocale()
3344 in the binary.
3345
3346 - Fixed a bug in the `SUPPORT{,_HARD}_LINKS` #defines which prevented rsync
3347 from being built without symlink or hard-link support.
3348
3349 - Only #define `HAVE_REMSH` if it is going to be set to 1.
3350
3351 - Configure now disables the use of mkstemp() under HP-UX (since they refuse
3352 to fix its broken handling of large files).
3353
3354 - Configure now explicitly checks for the lseek64() function so that the code
3355 can use `HAVE_LSEEK64` instead of inferring lseek64()'s presence based on
3356 the presence of the `off64_t` type.
3357
3358 - Configure no longer mentions the change in the default remote-shell (from
3359 rsh to ssh) that occurred for the 2.6.0 release.
3360
3361 - Some minor enhancements to the test scripts.
3362
3363 - Added a few new `*.diff` files to the patches dir, including a patch that
3364 enables the optional copying of extended attributes.
3365
3366------------------------------------------------------------------------------
87bca719
WD
3367
3368# NEWS for rsync 2.6.4 (30 March 2005)
3369
d640d78f 3370## Changes in this version:
87bca719 3371
d640d78f
WD
3372### PROTOCOL NUMBER:
3373
3374 - The protocol number was changed to 29.
87bca719
WD
3375
3376### OUTPUT CHANGES:
3377
3378 - When rsync deletes a directory and outputs a verbose message about it, it
3379 now appends a trailing slash to the name instead of (only sometimes)
3380 outputting a preceding "directory " string.
3381
3382 - The `--stats` output will contain file-list time-statistics if both sides
3383 are 2.6.4, or if the local side is 2.6.4 and the files are being pushed
3384 (since the stats come from the sending side). (Requires protocol 29 for a
3385 pull.)
3386
3387 - The `%o` (operation) log-format escape now has a third value (besides `send`
3388 and `recv`): `del.` (with trailing dot to make it 4 chars). This changes
3389 the way deletions are logged in the daemon's log file.
3390
3391 - When the `--log-format` option is combined with `--verbose`, rsync now
3392 avoids outputting the name of the file twice in most circumstances. As long
3393 as the `--log-format` item does not refer to any post-transfer items (such
3394 as %b or %c), the `--log-format` message is output prior to the transfer, so
3395 `--verbose` is now the equivalent of a `--log-format` of '%n%L' (which
3396 outputs the name and any link info). If the log output must occur after the
3397 transfer to be complete, the only time the name is also output prior to the
3398 transfer is when `--progress` was specified (so that the name will precede
3399 the progress stats, and the full `--log-format` output will come after).
3400
3401 - Non-printable characters in filenames are replaced with a '?' to avoid
3402 corrupting the screen or generating empty lines in the output.
3403
3404### BUG FIXES:
3405
3406 - Restore the list-clearing behavior of `!` in a .cvsignore file (2.6.3 was
3407 only treating it as a special token in an rsync include/exclude file).
3408
3409 - The combination of `--verbose` and `--dry-run` now mentions the full list of
3410 changes that would be output without `--dry-run`.
3411
3412 - Avoid a mkdir warning when removing a directory in the destination that
3413 already exists in the `--backup-dir`.
3414
f43412f1 3415 - An OS that has a binary mode for its files (such as Cygwin) needed
87bca719 3416 `setmode(fd, O_BINARY)` called on the temp-file we opened with mkstemp().
f43412f1 3417 (Fix derived from Cygwin's 2.6.3 rsync package.)
87bca719
WD
3418
3419 - Fixed a potential hang when verbosity is high, the client side is the
3420 sender, and the file-list is large.
3421
3422 - Fixed a potential protocol-corrupting bug where the generator could merge a
3423 message from the receiver into the middle of a multiplexed packet of data if
3424 only part of that data had been written out to the socket when the message
3425 from the generator arrived.
3426
3427 - We now check if the OS doesn't support using mknod() for creating FIFOs and
3428 sockets, and compile-in some compatibility code using mkfifo() and socket()
3429 when necessary.
3430
3431 - Fixed an off-by-one error in the handling of `--max-delete=N`. Also, if the
3432 `--max-delete` limit is exceeded during a run, we now output a warning about
3433 this at the end of the run and exit with a new error code (25).
3434
3435 - One place in the code wasn't checking if fork() failed.
3436
3437 - The `ignore nonreadable` daemon parameter used to erroneously affect
3438 readable symlinks that pointed to a non-existent file.
3439
3440 - If the OS does not have lchown() and a chown() of a symlink will affect the
3441 referent of a symlink (as it should), we no longer try to set the user and
3442 group of a symlink.
3443
3444 - The generator now properly runs the hard-link loop and the dir-time
3445 rewriting loop after we're sure that the redo phase is complete.
3446
3447 - When `--backup` was specified with `--partial-dir=DIR`, where DIR is a
3448 relative path, the backup code was erroneously trying to backup a file that
3449 was put into the partial-dir.
3450
3451 - If a file gets resent in a single transfer and the `--backup` option is
3452 enabled along with `--inplace`, rsync no longer performs a duplicate backup
3453 (it used to overwrite the first backup with the failed file).
3454
3455 - One call to `flush_write_file()` was not being checked for an error.
3456
3457 - The `--no-relative` option was not being sent from the client to a server
3458 sender.
3459
3460 - If an rsync daemon specified `dont compress = ...` for a file and the client
3461 tried to specify `--compress`, the libz code was not handling a compression
3462 level of 0 properly. This could cause a transfer failure if the block-size
3463 for a file was large enough (e.g. rsync might have exited with an error for
3464 large files).
3465
3466 - Fixed a bug that would sometimes surface when using `--compress` and sending
3467 a file with a block-size larger than 64K (either manually specified, or
3468 computed due to the file being really large). Prior versions of rsync would
3469 sometimes fail to decompress the data properly, and thus the transferred
3470 file would fail its verification.
3471
3472 - If a daemon can't open the specified log file (i.e. syslog is not being
3473 used), die without crashing. We also output an error about the failure on
3474 stderr (which will only be seen if `--no-detach` was specified) and exit
3475 with a new error code (6).
3476
3477 - A local transfer no longer duplicates all its include/exclude options (since
3478 the forked process already has a copy of the exclude list, there's no need
3479 to send them a set of duplicates).
3480
3481 - The output of the items that are being updated by the generator (dirs,
3482 symlinks, devices) is now intermingled in the proper order with the output
3483 from the items that the receiver is updating (regular files) when pulling.
3484 This misordering was particularly bad when `--progress` was specified.
3485 (Requires protocol 29.)
3486
3487 - When `--timeout` is specified, lulls that occur in the transfer while the
3488 generator is doing work that does not generate socket traffic (looking for
3489 changed files, deleting files, doing directory-time touch-ups, etc.) will
3490 cause a new keep-alive packet to be sent that should keep the transfer going
3491 as long as the generator continues to make progress. (Requires protocol 29.)
3492
3493 - The stat size of a device is not added to the total file size of the items
3494 in the transfer (the size might be undefined on some OSes).
3495
3496 - Fixed a problem with refused-option messages sometimes not making it back to
3497 the client side when a remote `--files-from` was in effect and the daemon
3498 was the receiver.
3499
3500 - The `--compare-dest` option was not updating a file that differed in (the
3501 preserved) attributes from the version in the compare-dest DIR.
3502
3503 - When rsync is copying files into a write-protected directory, fixed the
3504 change-report output for the directory so that we don't report an identical
3505 directory as changed.
3506
3507### ENHANCEMENTS:
3508
3509 - Rsync now supports popt's option aliases, which means that you can use
3510 /etc/popt and/or ~/.popt to create your own option aliases.
3511
3512 - Added the `--delete-during` (`--del`) option which will delete files from
3513 the receiving side incrementally as each directory in the transfer is being
3514 processed. This makes it more efficient than the default,
3515 before-the-transfer behavior, which is now also available as
3516 `--delete-before` (and is still the default `--delete-WHEN` option that will
3517 be chosen if `--delete` or `--delete-excluded` is specified without a
3518 `--delete-WHEN` choice). All the `--del*` options infer `--delete`, so an
3519 rsync daemon that refuses `delete` will still refuse to allow any
3520 file-deleting options (including the new `--remove-sent-files` option).
3521
3522 - All the `--delete-WHEN` options are now more memory efficient: Previously an
3523 duplicate set of file-list objects was created on the receiving side for the
3524 entire destination hierarchy. The new algorithm only creates one directory
3525 of objects at a time (for files inside the transfer).
3526
3527 - Added the `--copy-dest` option, which works like `--link-dest` except that
3528 it locally copies identical files instead of hard-linking them.
3529
3530 - Added support for specifying multiple `--compare-dest`, `--copy-dest`, or
3531 `--link-dest` options, but only of a single type. (Promoted from the patches
3532 dir and enhanced.) (Requires protocol 29.)
3533
3534 - Added the `--max-size` option. (Promoted from the patches dir.)
3535
3536 - The daemon-mode options are now separated from the normal rsync options so
3537 that they can't be mixed together. This makes it impossible to start a
3538 daemon that has improper default option values (which could cause problems
3539 when a client connects, such as hanging or crashing).
3540
3541 - The `--bwlimit` option may now be used in combination with `--daemon` to
3542 specify both a default value for the daemon side and a value that cannot be
3543 exceeded by a user-specified `--bwlimit` option.
3544
3545 - Added the `port` parameter to the rsyncd.conf file. (Promoted from the
3546 patches dir.) Also added `address`. The command-line options take precedence
3547 over a config-file option, as expected.
3548
3549 - In `_exit_cleanup()`: when we are exiting with a partially-received file, we
3550 now flush any data in the write-cache before closing the partial file.
3551
3552 - The `--inplace` support was enhanced to work with `--compare-dest`,
3553 `--link-dest`, and (the new) `--copy-dest` options. (Requires protocol 29.)
3554
3555 - Added the `--dirs` (`-d`) option for an easier way to copy directories
3556 without recursion. Any directories that are encountered are created on the
3557 destination. Specifying a directory with a trailing slash copies its
3558 immediate contents to the destination.
3559
3560 - The `--files-from` option now implies `--dirs` (`-d`).
3561
3562 - Added the `--list-only` option, which is mainly a way for the client to put
3563 the server into listing mode without needing to resort to any internal
3564 option kluges (e.g. the age-old use of `-r --exclude='/*/*'` for a
3565 non-recursive listing). This option is used automatically (behind the
3566 scenes) when a modern rsync speaks to a modern daemon, but may also be
3567 specified manually if you want to force the use of the `--list-only` option
3568 over a remote-shell connection.
3569
3570 - Added the `--omit-dir-times` (`-O`) option, which will avoid updating the
3571 modified time for directories when `--times` was specified. This option will
3572 avoid an extra pass through the file-list at the end of the transfer (to
3573 tweak all the directory times), which may provide an appreciable speedup for
3574 a really large transfer. (Promoted from the patches dir.)
3575
3576 - Added the `--filter` (`-f`) option and its helper option, `-F`. Filter rules
3577 are an extension to the existing include/exclude handling that also supports
3578 nested filter files as well as per-directory filter files (like .cvsignore,
3579 but with full filter-rule parsing). This new option was chosen in order to
3580 ensure that all existing include/exclude processing remained 100% compatible
3581 with older versions. Protocol 29 is needed for full filter-rule support, but
3582 backward-compatible rules work with earlier protocol versions. (Promoted
3583 from the patches dir and enhanced.)
3584
3585 - Added the `--delay-updates` option that puts all updated files into a
3586 temporary directory (by default `.~tmp~`, but settable via the
3587 `--partial-dir=DIR` option) until the end of the transfer. This makes the
3588 updates a little more atomic for a large transfer.
3589
3590 - If rsync is put into the background, any output from `--progress` is
3591 reduced.
3592
3593 - Documented the `max verbosity` setting for rsyncd.conf. (This setting was
3594 added a couple releases ago, but left undocumented.)
3595
3596 - The sender and the generator now double-check the file-list index they are
3597 given, and refuse to try to do a file transfer on a non-file index (since
3598 that would indicate that something had gone very wrong).
3599
3600 - Added the `--itemize-changes` (`-i`) option, which is a way to output a more
3601 detailed list of what files changed and in what way. The effect is the same
3602 as specifying a `--log-format` of `%i %n%L` (see both the rsync and
3603 rsyncd.conf manpages). Works with `--dry-run` too.
3604
3605 - Added the `--fuzzy` (`-y`) option, which attempts to find a basis file for a
3606 file that is being created from scratch. The current algorithm only looks in
3607 the destination directory for the created file, but it does attempt to find
3608 a match based on size/mod-time (in case the file was renamed with no other
3609 changes) as well as based on a fuzzy name-matching algorithm. This option
3610 requires protocol 29 because it needs the new file-sorting order. (Promoted
3611 from patches dir and enhanced.) (Requires protocol 29.)
3612
3613 - Added the `--remove-sent-files` option, which lets you move files between
3614 systems.
3615
3616 - The hostname in HOST:PATH or HOST::PATH may now be an IPv6 literal enclosed
3617 in '[' and ']' (e.g. `[::1]`). (We already allowed IPv6 literals in the
3618 rsync://HOST:PORT/PATH format.)
3619
3620 - When rsync recurses to build the file list, it no longer keeps open one or
3621 more directory handles from the dir's parent dirs.
3622
3623 - When building under windows, the default for `--daemon` is now to avoid
3624 detaching, requiring the new `--detach` option to force rsync to detach.
3625
3626 - The `--dry-run` option can now be combined with either `--write-batch` or
3627 `--read-batch`, allowing you to run a do-nothing test command to see what
3628 would happen without `--dry-run`.
3629
3630 - The daemon's `read only` config item now sets an internal `read_only`
3631 variable that makes extra sure that no write/delete calls on the read-only
3632 side can succeed.
3633
3634 - The log-format % escapes can now have a numeric field width in between the %
3635 and the escape letter (e.g. `%-40n %08p`).
3636
3637 - Improved the option descriptions in the `--help` text.
3638
3639### SUPPORT FILES:
3640
3641 - Added atomic-rsync to the support dir: a perl script that will transfer some
3642 files using rsync, and then move the updated files into place all at once at
3643 the end of the transfer. Only works when pulling, and uses `--link-dest` and
3644 a parallel hierarchy of files to effect its update.
3645
3646 - Added mnt-excl to the support dir: a perl script that takes the /proc/mounts
3647 file and translates it into a set of excludes that will exclude all mount
3648 points (even mapped mounts to the same disk). The excludes are made relative
3649 to the specified source dir and properly anchored.
3650
3651 - Added savetransfer.c to the support dir: a C program that can make a copy of
3652 all the data that flows over the wire. This lets you test for data
3653 corruption (by saving the data on both the sending side and the receiving
3654 side) and provides one way to debug a protocol error.
3655
3656 - Added rrsync to the support dir: this is an updated version of Joe Smith's
3657 restricted rsync perl script. This helps to ensure that only certain rsync
3658 commands can be run by an ssh invocation.
3659
3660### INTERNAL:
3661
3662 - Added better checking of the checksum-header values that come over the
3663 socket.
3664
3665 - Merged a variety of file-deleting functions into a single function so that
3666 it is easier to maintain.
3667
3668 - Improved the type of some variables (particularly blocksize vars) for
3669 consistency and proper size.
3670
3671 - Got rid of the uint64 type (which we didn't need).
3672
3673 - Use a slightly more compatible set of core #include directives.
3674
3675 - Defined int32 in a way that ensures that the build dies if we can't find a
3676 variable with at least 32 bits.
3677
3678### PROTOCOL DIFFERENCES FOR VERSION 29:
3679
3680 - A 16-bit flag-word is transmitted after every file-list index. This
3681 indicates what is changing between the sender and the receiver. The
3682 generator now transmits an index and a flag-word to indicate when dirs and
3683 symlinks have changed (instead of producing a message), which makes the
3684 outputting of the information more consistent and less prone to screen
3685 corruption (because the local receiver/sender is now outputting all the
3686 file-change info messages).
3687
3688 - If a file is being hard-linked, the `ITEM_XNAME_FOLLOWS` bit is enabled in
3689 the flag-word and the name of the file that was linked immediately follows
3690 in vstring format (see below).
3691
3692 - If a file is being transferred with an alternate-basis file, the
3693 `ITEM_BASIS_TYPE_FOLLOWS` bit is enabled in the flag-word and a single byte
3694 follows, indicating what type of basis file was chosen. If that indicates
3695 that a fuzzy-match was selected, the `ITEM_XNAME_FOLLOWS` bit is set in the
3696 flag-word and the name of the match in vstring format follows the basis
3697 byte. A vstring is a variable length string that has its size written prior
3698 to the string, and no terminating null. If the string is from 1-127 bytes,
3699 the length is a single byte. If it is from 128-32767 bytes, the length is
3700 written as ((len >> 8) | 0x80) followed by (len % 0x100).
3701
3702 - The sending of exclude names is done using filter-rule syntax. This means
3703 that all names have a prefixed rule indicator, even excludes (which used to
3704 be sent as a bare pattern, when possible). The `-C` option will include the
3705 per-dir .cvsignore merge file in the list of filter rules so it is
3706 positioned correctly (unlike in some older transfer scenarios).
3707
3708 - Rsync sorts the filename list in a different way: it sorts the subdir names
3709 after the non-subdir names for each dir's contents, and it always puts a
3710 dir's contents immediately after the dir's name in the list. (Previously an
3711 item named `foo.txt` would sort in between directory `foo/` and `foo/bar`.)
3712
3713 - When talking to a protocol 29 rsync daemon, a list-only request is able to
3714 note this before the options are sent over the wire and the new
3715 `--list-only` option is included in the options.
3716
3717 - When the `--stats` bytes are sent over the wire (or stored in a batch), they
3718 now include two elapsed-time values: one for how long it took to build the
3719 file-list, and one for how long it took to send it over the wire (each
3720 expressed in thousandths of a second).
3721
3722 - When `--delete-excluded` is specified with some filter rules (AKA excludes),
3723 a client sender will now initiate a send of the rules to the receiver (older
3724 protocols used to omit the sending of excludes in this situation since there
3725 were no receiver-specific rules that survived `--delete-excluded` back
3726 then). Note that, as with all the filter-list sending, only items that are
3727 significant to the other side will actually be sent over the wire, so the
3728 filter-rule list that is sent in this scenario is often empty.
3729
3730 - An index equal to the file-list count is sent as a keep-alive packet from
3731 the generator to the sender, which then forwards it on to the receiver. This
3732 normally invalid index is only a valid keep-alive packet if the 16-bit
3733 flag-word that follows it contains a single bit (`ITEM_IS_NEW`, which is
3734 normally an illegal flag to appear alone).
3735
3736 - A protocol-29 batch file includes a bit for the setting of the `--dirs`
3737 option and for the setting of the `--compress` option. Also, the shell
3738 script created by `--write-batch` will use the `--filter` option instead of
3739 `--exclude-from` to capture any filter rules.
3740
3741### BUILD CHANGES:
3742
3743 - Handle an operating system that use mkdev() in place of makedev().
3744
3745 - Improved configure to better handle cross-compiling.
3746
3747------------------------------------------------------------------------------
87bca719
WD
3748
3749# NEWS for rsync 2.6.3 (30 Sep 2004)
3750
d640d78f 3751## Changes in this version:
87bca719
WD
3752
3753### SECURITY FIXES:
3754
3755 - A bug in the `sanitize_path` routine (which affects a non-chrooted rsync
3756 daemon) could allow a user to craft a pathname that would get transformed
3757 into an absolute path for certain options (but not for file-transfer names).
3758 If you're running an rsync daemon with chroot disabled, **please upgrade**,
3759 ESPECIALLY if the user privs you run rsync under is anything above `nobody`.
3760
3761 OUTPUT CHANGES (ATTN: those using a script to parse the verbose output):
3762
3763 - Please note that the 2-line footer (output when verbose) now uses the term
3764 `sent` instead of `wrote` and `received` instead of `read`. If you are not
3765 parsing the numeric values out of this footer, a script would be better off
3766 using the empty line prior to the footer as the indicator that the verbose
3767 output is over.
3768
3769 - The output from the `--stats` option was similarly affected to change
3770 `written` to `sent` and `read` to `received`.
3771
3772 - Rsync ensures that a filename that contains a newline gets mentioned with
3773 each newline transformed into a question mark (which prevents a filename
3774 from causing an empty line to be output).
3775
3776 - The `backed up ...` message that is output when at least 2 `--verbose`
3777 options are specified is now the same both with and without the
3778 `--backup-dir` option.
3779
3780### BUG FIXES:
3781
3782 - Fixed a crash bug that might appear when `--delete` was used and multiple
3783 source directories were specified.
3784
3785 - Fixed a 32-bit truncation of the file length when generating the checksums.
3786
3787 - The `--backup` code no longer attempts to create some directories over and
3788 over again (generating warnings along the way).
3789
3790 - Fixed a bug in the reading of the secrets file (by the daemon) and the
3791 password file (by the client): the files no longer need to be terminated by
3792 a newline for their content to be read in.
3793
3794 - If a file has a read error on the sending side or the reconstructed data
3795 doesn't match the expected checksum (perhaps due to the basis file changing
3796 during the transfer), the receiver will no longer retain the resulting file
3797 unless the `--partial` option was specified. (Note: for the read-error
3798 detection to work, neither side can be older than 2.6.3 -- older receivers
3799 will always retain the file, and older senders don't tell the receiver that
3800 the file had a read error.)
3801
3802 - If a file gets resent in a single transfer and the `--backup` option is
3803 enabled, rsync no longer performs a duplicate backup (it used to overwrite
3804 the original file in the backup area).
3805
3806 - Files specified in the daemon's `exclude` or `exclude from` config items are
3807 now excluded from being uploaded (assuming that the module allows uploading
3808 at all) in addition to the old download exclusion.
3809
3810 - Got rid of a potential hang in the receiver when near the end of a phase.
3811
3812 - When using `--backup` without a `--backup-dir`, rsync no longer preserves
3813 the modify time on directories. This avoids confusing NFS.
3814
3815 - When `--copy-links` (`-L`) is specified, we now output a separate error for
3816 a symlink that has no referent instead of claiming that a file `vanished`.
3817
3818 - The `--copy-links` (`-L`) option no longer has the side-effect of telling
3819 the receiving side to follow symlinks. See the `--keep-dirlinks` option
3820 (mentioned below) for a way to specify that behavior.
3821
3822 - Error messages from the daemon server's option-parsing (such as refused
3823 options) are now successfully transferred back to the client (the server
3824 used to fail to send the message because the socket wasn't in the right
3825 state for the message to get through).
3826
3827 - Most transfer errors that occur during a daemon transfer are now returned to
3828 the user in addition to being logged (some messages are intended to be
3829 daemon-only and are not affected by this).
3830
3831 - Fixed a bug in the daemon authentication code when using one of the
3832 batch-processing options.
3833
3834 - We try to work around some buggy IPv6 implementations that fail to implement
3835 `IPV6_V6ONLY`. This should fix the `address in use` error that some daemons
3836 get when running on an OS with a buggy IPv6 implementation. Also, if the new
3837 code gets this error, we might suggest that the user specify `--ipv4` or
3838 `--ipv6` (if we think it will help).
3839
3840 - When the remote rsync dies, make a better effort to recover any error
3841 messages it may have sent before dying (the local rsync used to just die
3842 with a socket-write error).
3843
3844 - When using `--delete` and a `--backup-dir` that contains files that are
3845 hard-linked to their destination equivalents, rsync now makes sure that
3846 removed files really get removed (avoids a really weird rename() behavior).
3847
3848 - Avoid a bogus run-time complaint about a lack of 64-bit integers when the
3849 int64 type is defined as an `off_t` and it actually has 64-bits.
3850
3851 - Added a configure check for open64() without mkstemp64() so that we can
3852 avoid using mkstemp() when such a combination is encountered. This bypasses
3853 a problem writing out large temp files on OSes such as AIX and HP-UX.
3854
3855 - Fixed an age-old crash problem with `--read-batch` on a local copy (rsync
3856 was improperly assuming `--whole-file` for the local copy).
3857
3858 - When `--dry-run` (`-n`) is used and the destination directory does not
3859 exist, rsync now produces a correct report of files that would be sent
3860 instead of dying with a chdir() error.
3861
3862 - Fixed a bug that could cause a slow-to-connect rsync daemon to die with an
3863 error instead of waiting for the connection to finish.
3864
3865 - Fixed an ssh interaction that could cause output to be lost when the user
3866 chose to combine the output of rsync's stdout and stderr (e.g. using the
3867 `2>&1`).
3868
3869 - Fixed an option-parsing bug when `--files-from` got passed to a daemon.
3870
3871### ENHANCEMENTS:
3872
3873 - Added the `--partial-dir=DIR` option that lets you specify where to
f43412f1 3874 (temporarily) put a partially transferred file (instead of overwriting the
87bca719
WD
3875 destination file). E.g. `--partial-dir=.rsync-partial` Also added support
3876 for the `RSYNC_PARTIAL_DIR` environment variable that, when found,
3877 transforms a regular `--partial` option (such as the convenient `-P` option)
3878 into one that also specifies a directory.
3879
3880 - Added `--keep-dirlinks` (`-K`), which allows you to symlink a directory onto
3881 another partition on the receiving side and have rsync treat it as matching
3882 a normal directory from the sender.
3883
3884 - Added the `--inplace` option that tells rsync to write each destination file
3885 without using a temporary file. The matching of existing data in the
3886 destination file can be severely limited by this, but there are also cases
3887 where this is more efficient (such as appending data). Use only when needed
96ed4b47 3888 (see the manpage for more details).
87bca719
WD
3889
3890 - Added the `write only` option for the daemon's config file.
3891
3892 - Added long-option names for `-4` and `-6` (namely `--ipv4` and `--ipv6`) and
96ed4b47 3893 documented all these options in the manpage.
87bca719
WD
3894
3895 - Improved the handling of the `--bwlimit` option so that it's less bursty,
3896 more accurate, and works properly over a larger range of values.
3897
3898 - The rsync daemon-over-ssh code now looks for `SSH_CONNECTION` and
3899 `SSH2_CLIENT` in addition to `SSH_CLIENT` to figure out the IP address.
3900
3901 - Added the `--checksum-seed=N` option for advanced users.
3902
3903 - Batch writing/reading has a brand-new implementation that is simpler, fixes
3904 a few weird problems with the old code (such as no longer sprinkling the
3905 batch files into different dirs or even onto different systems), and is much
3906 less intrusive into the code (making it easier to maintain for the future).
3907 The new code generates just one data file instead of three, which makes it
3908 possible to read the batch on stdin via a remote shell. Also, the old
3909 requirement of forcing the same fixed checksum-seed for all batch processing
3910 has been removed.
3911
3912 - If an rsync daemon has a module set with `list = no` (which hides its
3913 presence in the list of available modules), a user that fails to
3914 authenticate gets the same `unknown module` error that they would get if the
3915 module were actually unknown (while still logging the real error to the
3916 daemon's log file). This prevents fishing for module names.
3917
3918 - The daemon's `refuse options` config item now allows you to match option
3919 names using wildcards and/or the single-letter option names.
3920
3921 - Each transferred file now gets its permissions and modified-time updated
3922 before the temp-file gets moved into place. Previously, the finished file
3923 would have a very brief window where its permissions disallowed all group
3924 and world access.
3925
3926 - Added the ability to parse a literal IPv6 address in an `rsync:` URL (e.g.
3927 rsync://[2001:638:500:101::21]:873/module/dir).
3928
3929 - The daemon's wildcard expanding code can now handle more than 1000 filenames
3930 (it's now limited by memory instead of having a hard-wired limit).
3931
3932### INTERNAL:
3933
3934 - Some cleanup in the exclude code has saved some per-exclude memory and made
3935 the code easier to maintain.
3936
3937 - Improved the argv-overflow checking for a remote command that has a lot of
3938 args.
3939
3940 - Use rsyserr() in the various places that were still calling rprintf() with
3941 strerror() as an arg.
3942
3943 - If an rsync daemon is listening on multiple sockets (to handle both IPv4 and
3944 IPv6 to a single port), we now close all the unneeded file handles after we
3945 accept a connection (we used to close just one of them).
3946
3947 - Optimized the handling of larger block sizes (rsync used to slow to a crawl
3948 if the block size got too large).
3949
3950 - Optimized away a loop in `hash_search()`.
3951
3952 - Some improvements to the `sanitize_path()` and `clean_fname()` functions
3953 makes them more efficient and produce better results (while still being
3954 compatible with the file-name cleaning that gets done on both sides when
3955 sending the file-list).
3956
3957 - Got rid of `alloc_sanitize_path()` after adding a destination-buffer arg to
3958 `sanitize_path()` made it possible to put all the former's functionality
3959 into the latter.
3960
3961 - The file-list that is output when at least 4 verbose options are specified
3962 reports the uid value on the sender even when rsync is not running as root
3963 (since we might be sending to a root receiver).
3964
3965### BUILD CHANGES:
3966
3967 - Added a `gen` target to rebuild most of the generated files, including
96ed4b47 3968 configure, config.h.in, the manpages, and proto.h.
87bca719
WD
3969
3970 - If `make proto` doesn't find some changes in the prototypes, the proto.h
3971 file is left untouched (its time-stamp used to always be updated).
3972
f6df3708
WD
3973 - The variable `$STRIP` (that is optionally set by the install-strip target's
3974 rule) was changed to `$INSTALL_STRIP` because some systems have `$STRIP`
87bca719
WD
3975 already set in the environment.
3976
3977 - Fixed a build problem when `SUPPORT_HARD_LINKS` isn't defined.
3978
3979 - When cross-compiling, the gettimeofday() function is now assumed to be a
3980 modern version that takes two-args (since we can't test it).
3981
3982### DEVELOPER RELATED:
3983
3984 - The scripts in the testsuite dir were cleaned up a bit and a few new tests
3985 added.
3986
3987 - Some new diffs were added to the patches dir, and some accepted ones were
3988 removed.
3989
3990------------------------------------------------------------------------------
87bca719
WD
3991
3992# NEWS for rsync 2.6.2 (30 Apr 2004)
3993
d640d78f 3994## Changes in this version:
87bca719
WD
3995
3996### BUG FIXES:
3997
3998 - Fixed a major bug in the sorting of the filenames when `--relative` is used
3999 for some sources (just sources such as `/` and `/*` were affected). This fix
4000 ensures that we ask for the right file-list item when requesting changes
4001 from the sender.
4002
4003 - Rsync now checks the return value of the close() function to better report
4004 disk-full problems on an NFS file system.
4005
4006 - Restored the old daemon-server behavior of logging error messages rather
4007 than returning them to the user. (A better long-term fix will be sought in
4008 the future.)
4009
4010 - An obscure uninitialized-variable bug was fixed in the uid/gid code. (This
4011 bug probably had no ill effects.)
4012
4013### BUILD CHANGES:
4014
4015 - Got rid of the configure check for sys/sysctl.h (it wasn't used and was
4016 causing a problem on some systems). Also improved the
4017 broken-largefile-locking test to try to avoid failure due to an NFS
4018 build-dir.
4019
4020 - Fixed a compile problem on systems that don't define `AI_NUMERICHOST`.
4021
4022 - Fixed a compile problem in the popt source for compilers that don't support
4023 `__attribute__`.
4024
4025### DEVELOPER RELATED:
4026
4027 - Improved the testsuite's `merge` test to work on OSF1.
4028
4029 - Two new diffs were added to the patches dir.
4030
4031------------------------------------------------------------------------------
87bca719
WD
4032
4033# NEWS for rsync 2.6.1 (26 Apr 2004)
4034
d640d78f
WD
4035## Changes in this version:
4036
4037### PROTOCOL NUMBER:
87bca719 4038
d640d78f 4039 - The protocol number was changed to 28.
87bca719
WD
4040
4041### SECURITY FIXES:
4042
4043 - Paths sent to an rsync daemon are more thoroughly sanitized when chroot is
4044 not used. If you're running a non-read-only rsync daemon with chroot
4045 disabled, **please upgrade**, ESPECIALLY if the user privs you run rsync
4046 under is anything above `nobody`.
4047
4048### ENHANCEMENTS:
4049
4050 - Lower memory use, more optimal transfer of data over the socket, and lower
4051 CPU usage (see the INTERNAL section for details).
4052
4053 - The `RSYNC_PROXY` environment variable can now contain a `USER:PASS@` prefix
4054 before the `HOST:PORT` information. (Bardur Arantsson)
4055
4056 - The `--progress` output now mentions how far along in the transfer we are,
4057 including both a count of files transferred and a percentage of the total
4058 file-count that we've processed. It also shows better
4059 current-rate-of-transfer and remaining-transfer-time values.
4060
f43412f1 4061 - Documentation changes now attempt to describe some often misunderstood
87bca719
WD
4062 features more clearly.
4063
4064### BUG FIXES:
4065
4066 - When `-x` (`--one-file-system`) is combined with `-L` (`--copy-links`) or
4067 `--copy-unsafe-links,` no symlinked files are skipped, even if the referent
4068 file is on a different filesystem.
4069
4070 - The `--link-dest` code now works properly for a non-root user when (1) the
4071 UIDs of the source and destination differ and `-o` was specified, or (2)
4072 when the group of the source can't be used on the destination and `-g` was
4073 specified.
4074
4075 - Fixed a bug in the handling of `-H` (hard-links) that might cause the
4076 expanded PATH/NAME value of the current item to get overwritten (due to an
4077 expanded-name caching bug).
4078
4079 - We now reset the `new data has been sent` flag at the start of each file we
4080 send. This makes sure that an interrupted transfer with the `--partial`
4081 option set doesn't keep a shorter temp file than the current basis file when
4082 no new data has been transferred over the wire for that file.
4083
4084 - Fixed a byte-order problem in `--batch-mode` on big-endian machines. (Jay
4085 Fenlason)
4086
4087 - When using `--cvs-exclude`, the exclude items we get from a per-directory's
4088 .cvsignore file once again only affect that one directory (not all following
4089 directories too). The items are also now properly word-split and parsed
4090 without any +/- prefix parsing.
4091
4092 - When specifying the USER@HOST: prefix for a file, the USER part can now
4093 contain an '@', if needed (i.e. the last '@' is used to find the HOST, not
4094 the first).
4095
4096 - Fixed some bugs in the handling of group IDs for non-root users: (1) It
4097 properly handles a group that the sender didn't have a name for (it would
4098 previously skip changing the group on any files in that group). (2) If
4099 `--numeric-ids` is used, rsync no longer attempts to set groups that the
4100 user doesn't have the permission to set.
4101
4102 - Fixed the `refuse options` setting in the rsyncd.conf file.
4103
f43412f1 4104 - Improved the `-x` (`--one-file-system`) flag's handling of any mount-point
87bca719 4105 directories we encounter. It is both more optimal (in that it no longer does
f43412f1 4106 a useless scan of the contents of the mount-point dirs) and also fixes a
87bca719
WD
4107 bug where a remapped mount of the original filesystem could get discovered
4108 in a subdir we should be ignoring.
4109
4110 - Rsync no longer discards a double-slash at the start of a filename when
4111 trying to open the file. It also no longer constructs names that start with
4112 a double slash (unless the user supplied them).
4113
4114 - Path-specifying options to a daemon should now work the same with or without
4115 chroot turned on. Previously, such a option (such as `--link-dest`) would
4116 get its absolute path munged into a relative one if chroot was not on,
4117 making that setting fairly useless. Rsync now transforms the path into one
4118 that is based on the module's base dir when chroot is not enabled.
4119
4120 - Fixed a compatibility problem interacting with older rsync versions that
4121 might send us an empty `--suffix` value without telling us that
4122 `--backup-dir` was specified.
4123
4124 - The `hosts allow` option for a daemon-over-remote-shell process now has
4125 improved support for IPv6 addresses and a fix for systems that have a length
4126 field in their socket structs.
4127
4128 - Fixed the ability to request an empty backup `--suffix` when sending files
4129 to an rsync daemon.
4130
4131 - Fixed an option-parsing bug when `--files-from` was sent to a server sender.
4132
4133### INTERNAL:
4134
4135 - Most of the I/O is now buffered, which results in a pretty large speedup
4136 when running under MS Windows. (Craig Barratt)
4137
4138 - Optimizations to the name-handling/comparing code have made some significant
4139 reductions in user-CPU time for large file sets.
4140
4141 - Some cleanup of the variable types make the code more consistent.
4142
4143 - Reduced memory requirements of hard link preservation. (J.W. Schultz)
4144
4145 - Implemented a new algorithm for hard-link handling that speeds up the code
4146 significantly. (J.W. Schultz and Wayne Davison)
4147
4148 - The `--hard-link` option now uses the first existing file in the group of
4149 linked files as the basis for the transfer. This prevents the sub-optimal
4150 transfer of a file's data when a new hardlink is added on the sending side
4151 and it sorts alphabetically earlier in the list than the files that are
4152 already present on the receiving side.
4153
4154 - Dropped support for protocol versions less than 20 (2.3.0 released 15 Mar
4155 1999) and activated warnings for protocols less than 25 (2.5.0 released 23
4156 Aug 2001). (Wayne Davison and J.W. Schultz, severally)
4157
4158 - More optimal data transmission for `--hard-links` (protocol 28).
4159
4160 - More optimal data transmission for `--checksum` (protocol 28).
4161
4162 - Less memory is used when `--checksum` is specified.
4163
4164 - Less memory is used in the file list (a per-file savings).
4165
4166 - The generator is now better about not modifying the file list during the
4167 transfer in order to avoid a copy-on-write memory bifurcation (on systems
4168 where fork() uses shared memory). Previously, rsync's shared memory would
4169 slowly become unshared, resulting in real memory usage nearly doubling on
4170 the receiving side by the end of the transfer. Now, as long as permissions
4171 are being preserved, the shared memory should remain that way for the entire
4172 transfer.
4173
4174 - Changed hardlink info and `file_struct` + strings to use allocation pools.
4175 This reduces memory use for large file-sets and permits freeing memory to
4176 the OS. (J.W. Schultz)
4177
4178 - The 2 pipes used between the receiver and generator processes (which are
4179 forked on the same machine) were reduced to 1 pipe and the protocol improved
4180 so that (1) it is now impossible to have the `redo` pipe fill up and hang
4181 rsync, and (2) trailing messages from the receiver don't get lost on their
4182 way through the generator over to the sender (which mainly affected
4183 hard-link messages and verbose `--stats` output).
4184
4185 - Improved the internal uid/gid code to be more portable and a little more
4186 optimized.
4187
4188 - The device numbers sent when using `--devices` are now sent as separate
4189 major/minor values with 32-bit accuracy (protocol 28). Previously, the
4190 copied devices were sent as a single 32-bit number. This will make
4191 inter-operation of 64-bit binaries more compatible with their 32-bit
4192 brethren (with both ends of the connection are using protocol 28). Note that
4193 optimizations in the binary protocol for sending the device numbers often
4194 results in fewer bytes being used than before, even though more precision is
4195 now available.
4196
4197 - Some cleanup of the exclude/include structures and its code made things
4198 clearer (internally), simpler, and more efficient.
4199
4200 - The reading & writing of the file-list in batch-mode is now handled by the
4201 same code that sends & receives the list over the wire. This makes it much
4202 easier to maintain. (Note that the batch code is still considered to be
4203 experimental.)
4204
4205### BUILD CHANGES:
4206
4207 - The configure script now accepts `--with-rsyncd-conf=PATH` to override the
4208 default value of the /etc/rsyncd.conf file.
4209
4210 - Fixed configure bug when running `./configure --disable-ipv6`.
4211
4212 - Fixed compilation problem on Tru64 Unix (having to do with `sockaddr.sa_len`
4213 and `sockaddr.sin_len`).
4214
4215### DEVELOPER RELATED:
4216
4217 - Fixed `make test` bug when build dir is not the source dir.
4218
4219 - Added a couple extra diffs in the `patches` dir, removed the ones that got
4220 applied, and rebuilt the rest.
4221
4222------------------------------------------------------------------------------
87bca719
WD
4223
4224# NEWS for rsync 2.6.0 (1 Jan 2004)
4225
d640d78f 4226## Changes in this version:
87bca719 4227
d640d78f
WD
4228### PROTOCOL NUMBER:
4229
4230 - The protocol number was changed to 27. The maximum accepted protocol number
4231 was increased from 30 to 40.
87bca719
WD
4232
4233### ENHANCEMENTS:
4234
4235 - `ssh` is now the default remote shell for rsync. If you want to change this,
4236 configure like this: `./configure --with-rsh=rsh`.
4237
4238 - Added `--files-from`, `--no-relative`, `--no-implied-dirs`, and `--from0`.
4239 Note that `--from0` affects the line-ending character for all the files read
4240 by the `--*-from` options. (Wayne Davison)
4241
4242 - Length of csum2 is now per-file starting with protocol version
4243 27. (J.W. Schultz)
4244
4245 - Per-file dynamic block size is now sqrt(file length). The per-file checksum
4246 size is determined according to an algorithm provided by Donovan Baarda
4247 which reduces the probability of rsync algorithm corrupting data and falling
4248 back using the whole md4 checksums. (J.W. Schultz, Donovan Baarda)
4249
4250 - The `--stats` option no longer includes the (debug) malloc summary unless
4251 the verbose option was specified at least twice.
4252
4253 - Added a new error/warning code for when files vanish from the sending side.
4254 Made vanished source files not interfere with the file-deletion pass when
4255 `--delete-after` was specified.
4256
4257 - Various trailing-info sections are now preceded by a newline.
4258
4259### BUG FIXES:
4260
4261 - Fixed several exclude/include matching bugs when using wild-cards. This has
4262 a several user-visible effects, all of which make the matching more
4263 consistent and intuitive. This should hopefully not cause anyone problems
4264 since it makes the matching work more like what people are expecting. (Wayne
4265 Davison)
4266
4267 - A pattern with a `**` no longer causes a `*` to match slashes. For example,
4268 with `/*/foo/**`, `foo` must be 2 levels deep. [If your string has BOTH `*`
4269 and `**` wildcards, changing the `*` wildcards to `**` will provide the old
4270 behavior in all versions.]
4271
4272 - `**/foo` now matches at the base of the transfer (like /foo does). [Use
4273 `/**/foo` to get the old behavior in all versions.]
4274
4275 - A non-anchored wildcard term floats to match beyond the base of the
4276 transfer. E.g. `CVS/R*` matches at the end of the path, just like the
4277 non-wildcard term `CVS/Root` does. [Use `/CVS/R*` to get the old behavior in
4278 all versions.]
4279
4280 - Including a `**` in the match term causes it to be matched against the
4281 entire path, not just the name portion, even if there aren't any interior
4282 slashes in the term. E.g. `foo**bar` would exclude `/path/foo-bar` (just
4283 like before) as well as `/foo-path/baz-bar` (unlike before). [Use `foo*bar`
4284 to get the old behavior in all versions.]
4285
4286 - The exclude list specified in the daemon's config file is now properly
4287 applied to the pulled items no matter how deep the user's file-args are in
4288 the source tree. (Wayne Davison)
4289
4290 - For protocol version >= 27, `mdfour_tail()` is called when the block size
4291 (including `checksum_seed`) is a multiple of 64. Previously it was not
4292 called, giving the wrong MD4 checksum. (Craig Barratt)
4293
4294 - For protocol version >= 27, a 64 bit bit counter is used in mdfour.c as
4295 required by the RFC. Previously only a 32 bit bit counter was used, causing
4296 incorrect MD4 file checksums for file sizes >= 512MB - 4. (Craig Barratt)
4297
4298 - Fixed a crash bug when interacting with older rsync versions and multiple
4299 files of the same name are destined for the same dir. (Wayne Davison)
4300
4301 - Keep tmp names from overflowing MAXPATHLEN.
4302
4303 - Make `--link-dest` honor the absence of `-p`, `-o`, and `-g`.
4304
4305 - Made rsync treat a trailing slash in the destination in a more consistent
4306 manner.
4307
4308 - Fixed file I/O error detection. (John Van Essen)
4309
4310 - Fixed bogus `malformed address {hostname}` message in rsyncd log when
4311 checking IP address against hostnames from `hosts allow` and `hosts deny`
4312 parameters in config file.
4313
4314 - Print heap statistics when verbose >= 2 instead of when >= 1.
4315
4316 - Fixed a compression (`-z`) bug when syncing a mostly-matching file that
4317 contains already-compressed data. (Yasuoka Masahiko and Wayne Davison)
4318
4319 - Fixed a bug in the `--backup` code that could cause deleted files to not get
4320 backed up.
4321
4322 - When the backup code makes new directories, create them with mode 0700
4323 instead of 0755 (since the directory permissions in the backup tree are not
4324 yet copied from the main tree).
4325
4326 - Call setgroups() in a more portable manner.
4327
4328 - Improved file-related error messages to better indicate exactly what
4329 pathname failed. (Wayne Davison)
4330
4331 - Fixed some bugs in the handling of `--delete` and `--exclude` when using the
4332 `--relative` (`-R`) option. (Wayne Davison)
4333
4334 - Fixed bug that prevented regular files from replacing special files and
4335 caused a directory in `--link-dest` or `--compare-dest` to block the
4336 creation of a file with the same path. A directory still cannot be replaced
4337 by a regular file unless `--delete` specified. (J.W. Schultz)
4338
4339 - Detect and report when open or opendir succeed but read and readdir fail
4340 caused by network filesystem issues and truncated files. (David Norwood,
4341 Michael Brown, J.W. Schultz)
4342
4343 - Added a fix that should give ssh time to restore the tty settings if the
4344 user presses Ctrl-C at an ssh password prompt.
4345
4346### INTERNAL:
4347
4348 - Eliminated vestigial support for old versions that we stopped supporting.
4349 (J.W. Schultz)
4350
4351 - Simplified some of the option-parsing code. (Wayne Davison)
4352
4353 - Some cleanup made to the exclude code, as well as some new defines added to
4354 enhance readability. (Wayne Davison)
4355
4356 - Changed the protocol-version code so that it can interact at a lower
4357 protocol level than the maximum supported by both sides. Added an
4358 undocumented option, `--protocol=N`, to force the value we advertise to the
4359 other side (primarily for testing purposes). (Wayne Davison)
4360
4361------------------------------------------------------------------------------
87bca719
WD
4362
4363# NEWS for rsync 2.5.7 (4 Dec 2003)
4364
d640d78f 4365## Changes in this version:
87bca719
WD
4366
4367### SECURITY FIXES:
4368
4369 - Fix buffer handling bugs. (Andrew Tridgell, Martin Pool, Paul Russell,
4370 Andrea Barisani)
4371
4372------------------------------------------------------------------------------
87bca719
WD
4373
4374# NEWS for rsync 2.5.6, aka "the dwd-between-jobs release" (26 Jan 2003)
4375
d640d78f 4376## Changes in this version:
87bca719
WD
4377
4378### ENHANCEMENTS:
4379
4380 - The `--delete-after` option now implies `--delete`. (Wayne Davison)
4381
4382 - The `--suffix` option can now be used with `--backup-dir`. (Michael
4383 Zimmerman)
4384
4385 - Combining `::` syntax with the `--rsh`/`-e` option now uses the specified
4386 remote-shell as a transport to talk to a (newly-spawned) server-daemon. This
4387 allows someone to use daemon features, such as modules, over a secure
4388 protocol, such as ssh. (JD Paul)
4389
4390 - The rsync:// syntax for daemon connections is now accepted in the
4391 destination field.
4392
4393 - If the file name given to `--include-from` or `--exclude-from` is `-`, rsync
4394 will read from standard input. (J.W. Schultz)
4395
4396 - New option `--link-dest` which is like `--compare-dest` except that
4397 unchanged files are hard-linked in to the destination directory. (J.W.
4398 Schultz)
4399
4400 - Don't report an error if an excluded file disappears during an rsync run.
4401 (Eugene Chupriyanov and Bo Kersey)
4402
4403 - Added .svn to `--cvs-exclude` list to support subversion. (Jon Middleton)
4404
4405 - Properly support IPv6 addresses in the rsyncd.conf `hosts allow` and `hosts
4406 deny` fields. (Hideaki Yoshifuji)
4407
4408 - Changed exclude file handling to permit DOS or MAC style line terminations.
4409 (J.W. Schultz)
4410
4411 - Ignore errors from chmod when `-p`/`-a`/`--preserve-perms` is not set.
4412 (Dave Dykstra)
4413
4414### BUG FIXES:
4415
4416 - Fix `forward name lookup failed` errors on AIX 4.3.3. (John L. Allen, Martin
4417 Pool)
4418
4419 - Generate each file's rolling-checksum data as we send it, not in a separate
4420 (memory-eating) pass before hand. This prevents timeout errors on really
4421 large files. (Stefan Nehlsen)
4422
4423 - Fix compilation on Tru64. (Albert Chin, Zoong Pham)
4424
4425 - Better handling of some client-server errors. (Martin Pool)
4426
4427 - Fixed a crash that would occur when sending a list of files that contains a
4428 duplicate name (if it sorts to the end of the file list) and using
4429 `--delete`. (Wayne Davison)
4430
4431 - Fixed the file-name duplicate-removal code when dealing with multiple dups
4432 in a row. (Wayne Davison)
4433
4434 - Fixed a bug that caused rsync to lose the exit status of its child processes
4435 and sometimes return an exit code of 0 instead of showing an error. (David
4436 R. Staples, Dave Dykstra)
4437
4438 - Fixed bug in `--copy-unsafe-links` that caused it to be completely broken.
4439 (Dave Dykstra)
4440
4441 - Prevent infinite recursion in cleanup code under certain circumstances.
4442 (Sviatoslav Sviridov and Marc Espie)
4443
4444 - Fixed a bug that prevented rsync from creating intervening directories when
4445 `--relative-paths`/`-R` is set. (Craig Barratt)
4446
4447 - Prevent `Connection reset by peer` messages from Cygwin. (Randy O'Meara)
4448
4449### INTERNAL:
4450
4451 - Many code cleanups and improved internal documentation. (Martin Pool, Nelson
4452 Beebe)
4453
4454 - Portability fixes. (Dave Dykstra and Wayne Davison)
4455
4456 - More test cases. (Martin Pool)
4457
4458 - Some test-case fixes. (Brian Poole, Wayne Davison)
4459
4460 - Updated included popt to the latest vendor drop, version 1.6.4. (Jos
4461 Backus)
4462
4463 - Updated config.guess and config.sub to latest versions; this means rsync
4464 should build on more platforms. (Paul Green)
4465
4466------------------------------------------------------------------------------
87bca719
WD
4467
4468# NEWS for rsync 2.5.5, aka Snowy River (2 Apr 2002)
4469
d640d78f 4470## Changes in this version:
87bca719
WD
4471
4472### ENHANCEMENTS:
4473
4474 - With `--progress`, when a transfer is complete show the time taken;
4475 otherwise show expected time to complete. (Cameron Simpson)
4476
4477 - Make `make install-strip` works properly, and `make install` accepts a
4478 DESTDIR variable for help in building binary packages. (Peter
4479 Breitenlohner, Greg Louis)
4480
4481 - If configured with `--enable-maintainer-mode`, then on receipt of a fatal
4482 signal rsync will try to open an xterm running gdb, similarly to Samba's
4483 `panic action` or GNOME's bug-buddy. (Martin Pool)
4484
4485### BUG FIXES:
4486
4487 - Fix situation where failure to fork (e.g. because out of process slots)
4488 would cause rsync to kill all processes owned by the current user. Yes,
4489 really! (Paul Haas, Martin Pool)
4490
4491 - Fix test suite on Solaris. (Jos Backus, Martin Pool)
4492
4493 - Fix minor memory leak in socket code. (Dave Dykstra, Martin Pool.)
4494
4495 - Fix `--whole-file` problem that caused it to be the default even for remote
4496 connections. (Martin Pool, Frank Schulz)
4497
4498 - Work around bug in Mac OS X mkdir(2), which cannot handle trailing slashes.
4499 <http://www.opensource.apple.com/bugs/X/BSD%20Kernel/2734739.html> (Martin
4500 Pool)
4501
4502 - Improved network error handling. (Greg A. Woods)
4503
4504------------------------------------------------------------------------------
87bca719
WD
4505
4506# NEWS for rsync 2.5.4, aka "Imitation lizard skin" (13 Mar 2002)
4507
d640d78f 4508## Changes in this version:
87bca719
WD
4509
4510### BUG FIXES:
4511
4512 - Additional fix for zlib double-free bug. (Martin Pool, Andrew Tridgell) (CVE
4513 CAN-2002-0059)
4514
4515### ENHANCEMENTS:
4516
4517 - Merge in changes from zlib 1.1.3 to zlib 1.1.4. (Jos Backus) (Note that
4518 rsync still uses a custom version of zlib; you can not just link against a
4519 system library. See zlib/README.rsync)
4520
4521 - Additional test cases for `--compress`. (Martin Pool)
4522
4523------------------------------------------------------------------------------
87bca719
WD
4524
4525# NEWS for rsync 2.5.3, aka "Happy 26" (11 Mar 2002)
4526
d640d78f 4527## Changes in this version:
87bca719
WD
4528
4529### SECURITY FIXES:
4530
4531 - Make sure that supplementary groups are removed from a server
4532 process after changing uid and gid. (Ethan Benson) (Debian bug
4533 #132272, CVE CAN-2002-0080)
4534
4535### BUG FIXES:
4536
4537 - Fix zlib double-free bug. (Owen Taylor, Mark J Cox) (CVE CAN-2002-0059)
4538
4539 - Fixed problem that in many cases caused the error message unexpected read
4540 size of 0 in `map_ptr` and resulted in the wrong data being copied.
4541
4542 - Fixed compilation errors on some systems caused by the use of `unsigned
4543 int64` in rsync.h.
4544
4545 - Fixed problem on systems such as Sunos4 that do not support realloc on a
4546 NULL pointer; error was 'out of memory in "flist_expand"'.
4547
4548 - Fix for rsync server processes hanging around after the client unexpectedly
4549 disconnects. (Colin Walters) (Debian bug #128632)
4550
4551 - Cope with BSD systems on which mkdir() will not accept a trailing slash.
4552
4553### ENHANCEMENTS:
4554
4555 - Merge in changes from zlib 1.1.2 to zlib 1.1.3. (Note that rsync still uses
4556 a custom version of zlib; you can not just link against a system library.
4557 See zlib/README.rsync)
4558
4559 - Command to initiate connections is only shown with `-vv`, rather than `-v`
4560 as in 2.5.2. Output from plain `-v` is more similar to what was historically
4561 used so as not to break scripts that try to parse the output.
4562
4563 - Added `--no-whole-file` and `--no-blocking-io` options (Dave Dykstra)
4564
4565 - Made the `--write-batch` and `--read-batch` options actually work and added
96ed4b47 4566 documentation in the manpage (Jos Backus)
87bca719
WD
4567
4568 - If the daemon is unable to fork a child to accept a connection, print an
4569 error message. (Colin Walters)
4570
4571------------------------------------------------------------------------------
87bca719
WD
4572
4573# NEWS for rsync 2.5.2 (26 Jan 2002)
4574
d640d78f 4575## Changes in this version:
87bca719
WD
4576
4577### SECURITY FIXES:
4578
4579 - Signedness security patch from Sebastian Krahmer <krahmer@suse.de> -- in
4580 some cases we were not sufficiently careful about reading integers from the
4581 network.
4582
d640d78f
WD
4583### PROTOCOL NUMBER:
4584
4585 - The protocol number was changed to 26.
4586
87bca719
WD
4587### BUG FIXES:
4588
4589 - Fix possible string mangling in log files.
4590
4591 - Fix for setting local address of outgoing sockets.
4592
4593 - Better handling of hardlinks and devices on platforms with 64-bit `dev_t` or
4594 `ino_t`.
4595
4596 - Name resolution on machines supporting IPv6 is improved.
4597
4598 - Fix for device nodes. (dann frazier) (Debian #129135)
4599
4600### ENHANCEMENTS:
4601
4602 - With `-v`, rsync now shows the command used to initiate an ssh/rsh
4603 connection.
4604
4605 - `--statistics` now shows memory heap usage on platforms that support
4606 mallinfo().
4607
4608 - "The Ted T'so school of program optimization": make progress visible and
4609 people will think it's faster. (With `--progress`, rsync will show you how
4610 many files it has seen as it builds the `file_list`, giving some indication
4611 that it has not hung.)
4612
4613 - Improvements to batch mode support. This is still experimental but testing
4614 would be welcome. (Jos Backus)
4615
4616 - New `--ignore-existing` option, patch previously distributed with Vipul's
4617 Razor. (Debian #124286)
4618
4619------------------------------------------------------------------------------
87bca719
WD
4620
4621# NEWS for rsync 2.5.1 (3 Jan 2002)
4622
d640d78f 4623## Changes in this version:
87bca719
WD
4624
4625### BUG FIXES:
4626
4627 - Fix for segfault in `--daemon` mode configuration parser. (Paul Mackerras)
4628
4629 - Correct `string<->address` parsing for both IPv4 and 6. (YOSHIFUJI Hideaki,
4630 SUMIKAWA Munechika and Jun-ichiro `itojun` Hagino)
4631
4632 - Various fixes for IPv6 support. (Dave Dykstra)
4633
4634 - rsync.1 typo fix. (Matt Kraai)
4635
4636 - Test suite typo fixes. (Tom Schmidt)
4637
4638 - rsync.1 grammar and clarity improvements. (Edward Welbourne)
4639
4640 - Correction to ./configure tests for `inet_ntop`. (Jeff Garzik)
4641
4642### ENHANCEMENTS:
4643
4644 - `--progress` and `-P` now show estimated data transfer rate (in a multiple
4645 of bytes/s) and estimated time to completion. (Rik Faith)
4646
4647 - `--no-detach` option, required to run as a W32 service and also useful when
4648 running on Unix under daemontools, AIX's SRC, or a debugger. (Max Bowsher,
4649 Jos Backus)
4650
4651 - Clearer error messages for some conditions.
4652
4653------------------------------------------------------------------------------
87bca719
WD
4654
4655# NEWS for rsync 2.5.0 (30 Nov 2001)
4656
d640d78f
WD
4657## Changes in this version:
4658
4659### PROTOCOL NUMBER:
87bca719 4660
d640d78f 4661 - The protocol number was changed to 25.
87bca719
WD
4662
4663### ANNOUNCEMENTS:
4664
4665 - Martin Pool <mbp@samba.org> is now a co-maintainer.
4666
4667### NEW FEATURES:
4668
4669 - Support for LSB-compliant packaging <http://www.linuxbase.org/>
4670
4671 - Shell wildcards are allowed in `auth users` lines.
4672
4673 - Merged UNC rsync+ patch to support creation of standalone patch sets. By
4674 Bert J. Dempsey and Debra Weiss, updated by Jos Backus.
4675 <http://www.ils.unc.edu/i2dsi/unc_rsync+.html>
4676
4677 - IPv6 support based on a patch from KAME.net, on systems including modern
4678 versions of Linux, Solaris, and HP-UX. Also includes IPv6 compatibility
4679 functions for old OSs by the Internet Software Consortium, Paul Vixie, the
4680 OpenSSH portability project, and OpenBSD.
4681
4682### ENHANCEMENTS:
4683
4684 - Include/exclude cluestick: with `-vv`, print out whether files are included
4685 or excluded and why.
4686
4687 - Many error messages have more friendly explanations and more details.
4688
4689 - Manual page improvements plus scanty protocol documentation.
4690
4691 - When running as `--daemon` in the background and using a `log file`
4692 rsyncd.conf directive, close the log file every time it is open when going
4693 to sleep on the socket. This allows the log file to get cleaned out by
4694 another process.
4695
4696 - Change to using libpopt rather than getopt for processing options. This
4697 makes the code cleaner and the behaviour more consistent across platforms.
4698 popt is included and built if not installed on the platform.
4699
4700 - More details in `--version`, including note about whether 64-bit files,
4701 symlinks and hardlinks are supported.
4702
4703 - MD4 code may use less CPU cycles.
4704
4705 - Use mkstemp on systems where it is secure. If we use mktemp, explain that we
4706 do it in a secure way.
4707
4708 - `--whole-file` is the default when source and target are on the local
4709 machine.
4710
4711### BUG FIXES:
4712
4713 - Fix for various bugs causing rsync to hang.
4714
4715 - Attempt to fix Large File Summit support on AIX.
4716
4717 - Attempt to fix error handling lockup bug.
4718
4719 - Give a non-0 exit code if **any** of the files we have been asked to
4720 transfer fail to transfer.
4721
4722 - For log messages containing ridiculously long strings that might overflow a
4723 buffer rsync no longer aborts, but rather prints an ellipsis at the end of
4724 the string. (Patch from Ed Santiago.)
4725
4726### PLATFORMS:
4727
4728 - Improved support for UNICOS (tested on Cray T3E and Cray SV1)
4729
4730 - autoconf2.52 (or later) is now required to rebuild the autoconf scripts. It
4731 is not required to simply build rsync.
4732
4733 - Platforms thought to work in this release:
4734
4735 - Cray SV1 UNICOS 10.0.0.8 cc
4736 - Debian Linux 2.2 UltraSparc gcc
4737 - Debian Linux testing/unstable ARM gcc
4738 - FreeBSD 3.3-RELEASE i386 cc
4739 - FreeBSD 4.1.1-RELEASE i386 cc
4740 - FreeBSD 4.3-STABLE i386 cc
4741 - HP PA-RISC HP-UX 10.20 gcc
4742 - HP PA-RISC HP-UX 11.11 cc
4743 - IRIX 6.5 MIPS cc
4744 - IRIX 6.5 MIPS gcc
7f8cf771 4745 - Mac OS X PPC (`--disable-ipv6`) cc
87bca719
WD
4746 - NetBSD 1.5 i386 gcc
4747 - NetBSD Current i386 cc
4748 - OpenBSD 2.5 Sparc gcc
4749 - OpenBSD 2.9 i386 cc
4750 - OpenBSD Current i386 cc
4751 - RedHat 6.2 i386 gcc
4752 - RedHat 6.2 i386 insure++
4753 - RedHat 7.0 i386 gcc
4754 - RedHat 7.1 i386 (Kernel 2.4.10) gcc
4755 - Slackware 8.0 i686 (Kernel 2.4.10)
4756 - Solaris 8 UltraSparc cc
4757 - Solaris 8 UltraSparc gcc
4758 - Solaris 8 i386 gcc
4759 - SuSE 7.1 i386 gcc2.95.2
4760 - SuSE 7.1 ppc gcc2.95.2
4761 - i386-pc-sco3.2v5.0.5 cc
4762 - i386-pc-sco3.2v5.0.5 gcc
4763 - powerpc-ibm-aix4.3.3.0 cc
4764 - i686-unknown-sysv5UnixWare7.1.0 gcc
4765 - i686-unknown-sysv5UnixWare7.1.0 cc
4766
4767### TESTING:
4768
4769 - The existing test.sh script by Phil Hands has been merged into a
4770 test framework that works from both `make check` and the Samba
4771 build farm.
4772
4773------------------------------------------------------------------------------
4774
4775## Partial Protocol History
4776
4777| RELEASE DATE | VER. | DATE OF COMMIT\* | PROTOCOL |
4778|--------------|--------|------------------|-------------|
56a039b0 4779| ?? Apr 2024 | 3.3.1 | | 31 |
6c8ca91c 4780| 06 Apr 2024 | 3.3.0 | | 31 |
6b5ae825 4781| 20 Oct 2022 | 3.2.7 | | 31 |
db5bfe67 4782| 09 Sep 2022 | 3.2.6 | | 31 |
5fcf20ee 4783| 14 Aug 2022 | 3.2.5 | | 31 |
0ac7ebce 4784| 15 Apr 2022 | 3.2.4 | | 31 |
e94bad1c 4785| 06 Aug 2020 | 3.2.3 | | 31 |
194cee67 4786| 04 Jul 2020 | 3.2.2 | | 31 |
a8fc8fc2 4787| 22 Jun 2020 | 3.2.1 | | 31 |
87bca719
WD
4788| 19 Jun 2020 | 3.2.0 | | 31 |
4789| 28 Jan 2018 | 3.1.3 | | 31 |
4790| 21 Dec 2015 | 3.1.2 | | 31 |
4791| 22 Jun 2014 | 3.1.1 | | 31 |
4792| 28 Sep 2013 | 3.1.0 | 31 Aug 2008 | 31 |
4793| 23 Sep 2011 | 3.0.9 | | 30 |
4794| 26 Mar 2011 | 3.0.8 | | 30 |
4795| 31 Dec 2009 | 3.0.7 | | 30 |
4796| 08 May 2009 | 3.0.6 | | 30 |
4797| 28 Dec 2008 | 3.0.5 | | 30 |
4798| 06 Sep 2008 | 3.0.4 | | 30 |
4799| 29 Jun 2008 | 3.0.3 | | 30 |
4800| 08 Apr 2008 | 3.0.2 | | 30 |
4801| 03 Apr 2008 | 3.0.1 | | 30 |
4802| 01 Mar 2008 | 3.0.0 | 11 Nov 2006 | 30 |
4803| 06 Nov 2006 | 2.6.9 | | 29 |
4804| 22 Apr 2006 | 2.6.8 | | 29 |
4805| 11 Mar 2006 | 2.6.7 | | 29 |
4806| 28 Jul 2005 | 2.6.6 | | 29 |
4807| 01 Jun 2005 | 2.6.5 | | 29 |
4808| 30 Mar 2005 | 2.6.4 | 17 Jan 2005 | 29 |
4809| 30 Sep 2004 | 2.6.3 | | 28 |
4810| 30 Apr 2004 | 2.6.2 | | 28 |
4811| 26 Apr 2004 | 2.6.1 | 08 Jan 2004 | 28 |
4812| 01 Jan 2004 | 2.6.0 | 10 Apr 2003 | 27 (MAX=40) |
4813| 04 Dec 2003 | 2.5.7 | | 26 |
4814| 26 Jan 2003 | 2.5.6 | | 26 |
4815| 02 Apr 2002 | 2.5.5 | | 26 |
4816| 13 Mar 2002 | 2.5.4 | | 26 |
4817| 11 Mar 2002 | 2.5.3 | | 26 |
4818| 26 Jan 2002 | 2.5.2 | 11 Jan 2002 | 26 |
4819| 03 Jan 2002 | 2.5.1 | | 25 |
4820| 30 Nov 2001 | 2.5.0 | 23 Aug 2001 | 25 |
4821| 06 Sep 2000 | 2.4.6 | | 24 |
4822| 19 Aug 2000 | 2.4.5 | | 24 |
4823| 29 Jul 2000 | 2.4.4 | | 24 |
4824| 09 Apr 2000 | 2.4.3 | | 24 |
4825| 30 Mar 2000 | 2.4.2 | | 24 |
4826| 30 Jan 2000 | 2.4.1 | 29 Jan 2000 | 24 |
4827| 29 Jan 2000 | 2.4.0 | 28 Jan 2000 | 23 |
4828| 25 Jan 2000 | 2.3.3 | 23 Jan 2000 | 22 |
4829| 08 Nov 1999 | 2.3.2 | 26 Jun 1999 | 21 |
4830| 06 Apr 1999 | 2.3.1 | | 20 |
4831| 15 Mar 1999 | 2.3.0 | 15 Mar 1999 | 20 |
4832| 25 Nov 1998 | 2.2.1 | | 19 |
4833| 03 Nov 1998 | 2.2.0 | | 19 |
4834| 09 Sep 1998 | 2.1.1 | | 19 |
4835| 20 Jul 1998 | 2.1.0 | | 19 |
4836| 17 Jul 1998 | 2.0.19 | | 19 |
4837| 18 Jun 1998 | 2.0.17 | | 19 |
4838| 01 Jun 1998 | 2.0.16 | | 19 |
4839| 27 May 1998 | 2.0.13 | 27 May 1998 | 19 |
4840| 26 May 1998 | 2.0.12 | | 18 |
4841| 22 May 1998 | 2.0.11 | | 18 |
4842| 18 May 1998 | 2.0.9 | 18 May 1998 | 18 |
4843| 17 May 1998 | 2.0.8 | | 17 |
4844| 15 May 1998 | 2.0.1 | | 17 |
4845| 14 May 1998 | 2.0.0 | | 17 |
4846| 17 Apr 1998 | 1.7.4 | | 17 |
4847| 13 Apr 1998 | 1.7.3 | | 17 |
4848| 05 Apr 1998 | 1.7.2 | | 17 |
4849| 26 Mar 1998 | 1.7.1 | | 17 |
4850| 26 Mar 1998 | 1.7.0 | 26 Mar 1998 | 17 (MAX=30) |
4851| 13 Jan 1998 | 1.6.9 | 13 Jan 1998 | 15 (MAX=20) |
4852
4853\* DATE OF COMMIT is the date the protocol change was committed to version
4854control.
a2b630c0
WD
4855
4856@USE_GFM_PARSER@