]> git.ipfire.org Git - thirdparty/glibc.git/blame - manual/llio.texi
test-container: Fix "unused code" warnings on HURD
[thirdparty/glibc.git] / manual / llio.texi
CommitLineData
28f540f4 1@node Low-Level I/O, File System Interface, I/O on Streams, Top
7a68c94a 2@c %MENU% Low-level, less portable I/O
28f540f4
RM
3@chapter Low-Level Input/Output
4
5This chapter describes functions for performing low-level input/output
6operations on file descriptors. These functions include the primitives
7for the higher-level I/O functions described in @ref{I/O on Streams}, as
8well as functions for performing low-level control operations for which
9there are no equivalents on streams.
10
11Stream-level I/O is more flexible and usually more convenient;
12therefore, programmers generally use the descriptor-level functions only
13when necessary. These are some of the usual reasons:
14
15@itemize @bullet
16@item
17For reading binary files in large chunks.
18
19@item
20For reading an entire file into core before parsing it.
21
22@item
23To perform operations other than data transfer, which can only be done
24with a descriptor. (You can use @code{fileno} to get the descriptor
25corresponding to a stream.)
26
27@item
28To pass descriptors to a child process. (The child can create its own
29stream to use a descriptor that it inherits, but cannot inherit a stream
30directly.)
31@end itemize
32
33@menu
34* Opening and Closing Files:: How to open and close file
2c6fe0bd 35 descriptors.
28f540f4
RM
36* I/O Primitives:: Reading and writing data.
37* File Position Primitive:: Setting a descriptor's file
2c6fe0bd 38 position.
28f540f4
RM
39* Descriptors and Streams:: Converting descriptor to stream
40 or vice-versa.
41* Stream/Descriptor Precautions:: Precautions needed if you use both
42 descriptors and streams.
49c091e5 43* Scatter-Gather:: Fast I/O to discontinuous buffers.
bad7a0c8 44* Copying File Data:: Copying data between files.
07435eb4 45* Memory-mapped I/O:: Using files like memory.
28f540f4
RM
46* Waiting for I/O:: How to check for input or output
47 on multiple file descriptors.
dfd2257a 48* Synchronizing I/O:: Making sure all I/O actions completed.
b07d03e0 49* Asynchronous I/O:: Perform I/O in parallel.
28f540f4
RM
50* Control Operations:: Various other operations on file
51 descriptors.
52* Duplicating Descriptors:: Fcntl commands for duplicating
53 file descriptors.
54* Descriptor Flags:: Fcntl commands for manipulating
55 flags associated with file
2c6fe0bd 56 descriptors.
28f540f4
RM
57* File Status Flags:: Fcntl commands for manipulating
58 flags associated with open files.
59* File Locks:: Fcntl commands for implementing
60 file locking.
0961f7e1
JL
61* Open File Description Locks:: Fcntl commands for implementing
62 open file description locking.
63* Open File Description Locks Example:: An example of open file description lock
64 usage
28f540f4
RM
65* Interrupt Input:: Getting an asynchronous signal when
66 input arrives.
07435eb4 67* IOCTLs:: Generic I/O Control operations.
28f540f4
RM
68@end menu
69
70
71@node Opening and Closing Files
72@section Opening and Closing Files
73
74@cindex opening a file descriptor
75@cindex closing a file descriptor
76This section describes the primitives for opening and closing files
77using file descriptors. The @code{open} and @code{creat} functions are
78declared in the header file @file{fcntl.h}, while @code{close} is
79declared in @file{unistd.h}.
80@pindex unistd.h
81@pindex fcntl.h
82
28f540f4 83@deftypefun int open (const char *@var{filename}, int @var{flags}[, mode_t @var{mode}])
d08a7e4c 84@standards{POSIX.1, fcntl.h}
2cc3615c 85@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{@acsfd{}}}
624254b1
SC
86The @code{open} function creates and returns a new file descriptor for
87the file named by @var{filename}. Initially, the file position
28f540f4 88indicator for the file is at the beginning of the file. The argument
624254b1
SC
89@var{mode} (@pxref{Permission Bits}) is used only when a file is
90created, but it doesn't hurt to supply the argument in any case.
28f540f4
RM
91
92The @var{flags} argument controls how the file is to be opened. This is
93a bit mask; you create the value by the bitwise OR of the appropriate
94parameters (using the @samp{|} operator in C).
95@xref{File Status Flags}, for the parameters available.
96
97The normal return value from @code{open} is a non-negative integer file
07435eb4 98descriptor. In the case of an error, a value of @math{-1} is returned
28f540f4
RM
99instead. In addition to the usual file name errors (@pxref{File
100Name Errors}), the following @code{errno} error conditions are defined
101for this function:
102
103@table @code
104@item EACCES
19e4c7dd 105The file exists but is not readable/writable as requested by the @var{flags}
9739d2d5 106argument, or the file does not exist and the directory is unwritable so
28f540f4
RM
107it cannot be created.
108
109@item EEXIST
110Both @code{O_CREAT} and @code{O_EXCL} are set, and the named file already
111exists.
112
113@item EINTR
114The @code{open} operation was interrupted by a signal.
115@xref{Interrupted Primitives}.
116
117@item EISDIR
118The @var{flags} argument specified write access, and the file is a directory.
119
120@item EMFILE
121The process has too many files open.
122The maximum number of file descriptors is controlled by the
123@code{RLIMIT_NOFILE} resource limit; @pxref{Limits on Resources}.
124
125@item ENFILE
126The entire system, or perhaps the file system which contains the
127directory, cannot support any additional open files at the moment.
a7a93d50 128(This problem cannot happen on @gnuhurdsystems{}.)
28f540f4
RM
129
130@item ENOENT
131The named file does not exist, and @code{O_CREAT} is not specified.
132
133@item ENOSPC
134The directory or file system that would contain the new file cannot be
135extended, because there is no disk space left.
136
137@item ENXIO
138@code{O_NONBLOCK} and @code{O_WRONLY} are both set in the @var{flags}
139argument, the file named by @var{filename} is a FIFO (@pxref{Pipes and
140FIFOs}), and no process has the file open for reading.
141
142@item EROFS
143The file resides on a read-only file system and any of @w{@code{O_WRONLY}},
144@code{O_RDWR}, and @code{O_TRUNC} are set in the @var{flags} argument,
145or @code{O_CREAT} is set and the file does not already exist.
146@end table
147
148@c !!! umask
149
04b9968b 150If on a 32 bit machine the sources are translated with
b07d03e0
UD
151@code{_FILE_OFFSET_BITS == 64} the function @code{open} returns a file
152descriptor opened in the large file mode which enables the file handling
9ceeb279
OB
153functions to use files up to @twoexp{63} bytes in size and offset from
154@minus{}@twoexp{63} to @twoexp{63}. This happens transparently for the user
9739d2d5 155since all of the low-level file handling functions are equally replaced.
b07d03e0 156
04b9968b 157This function is a cancellation point in multi-threaded programs. This
dfd2257a
UD
158is a problem if the thread allocates some resources (like memory, file
159descriptors, semaphores or whatever) at the time @code{open} is
19e4c7dd 160called. If the thread gets canceled these resources stay allocated
dfd2257a 161until the program ends. To avoid this calls to @code{open} should be
04b9968b 162protected using cancellation handlers.
dfd2257a
UD
163@c ref pthread_cleanup_push / pthread_cleanup_pop
164
28f540f4
RM
165The @code{open} function is the underlying primitive for the @code{fopen}
166and @code{freopen} functions, that create streams.
167@end deftypefun
168
b07d03e0 169@deftypefun int open64 (const char *@var{filename}, int @var{flags}[, mode_t @var{mode}])
d08a7e4c 170@standards{Unix98, fcntl.h}
2cc3615c 171@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{@acsfd{}}}
b07d03e0
UD
172This function is similar to @code{open}. It returns a file descriptor
173which can be used to access the file named by @var{filename}. The only
04b9968b 174difference is that on 32 bit systems the file is opened in the
b07d03e0
UD
175large file mode. I.e., file length and file offsets can exceed 31 bits.
176
b07d03e0
UD
177When the sources are translated with @code{_FILE_OFFSET_BITS == 64} this
178function is actually available under the name @code{open}. I.e., the
179new, extended API using 64 bit file sizes and offsets transparently
180replaces the old API.
181@end deftypefun
182
28f540f4 183@deftypefn {Obsolete function} int creat (const char *@var{filename}, mode_t @var{mode})
d08a7e4c 184@standards{POSIX.1, fcntl.h}
2cc3615c 185@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{@acsfd{}}}
28f540f4
RM
186This function is obsolete. The call:
187
188@smallexample
189creat (@var{filename}, @var{mode})
190@end smallexample
191
192@noindent
193is equivalent to:
194
195@smallexample
196open (@var{filename}, O_WRONLY | O_CREAT | O_TRUNC, @var{mode})
197@end smallexample
b07d03e0 198
04b9968b 199If on a 32 bit machine the sources are translated with
b07d03e0
UD
200@code{_FILE_OFFSET_BITS == 64} the function @code{creat} returns a file
201descriptor opened in the large file mode which enables the file handling
9ceeb279
OB
202functions to use files up to @twoexp{63} in size and offset from
203@minus{}@twoexp{63} to @twoexp{63}. This happens transparently for the user
9739d2d5 204since all of the low-level file handling functions are equally replaced.
b07d03e0
UD
205@end deftypefn
206
b07d03e0 207@deftypefn {Obsolete function} int creat64 (const char *@var{filename}, mode_t @var{mode})
d08a7e4c 208@standards{Unix98, fcntl.h}
2cc3615c 209@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{@acsfd{}}}
b07d03e0
UD
210This function is similar to @code{creat}. It returns a file descriptor
211which can be used to access the file named by @var{filename}. The only
9739d2d5 212difference is that on 32 bit systems the file is opened in the
b07d03e0
UD
213large file mode. I.e., file length and file offsets can exceed 31 bits.
214
215To use this file descriptor one must not use the normal operations but
216instead the counterparts named @code{*64}, e.g., @code{read64}.
217
218When the sources are translated with @code{_FILE_OFFSET_BITS == 64} this
219function is actually available under the name @code{open}. I.e., the
220new, extended API using 64 bit file sizes and offsets transparently
221replaces the old API.
28f540f4
RM
222@end deftypefn
223
28f540f4 224@deftypefun int close (int @var{filedes})
d08a7e4c 225@standards{POSIX.1, unistd.h}
2cc3615c 226@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{@acsfd{}}}
28f540f4
RM
227The function @code{close} closes the file descriptor @var{filedes}.
228Closing a file has the following consequences:
229
230@itemize @bullet
2c6fe0bd 231@item
28f540f4
RM
232The file descriptor is deallocated.
233
234@item
235Any record locks owned by the process on the file are unlocked.
236
237@item
238When all file descriptors associated with a pipe or FIFO have been closed,
239any unread data is discarded.
240@end itemize
241
04b9968b 242This function is a cancellation point in multi-threaded programs. This
dfd2257a
UD
243is a problem if the thread allocates some resources (like memory, file
244descriptors, semaphores or whatever) at the time @code{close} is
19e4c7dd 245called. If the thread gets canceled these resources stay allocated
04b9968b
UD
246until the program ends. To avoid this, calls to @code{close} should be
247protected using cancellation handlers.
dfd2257a
UD
248@c ref pthread_cleanup_push / pthread_cleanup_pop
249
07435eb4 250The normal return value from @code{close} is @math{0}; a value of @math{-1}
28f540f4
RM
251is returned in case of failure. The following @code{errno} error
252conditions are defined for this function:
253
254@table @code
255@item EBADF
256The @var{filedes} argument is not a valid file descriptor.
257
258@item EINTR
259The @code{close} call was interrupted by a signal.
260@xref{Interrupted Primitives}.
261Here is an example of how to handle @code{EINTR} properly:
262
263@smallexample
264TEMP_FAILURE_RETRY (close (desc));
265@end smallexample
266
267@item ENOSPC
268@itemx EIO
269@itemx EDQUOT
2c6fe0bd 270When the file is accessed by NFS, these errors from @code{write} can sometimes
28f540f4
RM
271not be detected until @code{close}. @xref{I/O Primitives}, for details
272on their meaning.
273@end table
b07d03e0
UD
274
275Please note that there is @emph{no} separate @code{close64} function.
276This is not necessary since this function does not determine nor depend
fed8f7f7 277on the mode of the file. The kernel which performs the @code{close}
04b9968b 278operation knows which mode the descriptor is used for and can handle
b07d03e0 279this situation.
28f540f4
RM
280@end deftypefun
281
282To close a stream, call @code{fclose} (@pxref{Closing Streams}) instead
283of trying to close its underlying file descriptor with @code{close}.
284This flushes any buffered output and updates the stream object to
285indicate that it is closed.
286
28628628
AZ
287@deftypefun int close_range (unsigned int @var{lowfd}, unsigned int @var{maxfd}, int @var{flags})
288@standards{Linux, unistd.h}
289@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{@acsfd{}}}
290@c This is a syscall for Linux v5.9. There is no fallback emulation for
291@c older kernels.
292
293The function @code{close_range} closes the file descriptor from @var{lowfd}
294to @var{maxfd} (inclusive). This function is similar to call @code{close} in
295specified file descriptor range depending on the @var{flags}.
296
297This is function is only supported on recent Linux versions and @theglibc{}
298does not provide any fallback (the application will need to handle possible
299@code{ENOSYS}).
300
301The @var{flags} add options on how the files are closes. Linux currently
302supports:
303
304@vtable @code
305@item CLOSE_RANGE_UNSHARE
306Unshare the file descriptor table before closing file descriptors.
307
308@item CLOSE_RANGE_CLOEXEC
309Set the @code{FD_CLOEXEC} bit instead of closing the file descriptor.
310@end vtable
311
312The normal return value from @code{close_range} is @math{0}; a value
313of @math{-1} is returned in case of failure. The following @code{errno} error
314conditions are defined for this function:
315
316@table @code
317@item EINVAL
318The @var{lowfd} value is larger than @var{maxfd} or an unsupported @var{flags}
319is used.
320
321@item ENOMEM
322Either there is not enough memory for the operation, or the process is
323out of address space. It can only happnes when @code{CLOSE_RANGE_UNSHARED}
324flag is used.
325
326@item EMFILE
327The process has too many files open and it can only happens when
328@code{CLOSE_RANGE_UNSHARED} flag is used.
329The maximum number of file descriptors is controlled by the
330@code{RLIMIT_NOFILE} resource limit; @pxref{Limits on Resources}.
331
332@item ENOSYS
333The kernel does not implement the required functionality.
334@end table
335@end deftypefun
336
60744950
AZ
337@deftypefun void closefrom (int @var{lowfd})
338@standards{GNU, unistd.h}
339@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{@acsfd{}}}
340
5aa359d3
MK
341The function @code{closefrom} closes all file descriptors greater than or equal
342to @var{lowfd}. This function is similar to calling
60744950
AZ
343@code{close} for all open file descriptors not less than @var{lowfd}.
344
345Already closed file descriptors are ignored.
346@end deftypefun
28628628 347
28f540f4
RM
348@node I/O Primitives
349@section Input and Output Primitives
350
351This section describes the functions for performing primitive input and
352output operations on file descriptors: @code{read}, @code{write}, and
353@code{lseek}. These functions are declared in the header file
354@file{unistd.h}.
355@pindex unistd.h
356
28f540f4 357@deftp {Data Type} ssize_t
d08a7e4c 358@standards{POSIX.1, unistd.h}
28f540f4
RM
359This data type is used to represent the sizes of blocks that can be
360read or written in a single operation. It is similar to @code{size_t},
361but must be a signed type.
362@end deftp
363
364@cindex reading from a file descriptor
28f540f4 365@deftypefun ssize_t read (int @var{filedes}, void *@var{buffer}, size_t @var{size})
d08a7e4c 366@standards{POSIX.1, unistd.h}
2cc3615c 367@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
28f540f4
RM
368The @code{read} function reads up to @var{size} bytes from the file
369with descriptor @var{filedes}, storing the results in the @var{buffer}.
04b9968b
UD
370(This is not necessarily a character string, and no terminating null
371character is added.)
28f540f4
RM
372
373@cindex end-of-file, on a file descriptor
374The return value is the number of bytes actually read. This might be
375less than @var{size}; for example, if there aren't that many bytes left
376in the file or if there aren't that many bytes immediately available.
377The exact behavior depends on what kind of file it is. Note that
378reading less than @var{size} bytes is not an error.
379
380A value of zero indicates end-of-file (except if the value of the
381@var{size} argument is also zero). This is not considered an error.
382If you keep calling @code{read} while at end-of-file, it will keep
383returning zero and doing nothing else.
384
385If @code{read} returns at least one character, there is no way you can
386tell whether end-of-file was reached. But if you did reach the end, the
387next read will return zero.
388
07435eb4 389In case of an error, @code{read} returns @math{-1}. The following
28f540f4
RM
390@code{errno} error conditions are defined for this function:
391
392@table @code
393@item EAGAIN
394Normally, when no input is immediately available, @code{read} waits for
395some input. But if the @code{O_NONBLOCK} flag is set for the file
396(@pxref{File Status Flags}), @code{read} returns immediately without
397reading any data, and reports this error.
398
399@strong{Compatibility Note:} Most versions of BSD Unix use a different
1f77f049 400error code for this: @code{EWOULDBLOCK}. In @theglibc{},
28f540f4
RM
401@code{EWOULDBLOCK} is an alias for @code{EAGAIN}, so it doesn't matter
402which name you use.
403
404On some systems, reading a large amount of data from a character special
405file can also fail with @code{EAGAIN} if the kernel cannot find enough
406physical memory to lock down the user's pages. This is limited to
407devices that transfer with direct memory access into the user's memory,
408which means it does not include terminals, since they always use
a7a93d50
JM
409separate buffers inside the kernel. This problem never happens on
410@gnuhurdsystems{}.
28f540f4
RM
411
412Any condition that could result in @code{EAGAIN} can instead result in a
413successful @code{read} which returns fewer bytes than requested.
414Calling @code{read} again immediately would result in @code{EAGAIN}.
415
416@item EBADF
417The @var{filedes} argument is not a valid file descriptor,
418or is not open for reading.
419
420@item EINTR
421@code{read} was interrupted by a signal while it was waiting for input.
9739d2d5 422@xref{Interrupted Primitives}. A signal will not necessarily cause
28f540f4
RM
423@code{read} to return @code{EINTR}; it may instead result in a
424successful @code{read} which returns fewer bytes than requested.
425
426@item EIO
427For many devices, and for disk files, this error code indicates
428a hardware error.
429
430@code{EIO} also occurs when a background process tries to read from the
431controlling terminal, and the normal action of stopping the process by
432sending it a @code{SIGTTIN} signal isn't working. This might happen if
04b9968b 433the signal is being blocked or ignored, or because the process group is
28f540f4
RM
434orphaned. @xref{Job Control}, for more information about job control,
435and @ref{Signal Handling}, for information about signals.
7e583a52
RM
436
437@item EINVAL
438In some systems, when reading from a character or block device, position
439and size offsets must be aligned to a particular block size. This error
440indicates that the offsets were not properly aligned.
28f540f4
RM
441@end table
442
b07d03e0
UD
443Please note that there is no function named @code{read64}. This is not
444necessary since this function does not directly modify or handle the
445possibly wide file offset. Since the kernel handles this state
04b9968b 446internally, the @code{read} function can be used for all cases.
b07d03e0 447
04b9968b 448This function is a cancellation point in multi-threaded programs. This
dfd2257a
UD
449is a problem if the thread allocates some resources (like memory, file
450descriptors, semaphores or whatever) at the time @code{read} is
19e4c7dd 451called. If the thread gets canceled these resources stay allocated
04b9968b
UD
452until the program ends. To avoid this, calls to @code{read} should be
453protected using cancellation handlers.
dfd2257a
UD
454@c ref pthread_cleanup_push / pthread_cleanup_pop
455
28f540f4
RM
456The @code{read} function is the underlying primitive for all of the
457functions that read from streams, such as @code{fgetc}.
458@end deftypefun
459
a5a0310d 460@deftypefun ssize_t pread (int @var{filedes}, void *@var{buffer}, size_t @var{size}, off_t @var{offset})
d08a7e4c 461@standards{Unix98, unistd.h}
2cc3615c
AO
462@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
463@c This is usually a safe syscall. The sysdeps/posix fallback emulation
464@c is not MT-Safe because it uses lseek, read and lseek back, but is it
465@c used anywhere?
a5a0310d 466The @code{pread} function is similar to the @code{read} function. The
04b9968b
UD
467first three arguments are identical, and the return values and error
468codes also correspond.
a5a0310d
UD
469
470The difference is the fourth argument and its handling. The data block
471is not read from the current position of the file descriptor
472@code{filedes}. Instead the data is read from the file starting at
473position @var{offset}. The position of the file descriptor itself is
04b9968b 474not affected by the operation. The value is the same as before the call.
a5a0310d 475
b07d03e0
UD
476When the source file is compiled with @code{_FILE_OFFSET_BITS == 64} the
477@code{pread} function is in fact @code{pread64} and the type
04b9968b 478@code{off_t} has 64 bits, which makes it possible to handle files up to
9ceeb279 479@twoexp{63} bytes in length.
b07d03e0 480
a5a0310d
UD
481The return value of @code{pread} describes the number of bytes read.
482In the error case it returns @math{-1} like @code{read} does and the
04b9968b
UD
483error codes are also the same, with these additions:
484
a5a0310d
UD
485@table @code
486@item EINVAL
487The value given for @var{offset} is negative and therefore illegal.
488
489@item ESPIPE
9739d2d5 490The file descriptor @var{filedes} is associated with a pipe or a FIFO and
a5a0310d
UD
491this device does not allow positioning of the file pointer.
492@end table
493
494The function is an extension defined in the Unix Single Specification
495version 2.
496@end deftypefun
497
b07d03e0 498@deftypefun ssize_t pread64 (int @var{filedes}, void *@var{buffer}, size_t @var{size}, off64_t @var{offset})
d08a7e4c 499@standards{Unix98, unistd.h}
2cc3615c
AO
500@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
501@c This is usually a safe syscall. The sysdeps/posix fallback emulation
502@c is not MT-Safe because it uses lseek64, read and lseek64 back, but is
503@c it used anywhere?
b07d03e0
UD
504This function is similar to the @code{pread} function. The difference
505is that the @var{offset} parameter is of type @code{off64_t} instead of
04b9968b 506@code{off_t} which makes it possible on 32 bit machines to address
9ceeb279 507files larger than @twoexp{31} bytes and up to @twoexp{63} bytes. The
b07d03e0
UD
508file descriptor @code{filedes} must be opened using @code{open64} since
509otherwise the large offsets possible with @code{off64_t} will lead to
510errors with a descriptor in small file mode.
511
c756c71c 512When the source file is compiled with @code{_FILE_OFFSET_BITS == 64} on a
04b9968b
UD
51332 bit machine this function is actually available under the name
514@code{pread} and so transparently replaces the 32 bit interface.
b07d03e0
UD
515@end deftypefun
516
28f540f4 517@cindex writing to a file descriptor
28f540f4 518@deftypefun ssize_t write (int @var{filedes}, const void *@var{buffer}, size_t @var{size})
d08a7e4c 519@standards{POSIX.1, unistd.h}
2cc3615c 520@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
0c6891a0
CD
521@c Some say write is thread-unsafe on Linux without O_APPEND. In the VFS layer
522@c the vfs_write() does no locking around the acquisition of a file offset and
523@c therefore multiple threads / kernel tasks may race and get the same offset
524@c resulting in data loss.
525@c
526@c See:
527@c http://thread.gmane.org/gmane.linux.kernel/397980
528@c http://lwn.net/Articles/180387/
529@c
530@c The counter argument is that POSIX only says that the write starts at the
531@c file position and that the file position is updated *before* the function
532@c returns. What that really means is that any expectation of atomic writes is
533@c strictly an invention of the interpretation of the reader. Data loss could
534@c happen if two threads start the write at the same time. Only writes that
535@c come after the return of another write are guaranteed to follow the other
536@c write.
537@c
538@c The other side of the coin is that POSIX goes on further to say in
539@c "2.9.7 Thread Interactions with Regular File Operations" that threads
540@c should never see interleaving sets of file operations, but it is insane
541@c to do anything like that because it kills performance, so you don't get
542@c those guarantees in Linux.
543@c
544@c So we mark it thread safe, it doesn't blow up, but you might loose
545@c data, and we don't strictly meet the POSIX requirements.
a2887bdb
CD
546@c
547@c The fix for file offsets racing was merged in 3.14, the commits were:
548@c 9c225f2655e36a470c4f58dbbc99244c5fc7f2d4, and
549@c d7a15f8d0777955986a2ab00ab181795cab14b01. Therefore after Linux 3.14 you
550@c should get mostly MT-safe writes.
28f540f4
RM
551The @code{write} function writes up to @var{size} bytes from
552@var{buffer} to the file with descriptor @var{filedes}. The data in
553@var{buffer} is not necessarily a character string and a null character is
554output like any other character.
555
556The return value is the number of bytes actually written. This may be
557@var{size}, but can always be smaller. Your program should always call
558@code{write} in a loop, iterating until all the data is written.
559
560Once @code{write} returns, the data is enqueued to be written and can be
561read back right away, but it is not necessarily written out to permanent
562storage immediately. You can use @code{fsync} when you need to be sure
563your data has been permanently stored before continuing. (It is more
564efficient for the system to batch up consecutive writes and do them all
565at once when convenient. Normally they will always be written to disk
a5a0310d
UD
566within a minute or less.) Modern systems provide another function
567@code{fdatasync} which guarantees integrity only for the file data and
568is therefore faster.
569@c !!! xref fsync, fdatasync
2c6fe0bd 570You can use the @code{O_FSYNC} open mode to make @code{write} always
28f540f4
RM
571store the data to disk before returning; @pxref{Operating Modes}.
572
07435eb4 573In the case of an error, @code{write} returns @math{-1}. The following
28f540f4
RM
574@code{errno} error conditions are defined for this function:
575
576@table @code
577@item EAGAIN
578Normally, @code{write} blocks until the write operation is complete.
579But if the @code{O_NONBLOCK} flag is set for the file (@pxref{Control
04b9968b 580Operations}), it returns immediately without writing any data and
28f540f4
RM
581reports this error. An example of a situation that might cause the
582process to block on output is writing to a terminal device that supports
583flow control, where output has been suspended by receipt of a STOP
584character.
585
586@strong{Compatibility Note:} Most versions of BSD Unix use a different
1f77f049 587error code for this: @code{EWOULDBLOCK}. In @theglibc{},
28f540f4
RM
588@code{EWOULDBLOCK} is an alias for @code{EAGAIN}, so it doesn't matter
589which name you use.
590
591On some systems, writing a large amount of data from a character special
592file can also fail with @code{EAGAIN} if the kernel cannot find enough
593physical memory to lock down the user's pages. This is limited to
594devices that transfer with direct memory access into the user's memory,
595which means it does not include terminals, since they always use
a7a93d50
JM
596separate buffers inside the kernel. This problem does not arise on
597@gnuhurdsystems{}.
28f540f4
RM
598
599@item EBADF
600The @var{filedes} argument is not a valid file descriptor,
601or is not open for writing.
602
603@item EFBIG
604The size of the file would become larger than the implementation can support.
605
606@item EINTR
607The @code{write} operation was interrupted by a signal while it was
04b9968b 608blocked waiting for completion. A signal will not necessarily cause
28f540f4
RM
609@code{write} to return @code{EINTR}; it may instead result in a
610successful @code{write} which writes fewer bytes than requested.
611@xref{Interrupted Primitives}.
612
613@item EIO
614For many devices, and for disk files, this error code indicates
615a hardware error.
616
617@item ENOSPC
618The device containing the file is full.
619
620@item EPIPE
621This error is returned when you try to write to a pipe or FIFO that
622isn't open for reading by any process. When this happens, a @code{SIGPIPE}
623signal is also sent to the process; see @ref{Signal Handling}.
7e583a52
RM
624
625@item EINVAL
626In some systems, when writing to a character or block device, position
627and size offsets must be aligned to a particular block size. This error
628indicates that the offsets were not properly aligned.
28f540f4
RM
629@end table
630
631Unless you have arranged to prevent @code{EINTR} failures, you should
632check @code{errno} after each failing call to @code{write}, and if the
633error was @code{EINTR}, you should simply repeat the call.
634@xref{Interrupted Primitives}. The easy way to do this is with the
635macro @code{TEMP_FAILURE_RETRY}, as follows:
636
637@smallexample
638nbytes = TEMP_FAILURE_RETRY (write (desc, buffer, count));
639@end smallexample
640
b07d03e0
UD
641Please note that there is no function named @code{write64}. This is not
642necessary since this function does not directly modify or handle the
643possibly wide file offset. Since the kernel handles this state
644internally the @code{write} function can be used for all cases.
645
04b9968b 646This function is a cancellation point in multi-threaded programs. This
dfd2257a
UD
647is a problem if the thread allocates some resources (like memory, file
648descriptors, semaphores or whatever) at the time @code{write} is
19e4c7dd 649called. If the thread gets canceled these resources stay allocated
04b9968b
UD
650until the program ends. To avoid this, calls to @code{write} should be
651protected using cancellation handlers.
dfd2257a
UD
652@c ref pthread_cleanup_push / pthread_cleanup_pop
653
28f540f4
RM
654The @code{write} function is the underlying primitive for all of the
655functions that write to streams, such as @code{fputc}.
656@end deftypefun
657
a5a0310d 658@deftypefun ssize_t pwrite (int @var{filedes}, const void *@var{buffer}, size_t @var{size}, off_t @var{offset})
d08a7e4c 659@standards{Unix98, unistd.h}
2cc3615c
AO
660@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
661@c This is usually a safe syscall. The sysdeps/posix fallback emulation
662@c is not MT-Safe because it uses lseek, write and lseek back, but is it
663@c used anywhere?
a5a0310d 664The @code{pwrite} function is similar to the @code{write} function. The
04b9968b
UD
665first three arguments are identical, and the return values and error codes
666also correspond.
a5a0310d
UD
667
668The difference is the fourth argument and its handling. The data block
669is not written to the current position of the file descriptor
670@code{filedes}. Instead the data is written to the file starting at
671position @var{offset}. The position of the file descriptor itself is
04b9968b 672not affected by the operation. The value is the same as before the call.
a5a0310d 673
717da4b3
AZ
674However, on Linux, if a file is opened with @code{O_APPEND}, @code{pwrite}
675appends data to the end of the file, regardless of the value of
676@code{offset}.
677
b07d03e0
UD
678When the source file is compiled with @code{_FILE_OFFSET_BITS == 64} the
679@code{pwrite} function is in fact @code{pwrite64} and the type
04b9968b 680@code{off_t} has 64 bits, which makes it possible to handle files up to
9ceeb279 681@twoexp{63} bytes in length.
b07d03e0 682
a5a0310d
UD
683The return value of @code{pwrite} describes the number of written bytes.
684In the error case it returns @math{-1} like @code{write} does and the
04b9968b
UD
685error codes are also the same, with these additions:
686
a5a0310d
UD
687@table @code
688@item EINVAL
689The value given for @var{offset} is negative and therefore illegal.
690
691@item ESPIPE
04b9968b 692The file descriptor @var{filedes} is associated with a pipe or a FIFO and
a5a0310d
UD
693this device does not allow positioning of the file pointer.
694@end table
695
696The function is an extension defined in the Unix Single Specification
697version 2.
698@end deftypefun
699
b07d03e0 700@deftypefun ssize_t pwrite64 (int @var{filedes}, const void *@var{buffer}, size_t @var{size}, off64_t @var{offset})
d08a7e4c 701@standards{Unix98, unistd.h}
2cc3615c
AO
702@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
703@c This is usually a safe syscall. The sysdeps/posix fallback emulation
704@c is not MT-Safe because it uses lseek64, write and lseek64 back, but
705@c is it used anywhere?
b07d03e0
UD
706This function is similar to the @code{pwrite} function. The difference
707is that the @var{offset} parameter is of type @code{off64_t} instead of
04b9968b 708@code{off_t} which makes it possible on 32 bit machines to address
9ceeb279 709files larger than @twoexp{31} bytes and up to @twoexp{63} bytes. The
b07d03e0
UD
710file descriptor @code{filedes} must be opened using @code{open64} since
711otherwise the large offsets possible with @code{off64_t} will lead to
712errors with a descriptor in small file mode.
713
c756c71c 714When the source file is compiled using @code{_FILE_OFFSET_BITS == 64} on a
04b9968b
UD
71532 bit machine this function is actually available under the name
716@code{pwrite} and so transparently replaces the 32 bit interface.
b07d03e0 717@end deftypefun
717da4b3 718
28f540f4
RM
719@node File Position Primitive
720@section Setting the File Position of a Descriptor
721
722Just as you can set the file position of a stream with @code{fseek}, you
723can set the file position of a descriptor with @code{lseek}. This
724specifies the position in the file for the next @code{read} or
725@code{write} operation. @xref{File Positioning}, for more information
726on the file position and what it means.
727
728To read the current file position value from a descriptor, use
729@code{lseek (@var{desc}, 0, SEEK_CUR)}.
730
731@cindex file positioning on a file descriptor
732@cindex positioning a file descriptor
733@cindex seeking on a file descriptor
28f540f4 734@deftypefun off_t lseek (int @var{filedes}, off_t @var{offset}, int @var{whence})
d08a7e4c 735@standards{POSIX.1, unistd.h}
2cc3615c 736@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
28f540f4
RM
737The @code{lseek} function is used to change the file position of the
738file with descriptor @var{filedes}.
739
740The @var{whence} argument specifies how the @var{offset} should be
04b9968b
UD
741interpreted, in the same way as for the @code{fseek} function, and it must
742be one of the symbolic constants @code{SEEK_SET}, @code{SEEK_CUR}, or
28f540f4
RM
743@code{SEEK_END}.
744
2fe82ca6 745@vtable @code
28f540f4 746@item SEEK_SET
4dad7bab 747Specifies that @var{offset} is a count of characters from the beginning
28f540f4
RM
748of the file.
749
750@item SEEK_CUR
4dad7bab 751Specifies that @var{offset} is a count of characters from the current
28f540f4
RM
752file position. This count may be positive or negative.
753
754@item SEEK_END
4dad7bab 755Specifies that @var{offset} is a count of characters from the end of
28f540f4
RM
756the file. A negative count specifies a position within the current
757extent of the file; a positive count specifies a position past the
2c6fe0bd 758current end. If you set the position past the current end, and
28f540f4 759actually write data, you will extend the file with zeros up to that
336dfb2d 760position.
2fe82ca6 761@end vtable
28f540f4
RM
762
763The return value from @code{lseek} is normally the resulting file
764position, measured in bytes from the beginning of the file.
765You can use this feature together with @code{SEEK_CUR} to read the
766current file position.
767
768If you want to append to the file, setting the file position to the
769current end of file with @code{SEEK_END} is not sufficient. Another
770process may write more data after you seek but before you write,
771extending the file so the position you write onto clobbers their data.
772Instead, use the @code{O_APPEND} operating mode; @pxref{Operating Modes}.
773
774You can set the file position past the current end of the file. This
775does not by itself make the file longer; @code{lseek} never changes the
776file. But subsequent output at that position will extend the file.
777Characters between the previous end of file and the new position are
778filled with zeros. Extending the file in this way can create a
779``hole'': the blocks of zeros are not actually allocated on disk, so the
78759725 780file takes up less space than it appears to; it is then called a
28f540f4
RM
781``sparse file''.
782@cindex sparse files
783@cindex holes in files
784
785If the file position cannot be changed, or the operation is in some way
07435eb4 786invalid, @code{lseek} returns a value of @math{-1}. The following
28f540f4
RM
787@code{errno} error conditions are defined for this function:
788
789@table @code
790@item EBADF
791The @var{filedes} is not a valid file descriptor.
792
793@item EINVAL
794The @var{whence} argument value is not valid, or the resulting
795file offset is not valid. A file offset is invalid.
796
797@item ESPIPE
798The @var{filedes} corresponds to an object that cannot be positioned,
799such as a pipe, FIFO or terminal device. (POSIX.1 specifies this error
a7a93d50 800only for pipes and FIFOs, but on @gnusystems{}, you always get
28f540f4
RM
801@code{ESPIPE} if the object is not seekable.)
802@end table
803
b07d03e0
UD
804When the source file is compiled with @code{_FILE_OFFSET_BITS == 64} the
805@code{lseek} function is in fact @code{lseek64} and the type
806@code{off_t} has 64 bits which makes it possible to handle files up to
9ceeb279 807@twoexp{63} bytes in length.
b07d03e0 808
04b9968b 809This function is a cancellation point in multi-threaded programs. This
dfd2257a
UD
810is a problem if the thread allocates some resources (like memory, file
811descriptors, semaphores or whatever) at the time @code{lseek} is
19e4c7dd 812called. If the thread gets canceled these resources stay allocated
dfd2257a 813until the program ends. To avoid this calls to @code{lseek} should be
04b9968b 814protected using cancellation handlers.
dfd2257a
UD
815@c ref pthread_cleanup_push / pthread_cleanup_pop
816
28f540f4 817The @code{lseek} function is the underlying primitive for the
dfd2257a
UD
818@code{fseek}, @code{fseeko}, @code{ftell}, @code{ftello} and
819@code{rewind} functions, which operate on streams instead of file
820descriptors.
28f540f4
RM
821@end deftypefun
822
b07d03e0 823@deftypefun off64_t lseek64 (int @var{filedes}, off64_t @var{offset}, int @var{whence})
d08a7e4c 824@standards{Unix98, unistd.h}
2cc3615c 825@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
b07d03e0
UD
826This function is similar to the @code{lseek} function. The difference
827is that the @var{offset} parameter is of type @code{off64_t} instead of
04b9968b 828@code{off_t} which makes it possible on 32 bit machines to address
9ceeb279 829files larger than @twoexp{31} bytes and up to @twoexp{63} bytes. The
b07d03e0
UD
830file descriptor @code{filedes} must be opened using @code{open64} since
831otherwise the large offsets possible with @code{off64_t} will lead to
832errors with a descriptor in small file mode.
833
c756c71c 834When the source file is compiled with @code{_FILE_OFFSET_BITS == 64} on a
b07d03e0 83532 bits machine this function is actually available under the name
04b9968b 836@code{lseek} and so transparently replaces the 32 bit interface.
b07d03e0
UD
837@end deftypefun
838
28f540f4 839You can have multiple descriptors for the same file if you open the file
2c6fe0bd 840more than once, or if you duplicate a descriptor with @code{dup}.
28f540f4
RM
841Descriptors that come from separate calls to @code{open} have independent
842file positions; using @code{lseek} on one descriptor has no effect on the
2c6fe0bd 843other. For example,
28f540f4
RM
844
845@smallexample
846@group
847@{
848 int d1, d2;
849 char buf[4];
850 d1 = open ("foo", O_RDONLY);
851 d2 = open ("foo", O_RDONLY);
852 lseek (d1, 1024, SEEK_SET);
853 read (d2, buf, 4);
854@}
855@end group
856@end smallexample
857
858@noindent
859will read the first four characters of the file @file{foo}. (The
860error-checking code necessary for a real program has been omitted here
861for brevity.)
862
863By contrast, descriptors made by duplication share a common file
864position with the original descriptor that was duplicated. Anything
865which alters the file position of one of the duplicates, including
866reading or writing data, affects all of them alike. Thus, for example,
867
868@smallexample
869@{
870 int d1, d2, d3;
871 char buf1[4], buf2[4];
872 d1 = open ("foo", O_RDONLY);
873 d2 = dup (d1);
874 d3 = dup (d2);
875 lseek (d3, 1024, SEEK_SET);
876 read (d1, buf1, 4);
877 read (d2, buf2, 4);
878@}
879@end smallexample
880
881@noindent
882will read four characters starting with the 1024'th character of
883@file{foo}, and then four more characters starting with the 1028'th
884character.
885
28f540f4 886@deftp {Data Type} off_t
d08a7e4c 887@standards{POSIX.1, sys/types.h}
07e12bb3
JM
888This is a signed integer type used to represent file sizes. In
889@theglibc{}, this type is no narrower than @code{int}.
a3a4a74e
UD
890
891If the source is compiled with @code{_FILE_OFFSET_BITS == 64} this type
892is transparently replaced by @code{off64_t}.
28f540f4
RM
893@end deftp
894
b07d03e0 895@deftp {Data Type} off64_t
d08a7e4c 896@standards{Unix98, sys/types.h}
b07d03e0 897This type is used similar to @code{off_t}. The difference is that even
04b9968b 898on 32 bit machines, where the @code{off_t} type would have 32 bits,
b07d03e0 899@code{off64_t} has 64 bits and so is able to address files up to
9ceeb279 900@twoexp{63} bytes in length.
a3a4a74e
UD
901
902When compiling with @code{_FILE_OFFSET_BITS == 64} this type is
903available under the name @code{off_t}.
b07d03e0
UD
904@end deftp
905
28f540f4
RM
906These aliases for the @samp{SEEK_@dots{}} constants exist for the sake
907of compatibility with older BSD systems. They are defined in two
908different header files: @file{fcntl.h} and @file{sys/file.h}.
909
2fe82ca6 910@vtable @code
28f540f4
RM
911@item L_SET
912An alias for @code{SEEK_SET}.
913
914@item L_INCR
915An alias for @code{SEEK_CUR}.
916
917@item L_XTND
918An alias for @code{SEEK_END}.
2fe82ca6 919@end vtable
28f540f4
RM
920
921@node Descriptors and Streams
922@section Descriptors and Streams
923@cindex streams, and file descriptors
924@cindex converting file descriptor to stream
925@cindex extracting file descriptor from stream
926
927Given an open file descriptor, you can create a stream for it with the
928@code{fdopen} function. You can get the underlying file descriptor for
929an existing stream with the @code{fileno} function. These functions are
930declared in the header file @file{stdio.h}.
931@pindex stdio.h
932
28f540f4 933@deftypefun {FILE *} fdopen (int @var{filedes}, const char *@var{opentype})
d08a7e4c 934@standards{POSIX.1, stdio.h}
2cc3615c 935@safety{@prelim{}@mtsafe{}@asunsafe{@ascuheap{} @asulock{}}@acunsafe{@acsmem{} @aculock{}}}
28f540f4
RM
936The @code{fdopen} function returns a new stream for the file descriptor
937@var{filedes}.
938
939The @var{opentype} argument is interpreted in the same way as for the
940@code{fopen} function (@pxref{Opening Streams}), except that
a7a93d50 941the @samp{b} option is not permitted; this is because @gnusystems{} make no
28f540f4 942distinction between text and binary files. Also, @code{"w"} and
04b9968b 943@code{"w+"} do not cause truncation of the file; these have an effect only
28f540f4
RM
944when opening a file, and in this case the file has already been opened.
945You must make sure that the @var{opentype} argument matches the actual
946mode of the open file descriptor.
947
948The return value is the new stream. If the stream cannot be created
949(for example, if the modes for the file indicated by the file descriptor
950do not permit the access specified by the @var{opentype} argument), a
951null pointer is returned instead.
952
953In some other systems, @code{fdopen} may fail to detect that the modes
9739d2d5 954for file descriptors do not permit the access specified by
1f77f049 955@code{opentype}. @Theglibc{} always checks for this.
28f540f4
RM
956@end deftypefun
957
958For an example showing the use of the @code{fdopen} function,
959see @ref{Creating a Pipe}.
960
28f540f4 961@deftypefun int fileno (FILE *@var{stream})
d08a7e4c 962@standards{POSIX.1, stdio.h}
2cc3615c 963@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
28f540f4
RM
964This function returns the file descriptor associated with the stream
965@var{stream}. If an error is detected (for example, if the @var{stream}
966is not valid) or if @var{stream} does not do I/O to a file,
07435eb4 967@code{fileno} returns @math{-1}.
28f540f4
RM
968@end deftypefun
969
7b4161bb 970@deftypefun int fileno_unlocked (FILE *@var{stream})
d08a7e4c 971@standards{GNU, stdio.h}
2cc3615c 972@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
7b4161bb
UD
973The @code{fileno_unlocked} function is equivalent to the @code{fileno}
974function except that it does not implicitly lock the stream if the state
975is @code{FSETLOCKING_INTERNAL}.
976
977This function is a GNU extension.
978@end deftypefun
979
28f540f4
RM
980@cindex standard file descriptors
981@cindex file descriptors, standard
982There are also symbolic constants defined in @file{unistd.h} for the
983file descriptors belonging to the standard streams @code{stdin},
984@code{stdout}, and @code{stderr}; see @ref{Standard Streams}.
985@pindex unistd.h
986
2fe82ca6 987@vtable @code
28f540f4 988@item STDIN_FILENO
d08a7e4c 989@standards{POSIX.1, unistd.h}
28f540f4
RM
990This macro has value @code{0}, which is the file descriptor for
991standard input.
992@cindex standard input file descriptor
993
28f540f4 994@item STDOUT_FILENO
d08a7e4c 995@standards{POSIX.1, unistd.h}
28f540f4
RM
996This macro has value @code{1}, which is the file descriptor for
997standard output.
998@cindex standard output file descriptor
999
28f540f4 1000@item STDERR_FILENO
d08a7e4c 1001@standards{POSIX.1, unistd.h}
28f540f4
RM
1002This macro has value @code{2}, which is the file descriptor for
1003standard error output.
2fe82ca6 1004@end vtable
28f540f4
RM
1005@cindex standard error file descriptor
1006
1007@node Stream/Descriptor Precautions
1008@section Dangers of Mixing Streams and Descriptors
1009@cindex channels
1010@cindex streams and descriptors
1011@cindex descriptors and streams
1012@cindex mixing descriptors and streams
1013
1014You can have multiple file descriptors and streams (let's call both
1015streams and descriptors ``channels'' for short) connected to the same
1016file, but you must take care to avoid confusion between channels. There
1017are two cases to consider: @dfn{linked} channels that share a single
1018file position value, and @dfn{independent} channels that have their own
1019file positions.
1020
1021It's best to use just one channel in your program for actual data
1022transfer to any given file, except when all the access is for input.
1023For example, if you open a pipe (something you can only do at the file
1024descriptor level), either do all I/O with the descriptor, or construct a
1025stream from the descriptor with @code{fdopen} and then do all I/O with
1026the stream.
1027
1028@menu
1029* Linked Channels:: Dealing with channels sharing a file position.
1030* Independent Channels:: Dealing with separately opened, unlinked channels.
2c6fe0bd 1031* Cleaning Streams:: Cleaning a stream makes it safe to use
28f540f4
RM
1032 another channel.
1033@end menu
1034
1035@node Linked Channels
1036@subsection Linked Channels
1037@cindex linked channels
1038
1039Channels that come from a single opening share the same file position;
1040we call them @dfn{linked} channels. Linked channels result when you
1041make a stream from a descriptor using @code{fdopen}, when you get a
1042descriptor from a stream with @code{fileno}, when you copy a descriptor
1043with @code{dup} or @code{dup2}, and when descriptors are inherited
1044during @code{fork}. For files that don't support random access, such as
1045terminals and pipes, @emph{all} channels are effectively linked. On
1046random-access files, all append-type output streams are effectively
1047linked to each other.
1048
1049@cindex cleaning up a stream
0295d266
UD
1050If you have been using a stream for I/O (or have just opened the stream),
1051and you want to do I/O using
28f540f4
RM
1052another channel (either a stream or a descriptor) that is linked to it,
1053you must first @dfn{clean up} the stream that you have been using.
1054@xref{Cleaning Streams}.
1055
1056Terminating a process, or executing a new program in the process,
1057destroys all the streams in the process. If descriptors linked to these
1058streams persist in other processes, their file positions become
1059undefined as a result. To prevent this, you must clean up the streams
1060before destroying them.
1061
1062@node Independent Channels
1063@subsection Independent Channels
1064@cindex independent channels
1065
1066When you open channels (streams or descriptors) separately on a seekable
1067file, each channel has its own file position. These are called
1068@dfn{independent channels}.
1069
1070The system handles each channel independently. Most of the time, this
1071is quite predictable and natural (especially for input): each channel
1072can read or write sequentially at its own place in the file. However,
1073if some of the channels are streams, you must take these precautions:
1074
1075@itemize @bullet
1076@item
1077You should clean an output stream after use, before doing anything else
1078that might read or write from the same part of the file.
1079
1080@item
1081You should clean an input stream before reading data that may have been
1082modified using an independent channel. Otherwise, you might read
1083obsolete data that had been in the stream's buffer.
1084@end itemize
1085
1086If you do output to one channel at the end of the file, this will
1087certainly leave the other independent channels positioned somewhere
1088before the new end. You cannot reliably set their file positions to the
1089new end of file before writing, because the file can always be extended
1090by another process between when you set the file position and when you
1091write the data. Instead, use an append-type descriptor or stream; they
1092always output at the current end of the file. In order to make the
1093end-of-file position accurate, you must clean the output channel you
1094were using, if it is a stream.
1095
1096It's impossible for two channels to have separate file pointers for a
1097file that doesn't support random access. Thus, channels for reading or
1098writing such files are always linked, never independent. Append-type
1099channels are also always linked. For these channels, follow the rules
1100for linked channels; see @ref{Linked Channels}.
1101
1102@node Cleaning Streams
1103@subsection Cleaning Streams
1104
6664049b 1105You can use @code{fflush} to clean a stream in most
28f540f4
RM
1106cases.
1107
6664049b 1108You can skip the @code{fflush} if you know the stream
28f540f4
RM
1109is already clean. A stream is clean whenever its buffer is empty. For
1110example, an unbuffered stream is always clean. An input stream that is
1111at end-of-file is clean. A line-buffered stream is clean when the last
0295d266
UD
1112character output was a newline. However, a just-opened input stream
1113might not be clean, as its input buffer might not be empty.
28f540f4
RM
1114
1115There is one case in which cleaning a stream is impossible on most
1116systems. This is when the stream is doing input from a file that is not
1117random-access. Such streams typically read ahead, and when the file is
1118not random access, there is no way to give back the excess data already
1119read. When an input stream reads from a random-access file,
1120@code{fflush} does clean the stream, but leaves the file pointer at an
1121unpredictable place; you must set the file pointer before doing any
6664049b 1122further I/O.
28f540f4
RM
1123
1124Closing an output-only stream also does @code{fflush}, so this is a
6664049b 1125valid way of cleaning an output stream.
28f540f4
RM
1126
1127You need not clean a stream before using its descriptor for control
1128operations such as setting terminal modes; these operations don't affect
1129the file position and are not affected by it. You can use any
1130descriptor for these operations, and all channels are affected
1131simultaneously. However, text already ``output'' to a stream but still
1132buffered by the stream will be subject to the new terminal modes when
1133subsequently flushed. To make sure ``past'' output is covered by the
1134terminal settings that were in effect at the time, flush the output
1135streams for that terminal before setting the modes. @xref{Terminal
1136Modes}.
1137
07435eb4
UD
1138@node Scatter-Gather
1139@section Fast Scatter-Gather I/O
1140@cindex scatter-gather
1141
1142Some applications may need to read or write data to multiple buffers,
04b9968b 1143which are separated in memory. Although this can be done easily enough
19e4c7dd 1144with multiple calls to @code{read} and @code{write}, it is inefficient
07435eb4
UD
1145because there is overhead associated with each kernel call.
1146
1147Instead, many platforms provide special high-speed primitives to perform
1f77f049
JM
1148these @dfn{scatter-gather} operations in a single kernel call. @Theglibc{}
1149will provide an emulation on any system that lacks these
07435eb4
UD
1150primitives, so they are not a portability threat. They are defined in
1151@code{sys/uio.h}.
1152
1153These functions are controlled with arrays of @code{iovec} structures,
1154which describe the location and size of each buffer.
1155
1156@deftp {Data Type} {struct iovec}
d08a7e4c 1157@standards{BSD, sys/uio.h}
07435eb4 1158
cf822e3c 1159The @code{iovec} structure describes a buffer. It contains two fields:
07435eb4
UD
1160
1161@table @code
1162
1163@item void *iov_base
1164Contains the address of a buffer.
1165
1166@item size_t iov_len
1167Contains the length of the buffer.
1168
1169@end table
1170@end deftp
1171
1172@deftypefun ssize_t readv (int @var{filedes}, const struct iovec *@var{vector}, int @var{count})
d08a7e4c 1173@standards{BSD, sys/uio.h}
2cc3615c
AO
1174@safety{@prelim{}@mtsafe{}@asunsafe{@ascuheap{}}@acunsafe{@acsmem{}}}
1175@c The fallback sysdeps/posix implementation, used even on GNU/Linux
1176@c with old kernels that lack a full readv/writev implementation, may
1177@c malloc the buffer into which data is read, if the total read size is
1178@c too large for alloca.
07435eb4
UD
1179
1180The @code{readv} function reads data from @var{filedes} and scatters it
1181into the buffers described in @var{vector}, which is taken to be
1182@var{count} structures long. As each buffer is filled, data is sent to the
1183next.
1184
1185Note that @code{readv} is not guaranteed to fill all the buffers.
1186It may stop at any point, for the same reasons @code{read} would.
1187
1188The return value is a count of bytes (@emph{not} buffers) read, @math{0}
1189indicating end-of-file, or @math{-1} indicating an error. The possible
1190errors are the same as in @code{read}.
1191
1192@end deftypefun
1193
1194@deftypefun ssize_t writev (int @var{filedes}, const struct iovec *@var{vector}, int @var{count})
d08a7e4c 1195@standards{BSD, sys/uio.h}
2cc3615c
AO
1196@safety{@prelim{}@mtsafe{}@asunsafe{@ascuheap{}}@acunsafe{@acsmem{}}}
1197@c The fallback sysdeps/posix implementation, used even on GNU/Linux
1198@c with old kernels that lack a full readv/writev implementation, may
1199@c malloc the buffer from which data is written, if the total write size
1200@c is too large for alloca.
07435eb4
UD
1201
1202The @code{writev} function gathers data from the buffers described in
1203@var{vector}, which is taken to be @var{count} structures long, and writes
1204them to @code{filedes}. As each buffer is written, it moves on to the
1205next.
1206
1207Like @code{readv}, @code{writev} may stop midstream under the same
1208conditions @code{write} would.
1209
1210The return value is a count of bytes written, or @math{-1} indicating an
1211error. The possible errors are the same as in @code{write}.
1212
1213@end deftypefun
1214
f6e965ee
FW
1215@deftypefun ssize_t preadv (int @var{fd}, const struct iovec *@var{iov}, int @var{iovcnt}, off_t @var{offset})
1216@standards{BSD, sys/uio.h}
1217@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
1218@c This is a syscall for Linux 3.2 for all architectures but microblaze
1219@c (which was added on 3.15). The sysdeps/posix fallback emulation
1220@c is also MT-Safe since it calls pread, and it is now a syscall on all
1221@c targets.
1222
1223This function is similar to the @code{readv} function, with the difference
1224it adds an extra @var{offset} parameter of type @code{off_t} similar to
b156c5f0 1225@code{pread}. The data is read from the file starting at position
f6e965ee
FW
1226@var{offset}. The position of the file descriptor itself is not affected
1227by the operation. The value is the same as before the call.
1228
1229When the source file is compiled with @code{_FILE_OFFSET_BITS == 64} the
1230@code{preadv} function is in fact @code{preadv64} and the type
1231@code{off_t} has 64 bits, which makes it possible to handle files up to
1232@twoexp{63} bytes in length.
1233
1234The return value is a count of bytes (@emph{not} buffers) read, @math{0}
1235indicating end-of-file, or @math{-1} indicating an error. The possible
1236errors are the same as in @code{readv} and @code{pread}.
1237@end deftypefun
1238
1239@deftypefun ssize_t preadv64 (int @var{fd}, const struct iovec *@var{iov}, int @var{iovcnt}, off64_t @var{offset})
1240@standards{BSD, unistd.h}
1241@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
1242@c This is a syscall for Linux 3.2 for all architectures but microblaze
1243@c (which was added on 3.15). The sysdeps/posix fallback emulation
1244@c is also MT-Safe since it calls pread64, and it is now a syscall on all
1245@c targets.
1246
1247This function is similar to the @code{preadv} function with the difference
1248is that the @var{offset} parameter is of type @code{off64_t} instead of
1249@code{off_t}. It makes it possible on 32 bit machines to address
1250files larger than @twoexp{31} bytes and up to @twoexp{63} bytes. The
1251file descriptor @code{filedes} must be opened using @code{open64} since
1252otherwise the large offsets possible with @code{off64_t} will lead to
1253errors with a descriptor in small file mode.
1254
1255When the source file is compiled using @code{_FILE_OFFSET_BITS == 64} on a
125632 bit machine this function is actually available under the name
1257@code{preadv} and so transparently replaces the 32 bit interface.
1258@end deftypefun
1259
1260@deftypefun ssize_t pwritev (int @var{fd}, const struct iovec *@var{iov}, int @var{iovcnt}, off_t @var{offset})
1261@standards{BSD, sys/uio.h}
1262@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
1263@c This is a syscall for Linux 3.2 for all architectures but microblaze
1264@c (which was added on 3.15). The sysdeps/posix fallback emulation
1265@c is also MT-Safe since it calls pwrite, and it is now a syscall on all
1266@c targets.
1267
1268This function is similar to the @code{writev} function, with the difference
1269it adds an extra @var{offset} parameter of type @code{off_t} similar to
1270@code{pwrite}. The data is written to the file starting at position
1271@var{offset}. The position of the file descriptor itself is not affected
1272by the operation. The value is the same as before the call.
1273
1274However, on Linux, if a file is opened with @code{O_APPEND}, @code{pwrite}
1275appends data to the end of the file, regardless of the value of
1276@code{offset}.
1277
1278When the source file is compiled with @code{_FILE_OFFSET_BITS == 64} the
1279@code{pwritev} function is in fact @code{pwritev64} and the type
1280@code{off_t} has 64 bits, which makes it possible to handle files up to
1281@twoexp{63} bytes in length.
1282
1283The return value is a count of bytes (@emph{not} buffers) written, @math{0}
1284indicating end-of-file, or @math{-1} indicating an error. The possible
1285errors are the same as in @code{writev} and @code{pwrite}.
1286@end deftypefun
1287
1288@deftypefun ssize_t pwritev64 (int @var{fd}, const struct iovec *@var{iov}, int @var{iovcnt}, off64_t @var{offset})
1289@standards{BSD, unistd.h}
1290@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
1291@c This is a syscall for Linux 3.2 for all architectures but microblaze
1292@c (which was added on 3.15). The sysdeps/posix fallback emulation
1293@c is also MT-Safe since it calls pwrite64, and it is now a syscall on all
1294@c targets.
1295
1296This function is similar to the @code{pwritev} function with the difference
1297is that the @var{offset} parameter is of type @code{off64_t} instead of
1298@code{off_t}. It makes it possible on 32 bit machines to address
1299files larger than @twoexp{31} bytes and up to @twoexp{63} bytes. The
1300file descriptor @code{filedes} must be opened using @code{open64} since
1301otherwise the large offsets possible with @code{off64_t} will lead to
1302errors with a descriptor in small file mode.
1303
1304When the source file is compiled using @code{_FILE_OFFSET_BITS == 64} on a
130532 bit machine this function is actually available under the name
1306@code{pwritev} and so transparently replaces the 32 bit interface.
1307@end deftypefun
1308
1309@deftypefun ssize_t preadv2 (int @var{fd}, const struct iovec *@var{iov}, int @var{iovcnt}, off_t @var{offset}, int @var{flags})
1310@standards{GNU, sys/uio.h}
1311@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
1312@c This is a syscall for Linux v4.6. The sysdeps/posix fallback emulation
1313@c is also MT-Safe since it calls preadv.
1314
d4b4a00a
FW
1315This function is similar to the @code{preadv} function, with the
1316difference it adds an extra @var{flags} parameter of type @code{int}.
1317Additionally, if @var{offset} is @math{-1}, the current file position
1318is used and updated (like the @code{readv} function).
1319
1320The supported @var{flags} are dependent of the underlying system. For
1321Linux it supports:
f6e965ee
FW
1322
1323@vtable @code
1324@item RWF_HIPRI
1325High priority request. This adds a flag that tells the file system that
1326this is a high priority request for which it is worth to poll the hardware.
1327The flag is purely advisory and can be ignored if not supported. The
1328@var{fd} must be opened using @code{O_DIRECT}.
1329
1330@item RWF_DSYNC
1331Per-IO synchronization as if the file was opened with @code{O_DSYNC} flag.
1332
1333@item RWF_SYNC
1334Per-IO synchronization as if the file was opened with @code{O_SYNC} flag.
1335
1336@item RWF_NOWAIT
1337Use nonblocking mode for this operation; that is, this call to @code{preadv2}
1338will fail and set @code{errno} to @code{EAGAIN} if the operation would block.
f2652643
L
1339
1340@item RWF_APPEND
1341Per-IO synchronization as if the file was opened with @code{O_APPEND} flag.
f6e965ee
FW
1342@end vtable
1343
1344When the source file is compiled with @code{_FILE_OFFSET_BITS == 64} the
1345@code{preadv2} function is in fact @code{preadv64v2} and the type
1346@code{off_t} has 64 bits, which makes it possible to handle files up to
1347@twoexp{63} bytes in length.
1348
1349The return value is a count of bytes (@emph{not} buffers) read, @math{0}
1350indicating end-of-file, or @math{-1} indicating an error. The possible
1351errors are the same as in @code{preadv} with the addition of:
1352
1353@table @code
1354
1355@item EOPNOTSUPP
1356
1357@c The default sysdeps/posix code will return it for any flags value
1358@c different than 0.
1359An unsupported @var{flags} was used.
1360
1361@end table
1362
1363@end deftypefun
1364
1365@deftypefun ssize_t preadv64v2 (int @var{fd}, const struct iovec *@var{iov}, int @var{iovcnt}, off64_t @var{offset}, int @var{flags})
1366@standards{GNU, unistd.h}
1367@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
1368@c This is a syscall for Linux v4.6. The sysdeps/posix fallback emulation
1369@c is also MT-Safe since it calls preadv.
07435eb4 1370
f6e965ee
FW
1371This function is similar to the @code{preadv2} function with the difference
1372is that the @var{offset} parameter is of type @code{off64_t} instead of
1373@code{off_t}. It makes it possible on 32 bit machines to address
1374files larger than @twoexp{31} bytes and up to @twoexp{63} bytes. The
1375file descriptor @code{filedes} must be opened using @code{open64} since
1376otherwise the large offsets possible with @code{off64_t} will lead to
1377errors with a descriptor in small file mode.
1378
1379When the source file is compiled using @code{_FILE_OFFSET_BITS == 64} on a
138032 bit machine this function is actually available under the name
1381@code{preadv2} and so transparently replaces the 32 bit interface.
1382@end deftypefun
1383
1384
1385@deftypefun ssize_t pwritev2 (int @var{fd}, const struct iovec *@var{iov}, int @var{iovcnt}, off_t @var{offset}, int @var{flags})
1386@standards{GNU, sys/uio.h}
1387@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
1388@c This is a syscall for Linux v4.6. The sysdeps/posix fallback emulation
1389@c is also MT-Safe since it calls pwritev.
1390
d4b4a00a
FW
1391This function is similar to the @code{pwritev} function, with the
1392difference it adds an extra @var{flags} parameter of type @code{int}.
1393Additionally, if @var{offset} is @math{-1}, the current file position
1394should is used and updated (like the @code{writev} function).
1395
1396The supported @var{flags} are dependent of the underlying system. For
1397Linux, the supported flags are the same as those for @code{preadv2}.
f6e965ee
FW
1398
1399When the source file is compiled with @code{_FILE_OFFSET_BITS == 64} the
1400@code{pwritev2} function is in fact @code{pwritev64v2} and the type
1401@code{off_t} has 64 bits, which makes it possible to handle files up to
1402@twoexp{63} bytes in length.
1403
1404The return value is a count of bytes (@emph{not} buffers) write, @math{0}
1405indicating end-of-file, or @math{-1} indicating an error. The possible
1406errors are the same as in @code{preadv2}.
1407@end deftypefun
1408
1409@deftypefun ssize_t pwritev64v2 (int @var{fd}, const struct iovec *@var{iov}, int @var{iovcnt}, off64_t @var{offset}, int @var{flags})
1410@standards{GNU, unistd.h}
1411@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
1412@c This is a syscall for Linux v4.6. The sysdeps/posix fallback emulation
1413@c is also MT-Safe since it calls pwritev.
1414
1415This function is similar to the @code{pwritev2} function with the difference
1416is that the @var{offset} parameter is of type @code{off64_t} instead of
1417@code{off_t}. It makes it possible on 32 bit machines to address
1418files larger than @twoexp{31} bytes and up to @twoexp{63} bytes. The
1419file descriptor @code{filedes} must be opened using @code{open64} since
1420otherwise the large offsets possible with @code{off64_t} will lead to
1421errors with a descriptor in small file mode.
1422
1423When the source file is compiled using @code{_FILE_OFFSET_BITS == 64} on a
142432 bit machine this function is actually available under the name
1425@code{pwritev2} and so transparently replaces the 32 bit interface.
1426@end deftypefun
07435eb4 1427
bad7a0c8
FW
1428@node Copying File Data
1429@section Copying data between two files
1430@cindex copying files
1431@cindex file copy
1432
1433A special function is provided to copy data between two files on the
1434same file system. The system can optimize such copy operations. This
1435is particularly important on network file systems, where the data would
1436otherwise have to be transferred twice over the network.
1437
1438Note that this function only copies file data, but not metadata such as
1439file permissions or extended attributes.
1440
1441@deftypefun ssize_t copy_file_range (int @var{inputfd}, off64_t *@var{inputpos}, int @var{outputfd}, off64_t *@var{outputpos}, ssize_t @var{length}, unsigned int @var{flags})
1442@standards{GNU, unistd.h}
1443@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
1444
1445This function copies up to @var{length} bytes from the file descriptor
1446@var{inputfd} to the file descriptor @var{outputfd}.
1447
1448The function can operate on both the current file position (like
1449@code{read} and @code{write}) and an explicit offset (like @code{pread}
1450and @code{pwrite}). If the @var{inputpos} pointer is null, the file
1451position of @var{inputfd} is used as the starting point of the copy
1452operation, and the file position is advanced during it. If
1453@var{inputpos} is not null, then @code{*@var{inputpos}} is used as the
1454starting point of the copy operation, and @code{*@var{inputpos}} is
1455incremented by the number of copied bytes, but the file position remains
1456unchanged. Similar rules apply to @var{outputfd} and @var{outputpos}
1457for the output file position.
1458
1459The @var{flags} argument is currently reserved and must be zero.
1460
1461The @code{copy_file_range} function returns the number of bytes copied.
1462This can be less than the specified @var{length} in case the input file
1463contains fewer remaining bytes than @var{length}, or if a read or write
1464failure occurs. The return value is zero if the end of the input file
1465is encountered immediately.
1466
1467If no bytes can be copied, to report an error, @code{copy_file_range}
5a659ccc
FW
1468returns the value @math{-1} and sets @code{errno}. The table below
1469lists some of the error conditions for this function.
bad7a0c8
FW
1470
1471@table @code
5a659ccc
FW
1472@item ENOSYS
1473The kernel does not implement the required functionality.
1474
bad7a0c8
FW
1475@item EISDIR
1476At least one of the descriptors @var{inputfd} or @var{outputfd} refers
1477to a directory.
1478
1479@item EINVAL
1480At least one of the descriptors @var{inputfd} or @var{outputfd} refers
1481to a non-regular, non-directory file (such as a socket or a FIFO).
1482
1483The input or output positions before are after the copy operations are
1484outside of an implementation-defined limit.
1485
1486The @var{flags} argument is not zero.
1487
1488@item EFBIG
1489The new file size would exceed the process file size limit.
1490@xref{Limits on Resources}.
1491
1492The input or output positions before are after the copy operations are
1493outside of an implementation-defined limit. This can happen if the file
1494was not opened with large file support (LFS) on 32-bit machines, and the
1495copy operation would create a file which is larger than what
1496@code{off_t} could represent.
1497
1498@item EBADF
1499The argument @var{inputfd} is not a valid file descriptor open for
1500reading.
1501
1502The argument @var{outputfd} is not a valid file descriptor open for
1503writing, or @var{outputfd} has been opened with @code{O_APPEND}.
bad7a0c8
FW
1504@end table
1505
1506In addition, @code{copy_file_range} can fail with the error codes
1507which are used by @code{read}, @code{pread}, @code{write}, and
1508@code{pwrite}.
1509
1510The @code{copy_file_range} function is a cancellation point. In case of
1511cancellation, the input location (the file position or the value at
1512@code{*@var{inputpos}}) is indeterminate.
1513@end deftypefun
1514
07435eb4
UD
1515@node Memory-mapped I/O
1516@section Memory-mapped I/O
1517
1518On modern operating systems, it is possible to @dfn{mmap} (pronounced
1519``em-map'') a file to a region of memory. When this is done, the file can
1520be accessed just like an array in the program.
1521
19e4c7dd 1522This is more efficient than @code{read} or @code{write}, as only the regions
04b9968b 1523of the file that a program actually accesses are loaded. Accesses to
07435eb4
UD
1524not-yet-loaded parts of the mmapped region are handled in the same way as
1525swapped out pages.
1526
b642f101
UD
1527Since mmapped pages can be stored back to their file when physical
1528memory is low, it is possible to mmap files orders of magnitude larger
1529than both the physical memory @emph{and} swap space. The only limit is
1530address space. The theoretical limit is 4GB on a 32-bit machine -
1531however, the actual limit will be smaller since some areas will be
1532reserved for other purposes. If the LFS interface is used the file size
1533on 32-bit systems is not limited to 2GB (offsets are signed which
1534reduces the addressable area of 4GB by half); the full 64-bit are
1535available.
07435eb4
UD
1536
1537Memory mapping only works on entire pages of memory. Thus, addresses
1538for mapping must be page-aligned, and length values will be rounded up.
a465b89e 1539To determine the default size of a page the machine uses one should use:
07435eb4 1540
b642f101 1541@vindex _SC_PAGESIZE
07435eb4
UD
1542@smallexample
1543size_t page_size = (size_t) sysconf (_SC_PAGESIZE);
1544@end smallexample
1545
a465b89e
FW
1546On some systems, mappings can use larger page sizes
1547for certain files, and applications can request larger page sizes for
1548anonymous mappings as well (see the @code{MAP_HUGETLB} flag below).
1549
1550The following functions are declared in @file{sys/mman.h}:
07435eb4 1551
cc6e48bc 1552@deftypefun {void *} mmap (void *@var{address}, size_t @var{length}, int @var{protect}, int @var{flags}, int @var{filedes}, off_t @var{offset})
d08a7e4c 1553@standards{POSIX, sys/mman.h}
2cc3615c 1554@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
07435eb4
UD
1555
1556The @code{mmap} function creates a new mapping, connected to bytes
b73147d0 1557(@var{offset}) to (@var{offset} + @var{length} - 1) in the file open on
b61345a1
UD
1558@var{filedes}. A new reference for the file specified by @var{filedes}
1559is created, which is not removed by closing the file.
07435eb4
UD
1560
1561@var{address} gives a preferred starting address for the mapping.
cf822e3c
OB
1562@code{NULL} expresses no preference. Any previous mapping at that
1563address is automatically removed. The address you give may still be
07435eb4
UD
1564changed, unless you use the @code{MAP_FIXED} flag.
1565
07435eb4
UD
1566@var{protect} contains flags that control what kind of access is
1567permitted. They include @code{PROT_READ}, @code{PROT_WRITE}, and
0f74bbf5
FW
1568@code{PROT_EXEC}. The special flag @code{PROT_NONE} reserves a region
1569of address space for future use. The @code{mprotect} function can be
1570used to change the protection flags. @xref{Memory Protection}.
07435eb4
UD
1571
1572@var{flags} contains flags that control the nature of the map.
1573One of @code{MAP_SHARED} or @code{MAP_PRIVATE} must be specified.
1574
1575They include:
1576
1577@vtable @code
1578@item MAP_PRIVATE
1579This specifies that writes to the region should never be written back
1580to the attached file. Instead, a copy is made for the process, and the
1581region will be swapped normally if memory runs low. No other process will
1582see the changes.
1583
1584Since private mappings effectively revert to ordinary memory
1585when written to, you must have enough virtual memory for a copy of
1586the entire mmapped region if you use this mode with @code{PROT_WRITE}.
1587
1588@item MAP_SHARED
1589This specifies that writes to the region will be written back to the
1590file. Changes made will be shared immediately with other processes
1591mmaping the same file.
1592
1593Note that actual writing may take place at any time. You need to use
1594@code{msync}, described below, if it is important that other processes
1595using conventional I/O get a consistent view of the file.
1596
1597@item MAP_FIXED
1598This forces the system to use the exact mapping address specified in
1599@var{address} and fail if it can't.
1600
1601@c One of these is official - the other is obviously an obsolete synonym
1602@c Which is which?
1603@item MAP_ANONYMOUS
1604@itemx MAP_ANON
1605This flag tells the system to create an anonymous mapping, not connected
9739d2d5 1606to a file. @var{filedes} and @var{offset} are ignored, and the region is
07435eb4
UD
1607initialized with zeros.
1608
1609Anonymous maps are used as the basic primitive to extend the heap on some
1610systems. They are also useful to share data between multiple tasks
1611without creating a file.
1612
49c091e5 1613On some systems using private anonymous mmaps is more efficient than using
1f77f049 1614@code{malloc} for large blocks. This is not an issue with @theglibc{},
07435eb4
UD
1615as the included @code{malloc} automatically uses @code{mmap} where appropriate.
1616
a465b89e
FW
1617@item MAP_HUGETLB
1618@standards{Linux, sys/mman.h}
1619This requests that the system uses an alternative page size which is
1620larger than the default page size for the mapping. For some workloads,
1621increasing the page size for large mappings improves performance because
1622the system needs to handle far fewer pages. For other workloads which
1623require frequent transfer of pages between storage or different nodes,
1624the decreased page granularity may cause performance problems due to the
1625increased page size and larger transfers.
1626
1627In order to create the mapping, the system needs physically contiguous
1628memory of the size of the increased page size. As a result,
1629@code{MAP_HUGETLB} mappings are affected by memory fragmentation, and
1630their creation can fail even if plenty of memory is available in the
1631system.
1632
1633Not all file systems support mappings with an increased page size.
1634
1635The @code{MAP_HUGETLB} flag is specific to Linux.
1636
1637@c There is a mechanism to select different hugepage sizes; see
1638@c include/uapi/asm-generic/hugetlb_encode.h in the kernel sources.
1639
07435eb4
UD
1640@c Linux has some other MAP_ options, which I have not discussed here.
1641@c MAP_DENYWRITE, MAP_EXECUTABLE and MAP_GROWSDOWN don't seem applicable to
cf822e3c 1642@c user programs (and I don't understand the last two). MAP_LOCKED does
07435eb4
UD
1643@c not appear to be implemented.
1644
1645@end vtable
1646
52e6d801
FB
1647@code{mmap} returns the address of the new mapping, or
1648@code{MAP_FAILED} for an error.
07435eb4
UD
1649
1650Possible errors include:
1651
1652@table @code
1653
1654@item EINVAL
1655
a465b89e
FW
1656Either @var{address} was unusable (because it is not a multiple of the
1657applicable page size), or inconsistent @var{flags} were given.
1658
1659If @code{MAP_HUGETLB} was specified, the file or system does not support
1660large page sizes.
07435eb4
UD
1661
1662@item EACCES
1663
1664@var{filedes} was not open for the type of access specified in @var{protect}.
1665
1666@item ENOMEM
1667
1668Either there is not enough memory for the operation, or the process is
1669out of address space.
1670
1671@item ENODEV
1672
1673This file is of a type that doesn't support mapping.
1674
1675@item ENOEXEC
1676
1677The file is on a filesystem that doesn't support mapping.
1678
1679@c On Linux, EAGAIN will appear if the file has a conflicting mandatory lock.
1680@c However mandatory locks are not discussed in this manual.
1681@c
1682@c Similarly, ETXTBSY will occur if the MAP_DENYWRITE flag (not documented
1683@c here) is used and the file is already open for writing.
1684
1685@end table
1686
1687@end deftypefun
1688
cc6e48bc 1689@deftypefun {void *} mmap64 (void *@var{address}, size_t @var{length}, int @var{protect}, int @var{flags}, int @var{filedes}, off64_t @var{offset})
d08a7e4c 1690@standards{LFS, sys/mman.h}
2cc3615c
AO
1691@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
1692@c The page_shift auto detection when MMAP2_PAGE_SHIFT is -1 (it never
1693@c is) would be thread-unsafe.
b642f101
UD
1694The @code{mmap64} function is equivalent to the @code{mmap} function but
1695the @var{offset} parameter is of type @code{off64_t}. On 32-bit systems
1696this allows the file associated with the @var{filedes} descriptor to be
1697larger than 2GB. @var{filedes} must be a descriptor returned from a
1698call to @code{open64} or @code{fopen64} and @code{freopen64} where the
1699descriptor is retrieved with @code{fileno}.
1700
1701When the sources are translated with @code{_FILE_OFFSET_BITS == 64} this
1702function is actually available under the name @code{mmap}. I.e., the
1703new, extended API using 64 bit file sizes and offsets transparently
1704replaces the old API.
1705@end deftypefun
1706
07435eb4 1707@deftypefun int munmap (void *@var{addr}, size_t @var{length})
d08a7e4c 1708@standards{POSIX, sys/mman.h}
2cc3615c 1709@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
07435eb4
UD
1710
1711@code{munmap} removes any memory maps from (@var{addr}) to (@var{addr} +
1712@var{length}). @var{length} should be the length of the mapping.
1713
04b9968b 1714It is safe to unmap multiple mappings in one command, or include unmapped
07435eb4 1715space in the range. It is also possible to unmap only part of an existing
04b9968b 1716mapping. However, only entire pages can be removed. If @var{length} is not
07435eb4
UD
1717an even number of pages, it will be rounded up.
1718
1719It returns @math{0} for success and @math{-1} for an error.
1720
1721One error is possible:
1722
1723@table @code
1724
1725@item EINVAL
04b9968b 1726The memory range given was outside the user mmap range or wasn't page
07435eb4
UD
1727aligned.
1728
1729@end table
1730
1731@end deftypefun
1732
1733@deftypefun int msync (void *@var{address}, size_t @var{length}, int @var{flags})
d08a7e4c 1734@standards{POSIX, sys/mman.h}
2cc3615c 1735@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
07435eb4
UD
1736
1737When using shared mappings, the kernel can write the file at any time
1738before the mapping is removed. To be certain data has actually been
49c091e5
UD
1739written to the file and will be accessible to non-memory-mapped I/O, it
1740is necessary to use this function.
07435eb4
UD
1741
1742It operates on the region @var{address} to (@var{address} + @var{length}).
1743It may be used on part of a mapping or multiple mappings, however the
1744region given should not contain any unmapped space.
1745
1746@var{flags} can contain some options:
1747
1748@vtable @code
1749
1750@item MS_SYNC
1751
1752This flag makes sure the data is actually written @emph{to disk}.
1753Normally @code{msync} only makes sure that accesses to a file with
1754conventional I/O reflect the recent changes.
1755
1756@item MS_ASYNC
1757
1758This tells @code{msync} to begin the synchronization, but not to wait for
1759it to complete.
1760
1761@c Linux also has MS_INVALIDATE, which I don't understand.
1762
1763@end vtable
1764
1765@code{msync} returns @math{0} for success and @math{-1} for
1766error. Errors include:
1767
1768@table @code
1769
1770@item EINVAL
1771An invalid region was given, or the @var{flags} were invalid.
1772
1773@item EFAULT
1774There is no existing mapping in at least part of the given region.
1775
1776@end table
1777
1778@end deftypefun
1779
1780@deftypefun {void *} mremap (void *@var{address}, size_t @var{length}, size_t @var{new_length}, int @var{flag})
d08a7e4c 1781@standards{GNU, sys/mman.h}
2cc3615c 1782@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
07435eb4
UD
1783
1784This function can be used to change the size of an existing memory
1785area. @var{address} and @var{length} must cover a region entirely mapped
cf822e3c 1786in the same @code{mmap} statement. A new mapping with the same
04b9968b 1787characteristics will be returned with the length @var{new_length}.
07435eb4 1788
cf822e3c 1789One option is possible, @code{MREMAP_MAYMOVE}. If it is given in
07435eb4
UD
1790@var{flags}, the system may remove the existing mapping and create a new
1791one of the desired length in another location.
1792
cf822e3c 1793The address of the resulting mapping is returned, or @math{-1}. Possible
07435eb4
UD
1794error codes include:
1795
07435eb4
UD
1796@table @code
1797
1798@item EFAULT
1799There is no existing mapping in at least part of the original region, or
1800the region covers two or more distinct mappings.
1801
1802@item EINVAL
1803The address given is misaligned or inappropriate.
1804
1805@item EAGAIN
1806The region has pages locked, and if extended it would exceed the
1807process's resource limit for locked pages. @xref{Limits on Resources}.
1808
1809@item ENOMEM
19e4c7dd 1810The region is private writable, and insufficient virtual memory is
07435eb4
UD
1811available to extend it. Also, this error will occur if
1812@code{MREMAP_MAYMOVE} is not given and the extension would collide with
1813another mapped region.
1814
1815@end table
1816@end deftypefun
1817
04b9968b
UD
1818This function is only available on a few systems. Except for performing
1819optional optimizations one should not rely on this function.
1820
07435eb4
UD
1821Not all file descriptors may be mapped. Sockets, pipes, and most devices
1822only allow sequential access and do not fit into the mapping abstraction.
1823In addition, some regular files may not be mmapable, and older kernels may
1824not support mapping at all. Thus, programs using @code{mmap} should
1825have a fallback method to use should it fail. @xref{Mmap,,,standards,GNU
1826Coding Standards}.
1827
0bc93a2f 1828@deftypefun int madvise (void *@var{addr}, size_t @var{length}, int @var{advice})
d08a7e4c 1829@standards{POSIX, sys/mman.h}
2cc3615c 1830@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
0bc93a2f
AJ
1831
1832This function can be used to provide the system with @var{advice} about
1833the intended usage patterns of the memory region starting at @var{addr}
1834and extending @var{length} bytes.
1835
1836The valid BSD values for @var{advice} are:
1837
2fe82ca6 1838@vtable @code
0bc93a2f
AJ
1839
1840@item MADV_NORMAL
1841The region should receive no further special treatment.
1842
1843@item MADV_RANDOM
cf822e3c 1844The region will be accessed via random page references. The kernel
0bc93a2f
AJ
1845should page-in the minimal number of pages for each page fault.
1846
1847@item MADV_SEQUENTIAL
cf822e3c 1848The region will be accessed via sequential page references. This
0bc93a2f
AJ
1849may cause the kernel to aggressively read-ahead, expecting further
1850sequential references after any page fault within this region.
1851
1852@item MADV_WILLNEED
1853The region will be needed. The pages within this region may
1854be pre-faulted in by the kernel.
1855
1856@item MADV_DONTNEED
1857The region is no longer needed. The kernel may free these pages,
1858causing any changes to the pages to be lost, as well as swapped
1859out pages to be discarded.
1860
a465b89e
FW
1861@item MADV_HUGEPAGE
1862@standards{Linux, sys/mman.h}
1863Indicate that it is beneficial to increase the page size for this
1864mapping. This can improve performance for larger mappings because the
1865system needs to handle far fewer pages. However, if parts of the
1866mapping are frequently transferred between storage or different nodes,
1867performance may suffer because individual transfers can become
1868substantially larger due to the increased page size.
1869
1870This flag is specific to Linux.
1871
1872@item MADV_NOHUGEPAGE
1873Undo the effect of a previous @code{MADV_HUGEPAGE} advice. This flag
1874is specific to Linux.
1875
2fe82ca6 1876@end vtable
0bc93a2f
AJ
1877
1878The POSIX names are slightly different, but with the same meanings:
1879
2fe82ca6 1880@vtable @code
0bc93a2f
AJ
1881
1882@item POSIX_MADV_NORMAL
1883This corresponds with BSD's @code{MADV_NORMAL}.
1884
1885@item POSIX_MADV_RANDOM
1886This corresponds with BSD's @code{MADV_RANDOM}.
1887
1888@item POSIX_MADV_SEQUENTIAL
1889This corresponds with BSD's @code{MADV_SEQUENTIAL}.
1890
1891@item POSIX_MADV_WILLNEED
1892This corresponds with BSD's @code{MADV_WILLNEED}.
1893
1894@item POSIX_MADV_DONTNEED
1895This corresponds with BSD's @code{MADV_DONTNEED}.
1896
2fe82ca6 1897@end vtable
0bc93a2f 1898
bb4e6db2 1899@code{madvise} returns @math{0} for success and @math{-1} for
0bc93a2f
AJ
1900error. Errors include:
1901@table @code
1902
1903@item EINVAL
1904An invalid region was given, or the @var{advice} was invalid.
1905
1906@item EFAULT
1907There is no existing mapping in at least part of the given region.
1908
1909@end table
1910@end deftypefun
07435eb4 1911
416e0145 1912@deftypefn Function int shm_open (const char *@var{name}, int @var{oflag}, mode_t @var{mode})
d08a7e4c 1913@standards{POSIX, sys/mman.h}
2cc3615c
AO
1914@safety{@prelim{}@mtsafe{@mtslocale{}}@asunsafe{@asuinit{} @ascuheap{} @asulock{}}@acunsafe{@aculock{} @acsmem{} @acsfd{}}}
1915@c shm_open @mtslocale @asuinit @ascuheap @asulock @aculock @acsmem @acsfd
1916@c libc_once(where_is_shmfs) @mtslocale @asuinit @ascuheap @asulock @aculock @acsmem @acsfd
1917@c where_is_shmfs @mtslocale @ascuheap @asulock @aculock @acsmem @acsfd
1918@c statfs dup ok
1919@c setmntent dup @ascuheap @asulock @acsmem @acsfd @aculock
1920@c getmntent_r dup @mtslocale @ascuheap @aculock @acsmem [no @asucorrupt @acucorrupt; exclusive stream]
1921@c strcmp dup ok
1922@c strlen dup ok
1923@c malloc dup @ascuheap @acsmem
1924@c mempcpy dup ok
1925@c endmntent dup @ascuheap @asulock @aculock @acsmem @acsfd
1926@c strlen dup ok
1927@c strchr dup ok
1928@c mempcpy dup ok
1929@c open dup @acsfd
1930@c fcntl dup ok
1931@c close dup @acsfd
416e0145
OB
1932
1933This function returns a file descriptor that can be used to allocate shared
cf822e3c 1934memory via mmap. Unrelated processes can use same @var{name} to create or
416e0145
OB
1935open existing shared memory objects.
1936
1937A @var{name} argument specifies the shared memory object to be opened.
1938In @theglibc{} it must be a string smaller than @code{NAME_MAX} bytes starting
1939with an optional slash but containing no other slashes.
1940
1941The semantics of @var{oflag} and @var{mode} arguments is same as in @code{open}.
1942
1943@code{shm_open} returns the file descriptor on success or @math{-1} on error.
1944On failure @code{errno} is set.
1945@end deftypefn
1946
1947@deftypefn Function int shm_unlink (const char *@var{name})
2cc3615c
AO
1948@safety{@prelim{}@mtsafe{@mtslocale{}}@asunsafe{@asuinit{} @ascuheap{} @asulock{}}@acunsafe{@aculock{} @acsmem{} @acsfd{}}}
1949@c shm_unlink @mtslocale @asuinit @ascuheap @asulock @aculock @acsmem @acsfd
1950@c libc_once(where_is_shmfs) dup @mtslocale @asuinit @ascuheap @asulock @aculock @acsmem @acsfd
1951@c strlen dup ok
1952@c strchr dup ok
1953@c mempcpy dup ok
1954@c unlink dup ok
416e0145 1955
9739d2d5 1956This function is the inverse of @code{shm_open} and removes the object with
416e0145
OB
1957the given @var{name} previously created by @code{shm_open}.
1958
1959@code{shm_unlink} returns @math{0} on success or @math{-1} on error.
1960On failure @code{errno} is set.
1961@end deftypefn
1962
59d2cbb1
FW
1963@deftypefun int memfd_create (const char *@var{name}, unsigned int @var{flags})
1964@standards{Linux, sys/mman.h}
1965@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{@acsfd{}}}
1966The @code{memfd_create} function returns a file descriptor which can be
1967used to create memory mappings using the @code{mmap} function. It is
1968similar to the @code{shm_open} function in the sense that these mappings
1969are not backed by actual files. However, the descriptor returned by
1970@code{memfd_create} does not correspond to a named object; the
1971@var{name} argument is used for debugging purposes only (e.g., will
1972appear in @file{/proc}), and separate invocations of @code{memfd_create}
1973with the same @var{name} will not return descriptors for the same region
1974of memory. The descriptor can also be used to create alias mappings
1975within the same process.
1976
1977The descriptor initially refers to a zero-length file. Before mappings
1978can be created which are backed by memory, the file size needs to be
1979increased with the @code{ftruncate} function. @xref{File Size}.
1980
1981The @var{flags} argument can be a combination of the following flags:
1982
1983@vtable @code
1984@item MFD_CLOEXEC
1985@standards{Linux, sys/mman.h}
1986The descriptor is created with the @code{O_CLOEXEC} flag.
1987
1988@item MFD_ALLOW_SEALING
1989@standards{Linux, sys/mman.h}
1990The descriptor supports the addition of seals using the @code{fcntl}
1991function.
1992
1993@item MFD_HUGETLB
1994@standards{Linux, sys/mman.h}
1995This requests that mappings created using the returned file descriptor
1996use a larger page size. See @code{MAP_HUGETLB} above for details.
1997
1998This flag is incompatible with @code{MFD_ALLOW_SEALING}.
1999@end vtable
2000
2001@code{memfd_create} returns a file descriptor on success, and @math{-1}
2002on failure.
2003
2004The following @code{errno} error conditions are defined for this
2005function:
2006
2007@table @code
2008@item EINVAL
2009An invalid combination is specified in @var{flags}, or @var{name} is
2010too long.
2011
2012@item EFAULT
2013The @var{name} argument does not point to a string.
2014
2015@item EMFILE
2016The operation would exceed the file descriptor limit for this process.
2017
2018@item ENFILE
2019The operation would exceed the system-wide file descriptor limit.
2020
2021@item ENOMEM
2022There is not enough memory for the operation.
2023@end table
2024@end deftypefun
2025
28f540f4
RM
2026@node Waiting for I/O
2027@section Waiting for Input or Output
2028@cindex waiting for input or output
2029@cindex multiplexing input
2030@cindex input from multiple files
2031
2032Sometimes a program needs to accept input on multiple input channels
2033whenever input arrives. For example, some workstations may have devices
2034such as a digitizing tablet, function button box, or dial box that are
2035connected via normal asynchronous serial interfaces; good user interface
2036style requires responding immediately to input on any device. Another
2037example is a program that acts as a server to several other processes
2038via pipes or sockets.
2039
2040You cannot normally use @code{read} for this purpose, because this
2041blocks the program until input is available on one particular file
2042descriptor; input on other channels won't wake it up. You could set
2043nonblocking mode and poll each file descriptor in turn, but this is very
2044inefficient.
2045
2046A better solution is to use the @code{select} function. This blocks the
2047program until input or output is ready on a specified set of file
2048descriptors, or until a timer expires, whichever comes first. This
2049facility is declared in the header file @file{sys/types.h}.
2050@pindex sys/types.h
2051
2052In the case of a server socket (@pxref{Listening}), we say that
2053``input'' is available when there are pending connections that could be
2054accepted (@pxref{Accepting Connections}). @code{accept} for server
2055sockets blocks and interacts with @code{select} just as @code{read} does
2056for normal input.
2057
2058@cindex file descriptor sets, for @code{select}
2059The file descriptor sets for the @code{select} function are specified
2060as @code{fd_set} objects. Here is the description of the data type
2061and some macros for manipulating these objects.
2062
28f540f4 2063@deftp {Data Type} fd_set
d08a7e4c 2064@standards{BSD, sys/types.h}
28f540f4
RM
2065The @code{fd_set} data type represents file descriptor sets for the
2066@code{select} function. It is actually a bit array.
2067@end deftp
2068
28f540f4 2069@deftypevr Macro int FD_SETSIZE
d08a7e4c 2070@standards{BSD, sys/types.h}
28f540f4
RM
2071The value of this macro is the maximum number of file descriptors that a
2072@code{fd_set} object can hold information about. On systems with a
2073fixed maximum number, @code{FD_SETSIZE} is at least that number. On
2074some systems, including GNU, there is no absolute limit on the number of
2075descriptors open, but this macro still has a constant value which
2076controls the number of bits in an @code{fd_set}; if you get a file
2077descriptor with a value as high as @code{FD_SETSIZE}, you cannot put
2078that descriptor into an @code{fd_set}.
2079@end deftypevr
2080
28f540f4 2081@deftypefn Macro void FD_ZERO (fd_set *@var{set})
d08a7e4c 2082@standards{BSD, sys/types.h}
2cc3615c 2083@safety{@prelim{}@mtsafe{@mtsrace{:set}}@assafe{}@acsafe{}}
28f540f4
RM
2084This macro initializes the file descriptor set @var{set} to be the
2085empty set.
2086@end deftypefn
2087
28f540f4 2088@deftypefn Macro void FD_SET (int @var{filedes}, fd_set *@var{set})
d08a7e4c 2089@standards{BSD, sys/types.h}
2cc3615c
AO
2090@safety{@prelim{}@mtsafe{@mtsrace{:set}}@assafe{}@acsafe{}}
2091@c Setting a bit isn't necessarily atomic, so there's a potential race
2092@c here if set is not used exclusively.
28f540f4 2093This macro adds @var{filedes} to the file descriptor set @var{set}.
d9997a45
UD
2094
2095The @var{filedes} parameter must not have side effects since it is
2096evaluated more than once.
28f540f4
RM
2097@end deftypefn
2098
28f540f4 2099@deftypefn Macro void FD_CLR (int @var{filedes}, fd_set *@var{set})
d08a7e4c 2100@standards{BSD, sys/types.h}
2cc3615c
AO
2101@safety{@prelim{}@mtsafe{@mtsrace{:set}}@assafe{}@acsafe{}}
2102@c Setting a bit isn't necessarily atomic, so there's a potential race
2103@c here if set is not used exclusively.
28f540f4 2104This macro removes @var{filedes} from the file descriptor set @var{set}.
d9997a45
UD
2105
2106The @var{filedes} parameter must not have side effects since it is
2107evaluated more than once.
28f540f4
RM
2108@end deftypefn
2109
d9997a45 2110@deftypefn Macro int FD_ISSET (int @var{filedes}, const fd_set *@var{set})
d08a7e4c 2111@standards{BSD, sys/types.h}
2cc3615c 2112@safety{@prelim{}@mtsafe{@mtsrace{:set}}@assafe{}@acsafe{}}
28f540f4 2113This macro returns a nonzero value (true) if @var{filedes} is a member
3081378b 2114of the file descriptor set @var{set}, and zero (false) otherwise.
d9997a45
UD
2115
2116The @var{filedes} parameter must not have side effects since it is
2117evaluated more than once.
28f540f4
RM
2118@end deftypefn
2119
2120Next, here is the description of the @code{select} function itself.
2121
28f540f4 2122@deftypefun int select (int @var{nfds}, fd_set *@var{read-fds}, fd_set *@var{write-fds}, fd_set *@var{except-fds}, struct timeval *@var{timeout})
d08a7e4c 2123@standards{BSD, sys/types.h}
2cc3615c
AO
2124@safety{@prelim{}@mtsafe{@mtsrace{:read-fds} @mtsrace{:write-fds} @mtsrace{:except-fds}}@assafe{}@acsafe{}}
2125@c The select syscall is preferred, but pselect6 may be used instead,
2126@c which requires converting timeout to a timespec and back. The
2127@c conversions are not atomic.
28f540f4
RM
2128The @code{select} function blocks the calling process until there is
2129activity on any of the specified sets of file descriptors, or until the
2130timeout period has expired.
2131
2132The file descriptors specified by the @var{read-fds} argument are
2133checked to see if they are ready for reading; the @var{write-fds} file
2134descriptors are checked to see if they are ready for writing; and the
2135@var{except-fds} file descriptors are checked for exceptional
2136conditions. You can pass a null pointer for any of these arguments if
2137you are not interested in checking for that kind of condition.
2138
76de2021
UD
2139A file descriptor is considered ready for reading if a @code{read}
2140call will not block. This usually includes the read offset being at
2141the end of the file or there is an error to report. A server socket
2142is considered ready for reading if there is a pending connection which
2143can be accepted with @code{accept}; @pxref{Accepting Connections}. A
2144client socket is ready for writing when its connection is fully
2145established; @pxref{Connecting}.
28f540f4
RM
2146
2147``Exceptional conditions'' does not mean errors---errors are reported
2148immediately when an erroneous system call is executed, and do not
2149constitute a state of the descriptor. Rather, they include conditions
2150such as the presence of an urgent message on a socket. (@xref{Sockets},
2151for information on urgent messages.)
2152
2153The @code{select} function checks only the first @var{nfds} file
2154descriptors. The usual thing is to pass @code{FD_SETSIZE} as the value
2155of this argument.
2156
2157The @var{timeout} specifies the maximum time to wait. If you pass a
62193c4a
ZW
2158null pointer for this argument, it means to block indefinitely until
2159one of the file descriptors is ready. Otherwise, you should provide
2160the time in @code{struct timeval} format; see @ref{Time Types}.
2161Specify zero as the time (a @code{struct timeval} containing all
2162zeros) if you want to find out which descriptors are ready without
28f540f4
RM
2163waiting if none are ready.
2164
2165The normal return value from @code{select} is the total number of ready file
2166descriptors in all of the sets. Each of the argument sets is overwritten
2167with information about the descriptors that are ready for the corresponding
2168operation. Thus, to see if a particular descriptor @var{desc} has input,
2169use @code{FD_ISSET (@var{desc}, @var{read-fds})} after @code{select} returns.
2170
2171If @code{select} returns because the timeout period expires, it returns
2172a value of zero.
2173
2174Any signal will cause @code{select} to return immediately. So if your
2175program uses signals, you can't rely on @code{select} to keep waiting
2176for the full time specified. If you want to be sure of waiting for a
2177particular amount of time, you must check for @code{EINTR} and repeat
2178the @code{select} with a newly calculated timeout based on the current
2179time. See the example below. See also @ref{Interrupted Primitives}.
2180
2181If an error occurs, @code{select} returns @code{-1} and does not modify
2c6fe0bd 2182the argument file descriptor sets. The following @code{errno} error
28f540f4
RM
2183conditions are defined for this function:
2184
2185@table @code
2186@item EBADF
2187One of the file descriptor sets specified an invalid file descriptor.
2188
2189@item EINTR
2190The operation was interrupted by a signal. @xref{Interrupted Primitives}.
2191
2192@item EINVAL
2193The @var{timeout} argument is invalid; one of the components is negative
2194or too large.
2195@end table
2196@end deftypefun
2197
2198@strong{Portability Note:} The @code{select} function is a BSD Unix
2199feature.
2200
2201Here is an example showing how you can use @code{select} to establish a
2202timeout period for reading from a file descriptor. The @code{input_timeout}
2203function blocks the calling process until input is available on the
2204file descriptor, or until the timeout period expires.
2205
2206@smallexample
2207@include select.c.texi
2208@end smallexample
2209
2210There is another example showing the use of @code{select} to multiplex
2211input from multiple sockets in @ref{Server Example}.
2212
2213
dfd2257a
UD
2214@node Synchronizing I/O
2215@section Synchronizing I/O operations
2216
2217@cindex synchronizing
19e4c7dd 2218In most modern operating systems, the normal I/O operations are not
dfd2257a 2219executed synchronously. I.e., even if a @code{write} system call
19e4c7dd 2220returns, this does not mean the data is actually written to the media,
dfd2257a
UD
2221e.g., the disk.
2222
19e4c7dd 2223In situations where synchronization points are necessary, you can use
04b9968b 2224special functions which ensure that all operations finish before
dfd2257a
UD
2225they return.
2226
8ded91fb 2227@deftypefun void sync (void)
d08a7e4c 2228@standards{X/Open, unistd.h}
2cc3615c 2229@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
dfd2257a 2230A call to this function will not return as long as there is data which
04b9968b 2231has not been written to the device. All dirty buffers in the kernel will
dfd2257a
UD
2232be written and so an overall consistent system can be achieved (if no
2233other process in parallel writes data).
2234
2235A prototype for @code{sync} can be found in @file{unistd.h}.
dfd2257a
UD
2236@end deftypefun
2237
04b9968b
UD
2238Programs more often want to ensure that data written to a given file is
2239committed, rather than all data in the system. For this, @code{sync} is overkill.
2240
dfd2257a 2241
dfd2257a 2242@deftypefun int fsync (int @var{fildes})
d08a7e4c 2243@standards{POSIX, unistd.h}
2cc3615c 2244@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
19e4c7dd
AJ
2245The @code{fsync} function can be used to make sure all data associated with
2246the open file @var{fildes} is written to the device associated with the
dfd2257a
UD
2247descriptor. The function call does not return unless all actions have
2248finished.
2249
2250A prototype for @code{fsync} can be found in @file{unistd.h}.
2251
04b9968b 2252This function is a cancellation point in multi-threaded programs. This
dfd2257a
UD
2253is a problem if the thread allocates some resources (like memory, file
2254descriptors, semaphores or whatever) at the time @code{fsync} is
19e4c7dd 2255called. If the thread gets canceled these resources stay allocated
04b9968b
UD
2256until the program ends. To avoid this, calls to @code{fsync} should be
2257protected using cancellation handlers.
dfd2257a
UD
2258@c ref pthread_cleanup_push / pthread_cleanup_pop
2259
49c091e5 2260The return value of the function is zero if no error occurred. Otherwise
010fe231 2261it is @math{-1} and the global variable @code{errno} is set to the
dfd2257a
UD
2262following values:
2263@table @code
2264@item EBADF
2265The descriptor @var{fildes} is not valid.
2266
2267@item EINVAL
2268No synchronization is possible since the system does not implement this.
2269@end table
2270@end deftypefun
2271
2272Sometimes it is not even necessary to write all data associated with a
2273file descriptor. E.g., in database files which do not change in size it
2274is enough to write all the file content data to the device.
19e4c7dd 2275Meta-information, like the modification time etc., are not that important
dfd2257a 2276and leaving such information uncommitted does not prevent a successful
9739d2d5 2277recovery of the file in case of a problem.
dfd2257a 2278
dfd2257a 2279@deftypefun int fdatasync (int @var{fildes})
d08a7e4c 2280@standards{POSIX, unistd.h}
2cc3615c 2281@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
04b9968b 2282When a call to the @code{fdatasync} function returns, it is ensured
dfd2257a 2283that all of the file data is written to the device. For all pending I/O
04b9968b 2284operations, the parts guaranteeing data integrity finished.
dfd2257a
UD
2285
2286Not all systems implement the @code{fdatasync} operation. On systems
2287missing this functionality @code{fdatasync} is emulated by a call to
2288@code{fsync} since the performed actions are a superset of those
19e4c7dd 2289required by @code{fdatasync}.
dfd2257a
UD
2290
2291The prototype for @code{fdatasync} is in @file{unistd.h}.
2292
49c091e5 2293The return value of the function is zero if no error occurred. Otherwise
010fe231 2294it is @math{-1} and the global variable @code{errno} is set to the
dfd2257a
UD
2295following values:
2296@table @code
2297@item EBADF
2298The descriptor @var{fildes} is not valid.
2299
2300@item EINVAL
2301No synchronization is possible since the system does not implement this.
2302@end table
2303@end deftypefun
2304
2305
b07d03e0
UD
2306@node Asynchronous I/O
2307@section Perform I/O Operations in Parallel
2308
2309The POSIX.1b standard defines a new set of I/O operations which can
9739d2d5 2310significantly reduce the time an application spends waiting for I/O. The
b07d03e0 2311new functions allow a program to initiate one or more I/O operations and
04b9968b
UD
2312then immediately resume normal work while the I/O operations are
2313executed in parallel. This functionality is available if the
a3a4a74e 2314@file{unistd.h} file defines the symbol @code{_POSIX_ASYNCHRONOUS_IO}.
b07d03e0
UD
2315
2316These functions are part of the library with realtime functions named
2317@file{librt}. They are not actually part of the @file{libc} binary.
2318The implementation of these functions can be done using support in the
c756c71c
UD
2319kernel (if available) or using an implementation based on threads at
2320userlevel. In the latter case it might be necessary to link applications
fed8f7f7 2321with the thread library @file{libpthread} in addition to @file{librt}.
b07d03e0 2322
c756c71c 2323All AIO operations operate on files which were opened previously. There
04b9968b 2324might be arbitrarily many operations running for one file. The
b07d03e0
UD
2325asynchronous I/O operations are controlled using a data structure named
2326@code{struct aiocb} (@dfn{AIO control block}). It is defined in
2327@file{aio.h} as follows.
2328
b07d03e0 2329@deftp {Data Type} {struct aiocb}
d08a7e4c 2330@standards{POSIX.1b, aio.h}
b07d03e0
UD
2331The POSIX.1b standard mandates that the @code{struct aiocb} structure
2332contains at least the members described in the following table. There
04b9968b 2333might be more elements which are used by the implementation, but
19e4c7dd 2334depending upon these elements is not portable and is highly deprecated.
b07d03e0
UD
2335
2336@table @code
2337@item int aio_fildes
19e4c7dd
AJ
2338This element specifies the file descriptor to be used for the
2339operation. It must be a legal descriptor, otherwise the operation will
2340fail.
b07d03e0
UD
2341
2342The device on which the file is opened must allow the seek operation.
2343I.e., it is not possible to use any of the AIO operations on devices
2344like terminals where an @code{lseek} call would lead to an error.
2345
2346@item off_t aio_offset
19e4c7dd 2347This element specifies the offset in the file at which the operation (input
fed8f7f7 2348or output) is performed. Since the operations are carried out in arbitrary
b07d03e0
UD
2349order and more than one operation for one file descriptor can be
2350started, one cannot expect a current read/write position of the file
2351descriptor.
2352
2353@item volatile void *aio_buf
2354This is a pointer to the buffer with the data to be written or the place
c756c71c 2355where the read data is stored.
b07d03e0
UD
2356
2357@item size_t aio_nbytes
2358This element specifies the length of the buffer pointed to by @code{aio_buf}.
2359
2360@item int aio_reqprio
c756c71c 2361If the platform has defined @code{_POSIX_PRIORITIZED_IO} and
19e4c7dd 2362@code{_POSIX_PRIORITY_SCHEDULING}, the AIO requests are
b07d03e0
UD
2363processed based on the current scheduling priority. The
2364@code{aio_reqprio} element can then be used to lower the priority of the
2365AIO operation.
2366
2367@item struct sigevent aio_sigevent
2368This element specifies how the calling process is notified once the
fed8f7f7 2369operation terminates. If the @code{sigev_notify} element is
19e4c7dd
AJ
2370@code{SIGEV_NONE}, no notification is sent. If it is @code{SIGEV_SIGNAL},
2371the signal determined by @code{sigev_signo} is sent. Otherwise,
2372@code{sigev_notify} must be @code{SIGEV_THREAD}. In this case, a thread
c756c71c 2373is created which starts executing the function pointed to by
b07d03e0
UD
2374@code{sigev_notify_function}.
2375
2376@item int aio_lio_opcode
2377This element is only used by the @code{lio_listio} and
04b9968b
UD
2378@code{lio_listio64} functions. Since these functions allow an
2379arbitrary number of operations to start at once, and each operation can be
2380input or output (or nothing), the information must be stored in the
b07d03e0
UD
2381control block. The possible values are:
2382
2383@vtable @code
2384@item LIO_READ
2385Start a read operation. Read from the file at position
2386@code{aio_offset} and store the next @code{aio_nbytes} bytes in the
2387buffer pointed to by @code{aio_buf}.
2388
2389@item LIO_WRITE
2390Start a write operation. Write @code{aio_nbytes} bytes starting at
2391@code{aio_buf} into the file starting at position @code{aio_offset}.
2392
2393@item LIO_NOP
2394Do nothing for this control block. This value is useful sometimes when
2395an array of @code{struct aiocb} values contains holes, i.e., some of the
fed8f7f7 2396values must not be handled although the whole array is presented to the
b07d03e0
UD
2397@code{lio_listio} function.
2398@end vtable
2399@end table
a3a4a74e 2400
fed8f7f7 2401When the sources are compiled using @code{_FILE_OFFSET_BITS == 64} on a
19e4c7dd 240232 bit machine, this type is in fact @code{struct aiocb64}, since the LFS
a3a4a74e
UD
2403interface transparently replaces the @code{struct aiocb} definition.
2404@end deftp
2405
19e4c7dd 2406For use with the AIO functions defined in the LFS, there is a similar type
a3a4a74e 2407defined which replaces the types of the appropriate members with larger
04b9968b 2408types but otherwise is equivalent to @code{struct aiocb}. Particularly,
a3a4a74e
UD
2409all member names are the same.
2410
a3a4a74e 2411@deftp {Data Type} {struct aiocb64}
d08a7e4c 2412@standards{POSIX.1b, aio.h}
a3a4a74e
UD
2413@table @code
2414@item int aio_fildes
2415This element specifies the file descriptor which is used for the
2416operation. It must be a legal descriptor since otherwise the operation
2417fails for obvious reasons.
2418
2419The device on which the file is opened must allow the seek operation.
2420I.e., it is not possible to use any of the AIO operations on devices
2421like terminals where an @code{lseek} call would lead to an error.
2422
2423@item off64_t aio_offset
04b9968b 2424This element specifies at which offset in the file the operation (input
a3a4a74e
UD
2425or output) is performed. Since the operation are carried in arbitrary
2426order and more than one operation for one file descriptor can be
2427started, one cannot expect a current read/write position of the file
2428descriptor.
2429
2430@item volatile void *aio_buf
2431This is a pointer to the buffer with the data to be written or the place
19e4c7dd 2432where the read data is stored.
a3a4a74e
UD
2433
2434@item size_t aio_nbytes
2435This element specifies the length of the buffer pointed to by @code{aio_buf}.
2436
2437@item int aio_reqprio
2438If for the platform @code{_POSIX_PRIORITIZED_IO} and
04b9968b 2439@code{_POSIX_PRIORITY_SCHEDULING} are defined the AIO requests are
a3a4a74e
UD
2440processed based on the current scheduling priority. The
2441@code{aio_reqprio} element can then be used to lower the priority of the
2442AIO operation.
2443
2444@item struct sigevent aio_sigevent
2445This element specifies how the calling process is notified once the
9739d2d5 2446operation terminates. If the @code{sigev_notify} element is
19e4c7dd
AJ
2447@code{SIGEV_NONE} no notification is sent. If it is @code{SIGEV_SIGNAL},
2448the signal determined by @code{sigev_signo} is sent. Otherwise,
a3a4a74e 2449@code{sigev_notify} must be @code{SIGEV_THREAD} in which case a thread
9739d2d5 2450is created which starts executing the function pointed to by
a3a4a74e
UD
2451@code{sigev_notify_function}.
2452
2453@item int aio_lio_opcode
2454This element is only used by the @code{lio_listio} and
9739d2d5 2455@code{lio_listio64} functions. Since these functions allow an
04b9968b
UD
2456arbitrary number of operations to start at once, and since each operation can be
2457input or output (or nothing), the information must be stored in the
a3a4a74e
UD
2458control block. See the description of @code{struct aiocb} for a description
2459of the possible values.
2460@end table
2461
2462When the sources are compiled using @code{_FILE_OFFSET_BITS == 64} on a
19e4c7dd
AJ
246332 bit machine, this type is available under the name @code{struct
2464aiocb64}, since the LFS transparently replaces the old interface.
b07d03e0
UD
2465@end deftp
2466
2467@menu
a3a4a74e
UD
2468* Asynchronous Reads/Writes:: Asynchronous Read and Write Operations.
2469* Status of AIO Operations:: Getting the Status of AIO Operations.
2470* Synchronizing AIO Operations:: Getting into a consistent state.
04b9968b 2471* Cancel AIO Operations:: Cancellation of AIO Operations.
a3a4a74e 2472* Configuration of AIO:: How to optimize the AIO implementation.
b07d03e0
UD
2473@end menu
2474
a3a4a74e
UD
2475@node Asynchronous Reads/Writes
2476@subsection Asynchronous Read and Write Operations
b07d03e0 2477
b07d03e0 2478@deftypefun int aio_read (struct aiocb *@var{aiocbp})
d08a7e4c 2479@standards{POSIX.1b, aio.h}
2cc3615c
AO
2480@safety{@prelim{}@mtsafe{}@asunsafe{@asulock{} @ascuheap{}}@acunsafe{@aculock{} @acsmem{}}}
2481@c Calls aio_enqueue_request.
2482@c aio_enqueue_request @asulock @ascuheap @aculock @acsmem
2483@c pthread_self ok
2484@c pthread_getschedparam @asulock @aculock
2485@c lll_lock (pthread descriptor's lock) @asulock @aculock
2486@c sched_getparam ok
2487@c sched_getscheduler ok
2488@c lll_unlock @aculock
2489@c pthread_mutex_lock (aio_requests_mutex) @asulock @aculock
2490@c get_elem @ascuheap @acsmem [@asucorrupt @acucorrupt]
2491@c realloc @ascuheap @acsmem
2492@c calloc @ascuheap @acsmem
2493@c aio_create_helper_thread @asulock @ascuheap @aculock @acsmem
2494@c pthread_attr_init ok
2495@c pthread_attr_setdetachstate ok
2496@c pthread_get_minstack ok
2497@c pthread_attr_setstacksize ok
2498@c sigfillset ok
2499@c memset ok
2500@c sigdelset ok
2501@c SYSCALL rt_sigprocmask ok
2502@c pthread_create @asulock @ascuheap @aculock @acsmem
2503@c lll_lock (default_pthread_attr_lock) @asulock @aculock
2504@c alloca/malloc @ascuheap @acsmem
2505@c lll_unlock @aculock
2506@c allocate_stack @asulock @ascuheap @aculock @acsmem
2507@c getpagesize dup
2508@c lll_lock (default_pthread_attr_lock) @asulock @aculock
2509@c lll_unlock @aculock
2510@c _dl_allocate_tls @ascuheap @acsmem
2511@c _dl_allocate_tls_storage @ascuheap @acsmem
2512@c memalign @ascuheap @acsmem
2513@c memset ok
2514@c allocate_dtv dup
2515@c free @ascuheap @acsmem
2516@c allocate_dtv @ascuheap @acsmem
2517@c calloc @ascuheap @acsmem
2518@c INSTALL_DTV ok
2519@c list_add dup
2520@c get_cached_stack
2521@c lll_lock (stack_cache_lock) @asulock @aculock
2522@c list_for_each ok
2523@c list_entry dup
2524@c FREE_P dup
2525@c stack_list_del dup
2526@c stack_list_add dup
2527@c lll_unlock @aculock
2528@c _dl_allocate_tls_init ok
2529@c GET_DTV ok
2530@c mmap ok
2531@c atomic_increment_val ok
2532@c munmap ok
2533@c change_stack_perm ok
2534@c mprotect ok
2535@c mprotect ok
2536@c stack_list_del dup
2537@c _dl_deallocate_tls dup
2538@c munmap ok
2539@c THREAD_COPY_STACK_GUARD ok
2540@c THREAD_COPY_POINTER_GUARD ok
2541@c atomic_exchange_acq ok
2542@c lll_futex_wake ok
2543@c deallocate_stack @asulock @ascuheap @aculock @acsmem
2544@c lll_lock (state_cache_lock) @asulock @aculock
2545@c stack_list_del ok
2546@c atomic_write_barrier ok
2547@c list_del ok
2548@c atomic_write_barrier ok
2549@c queue_stack @ascuheap @acsmem
2550@c stack_list_add ok
2551@c atomic_write_barrier ok
2552@c list_add ok
2553@c atomic_write_barrier ok
2554@c free_stacks @ascuheap @acsmem
2555@c list_for_each_prev_safe ok
2556@c list_entry ok
2557@c FREE_P ok
2558@c stack_list_del dup
2559@c _dl_deallocate_tls dup
2560@c munmap ok
2561@c _dl_deallocate_tls @ascuheap @acsmem
2562@c free @ascuheap @acsmem
2563@c lll_unlock @aculock
2564@c create_thread @asulock @ascuheap @aculock @acsmem
2565@c td_eventword
2566@c td_eventmask
2567@c do_clone @asulock @ascuheap @aculock @acsmem
2568@c PREPARE_CREATE ok
2569@c lll_lock (pd->lock) @asulock @aculock
2570@c atomic_increment ok
2571@c clone ok
2572@c atomic_decrement ok
2573@c atomic_exchange_acq ok
2574@c lll_futex_wake ok
2575@c deallocate_stack dup
2576@c sched_setaffinity ok
2577@c tgkill ok
2578@c sched_setscheduler ok
2579@c atomic_compare_and_exchange_bool_acq ok
2580@c nptl_create_event ok
2581@c lll_unlock (pd->lock) @aculock
2582@c free @ascuheap @acsmem
2583@c pthread_attr_destroy ok (cpuset won't be set, so free isn't called)
2584@c add_request_to_runlist ok
2585@c pthread_cond_signal ok
2586@c aio_free_request ok
2587@c pthread_mutex_unlock @aculock
2588
2589@c (in the new thread, initiated with clone)
2590@c start_thread ok
2591@c HP_TIMING_NOW ok
2592@c ctype_init @mtslocale
2593@c atomic_exchange_acq ok
2594@c lll_futex_wake ok
2595@c sigemptyset ok
2596@c sigaddset ok
2597@c setjmp ok
ce0b7961 2598@c LIBC_CANCEL_ASYNC -> __pthread_enable_asynccancel ok
2cc3615c
AO
2599@c do_cancel ok
2600@c pthread_unwind ok
2601@c Unwind_ForcedUnwind or longjmp ok [@ascuheap @acsmem?]
2602@c lll_lock @asulock @aculock
2603@c lll_unlock @asulock @aculock
ce0b7961 2604@c LIBC_CANCEL_RESET -> __pthread_disable_asynccancel ok
2cc3615c
AO
2605@c lll_futex_wait ok
2606@c ->start_routine ok -----
2607@c call_tls_dtors @asulock @ascuheap @aculock @acsmem
2608@c user-supplied dtor
2609@c rtld_lock_lock_recursive (dl_load_lock) @asulock @aculock
2610@c rtld_lock_unlock_recursive @aculock
2611@c free @ascuheap @acsmem
2612@c nptl_deallocate_tsd @ascuheap @acsmem
2613@c tsd user-supplied dtors ok
2614@c free @ascuheap @acsmem
2615@c libc_thread_freeres
2616@c libc_thread_subfreeres ok
2617@c atomic_decrement_and_test ok
2618@c td_eventword ok
2619@c td_eventmask ok
2620@c atomic_compare_exchange_bool_acq ok
2621@c nptl_death_event ok
2622@c lll_robust_dead ok
2623@c getpagesize ok
2624@c madvise ok
2625@c free_tcb @asulock @ascuheap @aculock @acsmem
2626@c free @ascuheap @acsmem
2627@c deallocate_stack @asulock @ascuheap @aculock @acsmem
2628@c lll_futex_wait ok
2629@c exit_thread_inline ok
2630@c syscall(exit) ok
2631
04b9968b
UD
2632This function initiates an asynchronous read operation. It
2633immediately returns after the operation was enqueued or when an
fed8f7f7 2634error was encountered.
b07d03e0 2635
a3a4a74e 2636The first @code{aiocbp->aio_nbytes} bytes of the file for which
c756c71c
UD
2637@code{aiocbp->aio_fildes} is a descriptor are written to the buffer
2638starting at @code{aiocbp->aio_buf}. Reading starts at the absolute
2639position @code{aiocbp->aio_offset} in the file.
b07d03e0
UD
2640
2641If prioritized I/O is supported by the platform the
2642@code{aiocbp->aio_reqprio} value is used to adjust the priority before
2643the request is actually enqueued.
2644
2645The calling process is notified about the termination of the read
2646request according to the @code{aiocbp->aio_sigevent} value.
2647
04b9968b 2648When @code{aio_read} returns, the return value is zero if no error
b07d03e0 2649occurred that can be found before the process is enqueued. If such an
04b9968b
UD
2650early error is found, the function returns @math{-1} and sets
2651@code{errno} to one of the following values:
b07d03e0
UD
2652
2653@table @code
2654@item EAGAIN
2655The request was not enqueued due to (temporarily) exceeded resource
2656limitations.
2657@item ENOSYS
2658The @code{aio_read} function is not implemented.
2659@item EBADF
2660The @code{aiocbp->aio_fildes} descriptor is not valid. This condition
04b9968b 2661need not be recognized before enqueueing the request and so this error
fed8f7f7 2662might also be signaled asynchronously.
b07d03e0
UD
2663@item EINVAL
2664The @code{aiocbp->aio_offset} or @code{aiocbp->aio_reqpiro} value is
2665invalid. This condition need not be recognized before enqueueing the
49c091e5 2666request and so this error might also be signaled asynchronously.
b07d03e0
UD
2667@end table
2668
04b9968b
UD
2669If @code{aio_read} returns zero, the current status of the request
2670can be queried using @code{aio_error} and @code{aio_return} functions.
2671As long as the value returned by @code{aio_error} is @code{EINPROGRESS}
2672the operation has not yet completed. If @code{aio_error} returns zero,
78759725
UD
2673the operation successfully terminated, otherwise the value is to be
2674interpreted as an error code. If the function terminated, the result of
2675the operation can be obtained using a call to @code{aio_return}. The
2676returned value is the same as an equivalent call to @code{read} would
04b9968b 2677have returned. Possible error codes returned by @code{aio_error} are:
b07d03e0
UD
2678
2679@table @code
2680@item EBADF
2681The @code{aiocbp->aio_fildes} descriptor is not valid.
2682@item ECANCELED
19e4c7dd 2683The operation was canceled before the operation was finished
b07d03e0
UD
2684(@pxref{Cancel AIO Operations})
2685@item EINVAL
2686The @code{aiocbp->aio_offset} value is invalid.
2687@end table
a3a4a74e
UD
2688
2689When the sources are compiled with @code{_FILE_OFFSET_BITS == 64} this
2690function is in fact @code{aio_read64} since the LFS interface transparently
2691replaces the normal implementation.
b07d03e0
UD
2692@end deftypefun
2693
8ded91fb 2694@deftypefun int aio_read64 (struct aiocb64 *@var{aiocbp})
d08a7e4c 2695@standards{Unix98, aio.h}
2cc3615c 2696@safety{@prelim{}@mtsafe{}@asunsafe{@asulock{} @ascuheap{}}@acunsafe{@aculock{} @acsmem{}}}
b07d03e0 2697This function is similar to the @code{aio_read} function. The only
19e4c7dd
AJ
2698difference is that on @w{32 bit} machines, the file descriptor should
2699be opened in the large file mode. Internally, @code{aio_read64} uses
a3a4a74e
UD
2700functionality equivalent to @code{lseek64} (@pxref{File Position
2701Primitive}) to position the file descriptor correctly for the reading,
9739d2d5 2702as opposed to the @code{lseek} functionality used in @code{aio_read}.
a3a4a74e 2703
19e4c7dd 2704When the sources are compiled with @code{_FILE_OFFSET_BITS == 64}, this
a3a4a74e 2705function is available under the name @code{aio_read} and so transparently
04b9968b 2706replaces the interface for small files on 32 bit machines.
b07d03e0
UD
2707@end deftypefun
2708
19e4c7dd 2709To write data asynchronously to a file, there exists an equivalent pair
a3a4a74e
UD
2710of functions with a very similar interface.
2711
a3a4a74e 2712@deftypefun int aio_write (struct aiocb *@var{aiocbp})
d08a7e4c 2713@standards{POSIX.1b, aio.h}
2cc3615c 2714@safety{@prelim{}@mtsafe{}@asunsafe{@asulock{} @ascuheap{}}@acunsafe{@aculock{} @acsmem{}}}
a3a4a74e
UD
2715This function initiates an asynchronous write operation. The function
2716call immediately returns after the operation was enqueued or if before
fed8f7f7 2717this happens an error was encountered.
a3a4a74e
UD
2718
2719The first @code{aiocbp->aio_nbytes} bytes from the buffer starting at
2720@code{aiocbp->aio_buf} are written to the file for which
9dcc8f11 2721@code{aiocbp->aio_fildes} is a descriptor, starting at the absolute
a3a4a74e
UD
2722position @code{aiocbp->aio_offset} in the file.
2723
19e4c7dd 2724If prioritized I/O is supported by the platform, the
a3a4a74e
UD
2725@code{aiocbp->aio_reqprio} value is used to adjust the priority before
2726the request is actually enqueued.
2727
2728The calling process is notified about the termination of the read
2729request according to the @code{aiocbp->aio_sigevent} value.
2730
19e4c7dd 2731When @code{aio_write} returns, the return value is zero if no error
a3a4a74e
UD
2732occurred that can be found before the process is enqueued. If such an
2733early error is found the function returns @math{-1} and sets
2734@code{errno} to one of the following values.
2735
2736@table @code
2737@item EAGAIN
2738The request was not enqueued due to (temporarily) exceeded resource
2739limitations.
2740@item ENOSYS
2741The @code{aio_write} function is not implemented.
2742@item EBADF
2743The @code{aiocbp->aio_fildes} descriptor is not valid. This condition
19e4c7dd 2744may not be recognized before enqueueing the request, and so this error
fed8f7f7 2745might also be signaled asynchronously.
a3a4a74e 2746@item EINVAL
19e4c7dd
AJ
2747The @code{aiocbp->aio_offset} or @code{aiocbp->aio_reqprio} value is
2748invalid. This condition may not be recognized before enqueueing the
fed8f7f7 2749request and so this error might also be signaled asynchronously.
a3a4a74e
UD
2750@end table
2751
19e4c7dd 2752In the case @code{aio_write} returns zero, the current status of the
9739d2d5 2753request can be queried using the @code{aio_error} and @code{aio_return}
c756c71c 2754functions. As long as the value returned by @code{aio_error} is
a3a4a74e 2755@code{EINPROGRESS} the operation has not yet completed. If
19e4c7dd 2756@code{aio_error} returns zero, the operation successfully terminated,
a3a4a74e 2757otherwise the value is to be interpreted as an error code. If the
9739d2d5 2758function terminated, the result of the operation can be obtained using a call
a3a4a74e 2759to @code{aio_return}. The returned value is the same as an equivalent
19e4c7dd 2760call to @code{read} would have returned. Possible error codes returned
a3a4a74e
UD
2761by @code{aio_error} are:
2762
2763@table @code
2764@item EBADF
2765The @code{aiocbp->aio_fildes} descriptor is not valid.
2766@item ECANCELED
19e4c7dd 2767The operation was canceled before the operation was finished.
a3a4a74e
UD
2768(@pxref{Cancel AIO Operations})
2769@item EINVAL
2770The @code{aiocbp->aio_offset} value is invalid.
2771@end table
2772
19e4c7dd 2773When the sources are compiled with @code{_FILE_OFFSET_BITS == 64}, this
a3a4a74e
UD
2774function is in fact @code{aio_write64} since the LFS interface transparently
2775replaces the normal implementation.
2776@end deftypefun
2777
8ded91fb 2778@deftypefun int aio_write64 (struct aiocb64 *@var{aiocbp})
d08a7e4c 2779@standards{Unix98, aio.h}
2cc3615c 2780@safety{@prelim{}@mtsafe{}@asunsafe{@asulock{} @ascuheap{}}@acunsafe{@aculock{} @acsmem{}}}
a3a4a74e 2781This function is similar to the @code{aio_write} function. The only
04b9968b 2782difference is that on @w{32 bit} machines the file descriptor should
a3a4a74e
UD
2783be opened in the large file mode. Internally @code{aio_write64} uses
2784functionality equivalent to @code{lseek64} (@pxref{File Position
2785Primitive}) to position the file descriptor correctly for the writing,
9739d2d5 2786as opposed to the @code{lseek} functionality used in @code{aio_write}.
a3a4a74e 2787
19e4c7dd 2788When the sources are compiled with @code{_FILE_OFFSET_BITS == 64}, this
a3a4a74e 2789function is available under the name @code{aio_write} and so transparently
04b9968b 2790replaces the interface for small files on 32 bit machines.
a3a4a74e
UD
2791@end deftypefun
2792
19e4c7dd
AJ
2793Besides these functions with the more or less traditional interface,
2794POSIX.1b also defines a function which can initiate more than one
2795operation at a time, and which can handle freely mixed read and write
2796operations. It is therefore similar to a combination of @code{readv} and
a3a4a74e
UD
2797@code{writev}.
2798
a3a4a74e 2799@deftypefun int lio_listio (int @var{mode}, struct aiocb *const @var{list}[], int @var{nent}, struct sigevent *@var{sig})
d08a7e4c 2800@standards{POSIX.1b, aio.h}
2cc3615c
AO
2801@safety{@prelim{}@mtsafe{}@asunsafe{@asulock{} @ascuheap{}}@acunsafe{@aculock{} @acsmem{}}}
2802@c Call lio_listio_internal, that takes the aio_requests_mutex lock and
2803@c enqueues each request. Then, it waits for notification or prepares
2804@c for it before releasing the lock. Even though it performs memory
2805@c allocation and locking of its own, it doesn't add any classes of
2806@c safety issues that aren't already covered by aio_enqueue_request.
a3a4a74e
UD
2807The @code{lio_listio} function can be used to enqueue an arbitrary
2808number of read and write requests at one time. The requests can all be
2809meant for the same file, all for different files or every solution in
2810between.
2811
2812@code{lio_listio} gets the @var{nent} requests from the array pointed to
19e4c7dd 2813by @var{list}. The operation to be performed is determined by the
a3a4a74e 2814@code{aio_lio_opcode} member in each element of @var{list}. If this
19e4c7dd 2815field is @code{LIO_READ} a read operation is enqueued, similar to a call
a3a4a74e
UD
2816of @code{aio_read} for this element of the array (except that the way
2817the termination is signalled is different, as we will see below). If
19e4c7dd 2818the @code{aio_lio_opcode} member is @code{LIO_WRITE} a write operation
a3a4a74e
UD
2819is enqueued. Otherwise the @code{aio_lio_opcode} must be @code{LIO_NOP}
2820in which case this element of @var{list} is simply ignored. This
2821``operation'' is useful in situations where one has a fixed array of
2822@code{struct aiocb} elements from which only a few need to be handled at
2823a time. Another situation is where the @code{lio_listio} call was
19e4c7dd 2824canceled before all requests are processed (@pxref{Cancel AIO
a3a4a74e
UD
2825Operations}) and the remaining requests have to be reissued.
2826
fed8f7f7 2827The other members of each element of the array pointed to by
a3a4a74e
UD
2828@code{list} must have values suitable for the operation as described in
2829the documentation for @code{aio_read} and @code{aio_write} above.
2830
2831The @var{mode} argument determines how @code{lio_listio} behaves after
2832having enqueued all the requests. If @var{mode} is @code{LIO_WAIT} it
2833waits until all requests terminated. Otherwise @var{mode} must be
fed8f7f7 2834@code{LIO_NOWAIT} and in this case the function returns immediately after
a3a4a74e
UD
2835having enqueued all the requests. In this case the caller gets a
2836notification of the termination of all requests according to the
2837@var{sig} parameter. If @var{sig} is @code{NULL} no notification is
9739d2d5 2838sent. Otherwise a signal is sent or a thread is started, just as
a3a4a74e
UD
2839described in the description for @code{aio_read} or @code{aio_write}.
2840
19e4c7dd 2841If @var{mode} is @code{LIO_WAIT}, the return value of @code{lio_listio}
a3a4a74e 2842is @math{0} when all requests completed successfully. Otherwise the
9739d2d5 2843function returns @math{-1} and @code{errno} is set accordingly. To find
a3a4a74e
UD
2844out which request or requests failed one has to use the @code{aio_error}
2845function on all the elements of the array @var{list}.
2846
19e4c7dd 2847In case @var{mode} is @code{LIO_NOWAIT}, the function returns @math{0} if
a3a4a74e
UD
2848all requests were enqueued correctly. The current state of the requests
2849can be found using @code{aio_error} and @code{aio_return} as described
19e4c7dd 2850above. If @code{lio_listio} returns @math{-1} in this mode, the
a3a4a74e 2851global variable @code{errno} is set accordingly. If a request did not
19e4c7dd
AJ
2852yet terminate, a call to @code{aio_error} returns @code{EINPROGRESS}. If
2853the value is different, the request is finished and the error value (or
a3a4a74e
UD
2854@math{0}) is returned and the result of the operation can be retrieved
2855using @code{aio_return}.
2856
2857Possible values for @code{errno} are:
2858
2859@table @code
2860@item EAGAIN
19e4c7dd 2861The resources necessary to queue all the requests are not available at
a3a4a74e 2862the moment. The error status for each element of @var{list} must be
19e4c7dd 2863checked to determine which request failed.
a3a4a74e 2864
fed8f7f7 2865Another reason could be that the system wide limit of AIO requests is
a7a93d50 2866exceeded. This cannot be the case for the implementation on @gnusystems{}
a3a4a74e
UD
2867since no arbitrary limits exist.
2868@item EINVAL
2869The @var{mode} parameter is invalid or @var{nent} is larger than
2870@code{AIO_LISTIO_MAX}.
2871@item EIO
2872One or more of the request's I/O operations failed. The error status of
19e4c7dd 2873each request should be checked to determine which one failed.
a3a4a74e
UD
2874@item ENOSYS
2875The @code{lio_listio} function is not supported.
2876@end table
2877
2878If the @var{mode} parameter is @code{LIO_NOWAIT} and the caller cancels
19e4c7dd 2879a request, the error status for this request returned by
a3a4a74e
UD
2880@code{aio_error} is @code{ECANCELED}.
2881
19e4c7dd 2882When the sources are compiled with @code{_FILE_OFFSET_BITS == 64}, this
a3a4a74e
UD
2883function is in fact @code{lio_listio64} since the LFS interface
2884transparently replaces the normal implementation.
2885@end deftypefun
2886
8ded91fb 2887@deftypefun int lio_listio64 (int @var{mode}, struct aiocb64 *const @var{list}[], int @var{nent}, struct sigevent *@var{sig})
d08a7e4c 2888@standards{Unix98, aio.h}
2cc3615c 2889@safety{@prelim{}@mtsafe{}@asunsafe{@asulock{} @ascuheap{}}@acunsafe{@aculock{} @acsmem{}}}
19e4c7dd
AJ
2890This function is similar to the @code{lio_listio} function. The only
2891difference is that on @w{32 bit} machines, the file descriptor should
2892be opened in the large file mode. Internally, @code{lio_listio64} uses
a3a4a74e
UD
2893functionality equivalent to @code{lseek64} (@pxref{File Position
2894Primitive}) to position the file descriptor correctly for the reading or
9739d2d5 2895writing, as opposed to the @code{lseek} functionality used in
a3a4a74e
UD
2896@code{lio_listio}.
2897
19e4c7dd 2898When the sources are compiled with @code{_FILE_OFFSET_BITS == 64}, this
a3a4a74e 2899function is available under the name @code{lio_listio} and so
04b9968b 2900transparently replaces the interface for small files on 32 bit
a3a4a74e
UD
2901machines.
2902@end deftypefun
2903
2904@node Status of AIO Operations
2905@subsection Getting the Status of AIO Operations
2906
fed8f7f7 2907As already described in the documentation of the functions in the last
04b9968b
UD
2908section, it must be possible to get information about the status of an I/O
2909request. When the operation is performed truly asynchronously (as with
19e4c7dd
AJ
2910@code{aio_read} and @code{aio_write} and with @code{lio_listio} when the
2911mode is @code{LIO_NOWAIT}), one sometimes needs to know whether a
2912specific request already terminated and if so, what the result was.
04b9968b 2913The following two functions allow you to get this kind of information.
a3a4a74e 2914
a3a4a74e 2915@deftypefun int aio_error (const struct aiocb *@var{aiocbp})
d08a7e4c 2916@standards{POSIX.1b, aio.h}
2cc3615c 2917@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
a3a4a74e 2918This function determines the error state of the request described by the
fed8f7f7 2919@code{struct aiocb} variable pointed to by @var{aiocbp}. If the
a3a4a74e
UD
2920request has not yet terminated the value returned is always
2921@code{EINPROGRESS}. Once the request has terminated the value
2922@code{aio_error} returns is either @math{0} if the request completed
fed8f7f7 2923successfully or it returns the value which would be stored in the
a3a4a74e
UD
2924@code{errno} variable if the request would have been done using
2925@code{read}, @code{write}, or @code{fsync}.
2926
2927The function can return @code{ENOSYS} if it is not implemented. It
2928could also return @code{EINVAL} if the @var{aiocbp} parameter does not
2929refer to an asynchronous operation whose return status is not yet known.
2930
2931When the sources are compiled with @code{_FILE_OFFSET_BITS == 64} this
2932function is in fact @code{aio_error64} since the LFS interface
2933transparently replaces the normal implementation.
2934@end deftypefun
2935
a3a4a74e 2936@deftypefun int aio_error64 (const struct aiocb64 *@var{aiocbp})
d08a7e4c 2937@standards{Unix98, aio.h}
2cc3615c 2938@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
a3a4a74e
UD
2939This function is similar to @code{aio_error} with the only difference
2940that the argument is a reference to a variable of type @code{struct
2941aiocb64}.
2942
2943When the sources are compiled with @code{_FILE_OFFSET_BITS == 64} this
2944function is available under the name @code{aio_error} and so
04b9968b 2945transparently replaces the interface for small files on 32 bit
a3a4a74e
UD
2946machines.
2947@end deftypefun
2948
8ded91fb 2949@deftypefun ssize_t aio_return (struct aiocb *@var{aiocbp})
d08a7e4c 2950@standards{POSIX.1b, aio.h}
2cc3615c 2951@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
a3a4a74e
UD
2952This function can be used to retrieve the return status of the operation
2953carried out by the request described in the variable pointed to by
2954@var{aiocbp}. As long as the error status of this request as returned
9739d2d5 2955by @code{aio_error} is @code{EINPROGRESS} the return value of this function is
a3a4a74e
UD
2956undefined.
2957
fed8f7f7
UD
2958Once the request is finished this function can be used exactly once to
2959retrieve the return value. Following calls might lead to undefined
19e4c7dd 2960behavior. The return value itself is the value which would have been
a3a4a74e
UD
2961returned by the @code{read}, @code{write}, or @code{fsync} call.
2962
2963The function can return @code{ENOSYS} if it is not implemented. It
2964could also return @code{EINVAL} if the @var{aiocbp} parameter does not
2965refer to an asynchronous operation whose return status is not yet known.
2966
2967When the sources are compiled with @code{_FILE_OFFSET_BITS == 64} this
2968function is in fact @code{aio_return64} since the LFS interface
2969transparently replaces the normal implementation.
2970@end deftypefun
2971
8ded91fb 2972@deftypefun ssize_t aio_return64 (struct aiocb64 *@var{aiocbp})
d08a7e4c 2973@standards{Unix98, aio.h}
2cc3615c 2974@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
a3a4a74e
UD
2975This function is similar to @code{aio_return} with the only difference
2976that the argument is a reference to a variable of type @code{struct
2977aiocb64}.
2978
2979When the sources are compiled with @code{_FILE_OFFSET_BITS == 64} this
2980function is available under the name @code{aio_return} and so
04b9968b 2981transparently replaces the interface for small files on 32 bit
a3a4a74e
UD
2982machines.
2983@end deftypefun
2984
2985@node Synchronizing AIO Operations
2986@subsection Getting into a Consistent State
2987
2988When dealing with asynchronous operations it is sometimes necessary to
fed8f7f7 2989get into a consistent state. This would mean for AIO that one wants to
9739d2d5 2990know whether a certain request or a group of requests were processed.
a3a4a74e 2991This could be done by waiting for the notification sent by the system
04b9968b 2992after the operation terminated, but this sometimes would mean wasting
a3a4a74e
UD
2993resources (mainly computation time). Instead POSIX.1b defines two
2994functions which will help with most kinds of consistency.
2995
2996The @code{aio_fsync} and @code{aio_fsync64} functions are only available
19e4c7dd 2997if the symbol @code{_POSIX_SYNCHRONIZED_IO} is defined in @file{unistd.h}.
a3a4a74e
UD
2998
2999@cindex synchronizing
a3a4a74e 3000@deftypefun int aio_fsync (int @var{op}, struct aiocb *@var{aiocbp})
d08a7e4c 3001@standards{POSIX.1b, aio.h}
2cc3615c
AO
3002@safety{@prelim{}@mtsafe{}@asunsafe{@asulock{} @ascuheap{}}@acunsafe{@aculock{} @acsmem{}}}
3003@c After fcntl to check that the FD is open, it calls
3004@c aio_enqueue_request.
9739d2d5 3005Calling this function forces all I/O operations queued at the
fed8f7f7 3006time of the function call operating on the file descriptor
a3a4a74e 3007@code{aiocbp->aio_fildes} into the synchronized I/O completion state
04b9968b 3008(@pxref{Synchronizing I/O}). The @code{aio_fsync} function returns
a3a4a74e
UD
3009immediately but the notification through the method described in
3010@code{aiocbp->aio_sigevent} will happen only after all requests for this
04b9968b 3011file descriptor have terminated and the file is synchronized. This also
a3a4a74e 3012means that requests for this very same file descriptor which are queued
04b9968b 3013after the synchronization request are not affected.
a3a4a74e
UD
3014
3015If @var{op} is @code{O_DSYNC} the synchronization happens as with a call
3016to @code{fdatasync}. Otherwise @var{op} should be @code{O_SYNC} and
fed8f7f7 3017the synchronization happens as with @code{fsync}.
a3a4a74e 3018
19e4c7dd 3019As long as the synchronization has not happened, a call to
a3a4a74e 3020@code{aio_error} with the reference to the object pointed to by
fed8f7f7
UD
3021@var{aiocbp} returns @code{EINPROGRESS}. Once the synchronization is
3022done @code{aio_error} return @math{0} if the synchronization was not
a3a4a74e
UD
3023successful. Otherwise the value returned is the value to which the
3024@code{fsync} or @code{fdatasync} function would have set the
3025@code{errno} variable. In this case nothing can be assumed about the
9739d2d5 3026consistency of the data written to this file descriptor.
a3a4a74e
UD
3027
3028The return value of this function is @math{0} if the request was
19e4c7dd 3029successfully enqueued. Otherwise the return value is @math{-1} and
a3a4a74e
UD
3030@code{errno} is set to one of the following values:
3031
3032@table @code
3033@item EAGAIN
fed8f7f7 3034The request could not be enqueued due to temporary lack of resources.
a3a4a74e 3035@item EBADF
47792506 3036The file descriptor @code{@var{aiocbp}->aio_fildes} is not valid.
a3a4a74e
UD
3037@item EINVAL
3038The implementation does not support I/O synchronization or the @var{op}
3039parameter is other than @code{O_DSYNC} and @code{O_SYNC}.
3040@item ENOSYS
3041This function is not implemented.
3042@end table
3043
3044When the sources are compiled with @code{_FILE_OFFSET_BITS == 64} this
37de3d55 3045function is in fact @code{aio_fsync64} since the LFS interface
a3a4a74e
UD
3046transparently replaces the normal implementation.
3047@end deftypefun
3048
a3a4a74e 3049@deftypefun int aio_fsync64 (int @var{op}, struct aiocb64 *@var{aiocbp})
d08a7e4c 3050@standards{Unix98, aio.h}
2cc3615c 3051@safety{@prelim{}@mtsafe{}@asunsafe{@asulock{} @ascuheap{}}@acunsafe{@aculock{} @acsmem{}}}
a3a4a74e
UD
3052This function is similar to @code{aio_fsync} with the only difference
3053that the argument is a reference to a variable of type @code{struct
3054aiocb64}.
3055
3056When the sources are compiled with @code{_FILE_OFFSET_BITS == 64} this
3057function is available under the name @code{aio_fsync} and so
04b9968b 3058transparently replaces the interface for small files on 32 bit
a3a4a74e
UD
3059machines.
3060@end deftypefun
3061
fed8f7f7 3062Another method of synchronization is to wait until one or more requests of a
a3a4a74e
UD
3063specific set terminated. This could be achieved by the @code{aio_*}
3064functions to notify the initiating process about the termination but in
3065some situations this is not the ideal solution. In a program which
3066constantly updates clients somehow connected to the server it is not
3067always the best solution to go round robin since some connections might
9739d2d5 3068be slow. On the other hand letting the @code{aio_*} functions notify the
a3a4a74e 3069caller might also be not the best solution since whenever the process
9739d2d5 3070works on preparing data for a client it makes no sense to be
a3a4a74e
UD
3071interrupted by a notification since the new client will not be handled
3072before the current client is served. For situations like this
3073@code{aio_suspend} should be used.
3074
a3a4a74e 3075@deftypefun int aio_suspend (const struct aiocb *const @var{list}[], int @var{nent}, const struct timespec *@var{timeout})
d08a7e4c 3076@standards{POSIX.1b, aio.h}
2cc3615c
AO
3077@safety{@prelim{}@mtsafe{}@asunsafe{@asulock{}}@acunsafe{@aculock{}}}
3078@c Take aio_requests_mutex, set up waitlist and requestlist, wait
3079@c for completion or timeout, and release the mutex.
19e4c7dd 3080When calling this function, the calling thread is suspended until at
a3a4a74e 3081least one of the requests pointed to by the @var{nent} elements of the
19e4c7dd
AJ
3082array @var{list} has completed. If any of the requests has already
3083completed at the time @code{aio_suspend} is called, the function returns
3084immediately. Whether a request has terminated or not is determined by
a3a4a74e 3085comparing the error status of the request with @code{EINPROGRESS}. If
19e4c7dd 3086an element of @var{list} is @code{NULL}, the entry is simply ignored.
a3a4a74e 3087
19e4c7dd
AJ
3088If no request has finished, the calling process is suspended. If
3089@var{timeout} is @code{NULL}, the process is not woken until a request
3090has finished. If @var{timeout} is not @code{NULL}, the process remains
3091suspended at least as long as specified in @var{timeout}. In this case,
a3a4a74e
UD
3092@code{aio_suspend} returns with an error.
3093
fed8f7f7 3094The return value of the function is @math{0} if one or more requests
a3a4a74e
UD
3095from the @var{list} have terminated. Otherwise the function returns
3096@math{-1} and @code{errno} is set to one of the following values:
3097
3098@table @code
3099@item EAGAIN
3100None of the requests from the @var{list} completed in the time specified
3101by @var{timeout}.
3102@item EINTR
3103A signal interrupted the @code{aio_suspend} function. This signal might
3104also be sent by the AIO implementation while signalling the termination
3105of one of the requests.
3106@item ENOSYS
3107The @code{aio_suspend} function is not implemented.
3108@end table
3109
3110When the sources are compiled with @code{_FILE_OFFSET_BITS == 64} this
3111function is in fact @code{aio_suspend64} since the LFS interface
3112transparently replaces the normal implementation.
3113@end deftypefun
3114
a3a4a74e 3115@deftypefun int aio_suspend64 (const struct aiocb64 *const @var{list}[], int @var{nent}, const struct timespec *@var{timeout})
d08a7e4c 3116@standards{Unix98, aio.h}
2cc3615c 3117@safety{@prelim{}@mtsafe{}@asunsafe{@asulock{}}@acunsafe{@aculock{}}}
a3a4a74e
UD
3118This function is similar to @code{aio_suspend} with the only difference
3119that the argument is a reference to a variable of type @code{struct
3120aiocb64}.
3121
3122When the sources are compiled with @code{_FILE_OFFSET_BITS == 64} this
3123function is available under the name @code{aio_suspend} and so
04b9968b 3124transparently replaces the interface for small files on 32 bit
a3a4a74e
UD
3125machines.
3126@end deftypefun
b07d03e0
UD
3127
3128@node Cancel AIO Operations
04b9968b 3129@subsection Cancellation of AIO Operations
b07d03e0 3130
19e4c7dd 3131When one or more requests are asynchronously processed, it might be
a3a4a74e 3132useful in some situations to cancel a selected operation, e.g., if it
19e4c7dd
AJ
3133becomes obvious that the written data is no longer accurate and would
3134have to be overwritten soon. As an example, assume an application, which
a3a4a74e
UD
3135writes data in files in a situation where new incoming data would have
3136to be written in a file which will be updated by an enqueued request.
19e4c7dd
AJ
3137The POSIX AIO implementation provides such a function, but this function
3138is not capable of forcing the cancellation of the request. It is up to the
a3a4a74e
UD
3139implementation to decide whether it is possible to cancel the operation
3140or not. Therefore using this function is merely a hint.
3141
a3a4a74e 3142@deftypefun int aio_cancel (int @var{fildes}, struct aiocb *@var{aiocbp})
d08a7e4c 3143@standards{POSIX.1b, aio.h}
2cc3615c
AO
3144@safety{@prelim{}@mtsafe{}@asunsafe{@asulock{} @ascuheap{}}@acunsafe{@aculock{} @acsmem{}}}
3145@c After fcntl to check the fd is open, hold aio_requests_mutex, call
3146@c aio_find_req_fd, aio_remove_request, then aio_notify and
3147@c aio_free_request each request before releasing the lock.
3148@c aio_notify calls aio_notify_only and free, besides cond signal or
3149@c similar. aio_notify_only calls pthread_attr_init,
3150@c pthread_attr_setdetachstate, malloc, pthread_create,
3151@c notify_func_wrapper, aio_sigqueue, getpid, raise.
3152@c notify_func_wraper calls aio_start_notify_thread, free and then the
3153@c notifier function.
a3a4a74e 3154The @code{aio_cancel} function can be used to cancel one or more
19e4c7dd
AJ
3155outstanding requests. If the @var{aiocbp} parameter is @code{NULL}, the
3156function tries to cancel all of the outstanding requests which would process
3157the file descriptor @var{fildes} (i.e., whose @code{aio_fildes} member
3158is @var{fildes}). If @var{aiocbp} is not @code{NULL}, @code{aio_cancel}
3159attempts to cancel the specific request pointed to by @var{aiocbp}.
a3a4a74e 3160
19e4c7dd 3161For requests which were successfully canceled, the normal notification
a3a4a74e
UD
3162about the termination of the request should take place. I.e., depending
3163on the @code{struct sigevent} object which controls this, nothing
3164happens, a signal is sent or a thread is started. If the request cannot
19e4c7dd 3165be canceled, it terminates the usual way after performing the operation.
a3a4a74e 3166
19e4c7dd 3167After a request is successfully canceled, a call to @code{aio_error} with
a3a4a74e
UD
3168a reference to this request as the parameter will return
3169@code{ECANCELED} and a call to @code{aio_return} will return @math{-1}.
19e4c7dd 3170If the request wasn't canceled and is still running the error status is
a3a4a74e
UD
3171still @code{EINPROGRESS}.
3172
3173The return value of the function is @code{AIO_CANCELED} if there were
19e4c7dd
AJ
3174requests which haven't terminated and which were successfully canceled.
3175If there is one or more requests left which couldn't be canceled, the
a3a4a74e 3176return value is @code{AIO_NOTCANCELED}. In this case @code{aio_error}
9739d2d5 3177must be used to find out which of the, perhaps multiple, requests (if
19e4c7dd 3178@var{aiocbp} is @code{NULL}) weren't successfully canceled. If all
a3a4a74e
UD
3179requests already terminated at the time @code{aio_cancel} is called the
3180return value is @code{AIO_ALLDONE}.
3181
3182If an error occurred during the execution of @code{aio_cancel} the
3183function returns @math{-1} and sets @code{errno} to one of the following
3184values.
3185
3186@table @code
3187@item EBADF
3188The file descriptor @var{fildes} is not valid.
3189@item ENOSYS
3190@code{aio_cancel} is not implemented.
3191@end table
3192
19e4c7dd 3193When the sources are compiled with @code{_FILE_OFFSET_BITS == 64}, this
a3a4a74e
UD
3194function is in fact @code{aio_cancel64} since the LFS interface
3195transparently replaces the normal implementation.
3196@end deftypefun
3197
19e4c7dd 3198@deftypefun int aio_cancel64 (int @var{fildes}, struct aiocb64 *@var{aiocbp})
d08a7e4c 3199@standards{Unix98, aio.h}
2cc3615c 3200@safety{@prelim{}@mtsafe{}@asunsafe{@asulock{} @ascuheap{}}@acunsafe{@aculock{} @acsmem{}}}
a3a4a74e
UD
3201This function is similar to @code{aio_cancel} with the only difference
3202that the argument is a reference to a variable of type @code{struct
3203aiocb64}.
3204
19e4c7dd 3205When the sources are compiled with @code{_FILE_OFFSET_BITS == 64}, this
a3a4a74e 3206function is available under the name @code{aio_cancel} and so
04b9968b 3207transparently replaces the interface for small files on 32 bit
a3a4a74e
UD
3208machines.
3209@end deftypefun
3210
3211@node Configuration of AIO
3212@subsection How to optimize the AIO implementation
3213
3214The POSIX standard does not specify how the AIO functions are
19e4c7dd 3215implemented. They could be system calls, but it is also possible to
a3a4a74e
UD
3216emulate them at userlevel.
3217
9739d2d5 3218At the time of writing, the available implementation is a user-level
19e4c7dd
AJ
3219implementation which uses threads for handling the enqueued requests.
3220While this implementation requires making some decisions about
9739d2d5 3221limitations, hard limitations are something best avoided
1f77f049 3222in @theglibc{}. Therefore, @theglibc{} provides a means
19e4c7dd 3223for tuning the AIO implementation according to the individual use.
a3a4a74e 3224
a3a4a74e 3225@deftp {Data Type} {struct aioinit}
d08a7e4c 3226@standards{GNU, aio.h}
a3a4a74e
UD
3227This data type is used to pass the configuration or tunable parameters
3228to the implementation. The program has to initialize the members of
3229this struct and pass it to the implementation using the @code{aio_init}
3230function.
3231
3232@table @code
3233@item int aio_threads
19e4c7dd 3234This member specifies the maximal number of threads which may be used
a3a4a74e
UD
3235at any one time.
3236@item int aio_num
c756c71c 3237This number provides an estimate on the maximal number of simultaneously
a3a4a74e
UD
3238enqueued requests.
3239@item int aio_locks
19e4c7dd 3240Unused.
a3a4a74e 3241@item int aio_usedba
19e4c7dd 3242Unused.
a3a4a74e 3243@item int aio_debug
19e4c7dd 3244Unused.
a3a4a74e 3245@item int aio_numusers
19e4c7dd 3246Unused.
a3a4a74e 3247@item int aio_reserved[2]
19e4c7dd 3248Unused.
a3a4a74e
UD
3249@end table
3250@end deftp
3251
a3a4a74e 3252@deftypefun void aio_init (const struct aioinit *@var{init})
d08a7e4c 3253@standards{GNU, aio.h}
2cc3615c
AO
3254@safety{@prelim{}@mtsafe{}@asunsafe{@asulock{}}@acunsafe{@aculock{}}}
3255@c All changes to global objects are guarded by aio_requests_mutex.
a3a4a74e 3256This function must be called before any other AIO function. Calling it
19e4c7dd
AJ
3257is completely voluntary, as it is only meant to help the AIO
3258implementation perform better.
a3a4a74e 3259
9739d2d5 3260Before calling @code{aio_init}, the members of a variable of
a3a4a74e
UD
3261type @code{struct aioinit} must be initialized. Then a reference to
3262this variable is passed as the parameter to @code{aio_init} which itself
3263may or may not pay attention to the hints.
3264
c756c71c 3265The function has no return value and no error cases are defined. It is
9739d2d5 3266an extension which follows a proposal from the SGI implementation in
c756c71c 3267@w{Irix 6}. It is not covered by POSIX.1b or Unix98.
a3a4a74e 3268@end deftypefun
b07d03e0 3269
28f540f4
RM
3270@node Control Operations
3271@section Control Operations on Files
3272
3273@cindex control operations on files
3274@cindex @code{fcntl} function
3275This section describes how you can perform various other operations on
3276file descriptors, such as inquiring about or setting flags describing
3277the status of the file descriptor, manipulating record locks, and the
3278like. All of these operations are performed by the function @code{fcntl}.
3279
3280The second argument to the @code{fcntl} function is a command that
3281specifies which operation to perform. The function and macros that name
3282various flags that are used with it are declared in the header file
3283@file{fcntl.h}. Many of these flags are also used by the @code{open}
3284function; see @ref{Opening and Closing Files}.
3285@pindex fcntl.h
3286
28f540f4 3287@deftypefun int fcntl (int @var{filedes}, int @var{command}, @dots{})
d08a7e4c 3288@standards{POSIX.1, fcntl.h}
2cc3615c 3289@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
28f540f4
RM
3290The @code{fcntl} function performs the operation specified by
3291@var{command} on the file descriptor @var{filedes}. Some commands
3292require additional arguments to be supplied. These additional arguments
3293and the return value and error conditions are given in the detailed
3294descriptions of the individual commands.
3295
3296Briefly, here is a list of what the various commands are.
3297
2fe82ca6 3298@vtable @code
28f540f4
RM
3299@item F_DUPFD
3300Duplicate the file descriptor (return another file descriptor pointing
3301to the same open file). @xref{Duplicating Descriptors}.
3302
3303@item F_GETFD
3304Get flags associated with the file descriptor. @xref{Descriptor Flags}.
3305
3306@item F_SETFD
3307Set flags associated with the file descriptor. @xref{Descriptor Flags}.
3308
3309@item F_GETFL
3310Get flags associated with the open file. @xref{File Status Flags}.
3311
3312@item F_SETFL
3313Set flags associated with the open file. @xref{File Status Flags}.
3314
3315@item F_GETLK
0961f7e1 3316Test a file lock. @xref{File Locks}.
28f540f4
RM
3317
3318@item F_SETLK
3319Set or clear a file lock. @xref{File Locks}.
3320
3321@item F_SETLKW
3322Like @code{F_SETLK}, but wait for completion. @xref{File Locks}.
3323
0961f7e1
JL
3324@item F_OFD_GETLK
3325Test an open file description lock. @xref{Open File Description Locks}.
3326Specific to Linux.
3327
3328@item F_OFD_SETLK
3329Set or clear an open file description lock. @xref{Open File Description Locks}.
3330Specific to Linux.
3331
3332@item F_OFD_SETLKW
3333Like @code{F_OFD_SETLK}, but block until lock is acquired.
3334@xref{Open File Description Locks}. Specific to Linux.
3335
28f540f4
RM
3336@item F_GETOWN
3337Get process or process group ID to receive @code{SIGIO} signals.
3338@xref{Interrupt Input}.
3339
3340@item F_SETOWN
3341Set process or process group ID to receive @code{SIGIO} signals.
3342@xref{Interrupt Input}.
2fe82ca6 3343@end vtable
dfd2257a 3344
06ab719d
AZ
3345This function is a cancellation point in multi-threaded programs for the
3346commands @code{F_SETLKW} (and the LFS analogous @code{F_SETLKW64}) and
0b11b649 3347@code{F_OFD_SETLKW}. This is a problem if the thread allocates some
06ab719d
AZ
3348resources (like memory, file descriptors, semaphores or whatever) at the time
3349@code{fcntl} is called. If the thread gets canceled these resources stay
3350allocated until the program ends. To avoid this calls to @code{fcntl} should
3351be protected using cancellation handlers.
dfd2257a 3352@c ref pthread_cleanup_push / pthread_cleanup_pop
28f540f4
RM
3353@end deftypefun
3354
3355
3356@node Duplicating Descriptors
3357@section Duplicating Descriptors
3358
3359@cindex duplicating file descriptors
3360@cindex redirecting input and output
3361
3362You can @dfn{duplicate} a file descriptor, or allocate another file
3363descriptor that refers to the same open file as the original. Duplicate
3364descriptors share one file position and one set of file status flags
3365(@pxref{File Status Flags}), but each has its own set of file descriptor
3366flags (@pxref{Descriptor Flags}).
3367
3368The major use of duplicating a file descriptor is to implement
3369@dfn{redirection} of input or output: that is, to change the
3370file or pipe that a particular file descriptor corresponds to.
3371
3372You can perform this operation using the @code{fcntl} function with the
3373@code{F_DUPFD} command, but there are also convenient functions
3374@code{dup} and @code{dup2} for duplicating descriptors.
3375
3376@pindex unistd.h
3377@pindex fcntl.h
3378The @code{fcntl} function and flags are declared in @file{fcntl.h},
3379while prototypes for @code{dup} and @code{dup2} are in the header file
3380@file{unistd.h}.
3381
28f540f4 3382@deftypefun int dup (int @var{old})
d08a7e4c 3383@standards{POSIX.1, unistd.h}
2cc3615c 3384@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
28f540f4
RM
3385This function copies descriptor @var{old} to the first available
3386descriptor number (the first number not currently open). It is
3387equivalent to @code{fcntl (@var{old}, F_DUPFD, 0)}.
3388@end deftypefun
3389
28f540f4 3390@deftypefun int dup2 (int @var{old}, int @var{new})
d08a7e4c 3391@standards{POSIX.1, unistd.h}
2cc3615c 3392@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
28f540f4
RM
3393This function copies the descriptor @var{old} to descriptor number
3394@var{new}.
3395
3396If @var{old} is an invalid descriptor, then @code{dup2} does nothing; it
3397does not close @var{new}. Otherwise, the new duplicate of @var{old}
3398replaces any previous meaning of descriptor @var{new}, as if @var{new}
3399were closed first.
3400
3401If @var{old} and @var{new} are different numbers, and @var{old} is a
3402valid descriptor number, then @code{dup2} is equivalent to:
3403
3404@smallexample
3405close (@var{new});
3406fcntl (@var{old}, F_DUPFD, @var{new})
3407@end smallexample
3408
3409However, @code{dup2} does this atomically; there is no instant in the
3410middle of calling @code{dup2} at which @var{new} is closed and not yet a
3411duplicate of @var{old}.
3412@end deftypefun
3413
28f540f4 3414@deftypevr Macro int F_DUPFD
d08a7e4c 3415@standards{POSIX.1, fcntl.h}
28f540f4
RM
3416This macro is used as the @var{command} argument to @code{fcntl}, to
3417copy the file descriptor given as the first argument.
3418
3419The form of the call in this case is:
3420
3421@smallexample
3422fcntl (@var{old}, F_DUPFD, @var{next-filedes})
3423@end smallexample
3424
3425The @var{next-filedes} argument is of type @code{int} and specifies that
3426the file descriptor returned should be the next available one greater
3427than or equal to this value.
3428
3429The return value from @code{fcntl} with this command is normally the value
07435eb4 3430of the new file descriptor. A return value of @math{-1} indicates an
28f540f4
RM
3431error. The following @code{errno} error conditions are defined for
3432this command:
3433
3434@table @code
3435@item EBADF
3436The @var{old} argument is invalid.
3437
3438@item EINVAL
3439The @var{next-filedes} argument is invalid.
3440
3441@item EMFILE
3442There are no more file descriptors available---your program is already
3443using the maximum. In BSD and GNU, the maximum is controlled by a
3444resource limit that can be changed; @pxref{Limits on Resources}, for
3445more information about the @code{RLIMIT_NOFILE} limit.
3446@end table
3447
3448@code{ENFILE} is not a possible error code for @code{dup2} because
3449@code{dup2} does not create a new opening of a file; duplicate
3450descriptors do not count toward the limit which @code{ENFILE}
3451indicates. @code{EMFILE} is possible because it refers to the limit on
3452distinct descriptor numbers in use in one process.
3453@end deftypevr
3454
3455Here is an example showing how to use @code{dup2} to do redirection.
3456Typically, redirection of the standard streams (like @code{stdin}) is
3457done by a shell or shell-like program before calling one of the
3458@code{exec} functions (@pxref{Executing a File}) to execute a new
3459program in a child process. When the new program is executed, it
3460creates and initializes the standard streams to point to the
3461corresponding file descriptors, before its @code{main} function is
3462invoked.
3463
3464So, to redirect standard input to a file, the shell could do something
3465like:
3466
3467@smallexample
3468pid = fork ();
3469if (pid == 0)
3470 @{
3471 char *filename;
3472 char *program;
3473 int file;
3474 @dots{}
3475 file = TEMP_FAILURE_RETRY (open (filename, O_RDONLY));
3476 dup2 (file, STDIN_FILENO);
3477 TEMP_FAILURE_RETRY (close (file));
3478 execv (program, NULL);
3479 @}
3480@end smallexample
3481
3482There is also a more detailed example showing how to implement redirection
3483in the context of a pipeline of processes in @ref{Launching Jobs}.
3484
3485
3486@node Descriptor Flags
3487@section File Descriptor Flags
3488@cindex file descriptor flags
3489
3490@dfn{File descriptor flags} are miscellaneous attributes of a file
3491descriptor. These flags are associated with particular file
3492descriptors, so that if you have created duplicate file descriptors
3493from a single opening of a file, each descriptor has its own set of flags.
3494
3495Currently there is just one file descriptor flag: @code{FD_CLOEXEC},
3496which causes the descriptor to be closed if you use any of the
3497@code{exec@dots{}} functions (@pxref{Executing a File}).
3498
3499The symbols in this section are defined in the header file
3500@file{fcntl.h}.
3501@pindex fcntl.h
3502
28f540f4 3503@deftypevr Macro int F_GETFD
d08a7e4c 3504@standards{POSIX.1, fcntl.h}
28f540f4
RM
3505This macro is used as the @var{command} argument to @code{fcntl}, to
3506specify that it should return the file descriptor flags associated
2c6fe0bd 3507with the @var{filedes} argument.
28f540f4
RM
3508
3509The normal return value from @code{fcntl} with this command is a
3510nonnegative number which can be interpreted as the bitwise OR of the
3511individual flags (except that currently there is only one flag to use).
3512
07435eb4 3513In case of an error, @code{fcntl} returns @math{-1}. The following
28f540f4
RM
3514@code{errno} error conditions are defined for this command:
3515
3516@table @code
3517@item EBADF
3518The @var{filedes} argument is invalid.
3519@end table
3520@end deftypevr
3521
3522
28f540f4 3523@deftypevr Macro int F_SETFD
d08a7e4c 3524@standards{POSIX.1, fcntl.h}
28f540f4
RM
3525This macro is used as the @var{command} argument to @code{fcntl}, to
3526specify that it should set the file descriptor flags associated with the
3527@var{filedes} argument. This requires a third @code{int} argument to
3528specify the new flags, so the form of the call is:
3529
3530@smallexample
3531fcntl (@var{filedes}, F_SETFD, @var{new-flags})
3532@end smallexample
3533
3534The normal return value from @code{fcntl} with this command is an
07435eb4 3535unspecified value other than @math{-1}, which indicates an error.
28f540f4
RM
3536The flags and error conditions are the same as for the @code{F_GETFD}
3537command.
3538@end deftypevr
3539
3540The following macro is defined for use as a file descriptor flag with
3541the @code{fcntl} function. The value is an integer constant usable
3542as a bit mask value.
3543
28f540f4 3544@deftypevr Macro int FD_CLOEXEC
d08a7e4c 3545@standards{POSIX.1, fcntl.h}
28f540f4
RM
3546@cindex close-on-exec (file descriptor flag)
3547This flag specifies that the file descriptor should be closed when
3548an @code{exec} function is invoked; see @ref{Executing a File}. When
3549a file descriptor is allocated (as with @code{open} or @code{dup}),
3550this bit is initially cleared on the new file descriptor, meaning that
3551descriptor will survive into the new program after @code{exec}.
3552@end deftypevr
3553
3554If you want to modify the file descriptor flags, you should get the
3555current flags with @code{F_GETFD} and modify the value. Don't assume
3556that the flags listed here are the only ones that are implemented; your
3557program may be run years from now and more flags may exist then. For
3558example, here is a function to set or clear the flag @code{FD_CLOEXEC}
3559without altering any other flags:
3560
3561@smallexample
3562/* @r{Set the @code{FD_CLOEXEC} flag of @var{desc} if @var{value} is nonzero,}
3563 @r{or clear the flag if @var{value} is 0.}
2c6fe0bd 3564 @r{Return 0 on success, or -1 on error with @code{errno} set.} */
28f540f4
RM
3565
3566int
3567set_cloexec_flag (int desc, int value)
3568@{
3569 int oldflags = fcntl (desc, F_GETFD, 0);
8e96ae1a 3570 /* @r{If reading the flags failed, return error indication now.} */
28f540f4
RM
3571 if (oldflags < 0)
3572 return oldflags;
3573 /* @r{Set just the flag we want to set.} */
3574 if (value != 0)
3575 oldflags |= FD_CLOEXEC;
3576 else
3577 oldflags &= ~FD_CLOEXEC;
3578 /* @r{Store modified flag word in the descriptor.} */
3579 return fcntl (desc, F_SETFD, oldflags);
3580@}
3581@end smallexample
3582
3583@node File Status Flags
3584@section File Status Flags
3585@cindex file status flags
3586
3587@dfn{File status flags} are used to specify attributes of the opening of a
3588file. Unlike the file descriptor flags discussed in @ref{Descriptor
3589Flags}, the file status flags are shared by duplicated file descriptors
3590resulting from a single opening of the file. The file status flags are
3591specified with the @var{flags} argument to @code{open};
3592@pxref{Opening and Closing Files}.
3593
3594File status flags fall into three categories, which are described in the
3595following sections.
3596
3597@itemize @bullet
3598@item
3599@ref{Access Modes}, specify what type of access is allowed to the
3600file: reading, writing, or both. They are set by @code{open} and are
3601returned by @code{fcntl}, but cannot be changed.
3602
3603@item
3604@ref{Open-time Flags}, control details of what @code{open} will do.
3605These flags are not preserved after the @code{open} call.
3606
3607@item
3608@ref{Operating Modes}, affect how operations such as @code{read} and
3609@code{write} are done. They are set by @code{open}, and can be fetched or
3610changed with @code{fcntl}.
3611@end itemize
3612
3613The symbols in this section are defined in the header file
3614@file{fcntl.h}.
3615@pindex fcntl.h
3616
3617@menu
3618* Access Modes:: Whether the descriptor can read or write.
3619* Open-time Flags:: Details of @code{open}.
3620* Operating Modes:: Special modes to control I/O operations.
3621* Getting File Status Flags:: Fetching and changing these flags.
3622@end menu
3623
3624@node Access Modes
3625@subsection File Access Modes
3626
e960d831
FW
3627The file access mode allows a file descriptor to be used for reading,
3628writing, both, or neither. The access mode is determined when the file
3629is opened, and never change.
28f540f4 3630
28f540f4 3631@deftypevr Macro int O_RDONLY
d08a7e4c 3632@standards{POSIX.1, fcntl.h}
28f540f4
RM
3633Open the file for read access.
3634@end deftypevr
3635
28f540f4 3636@deftypevr Macro int O_WRONLY
d08a7e4c 3637@standards{POSIX.1, fcntl.h}
28f540f4
RM
3638Open the file for write access.
3639@end deftypevr
3640
28f540f4 3641@deftypevr Macro int O_RDWR
d08a7e4c 3642@standards{POSIX.1, fcntl.h}
28f540f4
RM
3643Open the file for both reading and writing.
3644@end deftypevr
3645
e960d831
FW
3646@deftypevr Macro int O_PATH
3647@standards{Linux, fcntl.h}
3648Obtain a file descriptor for the file, but do not open the file for
3649reading or writing. Permission checks for the file itself are skipped
3650when the file is opened (but permission to access the directory that
3651contains it is still needed), and permissions are checked when the
3652descriptor is used later on.
3653
3654For example, such descriptors can be used with the @code{fexecve}
3655function (@pxref{Executing a File}).
3656
3657This access mode is specific to Linux. On @gnuhurdsystems{}, it is
3658possible to use @code{O_EXEC} explicitly, or specify no access modes
3659at all (see below).
3660@end deftypevr
3661
3662The portable file access modes @code{O_RDONLY}, @code{O_WRONLY}, and
3663@code{O_RDWR} may not correspond to individual bits. To determine the
3664file access mode with @code{fcntl}, you must extract the access mode
3665bits from the retrieved file status flags, using the @code{O_ACCMODE}
3666mask.
3667
3668@deftypevr Macro int O_ACCMODE
3669@standards{POSIX.1, fcntl.h}
3670
3671This macro is a mask that can be bitwise-ANDed with the file status flag
3672value to recover the file access mode, assuming that a standard file
3673access mode is in use.
3674@end deftypevr
3675
3676If a non-standard file access mode is used (such as @code{O_PATH} or
3677@code{O_EXEC}), masking with @code{O_ACCMODE} may give incorrect
3678results. These non-standard access modes are identified by individual
3679bits and have to be checked directly (without masking with
3680@code{O_ACCMODE} first).
3681
3682On @gnuhurdsystems{} (but not on other systems), @code{O_RDONLY} and
28f540f4
RM
3683@code{O_WRONLY} are independent bits that can be bitwise-ORed together,
3684and it is valid for either bit to be set or clear. This means that
3685@code{O_RDWR} is the same as @code{O_RDONLY|O_WRONLY}. A file access
3686mode of zero is permissible; it allows no operations that do input or
3687output to the file, but does allow other operations such as
a7a93d50 3688@code{fchmod}. On @gnuhurdsystems{}, since ``read-only'' or ``write-only''
28f540f4 3689is a misnomer, @file{fcntl.h} defines additional names for the file
e960d831 3690access modes.
28f540f4 3691
28f540f4 3692@deftypevr Macro int O_READ
d08a7e4c 3693@standards{GNU, fcntl.h (optional)}
e960d831 3694Open the file for reading. Same as @code{O_RDONLY}; only defined on GNU/Hurd.
28f540f4
RM
3695@end deftypevr
3696
28f540f4 3697@deftypevr Macro int O_WRITE
d08a7e4c 3698@standards{GNU, fcntl.h (optional)}
e960d831 3699Open the file for writing. Same as @code{O_WRONLY}; only defined on GNU/Hurd.
28f540f4
RM
3700@end deftypevr
3701
28f540f4 3702@deftypevr Macro int O_EXEC
d08a7e4c 3703@standards{GNU, fcntl.h (optional)}
e960d831 3704Open the file for executing. Only defined on GNU/Hurd.
28f540f4
RM
3705@end deftypevr
3706
3707@node Open-time Flags
3708@subsection Open-time Flags
3709
3710The open-time flags specify options affecting how @code{open} will behave.
3711These options are not preserved once the file is open. The exception to
3712this is @code{O_NONBLOCK}, which is also an I/O operating mode and so it
3713@emph{is} saved. @xref{Opening and Closing Files}, for how to call
3714@code{open}.
3715
3716There are two sorts of options specified by open-time flags.
3717
3718@itemize @bullet
3719@item
3720@dfn{File name translation flags} affect how @code{open} looks up the
3721file name to locate the file, and whether the file can be created.
3722@cindex file name translation flags
3723@cindex flags, file name translation
3724
3725@item
3726@dfn{Open-time action flags} specify extra operations that @code{open} will
3727perform on the file once it is open.
3728@cindex open-time action flags
3729@cindex flags, open-time action
3730@end itemize
3731
3732Here are the file name translation flags.
3733
28f540f4 3734@deftypevr Macro int O_CREAT
d08a7e4c 3735@standards{POSIX.1, fcntl.h}
28f540f4
RM
3736If set, the file will be created if it doesn't already exist.
3737@c !!! mode arg, umask
3738@cindex create on open (file status flag)
3739@end deftypevr
3740
28f540f4 3741@deftypevr Macro int O_EXCL
d08a7e4c 3742@standards{POSIX.1, fcntl.h}
28f540f4
RM
3743If both @code{O_CREAT} and @code{O_EXCL} are set, then @code{open} fails
3744if the specified file already exists. This is guaranteed to never
3745clobber an existing file.
b9af29c0
FW
3746
3747The @code{O_EXCL} flag has a special meaning in combination with
3748@code{O_TMPFILE}; see below.
3749@end deftypevr
3750
fef7c63c
FW
3751@deftypevr Macro int O_DIRECTORY
3752@standards{POSIX.1, fcntl.h}
3753If set, the open operation fails if the given name is not the name of
3754a directory. The @code{errno} variable is set to @code{ENOTDIR} for
3755this error condition.
3756@end deftypevr
3757
ad14f4f8
FW
3758@deftypevr Macro int O_NOFOLLOW
3759@standards{POSIX.1, fcntl.h}
3760If set, the open operation fails if the final component of the file name
3761refers to a symbolic link. The @code{errno} variable is set to
3762@code{ELOOP} for this error condition.
3763@end deftypevr
3764
b9af29c0
FW
3765@deftypevr Macro int O_TMPFILE
3766@standards{GNU, fcntl.h}
3767If this flag is specified, functions in the @code{open} family create an
3768unnamed temporary file. In this case, the pathname argument to the
3769@code{open} family of functions (@pxref{Opening and Closing Files}) is
3770interpreted as the directory in which the temporary file is created
3771(thus determining the file system which provides the storage for the
3772file). The @code{O_TMPFILE} flag must be combined with @code{O_WRONLY}
3773or @code{O_RDWR}, and the @var{mode} argument is required.
3774
3775The temporary file can later be given a name using @code{linkat},
3776turning it into a regular file. This allows the atomic creation of a
3777file with the specific file attributes (mode and extended attributes)
3778and file contents. If, for security reasons, it is not desirable that a
3779name can be given to the file, the @code{O_EXCL} flag can be specified
3780along with @code{O_TMPFILE}.
3781
3782Not all kernels support this open flag. If this flag is unsupported, an
3783attempt to create an unnamed temporary file fails with an error of
3784@code{EINVAL}. If the underlying file system does not support the
3785@code{O_TMPFILE} flag, an @code{EOPNOTSUPP} error is the result.
3786
3787The @code{O_TMPFILE} flag is a GNU extension.
28f540f4
RM
3788@end deftypevr
3789
28f540f4 3790@deftypevr Macro int O_NONBLOCK
d08a7e4c 3791@standards{POSIX.1, fcntl.h}
28f540f4
RM
3792@cindex non-blocking open
3793This prevents @code{open} from blocking for a ``long time'' to open the
3794file. This is only meaningful for some kinds of files, usually devices
3795such as serial ports; when it is not meaningful, it is harmless and
9739d2d5 3796ignored. Often, opening a port to a modem blocks until the modem reports
28f540f4
RM
3797carrier detection; if @code{O_NONBLOCK} is specified, @code{open} will
3798return immediately without a carrier.
3799
3800Note that the @code{O_NONBLOCK} flag is overloaded as both an I/O operating
3801mode and a file name translation flag. This means that specifying
3802@code{O_NONBLOCK} in @code{open} also sets nonblocking I/O mode;
3803@pxref{Operating Modes}. To open the file without blocking but do normal
3804I/O that blocks, you must call @code{open} with @code{O_NONBLOCK} set and
3805then call @code{fcntl} to turn the bit off.
3806@end deftypevr
3807
28f540f4 3808@deftypevr Macro int O_NOCTTY
d08a7e4c 3809@standards{POSIX.1, fcntl.h}
28f540f4
RM
3810If the named file is a terminal device, don't make it the controlling
3811terminal for the process. @xref{Job Control}, for information about
3812what it means to be the controlling terminal.
3813
a7a93d50
JM
3814On @gnuhurdsystems{} and 4.4 BSD, opening a file never makes it the
3815controlling terminal and @code{O_NOCTTY} is zero. However, @gnulinuxsystems{}
3816and some other systems use a nonzero value for @code{O_NOCTTY} and set the
28f540f4
RM
3817controlling terminal when you open a file that is a terminal device; so
3818to be portable, use @code{O_NOCTTY} when it is important to avoid this.
3819@cindex controlling terminal, setting
3820@end deftypevr
3821
a7a93d50
JM
3822The following three file name translation flags exist only on
3823@gnuhurdsystems{}.
28f540f4 3824
28f540f4 3825@deftypevr Macro int O_IGNORE_CTTY
d08a7e4c 3826@standards{GNU, fcntl.h (optional)}
28f540f4
RM
3827Do not recognize the named file as the controlling terminal, even if it
3828refers to the process's existing controlling terminal device. Operations
3829on the new file descriptor will never induce job control signals.
3830@xref{Job Control}.
3831@end deftypevr
3832
28f540f4 3833@deftypevr Macro int O_NOLINK
d08a7e4c 3834@standards{GNU, fcntl.h (optional)}
28f540f4
RM
3835If the named file is a symbolic link, open the link itself instead of
3836the file it refers to. (@code{fstat} on the new file descriptor will
3837return the information returned by @code{lstat} on the link's name.)
3838@cindex symbolic link, opening
3839@end deftypevr
3840
28f540f4 3841@deftypevr Macro int O_NOTRANS
d08a7e4c 3842@standards{GNU, fcntl.h (optional)}
28f540f4
RM
3843If the named file is specially translated, do not invoke the translator.
3844Open the bare file the translator itself sees.
3845@end deftypevr
3846
3847
3848The open-time action flags tell @code{open} to do additional operations
3849which are not really related to opening the file. The reason to do them
3850as part of @code{open} instead of in separate calls is that @code{open}
3851can do them @i{atomically}.
3852
28f540f4 3853@deftypevr Macro int O_TRUNC
d08a7e4c 3854@standards{POSIX.1, fcntl.h}
28f540f4
RM
3855Truncate the file to zero length. This option is only useful for
3856regular files, not special files such as directories or FIFOs. POSIX.1
3857requires that you open the file for writing to use @code{O_TRUNC}. In
3858BSD and GNU you must have permission to write the file to truncate it,
3859but you need not open for write access.
3860
3861This is the only open-time action flag specified by POSIX.1. There is
3862no good reason for truncation to be done by @code{open}, instead of by
3863calling @code{ftruncate} afterwards. The @code{O_TRUNC} flag existed in
3864Unix before @code{ftruncate} was invented, and is retained for backward
3865compatibility.
3866@end deftypevr
3867
27e309c1
UD
3868The remaining operating modes are BSD extensions. They exist only
3869on some systems. On other systems, these macros are not defined.
3870
28f540f4 3871@deftypevr Macro int O_SHLOCK
d08a7e4c 3872@standards{BSD, fcntl.h (optional)}
28f540f4
RM
3873Acquire a shared lock on the file, as with @code{flock}.
3874@xref{File Locks}.
3875
3876If @code{O_CREAT} is specified, the locking is done atomically when
3877creating the file. You are guaranteed that no other process will get
3878the lock on the new file first.
3879@end deftypevr
3880
28f540f4 3881@deftypevr Macro int O_EXLOCK
d08a7e4c 3882@standards{BSD, fcntl.h (optional)}
28f540f4
RM
3883Acquire an exclusive lock on the file, as with @code{flock}.
3884@xref{File Locks}. This is atomic like @code{O_SHLOCK}.
3885@end deftypevr
3886
3887@node Operating Modes
3888@subsection I/O Operating Modes
3889
3890The operating modes affect how input and output operations using a file
3891descriptor work. These flags are set by @code{open} and can be fetched
3892and changed with @code{fcntl}.
3893
28f540f4 3894@deftypevr Macro int O_APPEND
d08a7e4c 3895@standards{POSIX.1, fcntl.h}
28f540f4
RM
3896The bit that enables append mode for the file. If set, then all
3897@code{write} operations write the data at the end of the file, extending
3898it, regardless of the current file position. This is the only reliable
3899way to append to a file. In append mode, you are guaranteed that the
3900data you write will always go to the current end of the file, regardless
3901of other processes writing to the file. Conversely, if you simply set
3902the file position to the end of file and write, then another process can
3903extend the file after you set the file position but before you write,
3904resulting in your data appearing someplace before the real end of file.
3905@end deftypevr
3906
2c6fe0bd 3907@deftypevr Macro int O_NONBLOCK
d08a7e4c 3908@standards{POSIX.1, fcntl.h}
28f540f4
RM
3909The bit that enables nonblocking mode for the file. If this bit is set,
3910@code{read} requests on the file can return immediately with a failure
3911status if there is no input immediately available, instead of blocking.
3912Likewise, @code{write} requests can also return immediately with a
3913failure status if the output can't be written immediately.
3914
3915Note that the @code{O_NONBLOCK} flag is overloaded as both an I/O
3916operating mode and a file name translation flag; @pxref{Open-time Flags}.
3917@end deftypevr
3918
28f540f4 3919@deftypevr Macro int O_NDELAY
d08a7e4c 3920@standards{BSD, fcntl.h}
28f540f4
RM
3921This is an obsolete name for @code{O_NONBLOCK}, provided for
3922compatibility with BSD. It is not defined by the POSIX.1 standard.
3923@end deftypevr
3924
3925The remaining operating modes are BSD and GNU extensions. They exist only
3926on some systems. On other systems, these macros are not defined.
3927
28f540f4 3928@deftypevr Macro int O_ASYNC
d08a7e4c 3929@standards{BSD, fcntl.h}
28f540f4
RM
3930The bit that enables asynchronous input mode. If set, then @code{SIGIO}
3931signals will be generated when input is available. @xref{Interrupt Input}.
3932
3933Asynchronous input mode is a BSD feature.
3934@end deftypevr
3935
28f540f4 3936@deftypevr Macro int O_FSYNC
d08a7e4c 3937@standards{BSD, fcntl.h}
28f540f4
RM
3938The bit that enables synchronous writing for the file. If set, each
3939@code{write} call will make sure the data is reliably stored on disk before
3940returning. @c !!! xref fsync
3941
3942Synchronous writing is a BSD feature.
3943@end deftypevr
3944
28f540f4 3945@deftypevr Macro int O_SYNC
d08a7e4c 3946@standards{BSD, fcntl.h}
28f540f4
RM
3947This is another name for @code{O_FSYNC}. They have the same value.
3948@end deftypevr
3949
28f540f4 3950@deftypevr Macro int O_NOATIME
d08a7e4c 3951@standards{GNU, fcntl.h}
28f540f4
RM
3952If this bit is set, @code{read} will not update the access time of the
3953file. @xref{File Times}. This is used by programs that do backups, so
3954that backing a file up does not count as reading it.
3955Only the owner of the file or the superuser may use this bit.
3956
3957This is a GNU extension.
3958@end deftypevr
3959
3960@node Getting File Status Flags
3961@subsection Getting and Setting File Status Flags
3962
3963The @code{fcntl} function can fetch or change file status flags.
3964
28f540f4 3965@deftypevr Macro int F_GETFL
d08a7e4c 3966@standards{POSIX.1, fcntl.h}
28f540f4
RM
3967This macro is used as the @var{command} argument to @code{fcntl}, to
3968read the file status flags for the open file with descriptor
3969@var{filedes}.
3970
3971The normal return value from @code{fcntl} with this command is a
3972nonnegative number which can be interpreted as the bitwise OR of the
3973individual flags. Since the file access modes are not single-bit values,
3974you can mask off other bits in the returned flags with @code{O_ACCMODE}
3975to compare them.
3976
07435eb4 3977In case of an error, @code{fcntl} returns @math{-1}. The following
28f540f4
RM
3978@code{errno} error conditions are defined for this command:
3979
3980@table @code
3981@item EBADF
3982The @var{filedes} argument is invalid.
3983@end table
3984@end deftypevr
3985
28f540f4 3986@deftypevr Macro int F_SETFL
d08a7e4c 3987@standards{POSIX.1, fcntl.h}
28f540f4
RM
3988This macro is used as the @var{command} argument to @code{fcntl}, to set
3989the file status flags for the open file corresponding to the
3990@var{filedes} argument. This command requires a third @code{int}
3991argument to specify the new flags, so the call looks like this:
3992
3993@smallexample
3994fcntl (@var{filedes}, F_SETFL, @var{new-flags})
3995@end smallexample
3996
3997You can't change the access mode for the file in this way; that is,
3998whether the file descriptor was opened for reading or writing.
3999
4000The normal return value from @code{fcntl} with this command is an
07435eb4 4001unspecified value other than @math{-1}, which indicates an error. The
28f540f4
RM
4002error conditions are the same as for the @code{F_GETFL} command.
4003@end deftypevr
4004
4005If you want to modify the file status flags, you should get the current
4006flags with @code{F_GETFL} and modify the value. Don't assume that the
4007flags listed here are the only ones that are implemented; your program
4008may be run years from now and more flags may exist then. For example,
4009here is a function to set or clear the flag @code{O_NONBLOCK} without
4010altering any other flags:
4011
4012@smallexample
4013@group
4014/* @r{Set the @code{O_NONBLOCK} flag of @var{desc} if @var{value} is nonzero,}
4015 @r{or clear the flag if @var{value} is 0.}
2c6fe0bd 4016 @r{Return 0 on success, or -1 on error with @code{errno} set.} */
28f540f4
RM
4017
4018int
4019set_nonblock_flag (int desc, int value)
4020@{
4021 int oldflags = fcntl (desc, F_GETFL, 0);
4022 /* @r{If reading the flags failed, return error indication now.} */
4023 if (oldflags == -1)
4024 return -1;
4025 /* @r{Set just the flag we want to set.} */
4026 if (value != 0)
4027 oldflags |= O_NONBLOCK;
4028 else
4029 oldflags &= ~O_NONBLOCK;
4030 /* @r{Store modified flag word in the descriptor.} */
4031 return fcntl (desc, F_SETFL, oldflags);
4032@}
4033@end group
4034@end smallexample
4035
4036@node File Locks
4037@section File Locks
4038
4039@cindex file locks
4040@cindex record locking
0961f7e1
JL
4041This section describes record locks that are associated with the process.
4042There is also a different type of record lock that is associated with the
4043open file description instead of the process. @xref{Open File Description Locks}.
4044
28f540f4
RM
4045The remaining @code{fcntl} commands are used to support @dfn{record
4046locking}, which permits multiple cooperating programs to prevent each
4047other from simultaneously accessing parts of a file in error-prone
4048ways.
4049
4050@cindex exclusive lock
4051@cindex write lock
4052An @dfn{exclusive} or @dfn{write} lock gives a process exclusive access
4053for writing to the specified part of the file. While a write lock is in
4054place, no other process can lock that part of the file.
4055
4056@cindex shared lock
4057@cindex read lock
4058A @dfn{shared} or @dfn{read} lock prohibits any other process from
4059requesting a write lock on the specified part of the file. However,
4060other processes can request read locks.
4061
4062The @code{read} and @code{write} functions do not actually check to see
4063whether there are any locks in place. If you want to implement a
4064locking protocol for a file shared by multiple processes, your application
4065must do explicit @code{fcntl} calls to request and clear locks at the
4066appropriate points.
4067
4068Locks are associated with processes. A process can only have one kind
4069of lock set for each byte of a given file. When any file descriptor for
4070that file is closed by the process, all of the locks that process holds
4071on that file are released, even if the locks were made using other
4072descriptors that remain open. Likewise, locks are released when a
4073process exits, and are not inherited by child processes created using
4074@code{fork} (@pxref{Creating a Process}).
4075
4076When making a lock, use a @code{struct flock} to specify what kind of
4077lock and where. This data type and the associated macros for the
4078@code{fcntl} function are declared in the header file @file{fcntl.h}.
4079@pindex fcntl.h
4080
28f540f4 4081@deftp {Data Type} {struct flock}
d08a7e4c 4082@standards{POSIX.1, fcntl.h}
28f540f4
RM
4083This structure is used with the @code{fcntl} function to describe a file
4084lock. It has these members:
4085
4086@table @code
4087@item short int l_type
4088Specifies the type of the lock; one of @code{F_RDLCK}, @code{F_WRLCK}, or
4089@code{F_UNLCK}.
4090
4091@item short int l_whence
4092This corresponds to the @var{whence} argument to @code{fseek} or
4093@code{lseek}, and specifies what the offset is relative to. Its value
4094can be one of @code{SEEK_SET}, @code{SEEK_CUR}, or @code{SEEK_END}.
4095
4096@item off_t l_start
4097This specifies the offset of the start of the region to which the lock
9739d2d5 4098applies, and is given in bytes relative to the point specified by the
28f540f4
RM
4099@code{l_whence} member.
4100
4101@item off_t l_len
4102This specifies the length of the region to be locked. A value of
4103@code{0} is treated specially; it means the region extends to the end of
4104the file.
4105
4106@item pid_t l_pid
4107This field is the process ID (@pxref{Process Creation Concepts}) of the
4108process holding the lock. It is filled in by calling @code{fcntl} with
0961f7e1
JL
4109the @code{F_GETLK} command, but is ignored when making a lock. If the
4110conflicting lock is an open file description lock
4111(@pxref{Open File Description Locks}), then this field will be set to
4112@math{-1}.
28f540f4
RM
4113@end table
4114@end deftp
4115
28f540f4 4116@deftypevr Macro int F_GETLK
d08a7e4c 4117@standards{POSIX.1, fcntl.h}
28f540f4
RM
4118This macro is used as the @var{command} argument to @code{fcntl}, to
4119specify that it should get information about a lock. This command
4120requires a third argument of type @w{@code{struct flock *}} to be passed
4121to @code{fcntl}, so that the form of the call is:
4122
4123@smallexample
4124fcntl (@var{filedes}, F_GETLK, @var{lockp})
4125@end smallexample
4126
4127If there is a lock already in place that would block the lock described
4128by the @var{lockp} argument, information about that lock overwrites
4129@code{*@var{lockp}}. Existing locks are not reported if they are
4130compatible with making a new lock as specified. Thus, you should
4131specify a lock type of @code{F_WRLCK} if you want to find out about both
4132read and write locks, or @code{F_RDLCK} if you want to find out about
4133write locks only.
4134
4135There might be more than one lock affecting the region specified by the
4136@var{lockp} argument, but @code{fcntl} only returns information about
4137one of them. The @code{l_whence} member of the @var{lockp} structure is
4138set to @code{SEEK_SET} and the @code{l_start} and @code{l_len} fields
4139set to identify the locked region.
4140
4141If no lock applies, the only change to the @var{lockp} structure is to
4142update the @code{l_type} to a value of @code{F_UNLCK}.
4143
4144The normal return value from @code{fcntl} with this command is an
07435eb4 4145unspecified value other than @math{-1}, which is reserved to indicate an
28f540f4
RM
4146error. The following @code{errno} error conditions are defined for
4147this command:
4148
4149@table @code
4150@item EBADF
4151The @var{filedes} argument is invalid.
4152
4153@item EINVAL
4154Either the @var{lockp} argument doesn't specify valid lock information,
4155or the file associated with @var{filedes} doesn't support locks.
4156@end table
4157@end deftypevr
4158
28f540f4 4159@deftypevr Macro int F_SETLK
d08a7e4c 4160@standards{POSIX.1, fcntl.h}
28f540f4
RM
4161This macro is used as the @var{command} argument to @code{fcntl}, to
4162specify that it should set or clear a lock. This command requires a
4163third argument of type @w{@code{struct flock *}} to be passed to
4164@code{fcntl}, so that the form of the call is:
4165
4166@smallexample
4167fcntl (@var{filedes}, F_SETLK, @var{lockp})
4168@end smallexample
4169
4170If the process already has a lock on any part of the region, the old lock
4171on that part is replaced with the new lock. You can remove a lock
4172by specifying a lock type of @code{F_UNLCK}.
4173
4174If the lock cannot be set, @code{fcntl} returns immediately with a value
9739d2d5
RJ
4175of @math{-1}. This function does not block while waiting for other processes
4176to release locks. If @code{fcntl} succeeds, it returns a value other
07435eb4 4177than @math{-1}.
28f540f4
RM
4178
4179The following @code{errno} error conditions are defined for this
4180function:
4181
4182@table @code
4183@item EAGAIN
4184@itemx EACCES
4185The lock cannot be set because it is blocked by an existing lock on the
4186file. Some systems use @code{EAGAIN} in this case, and other systems
4187use @code{EACCES}; your program should treat them alike, after
a7a93d50 4188@code{F_SETLK}. (@gnulinuxhurdsystems{} always use @code{EAGAIN}.)
28f540f4
RM
4189
4190@item EBADF
4191Either: the @var{filedes} argument is invalid; you requested a read lock
4192but the @var{filedes} is not open for read access; or, you requested a
4193write lock but the @var{filedes} is not open for write access.
4194
4195@item EINVAL
4196Either the @var{lockp} argument doesn't specify valid lock information,
4197or the file associated with @var{filedes} doesn't support locks.
4198
4199@item ENOLCK
4200The system has run out of file lock resources; there are already too
4201many file locks in place.
4202
4203Well-designed file systems never report this error, because they have no
4204limitation on the number of locks. However, you must still take account
4205of the possibility of this error, as it could result from network access
4206to a file system on another machine.
4207@end table
4208@end deftypevr
4209
28f540f4 4210@deftypevr Macro int F_SETLKW
d08a7e4c 4211@standards{POSIX.1, fcntl.h}
28f540f4
RM
4212This macro is used as the @var{command} argument to @code{fcntl}, to
4213specify that it should set or clear a lock. It is just like the
4214@code{F_SETLK} command, but causes the process to block (or wait)
4215until the request can be specified.
4216
4217This command requires a third argument of type @code{struct flock *}, as
4218for the @code{F_SETLK} command.
4219
4220The @code{fcntl} return values and errors are the same as for the
4221@code{F_SETLK} command, but these additional @code{errno} error conditions
4222are defined for this command:
4223
4224@table @code
4225@item EINTR
4226The function was interrupted by a signal while it was waiting.
4227@xref{Interrupted Primitives}.
4228
4229@item EDEADLK
4230The specified region is being locked by another process. But that
4231process is waiting to lock a region which the current process has
4232locked, so waiting for the lock would result in deadlock. The system
4233does not guarantee that it will detect all such conditions, but it lets
4234you know if it notices one.
4235@end table
4236@end deftypevr
4237
4238
4239The following macros are defined for use as values for the @code{l_type}
4240member of the @code{flock} structure. The values are integer constants.
4241
2fe82ca6 4242@vtable @code
28f540f4 4243@item F_RDLCK
d08a7e4c 4244@standards{POSIX.1, fcntl.h}
28f540f4
RM
4245This macro is used to specify a read (or shared) lock.
4246
28f540f4 4247@item F_WRLCK
d08a7e4c 4248@standards{POSIX.1, fcntl.h}
28f540f4
RM
4249This macro is used to specify a write (or exclusive) lock.
4250
28f540f4 4251@item F_UNLCK
d08a7e4c 4252@standards{POSIX.1, fcntl.h}
28f540f4 4253This macro is used to specify that the region is unlocked.
2fe82ca6 4254@end vtable
28f540f4
RM
4255
4256As an example of a situation where file locking is useful, consider a
4257program that can be run simultaneously by several different users, that
4258logs status information to a common file. One example of such a program
4259might be a game that uses a file to keep track of high scores. Another
4260example might be a program that records usage or accounting information
4261for billing purposes.
4262
4263Having multiple copies of the program simultaneously writing to the
4264file could cause the contents of the file to become mixed up. But
4265you can prevent this kind of problem by setting a write lock on the
2c6fe0bd 4266file before actually writing to the file.
28f540f4
RM
4267
4268If the program also needs to read the file and wants to make sure that
4269the contents of the file are in a consistent state, then it can also use
4270a read lock. While the read lock is set, no other process can lock
4271that part of the file for writing.
4272
4273@c ??? This section could use an example program.
4274
0961f7e1 4275Remember that file locks are only an @emph{advisory} protocol for
28f540f4
RM
4276controlling access to a file. There is still potential for access to
4277the file by programs that don't use the lock protocol.
4278
0961f7e1
JL
4279@node Open File Description Locks
4280@section Open File Description Locks
4281
4282In contrast to process-associated record locks (@pxref{File Locks}),
4283open file description record locks are associated with an open file
4284description rather than a process.
4285
4286Using @code{fcntl} to apply an open file description lock on a region that
4287already has an existing open file description lock that was created via the
4288same file descriptor will never cause a lock conflict.
4289
4290Open file description locks are also inherited by child processes across
4291@code{fork}, or @code{clone} with @code{CLONE_FILES} set
4292(@pxref{Creating a Process}), along with the file descriptor.
4293
4294It is important to distinguish between the open file @emph{description} (an
4295instance of an open file, usually created by a call to @code{open}) and
4296an open file @emph{descriptor}, which is a numeric value that refers to the
4297open file description. The locks described here are associated with the
4298open file @emph{description} and not the open file @emph{descriptor}.
4299
4300Using @code{dup} (@pxref{Duplicating Descriptors}) to copy a file
4301descriptor does not give you a new open file description, but rather copies a
4302reference to an existing open file description and assigns it to a new
4303file descriptor. Thus, open file description locks set on a file
4304descriptor cloned by @code{dup} will never conflict with open file
4305description locks set on the original descriptor since they refer to the
4306same open file description. Depending on the range and type of lock
4307involved, the original lock may be modified by a @code{F_OFD_SETLK} or
4308@code{F_OFD_SETLKW} command in this situation however.
4309
4310Open file description locks always conflict with process-associated locks,
4311even if acquired by the same process or on the same open file
4312descriptor.
4313
4314Open file description locks use the same @code{struct flock} as
4315process-associated locks as an argument (@pxref{File Locks}) and the
4316macros for the @code{command} values are also declared in the header file
4317@file{fcntl.h}. To use them, the macro @code{_GNU_SOURCE} must be
4318defined prior to including any header file.
4319
4320In contrast to process-associated locks, any @code{struct flock} used as
4321an argument to open file description lock commands must have the @code{l_pid}
4322value set to @math{0}. Also, when returning information about an
4323open file description lock in a @code{F_GETLK} or @code{F_OFD_GETLK} request,
4324the @code{l_pid} field in @code{struct flock} will be set to @math{-1}
4325to indicate that the lock is not associated with a process.
4326
4327When the same @code{struct flock} is reused as an argument to a
4328@code{F_OFD_SETLK} or @code{F_OFD_SETLKW} request after being used for an
4329@code{F_OFD_GETLK} request, it is necessary to inspect and reset the
4330@code{l_pid} field to @math{0}.
4331
4332@pindex fcntl.h.
4333
4334@deftypevr Macro int F_OFD_GETLK
4335This macro is used as the @var{command} argument to @code{fcntl}, to
4336specify that it should get information about a lock. This command
4337requires a third argument of type @w{@code{struct flock *}} to be passed
4338to @code{fcntl}, so that the form of the call is:
4339
4340@smallexample
4341fcntl (@var{filedes}, F_OFD_GETLK, @var{lockp})
4342@end smallexample
4343
4344If there is a lock already in place that would block the lock described
4345by the @var{lockp} argument, information about that lock is written to
4346@code{*@var{lockp}}. Existing locks are not reported if they are
4347compatible with making a new lock as specified. Thus, you should
4348specify a lock type of @code{F_WRLCK} if you want to find out about both
4349read and write locks, or @code{F_RDLCK} if you want to find out about
4350write locks only.
4351
4352There might be more than one lock affecting the region specified by the
4353@var{lockp} argument, but @code{fcntl} only returns information about
4354one of them. Which lock is returned in this situation is undefined.
4355
4356The @code{l_whence} member of the @var{lockp} structure are set to
4357@code{SEEK_SET} and the @code{l_start} and @code{l_len} fields are set
4358to identify the locked region.
4359
4360If no conflicting lock exists, the only change to the @var{lockp} structure
4361is to update the @code{l_type} field to the value @code{F_UNLCK}.
4362
4363The normal return value from @code{fcntl} with this command is either @math{0}
4364on success or @math{-1}, which indicates an error. The following @code{errno}
4365error conditions are defined for this command:
4366
4367@table @code
4368@item EBADF
4369The @var{filedes} argument is invalid.
4370
4371@item EINVAL
4372Either the @var{lockp} argument doesn't specify valid lock information,
4373the operating system kernel doesn't support open file description locks, or the file
4374associated with @var{filedes} doesn't support locks.
4375@end table
4376@end deftypevr
4377
0961f7e1 4378@deftypevr Macro int F_OFD_SETLK
d08a7e4c 4379@standards{POSIX.1, fcntl.h}
0961f7e1
JL
4380This macro is used as the @var{command} argument to @code{fcntl}, to
4381specify that it should set or clear a lock. This command requires a
4382third argument of type @w{@code{struct flock *}} to be passed to
4383@code{fcntl}, so that the form of the call is:
4384
4385@smallexample
4386fcntl (@var{filedes}, F_OFD_SETLK, @var{lockp})
4387@end smallexample
4388
4389If the open file already has a lock on any part of the
4390region, the old lock on that part is replaced with the new lock. You
4391can remove a lock by specifying a lock type of @code{F_UNLCK}.
4392
4393If the lock cannot be set, @code{fcntl} returns immediately with a value
4394of @math{-1}. This command does not wait for other tasks
4395to release locks. If @code{fcntl} succeeds, it returns @math{0}.
4396
4397The following @code{errno} error conditions are defined for this
4398command:
4399
4400@table @code
4401@item EAGAIN
4402The lock cannot be set because it is blocked by an existing lock on the
4403file.
4404
4405@item EBADF
4406Either: the @var{filedes} argument is invalid; you requested a read lock
4407but the @var{filedes} is not open for read access; or, you requested a
4408write lock but the @var{filedes} is not open for write access.
4409
4410@item EINVAL
4411Either the @var{lockp} argument doesn't specify valid lock information,
4412the operating system kernel doesn't support open file description locks, or the
4413file associated with @var{filedes} doesn't support locks.
4414
4415@item ENOLCK
4416The system has run out of file lock resources; there are already too
4417many file locks in place.
4418
4419Well-designed file systems never report this error, because they have no
4420limitation on the number of locks. However, you must still take account
4421of the possibility of this error, as it could result from network access
4422to a file system on another machine.
4423@end table
4424@end deftypevr
4425
0961f7e1 4426@deftypevr Macro int F_OFD_SETLKW
d08a7e4c 4427@standards{POSIX.1, fcntl.h}
0961f7e1
JL
4428This macro is used as the @var{command} argument to @code{fcntl}, to
4429specify that it should set or clear a lock. It is just like the
4430@code{F_OFD_SETLK} command, but causes the process to wait until the request
4431can be completed.
4432
4433This command requires a third argument of type @code{struct flock *}, as
4434for the @code{F_OFD_SETLK} command.
4435
4436The @code{fcntl} return values and errors are the same as for the
4437@code{F_OFD_SETLK} command, but these additional @code{errno} error conditions
4438are defined for this command:
4439
4440@table @code
4441@item EINTR
4442The function was interrupted by a signal while it was waiting.
4443@xref{Interrupted Primitives}.
4444
4445@end table
4446@end deftypevr
4447
4448Open file description locks are useful in the same sorts of situations as
4449process-associated locks. They can also be used to synchronize file
4450access between threads within the same process by having each thread perform
4451its own @code{open} of the file, to obtain its own open file description.
4452
4453Because open file description locks are automatically freed only upon
4454closing the last file descriptor that refers to the open file
4455description, this locking mechanism avoids the possibility that locks
4456are inadvertently released due to a library routine opening and closing
4457a file without the application being aware.
4458
4459As with process-associated locks, open file description locks are advisory.
4460
4461@node Open File Description Locks Example
4462@section Open File Description Locks Example
4463
4464Here is an example of using open file description locks in a threaded
4465program. If this program used process-associated locks, then it would be
4466subject to data corruption because process-associated locks are shared
4467by the threads inside a process, and thus cannot be used by one thread
4468to lock out another thread in the same process.
4469
4470Proper error handling has been omitted in the following program for
4471brevity.
4472
4473@smallexample
4474@include ofdlocks.c.texi
4475@end smallexample
4476
4477This example creates three threads each of which loops five times,
4478appending to the file. Access to the file is serialized via open file
4479description locks. If we compile and run the above program, we'll end up
4480with /tmp/foo that has 15 lines in it.
4481
4482If we, however, were to replace the @code{F_OFD_SETLK} and
4483@code{F_OFD_SETLKW} commands with their process-associated lock
4484equivalents, the locking essentially becomes a noop since it is all done
4485within the context of the same process. That leads to data corruption
4486(typically manifested as missing lines) as some threads race in and
4487overwrite the data written by others.
4488
28f540f4
RM
4489@node Interrupt Input
4490@section Interrupt-Driven Input
4491
4492@cindex interrupt-driven input
4493If you set the @code{O_ASYNC} status flag on a file descriptor
4494(@pxref{File Status Flags}), a @code{SIGIO} signal is sent whenever
4495input or output becomes possible on that file descriptor. The process
4496or process group to receive the signal can be selected by using the
4497@code{F_SETOWN} command to the @code{fcntl} function. If the file
4498descriptor is a socket, this also selects the recipient of @code{SIGURG}
4499signals that are delivered when out-of-band data arrives on that socket;
4500see @ref{Out-of-Band Data}. (@code{SIGURG} is sent in any situation
4501where @code{select} would report the socket as having an ``exceptional
4502condition''. @xref{Waiting for I/O}.)
4503
4504If the file descriptor corresponds to a terminal device, then @code{SIGIO}
2c6fe0bd 4505signals are sent to the foreground process group of the terminal.
28f540f4
RM
4506@xref{Job Control}.
4507
4508@pindex fcntl.h
4509The symbols in this section are defined in the header file
4510@file{fcntl.h}.
4511
28f540f4 4512@deftypevr Macro int F_GETOWN
d08a7e4c 4513@standards{BSD, fcntl.h}
28f540f4
RM
4514This macro is used as the @var{command} argument to @code{fcntl}, to
4515specify that it should get information about the process or process
4516group to which @code{SIGIO} signals are sent. (For a terminal, this is
4517actually the foreground process group ID, which you can get using
4518@code{tcgetpgrp}; see @ref{Terminal Access Functions}.)
4519
4520The return value is interpreted as a process ID; if negative, its
4521absolute value is the process group ID.
4522
4523The following @code{errno} error condition is defined for this command:
4524
4525@table @code
4526@item EBADF
4527The @var{filedes} argument is invalid.
4528@end table
4529@end deftypevr
4530
28f540f4 4531@deftypevr Macro int F_SETOWN
d08a7e4c 4532@standards{BSD, fcntl.h}
28f540f4
RM
4533This macro is used as the @var{command} argument to @code{fcntl}, to
4534specify that it should set the process or process group to which
4535@code{SIGIO} signals are sent. This command requires a third argument
4536of type @code{pid_t} to be passed to @code{fcntl}, so that the form of
4537the call is:
4538
4539@smallexample
4540fcntl (@var{filedes}, F_SETOWN, @var{pid})
4541@end smallexample
4542
4543The @var{pid} argument should be a process ID. You can also pass a
4544negative number whose absolute value is a process group ID.
4545
07435eb4 4546The return value from @code{fcntl} with this command is @math{-1}
28f540f4
RM
4547in case of error and some other value if successful. The following
4548@code{errno} error conditions are defined for this command:
4549
4550@table @code
4551@item EBADF
4552The @var{filedes} argument is invalid.
4553
4554@item ESRCH
4555There is no process or process group corresponding to @var{pid}.
4556@end table
4557@end deftypevr
4558
4559@c ??? This section could use an example program.
07435eb4
UD
4560
4561@node IOCTLs
4562@section Generic I/O Control operations
4563@cindex generic i/o control operations
4564@cindex IOCTLs
4565
a7a93d50 4566@gnusystems{} can handle most input/output operations on many different
07435eb4
UD
4567devices and objects in terms of a few file primitives - @code{read},
4568@code{write} and @code{lseek}. However, most devices also have a few
cf822e3c 4569peculiar operations which do not fit into this model. Such as:
07435eb4
UD
4570
4571@itemize @bullet
4572
4573@item
4574Changing the character font used on a terminal.
4575
4576@item
4577Telling a magnetic tape system to rewind or fast forward. (Since they
4578cannot move in byte increments, @code{lseek} is inapplicable).
4579
4580@item
4581Ejecting a disk from a drive.
4582
4583@item
4584Playing an audio track from a CD-ROM drive.
4585
4586@item
4587Maintaining routing tables for a network.
4588
4589@end itemize
4590
4591Although some such objects such as sockets and terminals
4592@footnote{Actually, the terminal-specific functions are implemented with
4593IOCTLs on many platforms.} have special functions of their own, it would
4594not be practical to create functions for all these cases.
4595
4596Instead these minor operations, known as @dfn{IOCTL}s, are assigned code
4597numbers and multiplexed through the @code{ioctl} function, defined in
4598@code{sys/ioctl.h}. The code numbers themselves are defined in many
4599different headers.
4600
4601@deftypefun int ioctl (int @var{filedes}, int @var{command}, @dots{})
d08a7e4c 4602@standards{BSD, sys/ioctl.h}
2cc3615c 4603@safety{@prelim{}@mtsafe{}@assafe{}@acsafe{}}
07435eb4
UD
4604
4605The @code{ioctl} function performs the generic I/O operation
4606@var{command} on @var{filedes}.
4607
4608A third argument is usually present, either a single number or a pointer
4609to a structure. The meaning of this argument, the returned value, and
4610any error codes depends upon the command used. Often @math{-1} is
4611returned for a failure.
4612
4613@end deftypefun
4614
4615On some systems, IOCTLs used by different devices share the same numbers.
4616Thus, although use of an inappropriate IOCTL @emph{usually} only produces
4617an error, you should not attempt to use device-specific IOCTLs on an
4618unknown device.
4619
4620Most IOCTLs are OS-specific and/or only used in special system utilities,
4621and are thus beyond the scope of this document. For an example of the use
8b7fb588 4622of an IOCTL, see @ref{Out-of-Band Data}.
2cc3615c
AO
4623
4624@c FIXME this is undocumented:
4625@c dup3