]>
Commit | Line | Data |
---|---|---|
f757855e | 1 | <?xml version='1.0'?> <!--*- Mode: nxml; nxml-child-indent: 2; indent-tabs-mode: nil -*--> |
8f7a3c14 | 2 | <!DOCTYPE refentry PUBLIC "-//OASIS//DTD DocBook XML V4.2//EN" |
12b42c76 | 3 | "http://www.oasis-open.org/docbook/xml/4.2/docbookx.dtd"> |
8f7a3c14 LP |
4 | |
5 | <!-- | |
572eb058 ZJS |
6 | SPDX-License-Identifier: LGPL-2.1+ |
7 | ||
8f7a3c14 LP |
8 | This file is part of systemd. |
9 | ||
10 | Copyright 2010 Lennart Poettering | |
11 | ||
12 | systemd is free software; you can redistribute it and/or modify it | |
5430f7f2 LP |
13 | under the terms of the GNU Lesser General Public License as published by |
14 | the Free Software Foundation; either version 2.1 of the License, or | |
8f7a3c14 LP |
15 | (at your option) any later version. |
16 | ||
17 | systemd is distributed in the hope that it will be useful, but | |
18 | WITHOUT ANY WARRANTY; without even the implied warranty of | |
19 | MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU | |
5430f7f2 | 20 | Lesser General Public License for more details. |
8f7a3c14 | 21 | |
5430f7f2 | 22 | You should have received a copy of the GNU Lesser General Public License |
8f7a3c14 LP |
23 | along with systemd; If not, see <http://www.gnu.org/licenses/>. |
24 | --> | |
25 | ||
dfdebb1b | 26 | <refentry id="systemd-nspawn" |
798d3a52 ZJS |
27 | xmlns:xi="http://www.w3.org/2001/XInclude"> |
28 | ||
29 | <refentryinfo> | |
30 | <title>systemd-nspawn</title> | |
31 | <productname>systemd</productname> | |
32 | ||
33 | <authorgroup> | |
34 | <author> | |
35 | <contrib>Developer</contrib> | |
36 | <firstname>Lennart</firstname> | |
37 | <surname>Poettering</surname> | |
38 | <email>lennart@poettering.net</email> | |
39 | </author> | |
40 | </authorgroup> | |
41 | </refentryinfo> | |
42 | ||
43 | <refmeta> | |
44 | <refentrytitle>systemd-nspawn</refentrytitle> | |
45 | <manvolnum>1</manvolnum> | |
46 | </refmeta> | |
47 | ||
48 | <refnamediv> | |
49 | <refname>systemd-nspawn</refname> | |
50 | <refpurpose>Spawn a namespace container for debugging, testing and building</refpurpose> | |
51 | </refnamediv> | |
52 | ||
53 | <refsynopsisdiv> | |
54 | <cmdsynopsis> | |
55 | <command>systemd-nspawn</command> | |
56 | <arg choice="opt" rep="repeat">OPTIONS</arg> | |
57 | <arg choice="opt"><replaceable>COMMAND</replaceable> | |
58 | <arg choice="opt" rep="repeat">ARGS</arg> | |
59 | </arg> | |
60 | </cmdsynopsis> | |
61 | <cmdsynopsis> | |
62 | <command>systemd-nspawn</command> | |
4447e799 | 63 | <arg choice="plain">--boot</arg> |
798d3a52 ZJS |
64 | <arg choice="opt" rep="repeat">OPTIONS</arg> |
65 | <arg choice="opt" rep="repeat">ARGS</arg> | |
66 | </cmdsynopsis> | |
67 | </refsynopsisdiv> | |
68 | ||
69 | <refsect1> | |
70 | <title>Description</title> | |
71 | ||
b09c0bba LP |
72 | <para><command>systemd-nspawn</command> may be used to run a command or OS in a light-weight namespace |
73 | container. In many ways it is similar to <citerefentry | |
74 | project='man-pages'><refentrytitle>chroot</refentrytitle><manvolnum>1</manvolnum></citerefentry>, but more powerful | |
75 | since it fully virtualizes the file system hierarchy, as well as the process tree, the various IPC subsystems and | |
76 | the host and domain name.</para> | |
77 | ||
5164c3b4 | 78 | <para><command>systemd-nspawn</command> may be invoked on any directory tree containing an operating system tree, |
b09c0bba | 79 | using the <option>--directory=</option> command line option. By using the <option>--machine=</option> option an OS |
5164c3b4 | 80 | tree is automatically searched for in a couple of locations, most importantly in |
b09c0bba LP |
81 | <filename>/var/lib/machines</filename>, the suggested directory to place container images installed on the |
82 | system.</para> | |
83 | ||
84 | <para>In contrast to <citerefentry | |
85 | project='man-pages'><refentrytitle>chroot</refentrytitle><manvolnum>1</manvolnum></citerefentry> <command>systemd-nspawn</command> | |
86 | may be used to boot full Linux-based operating systems in a container.</para> | |
87 | ||
88 | <para><command>systemd-nspawn</command> limits access to various kernel interfaces in the container to read-only, | |
89 | such as <filename>/sys</filename>, <filename>/proc/sys</filename> or <filename>/sys/fs/selinux</filename>. The | |
90 | host's network interfaces and the system clock may not be changed from within the container. Device nodes may not | |
91 | be created. The host system cannot be rebooted and kernel modules may not be loaded from within the | |
798d3a52 ZJS |
92 | container.</para> |
93 | ||
b09c0bba LP |
94 | <para>Use a tool like <citerefentry |
95 | project='mankier'><refentrytitle>dnf</refentrytitle><manvolnum>8</manvolnum></citerefentry>, <citerefentry | |
96 | project='die-net'><refentrytitle>debootstrap</refentrytitle><manvolnum>8</manvolnum></citerefentry>, or | |
97 | <citerefentry project='archlinux'><refentrytitle>pacman</refentrytitle><manvolnum>8</manvolnum></citerefentry> to | |
98 | set up an OS directory tree suitable as file system hierarchy for <command>systemd-nspawn</command> containers. See | |
99 | the Examples section below for details on suitable invocation of these commands.</para> | |
100 | ||
101 | <para>As a safety check <command>systemd-nspawn</command> will verify the existence of | |
102 | <filename>/usr/lib/os-release</filename> or <filename>/etc/os-release</filename> in the container tree before | |
103 | starting the container (see | |
104 | <citerefentry><refentrytitle>os-release</refentrytitle><manvolnum>5</manvolnum></citerefentry>). It might be | |
105 | necessary to add this file to the container tree manually if the OS of the container is too old to contain this | |
798d3a52 | 106 | file out-of-the-box.</para> |
b09c0bba LP |
107 | |
108 | <para><command>systemd-nspawn</command> may be invoked directly from the interactive command line or run as system | |
109 | service in the background. In this mode each container instance runs as its own service instance; a default | |
110 | template unit file <filename>systemd-nspawn@.service</filename> is provided to make this easy, taking the container | |
111 | name as instance identifier. Note that different default options apply when <command>systemd-nspawn</command> is | |
6dd6a9c4 | 112 | invoked by the template unit file than interactively on the command line. Most importantly the template unit file |
b09c0bba | 113 | makes use of the <option>--boot</option> which is not the default in case <command>systemd-nspawn</command> is |
6dd6a9c4 | 114 | invoked from the interactive command line. Further differences with the defaults are documented along with the |
b09c0bba LP |
115 | various supported options below.</para> |
116 | ||
117 | <para>The <citerefentry><refentrytitle>machinectl</refentrytitle><manvolnum>1</manvolnum></citerefentry> tool may | |
118 | be used to execute a number of operations on containers. In particular it provides easy-to-use commands to run | |
119 | containers as system services using the <filename>systemd-nspawn@.service</filename> template unit | |
120 | file.</para> | |
121 | ||
122 | <para>Along with each container a settings file with the <filename>.nspawn</filename> suffix may exist, containing | |
123 | additional settings to apply when running the container. See | |
124 | <citerefentry><refentrytitle>systemd.nspawn</refentrytitle><manvolnum>5</manvolnum></citerefentry> for | |
125 | details. Settings files override the default options used by the <filename>systemd-nspawn@.service</filename> | |
126 | template unit file, making it usually unnecessary to alter this template file directly.</para> | |
127 | ||
128 | <para>Note that <command>systemd-nspawn</command> will mount file systems private to the container to | |
129 | <filename>/dev</filename>, <filename>/run</filename> and similar. These will not be visible outside of the | |
130 | container, and their contents will be lost when the container exits.</para> | |
131 | ||
132 | <para>Note that running two <command>systemd-nspawn</command> containers from the same directory tree will not make | |
133 | processes in them see each other. The PID namespace separation of the two containers is complete and the containers | |
134 | will share very few runtime objects except for the underlying file system. Use | |
135 | <citerefentry><refentrytitle>machinectl</refentrytitle><manvolnum>1</manvolnum></citerefentry>'s | |
136 | <command>login</command> or <command>shell</command> commands to request an additional login session in a running | |
137 | container.</para> | |
138 | ||
139 | <para><command>systemd-nspawn</command> implements the <ulink | |
28a0ad81 | 140 | url="https://www.freedesktop.org/wiki/Software/systemd/ContainerInterface">Container Interface</ulink> |
b09c0bba LP |
141 | specification.</para> |
142 | ||
143 | <para>While running, containers invoked with <command>systemd-nspawn</command> are registered with the | |
144 | <citerefentry><refentrytitle>systemd-machined</refentrytitle><manvolnum>8</manvolnum></citerefentry> service that | |
145 | keeps track of running containers, and provides programming interfaces to interact with them.</para> | |
798d3a52 ZJS |
146 | </refsect1> |
147 | ||
148 | <refsect1> | |
149 | <title>Options</title> | |
150 | ||
151 | <para>If option <option>-b</option> is specified, the arguments | |
3f2d1365 | 152 | are used as arguments for the init program. Otherwise, |
798d3a52 ZJS |
153 | <replaceable>COMMAND</replaceable> specifies the program to launch |
154 | in the container, and the remaining arguments are used as | |
b09c0bba | 155 | arguments for this program. If <option>--boot</option> is not used and |
ff9b60f3 | 156 | no arguments are specified, a shell is launched in the |
798d3a52 ZJS |
157 | container.</para> |
158 | ||
159 | <para>The following options are understood:</para> | |
160 | ||
161 | <variablelist> | |
162 | <varlistentry> | |
163 | <term><option>-D</option></term> | |
164 | <term><option>--directory=</option></term> | |
165 | ||
166 | <listitem><para>Directory to use as file system root for the | |
167 | container.</para> | |
168 | ||
169 | <para>If neither <option>--directory=</option>, nor | |
170 | <option>--image=</option> is specified the directory is | |
32b64cce RM |
171 | determined by searching for a directory named the same as the |
172 | machine name specified with <option>--machine=</option>. See | |
173 | <citerefentry><refentrytitle>machinectl</refentrytitle><manvolnum>1</manvolnum></citerefentry> | |
174 | section "Files and Directories" for the precise search path.</para> | |
175 | ||
176 | <para>If neither <option>--directory=</option>, | |
177 | <option>--image=</option>, nor <option>--machine=</option> | |
178 | are specified, the current directory will | |
179 | be used. May not be specified together with | |
798d3a52 ZJS |
180 | <option>--image=</option>.</para></listitem> |
181 | </varlistentry> | |
182 | ||
183 | <varlistentry> | |
184 | <term><option>--template=</option></term> | |
185 | ||
17cbb288 LP |
186 | <listitem><para>Directory or <literal>btrfs</literal> subvolume to use as template for the container's root |
187 | directory. If this is specified and the container's root directory (as configured by | |
188 | <option>--directory=</option>) does not yet exist it is created as <literal>btrfs</literal> snapshot (if | |
189 | supported) or plain directory (otherwise) and populated from this template tree. Ideally, the specified | |
190 | template path refers to the root of a <literal>btrfs</literal> subvolume, in which case a simple copy-on-write | |
191 | snapshot is taken, and populating the root directory is instant. If the specified template path does not refer | |
192 | to the root of a <literal>btrfs</literal> subvolume (or not even to a <literal>btrfs</literal> file system at | |
193 | all), the tree is copied (though possibly in a copy-on-write scheme — if the file system supports that), which | |
194 | can be substantially more time-consuming. May not be specified together with <option>--image=</option> or | |
3fe22bb4 LP |
195 | <option>--ephemeral</option>.</para> |
196 | ||
197 | <para>Note that this switch leaves host name, machine ID and | |
198 | all other settings that could identify the instance | |
199 | unmodified.</para></listitem> | |
798d3a52 ZJS |
200 | </varlistentry> |
201 | ||
202 | <varlistentry> | |
203 | <term><option>-x</option></term> | |
204 | <term><option>--ephemeral</option></term> | |
205 | ||
0f3be6ca LP |
206 | <listitem><para>If specified, the container is run with a temporary snapshot of its file system that is removed |
207 | immediately when the container terminates. May not be specified together with | |
3fe22bb4 LP |
208 | <option>--template=</option>.</para> |
209 | <para>Note that this switch leaves host name, machine ID and | |
210 | all other settings that could identify the instance | |
211 | unmodified.</para></listitem> | |
798d3a52 ZJS |
212 | </varlistentry> |
213 | ||
214 | <varlistentry> | |
215 | <term><option>-i</option></term> | |
216 | <term><option>--image=</option></term> | |
217 | ||
218 | <listitem><para>Disk image to mount the root directory for the | |
219 | container from. Takes a path to a regular file or to a block | |
220 | device node. The file or block device must contain | |
221 | either:</para> | |
222 | ||
223 | <itemizedlist> | |
224 | <listitem><para>An MBR partition table with a single | |
225 | partition of type 0x83 that is marked | |
226 | bootable.</para></listitem> | |
227 | ||
228 | <listitem><para>A GUID partition table (GPT) with a single | |
229 | partition of type | |
230 | 0fc63daf-8483-4772-8e79-3d69d8477de4.</para></listitem> | |
231 | ||
232 | <listitem><para>A GUID partition table (GPT) with a marked | |
233 | root partition which is mounted as the root directory of the | |
234 | container. Optionally, GPT images may contain a home and/or | |
235 | a server data partition which are mounted to the appropriate | |
236 | places in the container. All these partitions must be | |
237 | identified by the partition types defined by the <ulink | |
28a0ad81 | 238 | url="https://www.freedesktop.org/wiki/Specifications/DiscoverablePartitionsSpec/">Discoverable |
798d3a52 | 239 | Partitions Specification</ulink>.</para></listitem> |
58abb66f LP |
240 | |
241 | <listitem><para>No partition table, and a single file system spanning the whole image.</para></listitem> | |
798d3a52 ZJS |
242 | </itemizedlist> |
243 | ||
0f3be6ca LP |
244 | <para>On GPT images, if an EFI System Partition (ESP) is discovered, it is automatically mounted to |
245 | <filename>/efi</filename> (or <filename>/boot</filename> as fallback) in case a directory by this name exists | |
246 | and is empty.</para> | |
247 | ||
58abb66f LP |
248 | <para>Partitions encrypted with LUKS are automatically decrypted. Also, on GPT images dm-verity data integrity |
249 | hash partitions are set up if the root hash for them is specified using the <option>--root-hash=</option> | |
250 | option.</para> | |
251 | ||
0f3be6ca LP |
252 | <para>Any other partitions, such as foreign partitions or swap partitions are not mounted. May not be specified |
253 | together with <option>--directory=</option>, <option>--template=</option>.</para></listitem> | |
798d3a52 | 254 | </varlistentry> |
58abb66f LP |
255 | |
256 | <varlistentry> | |
257 | <term><option>--root-hash=</option></term> | |
258 | ||
259 | <listitem><para>Takes a data integrity (dm-verity) root hash specified in hexadecimal. This option enables data | |
260 | integrity checks using dm-verity, if the used image contains the appropriate integrity data (see above). The | |
ef3116b5 | 261 | specified hash must match the root hash of integrity data, and is usually at least 256 bits (and hence 64 |
41488e1f LP |
262 | formatted hexadecimal characters) long (in case of SHA256 for example). If this option is not specified, but |
263 | the image file carries the <literal>user.verity.roothash</literal> extended file attribute (see <citerefentry | |
264 | project='man-pages'><refentrytitle>xattr</refentrytitle><manvolnum>7</manvolnum></citerefentry>), then the root | |
265 | hash is read from it, also as formatted hexadecimal characters. If the extended file attribute is not found (or | |
ef3116b5 ZJS |
266 | is not supported by the underlying file system), but a file with the <filename>.roothash</filename> suffix is |
267 | found next to the image file, bearing otherwise the same name, the root hash is read from it and automatically | |
268 | used, also as formatted hexadecimal characters.</para></listitem> | |
58abb66f | 269 | </varlistentry> |
798d3a52 | 270 | |
7732f92b LP |
271 | <varlistentry> |
272 | <term><option>-a</option></term> | |
273 | <term><option>--as-pid2</option></term> | |
274 | ||
275 | <listitem><para>Invoke the shell or specified program as process ID (PID) 2 instead of PID 1 (init). By | |
3f2d1365 AJ |
276 | default, if neither this option nor <option>--boot</option> is used, the selected program is run as the process |
277 | with PID 1, a mode only suitable for programs that are aware of the special semantics that the process with | |
278 | PID 1 has on UNIX. For example, it needs to reap all processes reparented to it, and should implement | |
7732f92b LP |
279 | <command>sysvinit</command> compatible signal handling (specifically: it needs to reboot on SIGINT, reexecute |
280 | on SIGTERM, reload configuration on SIGHUP, and so on). With <option>--as-pid2</option> a minimal stub init | |
3f2d1365 | 281 | process is run as PID 1 and the selected program is executed as PID 2 (and hence does not need to implement any |
7732f92b LP |
282 | special semantics). The stub init process will reap processes as necessary and react appropriately to |
283 | signals. It is recommended to use this mode to invoke arbitrary commands in containers, unless they have been | |
284 | modified to run correctly as PID 1. Or in other words: this switch should be used for pretty much all commands, | |
285 | except when the command refers to an init or shell implementation, as these are generally capable of running | |
a6b5216c | 286 | correctly as PID 1. This option may not be combined with <option>--boot</option>.</para> |
7732f92b LP |
287 | </listitem> |
288 | </varlistentry> | |
289 | ||
798d3a52 ZJS |
290 | <varlistentry> |
291 | <term><option>-b</option></term> | |
292 | <term><option>--boot</option></term> | |
293 | ||
3f2d1365 | 294 | <listitem><para>Automatically search for an init program and invoke it as PID 1, instead of a shell or a user |
7732f92b | 295 | supplied program. If this option is used, arguments specified on the command line are used as arguments for the |
3f2d1365 | 296 | init program. This option may not be combined with <option>--as-pid2</option>.</para> |
7732f92b LP |
297 | |
298 | <para>The following table explains the different modes of invocation and relationship to | |
299 | <option>--as-pid2</option> (see above):</para> | |
300 | ||
301 | <table> | |
302 | <title>Invocation Mode</title> | |
303 | <tgroup cols='2' align='left' colsep='1' rowsep='1'> | |
304 | <colspec colname="switch" /> | |
305 | <colspec colname="explanation" /> | |
306 | <thead> | |
307 | <row> | |
308 | <entry>Switch</entry> | |
309 | <entry>Explanation</entry> | |
310 | </row> | |
311 | </thead> | |
312 | <tbody> | |
313 | <row> | |
314 | <entry>Neither <option>--as-pid2</option> nor <option>--boot</option> specified</entry> | |
4447e799 | 315 | <entry>The passed parameters are interpreted as the command line, which is executed as PID 1 in the container.</entry> |
7732f92b LP |
316 | </row> |
317 | ||
318 | <row> | |
319 | <entry><option>--as-pid2</option> specified</entry> | |
4447e799 | 320 | <entry>The passed parameters are interpreted as the command line, which is executed as PID 2 in the container. A stub init process is run as PID 1.</entry> |
7732f92b LP |
321 | </row> |
322 | ||
323 | <row> | |
324 | <entry><option>--boot</option> specified</entry> | |
3f2d1365 | 325 | <entry>An init program is automatically searched for and run as PID 1 in the container. The passed parameters are used as invocation parameters for this process.</entry> |
7732f92b LP |
326 | </row> |
327 | ||
328 | </tbody> | |
329 | </tgroup> | |
330 | </table> | |
b09c0bba LP |
331 | |
332 | <para>Note that <option>--boot</option> is the default mode of operation if the | |
333 | <filename>systemd-nspawn@.service</filename> template unit file is used.</para> | |
7732f92b | 334 | </listitem> |
798d3a52 ZJS |
335 | </varlistentry> |
336 | ||
5f932eb9 LP |
337 | <varlistentry> |
338 | <term><option>--chdir=</option></term> | |
339 | ||
340 | <listitem><para>Change to the specified working directory before invoking the process in the container. Expects | |
341 | an absolute path in the container's file system namespace.</para></listitem> | |
342 | </varlistentry> | |
343 | ||
b53ede69 PW |
344 | <varlistentry> |
345 | <term><option>--pivot-root=</option></term> | |
346 | ||
347 | <listitem><para>Pivot the specified directory to <filename>/</filename> inside the container, and either unmount the | |
348 | container's old root, or pivot it to another specified directory. Takes one of: a path argument — in which case the | |
349 | specified path will be pivoted to <filename>/</filename> and the old root will be unmounted; or a colon-separated pair | |
350 | of new root path and pivot destination for the old root. The new root path will be pivoted to <filename>/</filename>, | |
351 | and the old <filename>/</filename> will be pivoted to the other directory. Both paths must be absolute, and are resolved | |
352 | in the container's file system namespace.</para> | |
353 | ||
354 | <para>This is for containers which have several bootable directories in them; for example, several | |
3797fd0a ZJS |
355 | <ulink url="https://ostree.readthedocs.io/en/latest/">OSTree</ulink> deployments. It emulates the behavior of |
356 | the boot loader and initial RAM disk which normally select which directory to mount as the root and start the | |
357 | container's PID 1 in.</para></listitem> | |
b53ede69 PW |
358 | </varlistentry> |
359 | ||
798d3a52 ZJS |
360 | <varlistentry> |
361 | <term><option>-u</option></term> | |
362 | <term><option>--user=</option></term> | |
363 | ||
364 | <listitem><para>After transitioning into the container, change | |
365 | to the specified user-defined in the container's user | |
366 | database. Like all other systemd-nspawn features, this is not | |
367 | a security feature and provides protection against accidental | |
368 | destructive operations only.</para></listitem> | |
369 | </varlistentry> | |
370 | ||
371 | <varlistentry> | |
372 | <term><option>-M</option></term> | |
373 | <term><option>--machine=</option></term> | |
374 | ||
375 | <listitem><para>Sets the machine name for this container. This | |
376 | name may be used to identify this container during its runtime | |
377 | (for example in tools like | |
378 | <citerefentry><refentrytitle>machinectl</refentrytitle><manvolnum>1</manvolnum></citerefentry> | |
379 | and similar), and is used to initialize the container's | |
380 | hostname (which the container can choose to override, | |
381 | however). If not specified, the last component of the root | |
382 | directory path of the container is used, possibly suffixed | |
383 | with a random identifier in case <option>--ephemeral</option> | |
384 | mode is selected. If the root directory selected is the host's | |
385 | root directory the host's hostname is used as default | |
386 | instead.</para></listitem> | |
387 | </varlistentry> | |
388 | ||
389 | <varlistentry> | |
390 | <term><option>--uuid=</option></term> | |
391 | ||
392 | <listitem><para>Set the specified UUID for the container. The | |
393 | init system will initialize | |
394 | <filename>/etc/machine-id</filename> from this if this file is | |
e01ff70a MS |
395 | not set yet. Note that this option takes effect only if |
396 | <filename>/etc/machine-id</filename> in the container is | |
397 | unpopulated.</para></listitem> | |
798d3a52 ZJS |
398 | </varlistentry> |
399 | ||
400 | <varlistentry> | |
4deb5503 | 401 | <term><option>-S</option></term> |
798d3a52 ZJS |
402 | <term><option>--slice=</option></term> |
403 | ||
cd2dfc6f LP |
404 | <listitem><para>Make the container part of the specified slice, instead of the default |
405 | <filename>machine.slice</filename>. This applies only if the machine is run in its own scope unit, i.e. if | |
406 | <option>--keep-unit</option> isn't used.</para> | |
f36933fe LP |
407 | </listitem> |
408 | </varlistentry> | |
409 | ||
410 | <varlistentry> | |
411 | <term><option>--property=</option></term> | |
412 | ||
cd2dfc6f LP |
413 | <listitem><para>Set a unit property on the scope unit to register for the machine. This applies only if the |
414 | machine is run in its own scope unit, i.e. if <option>--keep-unit</option> isn't used. Takes unit property | |
415 | assignments in the same format as <command>systemctl set-property</command>. This is useful to set memory | |
416 | limits and similar for container.</para> | |
798d3a52 ZJS |
417 | </listitem> |
418 | </varlistentry> | |
419 | ||
03cfe0d5 LP |
420 | <varlistentry> |
421 | <term><option>--private-users=</option></term> | |
422 | ||
d2e5535f LP |
423 | <listitem><para>Controls user namespacing. If enabled, the container will run with its own private set of UNIX |
424 | user and group ids (UIDs and GIDs). This involves mapping the private UIDs/GIDs used in the container (starting | |
425 | with the container's root user 0 and up) to a range of UIDs/GIDs on the host that are not used for other | |
426 | purposes (usually in the range beyond the host's UID/GID 65536). The parameter may be specified as follows:</para> | |
427 | ||
428 | <orderedlist> | |
2dd67817 | 429 | <listitem><para>If one or two colon-separated numbers are specified, user namespacing is turned on. The first |
ae209204 ZJS |
430 | parameter specifies the first host UID/GID to assign to the container, the second parameter specifies the |
431 | number of host UIDs/GIDs to assign to the container. If the second parameter is omitted, 65536 UIDs/GIDs are | |
432 | assigned.</para></listitem> | |
433 | ||
434 | <listitem><para>If the parameter is omitted, or true, user namespacing is turned on. The UID/GID range to | |
435 | use is determined automatically from the file ownership of the root directory of the container's directory | |
436 | tree. To use this option, make sure to prepare the directory tree in advance, and ensure that all files and | |
437 | directories in it are owned by UIDs/GIDs in the range you'd like to use. Also, make sure that used file ACLs | |
438 | exclusively reference UIDs/GIDs in the appropriate range. If this mode is used the number of UIDs/GIDs | |
439 | assigned to the container for use is 65536, and the UID/GID of the root directory must be a multiple of | |
440 | 65536.</para></listitem> | |
441 | ||
442 | <listitem><para>If the parameter is false, user namespacing is turned off. This is the default.</para> | |
443 | </listitem> | |
444 | ||
445 | <listitem><para>The special value <literal>pick</literal> turns on user namespacing. In this case the UID/GID | |
446 | range is automatically chosen. As first step, the file owner of the root directory of the container's | |
447 | directory tree is read, and it is checked that it is currently not used by the system otherwise (in | |
448 | particular, that no other container is using it). If this check is successful, the UID/GID range determined | |
2dd67817 | 449 | this way is used, similar to the behavior if "yes" is specified. If the check is not successful (and thus |
ae209204 ZJS |
450 | the UID/GID range indicated in the root directory's file owner is already used elsewhere) a new – currently |
451 | unused – UID/GID range of 65536 UIDs/GIDs is randomly chosen between the host UID/GIDs of 524288 and | |
452 | 1878982656, always starting at a multiple of 65536. This setting implies | |
453 | <option>--private-users-chown</option> (see below), which has the effect that the files and directories in | |
454 | the container's directory tree will be owned by the appropriate users of the range picked. Using this option | |
2dd67817 | 455 | makes user namespace behavior fully automatic. Note that the first invocation of a previously unused |
ae209204 ZJS |
456 | container image might result in picking a new UID/GID range for it, and thus in the (possibly expensive) file |
457 | ownership adjustment operation. However, subsequent invocations of the container will be cheap (unless of | |
458 | course the picked UID/GID range is assigned to a different use by then).</para></listitem> | |
d2e5535f LP |
459 | </orderedlist> |
460 | ||
461 | <para>It is recommended to assign at least 65536 UIDs/GIDs to each container, so that the usable UID/GID range in the | |
462 | container covers 16 bit. For best security, do not assign overlapping UID/GID ranges to multiple containers. It is | |
463 | hence a good idea to use the upper 16 bit of the host 32-bit UIDs/GIDs as container identifier, while the lower 16 | |
2dd67817 | 464 | bit encode the container UID/GID used. This is in fact the behavior enforced by the |
d2e5535f LP |
465 | <option>--private-users=pick</option> option.</para> |
466 | ||
467 | <para>When user namespaces are used, the GID range assigned to each container is always chosen identical to the | |
468 | UID range.</para> | |
469 | ||
470 | <para>In most cases, using <option>--private-users=pick</option> is the recommended option as it enhances | |
471 | container security massively and operates fully automatically in most cases.</para> | |
472 | ||
473 | <para>Note that the picked UID/GID range is not written to <filename>/etc/passwd</filename> or | |
474 | <filename>/etc/group</filename>. In fact, the allocation of the range is not stored persistently anywhere, | |
aa10469e LP |
475 | except in the file ownership of the files and directories of the container.</para> |
476 | ||
477 | <para>Note that when user namespacing is used file ownership on disk reflects this, and all of the container's | |
478 | files and directories are owned by the container's effective user and group IDs. This means that copying files | |
479 | from and to the container image requires correction of the numeric UID/GID values, according to the UID/GID | |
480 | shift applied.</para></listitem> | |
03cfe0d5 LP |
481 | </varlistentry> |
482 | ||
d2e5535f LP |
483 | <varlistentry> |
484 | <term><option>--private-users-chown</option></term> | |
485 | ||
486 | <listitem><para>If specified, all files and directories in the container's directory tree will adjusted so that | |
487 | they are owned to the appropriate UIDs/GIDs selected for the container (see above). This operation is | |
488 | potentially expensive, as it involves descending and iterating through the full directory tree of the | |
489 | container. Besides actual file ownership, file ACLs are adjusted as well.</para> | |
490 | ||
491 | <para>This option is implied if <option>--private-users=pick</option> is used. This option has no effect if | |
492 | user namespacing is not used.</para></listitem> | |
493 | </varlistentry> | |
03cfe0d5 | 494 | |
6265bde2 ZJS |
495 | <varlistentry> |
496 | <term><option>-U</option></term> | |
497 | ||
498 | <listitem><para>If the kernel supports the user namespaces feature, equivalent to | |
499 | <option>--private-users=pick --private-users-chown</option>, otherwise equivalent to | |
500 | <option>--private-users=no</option>.</para> | |
501 | ||
502 | <para>Note that <option>-U</option> is the default if the | |
503 | <filename>systemd-nspawn@.service</filename> template unit file is used.</para> | |
504 | ||
505 | <para>Note: it is possible to undo the effect of <option>--private-users-chown</option> (or | |
506 | <option>-U</option>) on the file system by redoing the operation with the first UID of 0:</para> | |
507 | ||
508 | <programlisting>systemd-nspawn … --private-users=0 --private-users-chown</programlisting> | |
509 | </listitem> | |
510 | </varlistentry> | |
511 | ||
798d3a52 ZJS |
512 | <varlistentry> |
513 | <term><option>--private-network</option></term> | |
514 | ||
515 | <listitem><para>Disconnect networking of the container from | |
516 | the host. This makes all network interfaces unavailable in the | |
517 | container, with the exception of the loopback device and those | |
518 | specified with <option>--network-interface=</option> and | |
519 | configured with <option>--network-veth</option>. If this | |
520 | option is specified, the CAP_NET_ADMIN capability will be | |
521 | added to the set of capabilities the container retains. The | |
bc96c63c ZJS |
522 | latter may be disabled by using <option>--drop-capability=</option>. |
523 | If this option is not specified (or implied by one of the options | |
524 | listed below), the container will have full access to the host network. | |
525 | </para></listitem> | |
798d3a52 ZJS |
526 | </varlistentry> |
527 | ||
d7bea6b6 DP |
528 | <varlistentry> |
529 | <term><option>--network-namespace-path=</option></term> | |
530 | ||
531 | <listitem><para>Takes the path to a file representing a kernel | |
532 | network namespace that the container shall run in. The specified path | |
533 | should refer to a (possibly bind-mounted) network namespace file, as | |
534 | exposed by the kernel below <filename>/proc/$PID/ns/net</filename>. | |
535 | This makes the container enter the given network namespace. One of the | |
536 | typical use cases is to give a network namespace under | |
537 | <filename>/run/netns</filename> created by <citerefentry | |
538 | project='man-pages'><refentrytitle>ip-netns</refentrytitle><manvolnum>8</manvolnum></citerefentry>, | |
539 | for example, <option>--network-namespace-path=/run/netns/foo</option>. | |
540 | Note that this option cannot be used together with other | |
541 | network-related options, such as <option>--private-network</option> | |
542 | or <option>--network-interface=</option>.</para></listitem> | |
543 | </varlistentry> | |
544 | ||
798d3a52 ZJS |
545 | <varlistentry> |
546 | <term><option>--network-interface=</option></term> | |
547 | ||
548 | <listitem><para>Assign the specified network interface to the | |
549 | container. This will remove the specified interface from the | |
550 | calling namespace and place it in the container. When the | |
551 | container terminates, it is moved back to the host namespace. | |
552 | Note that <option>--network-interface=</option> implies | |
553 | <option>--private-network</option>. This option may be used | |
554 | more than once to add multiple network interfaces to the | |
555 | container.</para></listitem> | |
556 | </varlistentry> | |
557 | ||
558 | <varlistentry> | |
559 | <term><option>--network-macvlan=</option></term> | |
560 | ||
561 | <listitem><para>Create a <literal>macvlan</literal> interface | |
562 | of the specified Ethernet network interface and add it to the | |
563 | container. A <literal>macvlan</literal> interface is a virtual | |
564 | interface that adds a second MAC address to an existing | |
565 | physical Ethernet link. The interface in the container will be | |
566 | named after the interface on the host, prefixed with | |
567 | <literal>mv-</literal>. Note that | |
568 | <option>--network-macvlan=</option> implies | |
569 | <option>--private-network</option>. This option may be used | |
570 | more than once to add multiple network interfaces to the | |
571 | container.</para></listitem> | |
572 | </varlistentry> | |
573 | ||
574 | <varlistentry> | |
575 | <term><option>--network-ipvlan=</option></term> | |
576 | ||
577 | <listitem><para>Create an <literal>ipvlan</literal> interface | |
578 | of the specified Ethernet network interface and add it to the | |
579 | container. An <literal>ipvlan</literal> interface is a virtual | |
580 | interface, similar to a <literal>macvlan</literal> interface, | |
581 | which uses the same MAC address as the underlying interface. | |
582 | The interface in the container will be named after the | |
583 | interface on the host, prefixed with <literal>iv-</literal>. | |
584 | Note that <option>--network-ipvlan=</option> implies | |
585 | <option>--private-network</option>. This option may be used | |
586 | more than once to add multiple network interfaces to the | |
587 | container.</para></listitem> | |
588 | </varlistentry> | |
589 | ||
590 | <varlistentry> | |
591 | <term><option>-n</option></term> | |
592 | <term><option>--network-veth</option></term> | |
593 | ||
5e7423ff LP |
594 | <listitem><para>Create a virtual Ethernet link (<literal>veth</literal>) between host and container. The host |
595 | side of the Ethernet link will be available as a network interface named after the container's name (as | |
596 | specified with <option>--machine=</option>), prefixed with <literal>ve-</literal>. The container side of the | |
597 | Ethernet link will be named <literal>host0</literal>. The <option>--network-veth</option> option implies | |
598 | <option>--private-network</option>.</para> | |
599 | ||
600 | <para>Note that | |
601 | <citerefentry><refentrytitle>systemd-networkd.service</refentrytitle><manvolnum>8</manvolnum></citerefentry> | |
602 | includes by default a network file <filename>/usr/lib/systemd/network/80-container-ve.network</filename> | |
603 | matching the host-side interfaces created this way, which contains settings to enable automatic address | |
604 | provisioning on the created virtual link via DHCP, as well as automatic IP routing onto the host's external | |
605 | network interfaces. It also contains <filename>/usr/lib/systemd/network/80-container-host0.network</filename> | |
606 | matching the container-side interface created this way, containing settings to enable client side address | |
607 | assignment via DHCP. In case <filename>systemd-networkd</filename> is running on both the host and inside the | |
608 | container, automatic IP communication from the container to the host is thus available, with further | |
609 | connectivity to the external network.</para> | |
b09c0bba LP |
610 | |
611 | <para>Note that <option>--network-veth</option> is the default if the | |
612 | <filename>systemd-nspawn@.service</filename> template unit file is used.</para> | |
5e7423ff | 613 | </listitem> |
798d3a52 ZJS |
614 | </varlistentry> |
615 | ||
f6d6bad1 LP |
616 | <varlistentry> |
617 | <term><option>--network-veth-extra=</option></term> | |
618 | ||
619 | <listitem><para>Adds an additional virtual Ethernet link | |
620 | between host and container. Takes a colon-separated pair of | |
621 | host interface name and container interface name. The latter | |
622 | may be omitted in which case the container and host sides will | |
623 | be assigned the same name. This switch is independent of | |
ccddd104 | 624 | <option>--network-veth</option>, and — in contrast — may be |
f6d6bad1 LP |
625 | used multiple times, and allows configuration of the network |
626 | interface names. Note that <option>--network-bridge=</option> | |
627 | has no effect on interfaces created with | |
628 | <option>--network-veth-extra=</option>.</para></listitem> | |
629 | </varlistentry> | |
630 | ||
798d3a52 ZJS |
631 | <varlistentry> |
632 | <term><option>--network-bridge=</option></term> | |
633 | ||
5e7423ff LP |
634 | <listitem><para>Adds the host side of the Ethernet link created with <option>--network-veth</option> to the |
635 | specified Ethernet bridge interface. Expects a valid network interface name of a bridge device as | |
636 | argument. Note that <option>--network-bridge=</option> implies <option>--network-veth</option>. If this option | |
637 | is used, the host side of the Ethernet link will use the <literal>vb-</literal> prefix instead of | |
798d3a52 ZJS |
638 | <literal>ve-</literal>.</para></listitem> |
639 | </varlistentry> | |
640 | ||
938d2579 LP |
641 | <varlistentry> |
642 | <term><option>--network-zone=</option></term> | |
643 | ||
644 | <listitem><para>Creates a virtual Ethernet link (<literal>veth</literal>) to the container and adds it to an | |
645 | automatically managed Ethernet bridge interface. The bridge interface is named after the passed argument, | |
646 | prefixed with <literal>vz-</literal>. The bridge interface is automatically created when the first container | |
647 | configured for its name is started, and is automatically removed when the last container configured for its | |
648 | name exits. Hence, each bridge interface configured this way exists only as long as there's at least one | |
649 | container referencing it running. This option is very similar to <option>--network-bridge=</option>, besides | |
650 | this automatic creation/removal of the bridge device.</para> | |
651 | ||
652 | <para>This setting makes it easy to place multiple related containers on a common, virtual Ethernet-based | |
653 | broadcast domain, here called a "zone". Each container may only be part of one zone, but each zone may contain | |
654 | any number of containers. Each zone is referenced by its name. Names may be chosen freely (as long as they form | |
655 | valid network interface names when prefixed with <literal>vz-</literal>), and it is sufficient to pass the same | |
cf917c27 | 656 | name to the <option>--network-zone=</option> switch of the various concurrently running containers to join |
938d2579 LP |
657 | them in one zone.</para> |
658 | ||
659 | <para>Note that | |
660 | <citerefentry><refentrytitle>systemd-networkd.service</refentrytitle><manvolnum>8</manvolnum></citerefentry> | |
661 | includes by default a network file <filename>/usr/lib/systemd/network/80-container-vz.network</filename> | |
662 | matching the bridge interfaces created this way, which contains settings to enable automatic address | |
663 | provisioning on the created virtual network via DHCP, as well as automatic IP routing onto the host's external | |
664 | network interfaces. Using <option>--network-zone=</option> is hence in most cases fully automatic and | |
665 | sufficient to connect multiple local containers in a joined broadcast domain to the host, with further | |
666 | connectivity to the external network.</para> | |
667 | </listitem> | |
668 | </varlistentry> | |
669 | ||
798d3a52 ZJS |
670 | <varlistentry> |
671 | <term><option>-p</option></term> | |
672 | <term><option>--port=</option></term> | |
673 | ||
674 | <listitem><para>If private networking is enabled, maps an IP | |
675 | port on the host onto an IP port on the container. Takes a | |
676 | protocol specifier (either <literal>tcp</literal> or | |
677 | <literal>udp</literal>), separated by a colon from a host port | |
678 | number in the range 1 to 65535, separated by a colon from a | |
679 | container port number in the range from 1 to 65535. The | |
680 | protocol specifier and its separating colon may be omitted, in | |
681 | which case <literal>tcp</literal> is assumed. The container | |
7c918141 | 682 | port number and its colon may be omitted, in which case the |
798d3a52 | 683 | same port as the host port is implied. This option is only |
a8eaaee7 | 684 | supported if private networking is used, such as with |
938d2579 | 685 | <option>--network-veth</option>, <option>--network-zone=</option> |
798d3a52 ZJS |
686 | <option>--network-bridge=</option>.</para></listitem> |
687 | </varlistentry> | |
688 | ||
689 | <varlistentry> | |
690 | <term><option>-Z</option></term> | |
691 | <term><option>--selinux-context=</option></term> | |
692 | ||
693 | <listitem><para>Sets the SELinux security context to be used | |
694 | to label processes in the container.</para> | |
695 | </listitem> | |
696 | </varlistentry> | |
697 | ||
698 | <varlistentry> | |
699 | <term><option>-L</option></term> | |
700 | <term><option>--selinux-apifs-context=</option></term> | |
701 | ||
702 | <listitem><para>Sets the SELinux security context to be used | |
703 | to label files in the virtual API file systems in the | |
704 | container.</para> | |
705 | </listitem> | |
706 | </varlistentry> | |
707 | ||
708 | <varlistentry> | |
709 | <term><option>--capability=</option></term> | |
710 | ||
a30504ed AJ |
711 | <listitem><para>List one or more additional capabilities to grant the container. |
712 | Takes a comma-separated list of capability names, see | |
798d3a52 | 713 | <citerefentry project='man-pages'><refentrytitle>capabilities</refentrytitle><manvolnum>7</manvolnum></citerefentry> |
a30504ed AJ |
714 | for more information. Note that the following capabilities will be granted in any way: |
715 | CAP_AUDIT_CONTROL, CAP_AUDIT_WRITE, CAP_CHOWN, CAP_DAC_OVERRIDE, CAP_DAC_READ_SEARCH, | |
716 | CAP_FOWNER, CAP_FSETID, CAP_IPC_OWNER, CAP_KILL, CAP_LEASE, CAP_LINUX_IMMUTABLE, | |
717 | CAP_MKNOD, CAP_NET_BIND_SERVICE, CAP_NET_BROADCAST, CAP_NET_RAW, CAP_SETFCAP, | |
718 | CAP_SETGID, CAP_SETPCAP, CAP_SETUID, CAP_SYS_ADMIN, CAP_SYS_BOOT, CAP_SYS_CHROOT, | |
719 | CAP_SYS_NICE, CAP_SYS_PTRACE, CAP_SYS_RESOURCE, CAP_SYS_TTY_CONFIG. Also CAP_NET_ADMIN | |
720 | is retained if <option>--private-network</option> is specified. If the special value | |
721 | <literal>all</literal> is passed, all capabilities are retained.</para></listitem> | |
798d3a52 ZJS |
722 | </varlistentry> |
723 | ||
724 | <varlistentry> | |
725 | <term><option>--drop-capability=</option></term> | |
726 | ||
727 | <listitem><para>Specify one or more additional capabilities to | |
728 | drop for the container. This allows running the container with | |
729 | fewer capabilities than the default (see | |
730 | above).</para></listitem> | |
731 | </varlistentry> | |
732 | ||
960e4569 LP |
733 | <varlistentry> |
734 | <term><option>--system-call-filter=</option></term> | |
735 | ||
736 | <listitem><para>Alter the system call filter applied to containers. Takes a space-separated list of system call | |
737 | names or group names (the latter prefixed with <literal>@</literal>, as listed by the | |
738 | <command>syscall-filter</command> command of <citerefentry | |
739 | project='man-pages'><refentrytitle>systemd-analyze</refentrytitle><manvolnum>1</manvolnum></citerefentry>). Passed | |
740 | system calls will be permitted. The list may optionally be prefixed by <literal>~</literal>, in which case all | |
741 | listed system calls are prohibited. If this command line option is used multiple times the configured lists are | |
742 | combined. If both a positive and a negative list (that is one system call list without and one with the | |
96bedbe2 LP |
743 | <literal>~</literal> prefix) are configured, the negative list takes precedence over the positive list. Note |
744 | that <command>systemd-nspawn</command> always implements a system call whitelist (as opposed to a blacklist), | |
745 | and this command line option hence adds or removes entries from the default whitelist, depending on the | |
960e4569 LP |
746 | <literal>~</literal> prefix. Note that the applied system call filter is also altered implicitly if additional |
747 | capabilities are passed using the <command>--capabilities=</command>.</para></listitem> | |
748 | </varlistentry> | |
749 | ||
c6c8f6e2 LP |
750 | <varlistentry> |
751 | <term><option>--kill-signal=</option></term> | |
752 | ||
753 | <listitem><para>Specify the process signal to send to the | |
754 | container's PID 1 when nspawn itself receives SIGTERM, in | |
755 | order to trigger an orderly shutdown of the | |
756 | container. Defaults to SIGRTMIN+3 if <option>--boot</option> | |
757 | is used (on systemd-compatible init systems SIGRTMIN+3 | |
b3969f73 PA |
758 | triggers an orderly shutdown). For a list of valid signals, see |
759 | <citerefentry project='man-pages'><refentrytitle>signal</refentrytitle><manvolnum>7</manvolnum></citerefentry>.</para></listitem> | |
c6c8f6e2 LP |
760 | </varlistentry> |
761 | ||
798d3a52 ZJS |
762 | <varlistentry> |
763 | <term><option>--link-journal=</option></term> | |
764 | ||
765 | <listitem><para>Control whether the container's journal shall | |
766 | be made visible to the host system. If enabled, allows viewing | |
767 | the container's journal files from the host (but not vice | |
768 | versa). Takes one of <literal>no</literal>, | |
769 | <literal>host</literal>, <literal>try-host</literal>, | |
770 | <literal>guest</literal>, <literal>try-guest</literal>, | |
771 | <literal>auto</literal>. If <literal>no</literal>, the journal | |
772 | is not linked. If <literal>host</literal>, the journal files | |
773 | are stored on the host file system (beneath | |
774 | <filename>/var/log/journal/<replaceable>machine-id</replaceable></filename>) | |
775 | and the subdirectory is bind-mounted into the container at the | |
776 | same location. If <literal>guest</literal>, the journal files | |
777 | are stored on the guest file system (beneath | |
778 | <filename>/var/log/journal/<replaceable>machine-id</replaceable></filename>) | |
779 | and the subdirectory is symlinked into the host at the same | |
780 | location. <literal>try-host</literal> and | |
781 | <literal>try-guest</literal> do the same but do not fail if | |
2dd67817 | 782 | the host does not have persistent journaling enabled. If |
798d3a52 ZJS |
783 | <literal>auto</literal> (the default), and the right |
784 | subdirectory of <filename>/var/log/journal</filename> exists, | |
785 | it will be bind mounted into the container. If the | |
786 | subdirectory does not exist, no linking is performed. | |
787 | Effectively, booting a container once with | |
788 | <literal>guest</literal> or <literal>host</literal> will link | |
789 | the journal persistently if further on the default of | |
b09c0bba LP |
790 | <literal>auto</literal> is used.</para> |
791 | ||
792 | <para>Note that <option>--link-journal=try-guest</option> is the default if the | |
793 | <filename>systemd-nspawn@.service</filename> template unit file is used.</para></listitem> | |
798d3a52 ZJS |
794 | </varlistentry> |
795 | ||
796 | <varlistentry> | |
797 | <term><option>-j</option></term> | |
798 | ||
799 | <listitem><para>Equivalent to | |
800 | <option>--link-journal=try-guest</option>.</para></listitem> | |
801 | </varlistentry> | |
802 | ||
803 | <varlistentry> | |
804 | <term><option>--read-only</option></term> | |
805 | ||
806 | <listitem><para>Mount the root file system read-only for the | |
807 | container.</para></listitem> | |
808 | </varlistentry> | |
809 | ||
810 | <varlistentry> | |
811 | <term><option>--bind=</option></term> | |
812 | <term><option>--bind-ro=</option></term> | |
813 | ||
86c0dd4a | 814 | <listitem><para>Bind mount a file or directory from the host into the container. Takes one of: a path |
c7a4890c LP |
815 | argument — in which case the specified path will be mounted from the host to the same path in the container, or |
816 | a colon-separated pair of paths — in which case the first specified path is the source in the host, and the | |
817 | second path is the destination in the container, or a colon-separated triple of source path, destination path | |
86c0dd4a | 818 | and mount options. The source path may optionally be prefixed with a <literal>+</literal> character. If so, the |
c7a4890c LP |
819 | source path is taken relative to the image's root directory. This permits setting up bind mounts within the |
820 | container image. The source path may be specified as empty string, in which case a temporary directory below | |
821 | the host's <filename>/var/tmp</filename> directory is used. It is automatically removed when the container is | |
822 | shut down. Mount options are comma-separated and currently, only <option>rbind</option> and | |
823 | <option>norbind</option> are allowed, controlling whether to create a recursive or a regular bind | |
824 | mount. Defaults to "rbind". Backslash escapes are interpreted, so <literal>\:</literal> may be used to embed | |
825 | colons in either path. This option may be specified multiple times for creating multiple independent bind | |
994a6364 LP |
826 | mount points. The <option>--bind-ro=</option> option creates read-only bind mounts.</para> |
827 | ||
828 | <para>Note that when this option is used in combination with <option>--private-users</option>, the resulting | |
829 | mount points will be owned by the <constant>nobody</constant> user. That's because the mount and its files and | |
830 | directories continue to be owned by the relevant host users and groups, which do not exist in the container, | |
831 | and thus show up under the wildcard UID 65534 (nobody). If such bind mounts are created, it is recommended to | |
832 | make them read-only, using <option>--bind-ro=</option>.</para></listitem> | |
798d3a52 ZJS |
833 | </varlistentry> |
834 | ||
835 | <varlistentry> | |
836 | <term><option>--tmpfs=</option></term> | |
837 | ||
838 | <listitem><para>Mount a tmpfs file system into the container. | |
839 | Takes a single absolute path argument that specifies where to | |
840 | mount the tmpfs instance to (in which case the directory | |
841 | access mode will be chosen as 0755, owned by root/root), or | |
842 | optionally a colon-separated pair of path and mount option | |
b938cb90 | 843 | string that is used for mounting (in which case the kernel |
798d3a52 ZJS |
844 | default for access mode and owner will be chosen, unless |
845 | otherwise specified). This option is particularly useful for | |
846 | mounting directories such as <filename>/var</filename> as | |
847 | tmpfs, to allow state-less systems, in particular when | |
ffcd3e89 | 848 | combined with <option>--read-only</option>. |
b938cb90 | 849 | Backslash escapes are interpreted in the path, so |
ffcd3e89 RM |
850 | <literal>\:</literal> may be used to embed colons in the path. |
851 | </para></listitem> | |
798d3a52 ZJS |
852 | </varlistentry> |
853 | ||
5a8af538 LP |
854 | <varlistentry> |
855 | <term><option>--overlay=</option></term> | |
856 | <term><option>--overlay-ro=</option></term> | |
857 | ||
858 | <listitem><para>Combine multiple directory trees into one | |
859 | overlay file system and mount it into the container. Takes a | |
860 | list of colon-separated paths to the directory trees to | |
861 | combine and the destination mount point.</para> | |
862 | ||
2eadf91c RM |
863 | <para>Backslash escapes are interpreted in the paths, so |
864 | <literal>\:</literal> may be used to embed colons in the paths. | |
865 | </para> | |
866 | ||
5a8af538 LP |
867 | <para>If three or more paths are specified, then the last |
868 | specified path is the destination mount point in the | |
869 | container, all paths specified before refer to directory trees | |
870 | on the host and are combined in the specified order into one | |
871 | overlay file system. The left-most path is hence the lowest | |
872 | directory tree, the second-to-last path the highest directory | |
873 | tree in the stacking order. If <option>--overlay-ro=</option> | |
b938cb90 | 874 | is used instead of <option>--overlay=</option>, a read-only |
5a8af538 | 875 | overlay file system is created. If a writable overlay file |
b938cb90 | 876 | system is created, all changes made to it are written to the |
5a8af538 LP |
877 | highest directory tree in the stacking order, i.e. the |
878 | second-to-last specified.</para> | |
879 | ||
880 | <para>If only two paths are specified, then the second | |
881 | specified path is used both as the top-level directory tree in | |
882 | the stacking order as seen from the host, as well as the mount | |
883 | point for the overlay file system in the container. At least | |
884 | two paths have to be specified.</para> | |
885 | ||
86c0dd4a | 886 | <para>The source paths may optionally be prefixed with <literal>+</literal> character. If so they are taken |
c7a4890c LP |
887 | relative to the image's root directory. The uppermost source path may also be specified as empty string, in |
888 | which case a temporary directory below the host's <filename>/var/tmp</filename> is used. The directory is | |
889 | removed automatically when the container is shut down. This behaviour is useful in order to make read-only | |
890 | container directories writable while the container is running. For example, use the | |
891 | <literal>--overlay=+/var::/var</literal> option in order to automatically overlay a writable temporary | |
892 | directory on a read-only <filename>/var</filename> directory.</para> | |
86c0dd4a | 893 | |
5a8af538 LP |
894 | <para>For details about overlay file systems, see <ulink |
895 | url="https://www.kernel.org/doc/Documentation/filesystems/overlayfs.txt">overlayfs.txt</ulink>. Note | |
896 | that the semantics of overlay file systems are substantially | |
897 | different from normal file systems, in particular regarding | |
898 | reported device and inode information. Device and inode | |
899 | information may change for a file while it is being written | |
900 | to, and processes might see out-of-date versions of files at | |
901 | times. Note that this switch automatically derives the | |
902 | <literal>workdir=</literal> mount option for the overlay file | |
903 | system from the top-level directory tree, making it a sibling | |
904 | of it. It is hence essential that the top-level directory tree | |
905 | is not a mount point itself (since the working directory must | |
906 | be on the same file system as the top-most directory | |
907 | tree). Also note that the <literal>lowerdir=</literal> mount | |
908 | option receives the paths to stack in the opposite order of | |
909 | this switch.</para></listitem> | |
910 | </varlistentry> | |
911 | ||
798d3a52 | 912 | <varlistentry> |
a5f1cb3b ZJS |
913 | <term><option>-E <replaceable>NAME</replaceable>=<replaceable>VALUE</replaceable></option></term> |
914 | <term><option>--setenv=<replaceable>NAME</replaceable>=<replaceable>VALUE</replaceable></option></term> | |
798d3a52 ZJS |
915 | |
916 | <listitem><para>Specifies an environment variable assignment | |
917 | to pass to the init process in the container, in the format | |
918 | <literal>NAME=VALUE</literal>. This may be used to override | |
919 | the default variables or to set additional variables. This | |
920 | parameter may be used more than once.</para></listitem> | |
921 | </varlistentry> | |
922 | ||
798d3a52 ZJS |
923 | <varlistentry> |
924 | <term><option>--register=</option></term> | |
925 | ||
cd2dfc6f LP |
926 | <listitem><para>Controls whether the container is registered with |
927 | <citerefentry><refentrytitle>systemd-machined</refentrytitle><manvolnum>8</manvolnum></citerefentry>. Takes a | |
928 | boolean argument, which defaults to <literal>yes</literal>. This option should be enabled when the container | |
929 | runs a full Operating System (more specifically: a system and service manager as PID 1), and is useful to | |
930 | ensure that the container is accessible via | |
931 | <citerefentry><refentrytitle>machinectl</refentrytitle><manvolnum>1</manvolnum></citerefentry> and shown by | |
932 | tools such as <citerefentry | |
933 | project='man-pages'><refentrytitle>ps</refentrytitle><manvolnum>1</manvolnum></citerefentry>. If the container | |
934 | does not run a service manager, it is recommended to set this option to | |
935 | <literal>no</literal>.</para></listitem> | |
798d3a52 ZJS |
936 | </varlistentry> |
937 | ||
938 | <varlistentry> | |
939 | <term><option>--keep-unit</option></term> | |
940 | ||
bb849957 LP |
941 | <listitem><para>Instead of creating a transient scope unit to run the container in, simply use the service or |
942 | scope unit <command>systemd-nspawn</command> has been invoked in. If <option>--register=yes</option> is set | |
943 | this unit is registered with | |
944 | <citerefentry><refentrytitle>systemd-machined</refentrytitle><manvolnum>8</manvolnum></citerefentry>. This | |
945 | switch should be used if <command>systemd-nspawn</command> is invoked from within a service unit, and the | |
946 | service unit's sole purpose is to run a single <command>systemd-nspawn</command> container. This option is not | |
947 | available if run from a user session.</para> | |
cd2dfc6f | 948 | <para>Note that passing <option>--keep-unit</option> disables the effect of <option>--slice=</option> and |
bb849957 LP |
949 | <option>--property=</option>. Use <option>--keep-unit</option> and <option>--register=no</option> in |
950 | combination to disable any kind of unit allocation or registration with | |
951 | <command>systemd-machined</command>.</para></listitem> | |
798d3a52 ZJS |
952 | </varlistentry> |
953 | ||
954 | <varlistentry> | |
955 | <term><option>--personality=</option></term> | |
956 | ||
957 | <listitem><para>Control the architecture ("personality") | |
958 | reported by | |
3ba3a79d | 959 | <citerefentry project='man-pages'><refentrytitle>uname</refentrytitle><manvolnum>2</manvolnum></citerefentry> |
798d3a52 ZJS |
960 | in the container. Currently, only <literal>x86</literal> and |
961 | <literal>x86-64</literal> are supported. This is useful when | |
962 | running a 32-bit container on a 64-bit host. If this setting | |
963 | is not used, the personality reported in the container is the | |
964 | same as the one reported on the host.</para></listitem> | |
965 | </varlistentry> | |
966 | ||
967 | <varlistentry> | |
968 | <term><option>-q</option></term> | |
969 | <term><option>--quiet</option></term> | |
970 | ||
971 | <listitem><para>Turns off any status output by the tool | |
972 | itself. When this switch is used, the only output from nspawn | |
973 | will be the console output of the container OS | |
974 | itself.</para></listitem> | |
975 | </varlistentry> | |
976 | ||
977 | <varlistentry> | |
f757855e LP |
978 | <term><option>--volatile</option></term> |
979 | <term><option>--volatile=</option><replaceable>MODE</replaceable></term> | |
798d3a52 ZJS |
980 | |
981 | <listitem><para>Boots the container in volatile mode. When no | |
982 | mode parameter is passed or when mode is specified as | |
b938cb90 | 983 | <option>yes</option>, full volatile mode is enabled. This |
a8eaaee7 | 984 | means the root directory is mounted as a mostly unpopulated |
798d3a52 | 985 | <literal>tmpfs</literal> instance, and |
cd72d204 JE |
986 | <filename>/usr</filename> from the OS tree is mounted into it |
987 | in read-only mode (the system thus starts up with read-only OS | |
5164c3b4 ZJS |
988 | image, but pristine state and configuration, any changes |
989 | are lost on shutdown). When the mode parameter | |
b938cb90 | 990 | is specified as <option>state</option>, the OS tree is |
798d3a52 | 991 | mounted read-only, but <filename>/var</filename> is mounted as |
a8eaaee7 | 992 | a <literal>tmpfs</literal> instance into it (the system thus |
798d3a52 | 993 | starts up with read-only OS resources and configuration, but |
a8eaaee7 | 994 | pristine state, and any changes to the latter are lost on |
798d3a52 | 995 | shutdown). When the mode parameter is specified as |
b938cb90 | 996 | <option>no</option> (the default), the whole OS tree is made |
798d3a52 ZJS |
997 | available writable.</para> |
998 | ||
91214a37 LP |
999 | <para>This option provides similar functionality for containers as the <literal>systemd.volatile=</literal> |
1000 | kernel command line switch provides for host systems. See | |
1001 | <citerefentry><refentrytitle>kernel-command-line</refentrytitle><manvolnum>7</manvolnum></citerefentry> for | |
1002 | details.</para> | |
1003 | ||
1004 | <para>Note that enabling this setting will only work correctly with operating systems in the container that can | |
1005 | boot up with only <filename>/usr</filename> mounted, and are able to automatically populate | |
1006 | <filename>/var</filename>, and also <filename>/etc</filename> in case of | |
1007 | <literal>--volatile=yes</literal>.</para></listitem> | |
798d3a52 ZJS |
1008 | </varlistentry> |
1009 | ||
f757855e LP |
1010 | <varlistentry> |
1011 | <term><option>--settings=</option><replaceable>MODE</replaceable></term> | |
1012 | ||
1013 | <listitem><para>Controls whether | |
1014 | <command>systemd-nspawn</command> shall search for and use | |
1015 | additional per-container settings from | |
1016 | <filename>.nspawn</filename> files. Takes a boolean or the | |
1017 | special values <option>override</option> or | |
1018 | <option>trusted</option>.</para> | |
1019 | ||
b938cb90 | 1020 | <para>If enabled (the default), a settings file named after the |
f757855e LP |
1021 | machine (as specified with the <option>--machine=</option> |
1022 | setting, or derived from the directory or image file name) | |
1023 | with the suffix <filename>.nspawn</filename> is searched in | |
1024 | <filename>/etc/systemd/nspawn/</filename> and | |
1025 | <filename>/run/systemd/nspawn/</filename>. If it is found | |
1026 | there, its settings are read and used. If it is not found | |
b938cb90 | 1027 | there, it is subsequently searched in the same directory as the |
f757855e | 1028 | image file or in the immediate parent of the root directory of |
b938cb90 | 1029 | the container. In this case, if the file is found, its settings |
f757855e | 1030 | will be also read and used, but potentially unsafe settings |
b938cb90 | 1031 | are ignored. Note that in both these cases, settings on the |
4f76ef04 | 1032 | command line take precedence over the corresponding settings |
f757855e LP |
1033 | from loaded <filename>.nspawn</filename> files, if both are |
1034 | specified. Unsafe settings are considered all settings that | |
1035 | elevate the container's privileges or grant access to | |
1036 | additional resources such as files or directories of the | |
1037 | host. For details about the format and contents of | |
b938cb90 | 1038 | <filename>.nspawn</filename> files, consult |
f757855e LP |
1039 | <citerefentry><refentrytitle>systemd.nspawn</refentrytitle><manvolnum>5</manvolnum></citerefentry>.</para> |
1040 | ||
b938cb90 JE |
1041 | <para>If this option is set to <option>override</option>, the |
1042 | file is searched, read and used the same way, however, the order of | |
f757855e LP |
1043 | precedence is reversed: settings read from the |
1044 | <filename>.nspawn</filename> file will take precedence over | |
1045 | the corresponding command line options, if both are | |
1046 | specified.</para> | |
1047 | ||
b938cb90 | 1048 | <para>If this option is set to <option>trusted</option>, the |
f757855e | 1049 | file is searched, read and used the same way, but regardless |
a8eaaee7 | 1050 | of being found in <filename>/etc/systemd/nspawn/</filename>, |
f757855e LP |
1051 | <filename>/run/systemd/nspawn/</filename> or next to the image |
1052 | file or container root directory, all settings will take | |
b938cb90 | 1053 | effect, however, command line arguments still take precedence |
f757855e LP |
1054 | over corresponding settings.</para> |
1055 | ||
b938cb90 | 1056 | <para>If disabled, no <filename>.nspawn</filename> file is read |
f757855e LP |
1057 | and no settings except the ones on the command line are in |
1058 | effect.</para></listitem> | |
1059 | </varlistentry> | |
1060 | ||
9c1e04d0 | 1061 | <varlistentry> |
b09c0bba | 1062 | <term><option>--notify-ready=</option></term> |
9c1e04d0 AP |
1063 | |
1064 | <listitem><para>Configures support for notifications from the container's init process. | |
b09c0bba | 1065 | <option>--notify-ready=</option> takes a boolean (<option>no</option> and <option>yes</option>). |
9c1e04d0 AP |
1066 | With option <option>no</option> systemd-nspawn notifies systemd |
1067 | with a <literal>READY=1</literal> message when the init process is created. | |
1068 | With option <option>yes</option> systemd-nspawn waits for the | |
1069 | <literal>READY=1</literal> message from the init process in the container | |
1070 | before sending its own to systemd. For more details about notifications | |
1071 | see <citerefentry><refentrytitle>sd_notify</refentrytitle><manvolnum>3</manvolnum></citerefentry>).</para></listitem> | |
1072 | </varlistentry> | |
1073 | ||
798d3a52 ZJS |
1074 | <xi:include href="standard-options.xml" xpointer="help" /> |
1075 | <xi:include href="standard-options.xml" xpointer="version" /> | |
1076 | </variablelist> | |
1077 | ||
1078 | </refsect1> | |
1079 | ||
1080 | <refsect1> | |
1081 | <title>Examples</title> | |
1082 | ||
1083 | <example> | |
12c4ee0a ZJS |
1084 | <title>Download a |
1085 | <ulink url="https://getfedora.org">Fedora</ulink> image and start a shell in it</title> | |
798d3a52 | 1086 | |
3797fd0a ZJS |
1087 | <programlisting># machinectl pull-raw --verify=no \ |
1088 | https://download.fedoraproject.org/pub/fedora/linux/releases/25/CloudImages/x86_64/images/Fedora-Cloud-Base-25-1.3.x86_64.raw.xz | |
1089 | # systemd-nspawn -M Fedora-Cloud-Base-25-1.3.x86_64.raw</programlisting> | |
e0ea94c1 | 1090 | |
798d3a52 ZJS |
1091 | <para>This downloads an image using |
1092 | <citerefentry><refentrytitle>machinectl</refentrytitle><manvolnum>1</manvolnum></citerefentry> | |
1093 | and opens a shell in it.</para> | |
1094 | </example> | |
e0ea94c1 | 1095 | |
798d3a52 ZJS |
1096 | <example> |
1097 | <title>Build and boot a minimal Fedora distribution in a container</title> | |
8f7a3c14 | 1098 | |
55107232 | 1099 | <programlisting># dnf -y --releasever=27 --installroot=/var/lib/machines/f27container \ |
3797fd0a ZJS |
1100 | --disablerepo='*' --enablerepo=fedora --enablerepo=updates install \ |
1101 | systemd passwd dnf fedora-release vim-minimal | |
55107232 | 1102 | # systemd-nspawn -bD /var/lib/machines/f27container</programlisting> |
8f7a3c14 | 1103 | |
798d3a52 | 1104 | <para>This installs a minimal Fedora distribution into the |
55107232 ZJS |
1105 | directory <filename noindex='true'>/var/lib/machines/f27container</filename> |
1106 | and then boots an OS in a namespace container in it. Because the installation | |
1107 | is located underneath the standard <filename>/var/lib/machines/</filename> | |
1108 | directory, it is also possible to start the machine using | |
1109 | <command>systemd-nspawn -M f27container</command>.</para> | |
798d3a52 | 1110 | </example> |
8f7a3c14 | 1111 | |
798d3a52 ZJS |
1112 | <example> |
1113 | <title>Spawn a shell in a container of a minimal Debian unstable distribution</title> | |
8f7a3c14 | 1114 | |
7f8b3d1d | 1115 | <programlisting># debootstrap unstable ~/debian-tree/ |
25f5971b | 1116 | # systemd-nspawn -D ~/debian-tree/</programlisting> |
8f7a3c14 | 1117 | |
798d3a52 ZJS |
1118 | <para>This installs a minimal Debian unstable distribution into |
1119 | the directory <filename>~/debian-tree/</filename> and then | |
1120 | spawns a shell in a namespace container in it.</para> | |
12c4ee0a ZJS |
1121 | |
1122 | <para><command>debootstrap</command> supports | |
1123 | <ulink url="https://www.debian.org">Debian</ulink>, | |
1124 | <ulink url="https://www.ubuntu.com">Ubuntu</ulink>, | |
1125 | and <ulink url="https://www.tanglu.org">Tanglu</ulink> | |
1126 | out of the box, so the same command can be used to install any of those. For other | |
1127 | distributions from the Debian family, a mirror has to be specified, see | |
1128 | <citerefentry project='die-net'><refentrytitle>debootstrap</refentrytitle><manvolnum>8</manvolnum></citerefentry>. | |
1129 | </para> | |
798d3a52 | 1130 | </example> |
8f7a3c14 | 1131 | |
798d3a52 | 1132 | <example> |
12c4ee0a ZJS |
1133 | <title>Boot a minimal |
1134 | <ulink url="https://www.archlinux.org">Arch Linux</ulink> distribution in a container</title> | |
68562936 | 1135 | |
798d3a52 | 1136 | <programlisting># pacstrap -c -d ~/arch-tree/ base |
68562936 WG |
1137 | # systemd-nspawn -bD ~/arch-tree/</programlisting> |
1138 | ||
ff9b60f3 | 1139 | <para>This installs a minimal Arch Linux distribution into the |
798d3a52 ZJS |
1140 | directory <filename>~/arch-tree/</filename> and then boots an OS |
1141 | in a namespace container in it.</para> | |
1142 | </example> | |
68562936 | 1143 | |
f518ee04 | 1144 | <example> |
12c4ee0a ZJS |
1145 | <title>Install the |
1146 | <ulink url="https://software.opensuse.org/distributions/tumbleweed">OpenSUSE Tumbleweed</ulink> | |
1147 | rolling distribution</title> | |
f518ee04 ZJS |
1148 | |
1149 | <programlisting># zypper --root=/var/lib/machines/tumbleweed ar -c \ | |
1150 | https://download.opensuse.org/tumbleweed/repo/oss tumbleweed | |
1151 | # zypper --root=/var/lib/machines/tumbleweed refresh | |
1152 | # zypper --root=/var/lib/machines/tumbleweed install --no-recommends \ | |
1153 | systemd shadow zypper openSUSE-release vim | |
1154 | # systemd-nspawn -M tumbleweed passwd root | |
1155 | # systemd-nspawn -M tumbleweed -b</programlisting> | |
1156 | </example> | |
1157 | ||
798d3a52 | 1158 | <example> |
17cbb288 | 1159 | <title>Boot into an ephemeral snapshot of the host system</title> |
f9f4dd51 | 1160 | |
798d3a52 | 1161 | <programlisting># systemd-nspawn -D / -xb</programlisting> |
f9f4dd51 | 1162 | |
17cbb288 LP |
1163 | <para>This runs a copy of the host system in a snapshot which is removed immediately when the container |
1164 | exits. All file system changes made during runtime will be lost on shutdown, hence.</para> | |
798d3a52 | 1165 | </example> |
f9f4dd51 | 1166 | |
798d3a52 ZJS |
1167 | <example> |
1168 | <title>Run a container with SELinux sandbox security contexts</title> | |
a8828ed9 | 1169 | |
798d3a52 | 1170 | <programlisting># chcon system_u:object_r:svirt_sandbox_file_t:s0:c0,c1 -R /srv/container |
3797fd0a ZJS |
1171 | # systemd-nspawn -L system_u:object_r:svirt_sandbox_file_t:s0:c0,c1 \ |
1172 | -Z system_u:system_r:svirt_lxc_net_t:s0:c0,c1 -D /srv/container /bin/sh</programlisting> | |
798d3a52 | 1173 | </example> |
b53ede69 PW |
1174 | |
1175 | <example> | |
1176 | <title>Run a container with an OSTree deployment</title> | |
1177 | ||
3797fd0a ZJS |
1178 | <programlisting># systemd-nspawn -b -i ~/image.raw \ |
1179 | --pivot-root=/ostree/deploy/$OS/deploy/$CHECKSUM:/sysroot \ | |
1180 | --bind=+/sysroot/ostree/deploy/$OS/var:/var</programlisting> | |
b53ede69 | 1181 | </example> |
798d3a52 ZJS |
1182 | </refsect1> |
1183 | ||
1184 | <refsect1> | |
1185 | <title>Exit status</title> | |
1186 | ||
1187 | <para>The exit code of the program executed in the container is | |
1188 | returned.</para> | |
1189 | </refsect1> | |
1190 | ||
1191 | <refsect1> | |
1192 | <title>See Also</title> | |
1193 | <para> | |
1194 | <citerefentry><refentrytitle>systemd</refentrytitle><manvolnum>1</manvolnum></citerefentry>, | |
f757855e | 1195 | <citerefentry><refentrytitle>systemd.nspawn</refentrytitle><manvolnum>5</manvolnum></citerefentry>, |
798d3a52 ZJS |
1196 | <citerefentry project='man-pages'><refentrytitle>chroot</refentrytitle><manvolnum>1</manvolnum></citerefentry>, |
1197 | <citerefentry project='mankier'><refentrytitle>dnf</refentrytitle><manvolnum>8</manvolnum></citerefentry>, | |
798d3a52 ZJS |
1198 | <citerefentry project='die-net'><refentrytitle>debootstrap</refentrytitle><manvolnum>8</manvolnum></citerefentry>, |
1199 | <citerefentry project='archlinux'><refentrytitle>pacman</refentrytitle><manvolnum>8</manvolnum></citerefentry>, | |
f518ee04 | 1200 | <citerefentry project='mankier'><refentrytitle>zypper</refentrytitle><manvolnum>8</manvolnum></citerefentry>, |
798d3a52 ZJS |
1201 | <citerefentry><refentrytitle>systemd.slice</refentrytitle><manvolnum>5</manvolnum></citerefentry>, |
1202 | <citerefentry><refentrytitle>machinectl</refentrytitle><manvolnum>1</manvolnum></citerefentry>, | |
3ba3a79d | 1203 | <citerefentry project='man-pages'><refentrytitle>btrfs</refentrytitle><manvolnum>8</manvolnum></citerefentry> |
798d3a52 ZJS |
1204 | </para> |
1205 | </refsect1> | |
8f7a3c14 LP |
1206 | |
1207 | </refentry> |