]> git.ipfire.org Git - thirdparty/mdadm.git/blame - mdadm.8.in
Grow/raid10: support reducing the devices in a RAID10.
[thirdparty/mdadm.git] / mdadm.8.in
CommitLineData
52826846 1.\" -*- nroff -*-
e43d0cda
NB
2.\" Copyright Neil Brown and others.
3.\" This program is free software; you can redistribute it and/or modify
4.\" it under the terms of the GNU General Public License as published by
5.\" the Free Software Foundation; either version 2 of the License, or
6.\" (at your option) any later version.
7.\" See file COPYING in distribution for details.
3b2aad6e 8.TH MDADM 8 "" v3.2.5
52826846 9.SH NAME
9a9dab36 10mdadm \- manage MD devices
cd29a5c8 11.I aka
93e790af 12Linux Software RAID
cd29a5c8 13
52826846
NB
14.SH SYNOPSIS
15
e0d19036 16.BI mdadm " [mode] <raiddevice> [options] <component-devices>"
52826846 17
2ae555c3 18.SH DESCRIPTION
52826846 19RAID devices are virtual devices created from two or more
e0fe762a 20real block devices. This allows multiple devices (typically disk
35cc5be4 21drives or partitions thereof) to be combined into a single device to
cd29a5c8 22hold (for example) a single filesystem.
2d465520 23Some RAID levels include redundancy and so can survive some degree of
cd29a5c8
NB
24device failure.
25
2d465520
NB
26Linux Software RAID devices are implemented through the md (Multiple
27Devices) device driver.
cd29a5c8
NB
28
29Currently, Linux supports
30.B LINEAR
31md devices,
32.B RAID0
33(striping),
34.B RAID1
35(mirroring),
d013a55e
NB
36.BR RAID4 ,
37.BR RAID5 ,
98c6faba 38.BR RAID6 ,
1a7dfc35 39.BR RAID10 ,
b5e64645 40.BR MULTIPATH ,
90c8d668 41.BR FAULTY ,
cd29a5c8 42and
90c8d668 43.BR CONTAINER .
d013a55e 44
a9d69660
NB
45.B MULTIPATH
46is not a Software RAID mechanism, but does involve
93e790af 47multiple devices:
d013a55e 48each device is a path to one common physical storage device.
9652457e
N
49New installations should not use md/multipath as it is not well
50supported and has no ongoing development. Use the Device Mapper based
51multipath-tools instead.
d013a55e 52
a9d69660
NB
53.B FAULTY
54is also not true RAID, and it only involves one device. It
b5e64645 55provides a layer over a true device that can be used to inject faults.
52826846 56
4cce4069 57.B CONTAINER
8fd8d9c4
N
58is different again. A
59.B CONTAINER
60is a collection of devices that are
90c8d668
N
61managed as a set. This is similar to the set of devices connected to
62a hardware RAID controller. The set of devices may contain a number
9652457e 63of different RAID arrays each utilising some (or all) of the blocks from a
90c8d668 64number of the devices in the set. For example, two devices in a 5-device set
9652457e 65might form a RAID1 using the whole devices. The remaining three might
90c8d668
N
66have a RAID5 over the first half of each device, and a RAID0 over the
67second half.
68
8fd8d9c4
N
69With a
70.BR CONTAINER ,
71there is one set of metadata that describes all of
72the arrays in the container. So when
73.I mdadm
74creates a
75.B CONTAINER
9652457e
N
76device, the device just represents the metadata. Other normal arrays (RAID1
77etc) can be created inside the container.
52826846
NB
78
79.SH MODES
8382f19b 80mdadm has several major modes of operation:
cd29a5c8
NB
81.TP
82.B Assemble
93e790af 83Assemble the components of a previously created
e0fe762a 84array into an active array. Components can be explicitly given
2ae555c3 85or can be searched for.
51ac42e3 86.I mdadm
cd29a5c8
NB
87checks that the components
88do form a bona fide array, and can, on request, fiddle superblock
89information so as to assemble a faulty array.
90
91.TP
92.B Build
e0fe762a 93Build an array that doesn't have per-device metadata (superblocks). For these
a9d69660
NB
94sorts of arrays,
95.I mdadm
96cannot differentiate between initial creation and subsequent assembly
97of an array. It also cannot perform any checks that appropriate
93e790af 98components have been requested. Because of this, the
a9d69660
NB
99.B Build
100mode should only be used together with a complete understanding of
101what you are doing.
cd29a5c8
NB
102
103.TP
104.B Create
e0fe762a
N
105Create a new array with per-device metadata (superblocks).
106Appropriate metadata is written to each device, and then the array
107comprising those devices is activated. A 'resync' process is started
108to make sure that the array is consistent (e.g. both sides of a mirror
109contain the same data) but the content of the device is left otherwise
110untouched.
111The array can be used as soon as it has been created. There is no
112need to wait for the initial resync to finish.
cd29a5c8 113
cd29a5c8
NB
114.TP
115.B "Follow or Monitor"
5787fa49 116Monitor one or more md devices and act on any state changes. This is
e0fe762a
N
117only meaningful for RAID1, 4, 5, 6, 10 or multipath arrays, as
118only these have interesting state. RAID0 or Linear never have
98c6faba 119missing, spare, or failed drives, so there is nothing to monitor.
5787fa49 120
dd0781e5
NB
121.TP
122.B "Grow"
123Grow (or shrink) an array, or otherwise reshape it in some way.
124Currently supported growth options including changing the active size
c64881d7
N
125of component devices and changing the number of active devices in
126Linear and RAID levels 0/1/4/5/6,
127changing the RAID level between 0, 1, 5, and 6, and between 0 and 10,
128changing the chunk size and layout for RAID 0,4,5,6, as well as adding or
f24e2d6c 129removing a write-intent bitmap.
cd29a5c8 130
8382f19b
NB
131.TP
132.B "Incremental Assembly"
133Add a single device to an appropriate array. If the addition of the
134device makes the array runnable, the array will be started.
135This provides a convenient interface to a
136.I hot-plug
137system. As each device is detected,
138.I mdadm
139has a chance to include it in some array as appropriate.
29ba4804
N
140Optionally, when the
141.I \-\-fail
142flag is passed in we will remove the device from any active array
143instead of adding it.
9652457e 144
8fd8d9c4
N
145If a
146.B CONTAINER
147is passed to
148.I mdadm
149in this mode, then any arrays within that container will be assembled
150and started.
8382f19b 151
2ae555c3
NB
152.TP
153.B Manage
154This is for doing things to specific components of an array such as
155adding new spares and removing faulty devices.
156
157.TP
158.B Misc
159This is an 'everything else' mode that supports operations on active
160arrays, operations on component devices such as erasing old superblocks, and
161information gathering operations.
e43d0cda
NB
162.\"This mode allows operations on independent devices such as examine MD
163.\"superblocks, erasing old superblocks and stopping active arrays.
2ae555c3 164
1f48664b
NB
165.TP
166.B Auto-detect
167This mode does not act on a specific device or array, but rather it
168requests the Linux Kernel to activate any auto-detected arrays.
52826846
NB
169.SH OPTIONS
170
2ae555c3 171.SH Options for selecting a mode are:
52826846 172
cd29a5c8 173.TP
7e23fc43 174.BR \-A ", " \-\-assemble
2d465520 175Assemble a pre-existing array.
52826846 176
cd29a5c8 177.TP
7e23fc43 178.BR \-B ", " \-\-build
cd29a5c8 179Build a legacy array without superblocks.
52826846 180
cd29a5c8 181.TP
7e23fc43 182.BR \-C ", " \-\-create
cd29a5c8 183Create a new array.
52826846 184
cd29a5c8 185.TP
7e23fc43 186.BR \-F ", " \-\-follow ", " \-\-monitor
cd29a5c8
NB
187Select
188.B Monitor
189mode.
52826846 190
dd0781e5 191.TP
7e23fc43 192.BR \-G ", " \-\-grow
dd0781e5 193Change the size or shape of an active array.
8382f19b
NB
194
195.TP
1f48664b 196.BR \-I ", " \-\-incremental
29ba4804 197Add/remove a single device to/from an appropriate array, and possibly start the array.
8382f19b 198
1f48664b
NB
199.TP
200.B \-\-auto-detect
201Request that the kernel starts any auto-detected arrays. This can only
202work if
203.I md
204is compiled into the kernel \(em not if it is a module.
205Arrays can be auto-detected by the kernel if all the components are in
206primary MS-DOS partitions with partition type
e0fe762a
N
207.BR FD ,
208and all use v0.90 metadata.
1f48664b
NB
209In-kernel autodetect is not recommended for new installations. Using
210.I mdadm
211to detect and assemble arrays \(em possibly in an
212.I initrd
213\(em is substantially more flexible and should be preferred.
214
2ae555c3
NB
215.P
216If a device is given before any options, or if the first option is
7e23fc43
PS
217.BR \-\-add ,
218.BR \-\-fail ,
2ae555c3 219or
7e23fc43 220.BR \-\-remove ,
e0fe762a 221then the MANAGE mode is assumed.
2ae555c3
NB
222Anything other than these will cause the
223.B Misc
224mode to be assumed.
dd0781e5 225
2ae555c3 226.SH Options that are not mode-specific are:
e793c2e5 227
cd29a5c8 228.TP
7e23fc43 229.BR \-h ", " \-\-help
a9d69660 230Display general help message or, after one of the above options, a
93e790af 231mode-specific help message.
56eedc1a
NB
232
233.TP
7e23fc43 234.B \-\-help\-options
56eedc1a
NB
235Display more detailed help about command line parsing and some commonly
236used options.
52826846 237
cd29a5c8 238.TP
7e23fc43 239.BR \-V ", " \-\-version
9a9dab36 240Print version information for mdadm.
52826846 241
cd29a5c8 242.TP
7e23fc43 243.BR \-v ", " \-\-verbose
22892d56
NB
244Be more verbose about what is happening. This can be used twice to be
245extra-verbose.
a9d69660 246The extra verbosity currently only affects
7e23fc43 247.B \-\-detail \-\-scan
22892d56 248and
7e23fc43 249.BR "\-\-examine \-\-scan" .
52826846 250
dab6685f 251.TP
7e23fc43 252.BR \-q ", " \-\-quiet
dab6685f 253Avoid printing purely informative messages. With this,
51ac42e3 254.I mdadm
dab6685f
NB
255will be silent unless there is something really important to report.
256
08ca2adf
JS
257.TP
258.BR \-\-offroot
259Set first character of argv[0] to @ to indicate mdadm was launched
260from initrd/initramfs and should not be shutdown by systemd as part of
261the regular shutdown process. This option is normally only used by
262the system's initscripts. Please see here for more details on how
263systemd handled argv[0]:
264.IP
265.B http://www.freedesktop.org/wiki/Software/systemd/RootStorageDaemons
266.PP
267
268
e0d19036 269.TP
7e23fc43 270.BR \-f ", " \-\-force
93e790af 271Be more forceful about certain operations. See the various modes for
e0d19036
NB
272the exact meaning of this option in different contexts.
273
274.TP
7e23fc43 275.BR \-c ", " \-\-config=
2ae555c3
NB
276Specify the config file. Default is to use
277.BR /etc/mdadm.conf ,
93e790af 278or if that is missing then
2ae555c3 279.BR /etc/mdadm/mdadm.conf .
5787fa49 280If the config file given is
93e790af 281.B "partitions"
5787fa49
NB
282then nothing will be read, but
283.I mdadm
284will act as though the config file contained exactly
8fd8d9c4 285.B "DEVICE partitions containers"
5787fa49
NB
286and will read
287.B /proc/partitions
8fd8d9c4
N
288to find a list of devices to scan, and
289.B /proc/mdstat
290to find a list of containers to examine.
d013a55e 291If the word
93e790af 292.B "none"
d013a55e
NB
293is given for the config file, then
294.I mdadm
295will act as though the config file were empty.
e0d19036
NB
296
297.TP
7e23fc43 298.BR \-s ", " \-\-scan
93e790af 299Scan config file or
e0d19036
NB
300.B /proc/mdstat
301for missing information.
302In general, this option gives
51ac42e3 303.I mdadm
93e790af
SW
304permission to get any missing information (like component devices,
305array devices, array identities, and alert destination) from the
306configuration file (see previous option);
307one exception is MISC mode when using
7e23fc43 308.B \-\-detail
e0d19036 309or
93e790af 310.B \-\-stop,
e0d19036 311in which case
7e23fc43 312.B \-\-scan
e0d19036
NB
313says to get a list of array devices from
314.BR /proc/mdstat .
315
570c0542 316.TP
d16c7af6 317.BR \-e ", " \-\-metadata=
e0fe762a 318Declare the style of RAID metadata (superblock) to be used. The
26f467a9 319default is {DEFAULT_METADATA} for
7e23fc43 320.BR \-\-create ,
53e8b987 321and to guess for other operations.
2790ffe3
GB
322The default can be overridden by setting the
323.B metadata
324value for the
325.B CREATE
326keyword in
327.BR mdadm.conf .
570c0542
NB
328
329Options are:
330.RS
26f467a9 331.ie '{DEFAULT_METADATA}'0.90'
332.IP "0, 0.90, default"
333.el
7d5c3964 334.IP "0, 0.90"
26f467a9 335..
570c0542 336Use the original 0.90 format superblock. This format limits arrays to
93e790af 33728 component devices and limits component devices of levels 1 and
cd19c0cf
JR
338greater to 2 terabytes. It is also possible for there to be confusion
339about whether the superblock applies to a whole device or just the
340last partition, if that partition starts on a 64K boundary.
26f467a9 341.ie '{DEFAULT_METADATA}'0.90'
342.IP "1, 1.0, 1.1, 1.2"
343.el
7d5c3964 344.IP "1, 1.0, 1.1, 1.2 default"
26f467a9 345..
cd19c0cf
JR
346Use the new version-1 format superblock. This has fewer restrictions.
347It can easily be moved between hosts with different endian-ness, and a
348recovery operation can be checkpointed and restarted. The different
349sub-versions store the superblock at different locations on the
350device, either at the end (for 1.0), at the start (for 1.1) or 4K from
7050aa3f
N
351the start (for 1.2). "1" is equivalent to "1.2" (the commonly
352preferred 1.x format).
26f467a9 353'if '{DEFAULT_METADATA}'1.2' "default" is equivalent to "1.2".
8fd8d9c4 354.IP ddf
e0fe762a
N
355Use the "Industry Standard" DDF (Disk Data Format) format defined by
356SNIA.
357When creating a DDF array a
8fd8d9c4
N
358.B CONTAINER
359will be created, and normal arrays can be created in that container.
360.IP imsm
4cce4069 361Use the Intel(R) Matrix Storage Manager metadata format. This creates a
8fd8d9c4 362.B CONTAINER
4cce4069
DW
363which is managed in a similar manner to DDF, and is supported by an
364option-rom on some platforms:
365.IP
366.B http://www.intel.com/design/chipsets/matrixstorage_sb.htm
367.PP
570c0542
NB
368.RE
369
41a3b72a 370.TP
7e23fc43 371.B \-\-homehost=
35cc5be4 372This will override any
41a3b72a 373.B HOMEHOST
93e790af 374setting in the config file and provides the identity of the host which
41a3b72a
NB
375should be considered the home for any arrays.
376
377When creating an array, the
378.B homehost
e0fe762a 379will be recorded in the metadata. For version-1 superblocks, it will
93e790af 380be prefixed to the array name. For version-0.90 superblocks, part of
41a3b72a
NB
381the SHA1 hash of the hostname will be stored in the later half of the
382UUID.
383
384When reporting information about an array, any array which is tagged
385for the given homehost will be reported as such.
386
387When using Auto-Assemble, only arrays tagged for the given homehost
0ac91628 388will be allowed to use 'local' names (i.e. not ending in '_' followed
e0fe762a
N
389by a digit string). See below under
390.BR "Auto Assembly" .
41a3b72a 391
c2ecf5f6
N
392.TP
393.B \-\-prefer=
394When
395.I mdadm
396needs to print the name for a device it normally finds the name in
397.B /dev
398which refers to the device and is shortest. When a path component is
399given with
400.B \-\-prefer
401.I mdadm
402will prefer a longer name if it contains that component. For example
403.B \-\-prefer=by-uuid
404will prefer a name in a subdirectory of
405.B /dev
406called
407.BR by-uuid .
408
409This functionality is currently only provided by
410.B \-\-detail
411and
412.BR \-\-monitor .
413
2ae555c3
NB
414.SH For create, build, or grow:
415
416.TP
7e23fc43 417.BR \-n ", " \-\-raid\-devices=
2ae555c3
NB
418Specify the number of active devices in the array. This, plus the
419number of spare devices (see below) must equal the number of
420.I component-devices
421(including "\fBmissing\fP" devices)
422that are listed on the command line for
e0fe762a 423.BR \-\-create .
2ae555c3
NB
424Setting a value of 1 is probably
425a mistake and so requires that
7e23fc43 426.B \-\-force
2ae555c3 427be specified first. A value of 1 will then be allowed for linear,
e0fe762a 428multipath, RAID0 and RAID1. It is never allowed for RAID4, RAID5 or RAID6.
2ae555c3
NB
429.br
430This number can only be changed using
7e23fc43 431.B \-\-grow
e0fe762a
N
432for RAID1, RAID4, RAID5 and RAID6 arrays, and only on kernels which provide
433the necessary support.
2ae555c3
NB
434
435.TP
7e23fc43 436.BR \-x ", " \-\-spare\-devices=
2ae555c3
NB
437Specify the number of spare (eXtra) devices in the initial array.
438Spares can also be added
439and removed later. The number of component devices listed
e0fe762a 440on the command line must equal the number of RAID devices plus the
2ae555c3
NB
441number of spare devices.
442
2ae555c3 443.TP
7e23fc43 444.BR \-z ", " \-\-size=
e0fe762a 445Amount (in Kibibytes) of space to use from each drive in RAID levels 1/4/5/6.
2ae555c3
NB
446This must be a multiple of the chunk size, and must leave about 128Kb
447of space at the end of the drive for the RAID superblock.
448If this is not specified
449(as it normally is not) the smallest drive (or partition) sets the
450size, though if there is a variance among the drives of greater than 1%, a warning is
451issued.
452
36fad8ec
N
453A suffix of 'M' or 'G' can be given to indicate Megabytes or
454Gigabytes respectively.
455
9ab6e80a
N
456Sometimes a replacement drive can be a little smaller than the
457original drives though this should be minimised by IDEMA standards.
458Such a replacement drive will be rejected by
459.IR md .
460To guard against this it can be useful to set the initial size
461slightly smaller than the smaller device with the aim that it will
462still be larger than any replacement.
463
2ae555c3 464This value can be set with
7e23fc43 465.B \-\-grow
9ab6e80a
N
466for RAID level 1/4/5/6 though
467.B CONTAINER
468based arrays such as those with IMSM metadata may not be able to
469support this.
470If the array was created with a size smaller than the currently
471active drives, the extra space can be accessed using
7e23fc43 472.BR \-\-grow .
2ae555c3
NB
473The size can be given as
474.B max
475which means to choose the largest size that fits on all current drives.
52826846 476
c26d78fe
N
477Before reducing the size of the array (with
478.BR "\-\-grow \-\-size=" )
479you should make sure that space isn't needed. If the device holds a
480filesystem, you would need to resize the filesystem to use less space.
481
482After reducing the array size you should check that the data stored in
483the device is still available. If the device holds a filesystem, then
484an 'fsck' of the filesystem is a minimum requirement. If there are
485problems the array can be made bigger again with no loss with another
486.B "\-\-grow \-\-size="
487command.
488
9ab6e80a 489This value cannot be used when creating a
8fd8d9c4 490.B CONTAINER
9ab6e80a
N
491such as with DDF and IMSM metadata, though it perfectly valid when
492creating an array inside a container.
8fd8d9c4 493
f24e2d6c 494.TP
c26d78fe 495.BR \-Z ", " \-\-array\-size=
f24e2d6c
N
496This is only meaningful with
497.B \-\-grow
36fad8ec 498and its effect is not persistent: when the array is stopped and
f24e2d6c
N
499restarted the default array size will be restored.
500
501Setting the array-size causes the array to appear smaller to programs
502that access the data. This is particularly needed before reshaping an
503array so that it will be smaller. As the reshape is not reversible,
504but setting the size with
505.B \-\-array-size
506is, it is required that the array size is reduced as appropriate
507before the number of devices in the array is reduced.
508
c26d78fe
N
509Before reducing the size of the array you should make sure that space
510isn't needed. If the device holds a filesystem, you would need to
511resize the filesystem to use less space.
512
513After reducing the array size you should check that the data stored in
514the device is still available. If the device holds a filesystem, then
515an 'fsck' of the filesystem is a minimum requirement. If there are
516problems the array can be made bigger again with no loss with another
517.B "\-\-grow \-\-array\-size="
518command.
519
36fad8ec
N
520A suffix of 'M' or 'G' can be given to indicate Megabytes or
521Gigabytes respectively.
522A value of
523.B max
524restores the apparent size of the array to be whatever the real
525amount of available space is.
526
cd29a5c8 527.TP
7e23fc43 528.BR \-c ", " \-\-chunk=
5f175898
N
529Specify chunk size of kibibytes. The default when creating an
530array is 512KB. To ensure compatibility with earlier versions, the
531default when Building and array with no persistent metadata is 64KB.
e0fe762a 532This is only meaningful for RAID0, RAID4, RAID5, RAID6, and RAID10.
52826846 533
a252c078
N
534RAID4, RAID5, RAID6, and RAID10 require the chunk size to be a power
535of 2. In any case it must be a multiple of 4KB.
536
36fad8ec
N
537A suffix of 'M' or 'G' can be given to indicate Megabytes or
538Gigabytes respectively.
539
cd29a5c8 540.TP
7e23fc43 541.BR \-\-rounding=
e0fe762a
N
542Specify rounding factor for a Linear array. The size of each
543component will be rounded down to a multiple of this size.
544This is a synonym for
545.B \-\-chunk
546but highlights the different meaning for Linear as compared to other
5f175898
N
547RAID levels. The default is 64K if a kernel earlier than 2.6.16 is in
548use, and is 0K (i.e. no rounding) in later kernels.
52826846 549
cd29a5c8 550.TP
7e23fc43 551.BR \-l ", " \-\-level=
e0fe762a 552Set RAID level. When used with
7e23fc43 553.BR \-\-create ,
98c6faba 554options are: linear, raid0, 0, stripe, raid1, 1, mirror, raid4, 4,
8fd8d9c4
N
555raid5, 5, raid6, 6, raid10, 10, multipath, mp, faulty, container.
556Obviously some of these are synonymous.
557
558When a
559.B CONTAINER
560metadata type is requested, only the
561.B container
562level is permitted, and it does not need to be explicitly given.
aa88f531
NB
563
564When used with
7e23fc43 565.BR \-\-build ,
a9d69660 566only linear, stripe, raid0, 0, raid1, multipath, mp, and faulty are valid.
52826846 567
fd547b50
N
568Can be used with
569.B \-\-grow
570to change the RAID level in some cases. See LEVEL CHANGES below.
2ae555c3 571
cd29a5c8 572.TP
7e23fc43 573.BR \-p ", " \-\-layout=
f24e2d6c
N
574This option configures the fine details of data layout for RAID5, RAID6,
575and RAID10 arrays, and controls the failure modes for
1a7dfc35
NB
576.IR faulty .
577
e0fe762a 578The layout of the RAID5 parity block can be one of
7e23fc43
PS
579.BR left\-asymmetric ,
580.BR left\-symmetric ,
581.BR right\-asymmetric ,
582.BR right\-symmetric ,
53e8b987
PS
583.BR la ", " ra ", " ls ", " rs .
584The default is
7e23fc43 585.BR left\-symmetric .
52826846 586
cd19c0cf 587It is also possible to cause RAID5 to use a RAID4-like layout by
e0fe762a
N
588choosing
589.BR parity\-first ,
590or
591.BR parity\-last .
592
593Finally for RAID5 there are DDF\-compatible layouts,
594.BR ddf\-zero\-restart ,
595.BR ddf\-N\-restart ,
596and
597.BR ddf\-N\-continue .
598
599These same layouts are available for RAID6. There are also 4 layouts
600that will provide an intermediate stage for converting between RAID5
601and RAID6. These provide a layout which is identical to the
602corresponding RAID5 layout on the first N\-1 devices, and has the 'Q'
603syndrome (the second 'parity' block used by RAID6) on the last device.
604These layouts are:
605.BR left\-symmetric\-6 ,
606.BR right\-symmetric\-6 ,
607.BR left\-asymmetric\-6 ,
608.BR right\-asymmetric\-6 ,
609and
10adfe9a 610.BR parity\-first\-6 .
e0fe762a 611
93e790af
SW
612When setting the failure mode for level
613.I faulty,
1a7dfc35 614the options are:
7e23fc43
PS
615.BR write\-transient ", " wt ,
616.BR read\-transient ", " rt ,
617.BR write\-persistent ", " wp ,
618.BR read\-persistent ", " rp ,
619.BR write\-all ,
620.BR read\-fixable ", " rf ,
53e8b987 621.BR clear ", " flush ", " none .
b5e64645 622
93e790af 623Each failure mode can be followed by a number, which is used as a period
b5e64645
NB
624between fault generation. Without a number, the fault is generated
625once on the first relevant request. With a number, the fault will be
93e790af 626generated after that many requests, and will continue to be generated
b5e64645
NB
627every time the period elapses.
628
629Multiple failure modes can be current simultaneously by using the
7e23fc43 630.B \-\-grow
53e8b987 631option to set subsequent failure modes.
b5e64645
NB
632
633"clear" or "none" will remove any pending or periodic failure modes,
2ae555c3 634and "flush" will clear any persistent faults.
b5e64645 635
6f9a21a7 636Finally, the layout options for RAID10 are one of 'n', 'o' or 'f' followed
93e790af 637by a small number. The default is 'n2'. The supported options are:
1a7dfc35 638
93e790af 639.I 'n'
e0fe762a 640signals 'near' copies. Multiple copies of one data block are at
b578481c
NB
641similar offsets in different devices.
642
93e790af 643.I 'o'
b578481c
NB
644signals 'offset' copies. Rather than the chunks being duplicated
645within a stripe, whole stripes are duplicated but are rotated by one
646device so duplicate blocks are on different devices. Thus subsequent
647copies of a block are in the next drive, and are one chunk further
648down.
649
93e790af 650.I 'f'
1a7dfc35 651signals 'far' copies
93e790af 652(multiple copies have very different offsets).
e0fe762a 653See md(4) for more detail about 'near', 'offset', and 'far'.
1a7dfc35
NB
654
655The number is the number of copies of each datablock. 2 is normal, 3
656can be useful. This number can be at most equal to the number of
657devices in the array. It does not need to divide evenly into that
658number (e.g. it is perfectly legal to have an 'n2' layout for an array
659with an odd number of devices).
660
f24e2d6c
N
661When an array is converted between RAID5 and RAID6 an intermediate
662RAID6 layout is used in which the second parity block (Q) is always on
663the last device. To convert a RAID5 to RAID6 and leave it in this new
664layout (which does not require re-striping) use
665.BR \-\-layout=preserve .
666This will try to avoid any restriping.
667
668The converse of this is
669.B \-\-layout=normalise
670which will change a non-standard RAID6 layout into a more standard
671arrangement.
672
cd29a5c8 673.TP
7e23fc43 674.BR \-\-parity=
53e8b987 675same as
7e23fc43 676.B \-\-layout
53e8b987 677(thus explaining the p of
7e23fc43 678.BR \-p ).
52826846 679
e793c2e5 680.TP
7e23fc43 681.BR \-b ", " \-\-bitmap=
e793c2e5 682Specify a file to store a write-intent bitmap in. The file should not
53e8b987 683exist unless
7e23fc43 684.B \-\-force
53e8b987 685is also given. The same file should be provided
2ae555c3 686when assembling the array. If the word
93e790af 687.B "internal"
2ae555c3
NB
688is given, then the bitmap is stored with the metadata on the array,
689and so is replicated on all devices. If the word
93e790af 690.B "none"
2ae555c3 691is given with
7e23fc43 692.B \-\-grow
2ae555c3 693mode, then any bitmap that is present is removed.
e793c2e5 694
2ae555c3
NB
695To help catch typing errors, the filename must contain at least one
696slash ('/') if it is a real file (not 'internal' or 'none').
697
698Note: external bitmaps are only known to work on ext2 and ext3.
699Storing bitmap files on other filesystems may result in serious problems.
e793c2e5 700
cd29a5c8 701.TP
7e23fc43 702.BR \-\-bitmap\-chunk=
e0fe762a 703Set the chunksize of the bitmap. Each bit corresponds to that many
1bfdbe01
NB
704Kilobytes of storage.
705When using a file based bitmap, the default is to use the smallest
93e790af 706size that is at-least 4 and requires no more than 2^21 chunks.
2ae555c3
NB
707When using an
708.B internal
b8ab2a50
N
709bitmap, the chunksize defaults to 64Meg, or larger if necessary to
710fit the bitmap into the available space.
5787fa49 711
36fad8ec
N
712A suffix of 'M' or 'G' can be given to indicate Megabytes or
713Gigabytes respectively.
714
cd29a5c8 715.TP
7e23fc43 716.BR \-W ", " \-\-write\-mostly
e0fe762a 717subsequent devices listed in a
7e23fc43
PS
718.BR \-\-build ,
719.BR \-\-create ,
2ae555c3 720or
7e23fc43 721.B \-\-add
2ae555c3
NB
722command will be flagged as 'write-mostly'. This is valid for RAID1
723only and means that the 'md' driver will avoid reading from these
724devices if at all possible. This can be useful if mirroring over a
725slow link.
52826846 726
2ae555c3 727.TP
7e23fc43 728.BR \-\-write\-behind=
2ae555c3 729Specify that write-behind mode should be enabled (valid for RAID1
e0fe762a
N
730only). If an argument is specified, it will set the maximum number
731of outstanding writes allowed. The default value is 256.
2ae555c3
NB
732A write-intent bitmap is required in order to use write-behind
733mode, and write-behind is only attempted on drives marked as
734.IR write-mostly .
dd0781e5
NB
735
736.TP
7e23fc43 737.BR \-\-assume\-clean
dd0781e5
NB
738Tell
739.I mdadm
47d79ef8
NB
740that the array pre-existed and is known to be clean. It can be useful
741when trying to recover from a major failure as you can be sure that no
742data will be affected unless you actually write to the array. It can
743also be used when creating a RAID1 or RAID10 if you want to avoid the
b3f1c093 744initial resync, however this practice \(em while normally safe \(em is not
e0fe762a 745recommended. Use this only if you really know what you are doing.
6acad481
ME
746.IP
747When the devices that will be part of a new array were filled
748with zeros before creation the operator knows the array is
749actually clean. If that is the case, such as after running
750badblocks, this argument can be used to tell mdadm the
751facts the operator knows.
ce52f92f
N
752.IP
753When an array is resized to a larger size with
754.B "\-\-grow \-\-size="
755the new space is normally resynced in that same way that the whole
6cbf8fb8 756array is resynced at creation. From Linux version 3.0,
ce52f92f
N
757.B \-\-assume\-clean
758can be used with that command to avoid the automatic resync.
dd0781e5 759
2ae555c3 760.TP
7e23fc43 761.BR \-\-backup\-file=
53e8b987 762This is needed when
7e23fc43 763.B \-\-grow
cd19c0cf
JR
764is used to increase the number of raid-devices in a RAID5 or RAID6 if
765there are no spare devices available, or to shrink, change RAID level
766or layout. See the GROW MODE section below on RAID\-DEVICES CHANGES.
767The file must be stored on a separate device, not on the RAID array
768being reshaped.
2ae555c3 769
40c9a66a
N
770.TP
771.B \-\-data\-offset=
772Arrays with 1.x metadata can leave a gap between the start of the
773device and the start of array data. This gap can be used for various
774metadata. The start of data is known as the
775.IR data\-offset .
776Normally an appropriate data offset is computed automatically.
777However it can be useful to set it explicitly such as when re-creating
778an array which was originally created using a different version of
779.I mdadm
780which computed a different offset.
781
782Setting the offset explicitly over-rides the default. The value given
783is in Kilobytes unless an 'M' or 'G' suffix is given.
784
785Since Linux 3.4,
786.B \-\-data\-offset
787can also be used with
788.B --grow
789for some RAID levels (initially on RAID10). This allows the
790data-offset to be changed as part of the reshape process. When the
791data offset is changed, no backup file is required as the difference
792in offsets is used to provide the same functionality.
793
794When the new offset is earlier than the old offset, the number of
795devices in the array cannot shrink. When it is after the old offset,
796the number of devices in the array cannot increase.
797
f211a137
AK
798.TP
799.BR \-\-continue
800This option is complementary to the
801.B \-\-freeze-reshape
802option for assembly. It is needed when
803.B \-\-grow
804operation is interrupted and it is not restarted automatically due to
805.B \-\-freeze-reshape
806usage during array assembly. This option is used together with
807.BR \-G
808, (
809.BR \-\-grow
810) command and device for a pending reshape to be continued.
811All parameters required for reshape continuation will be read from array metadata.
812If initial
813.BR \-\-grow
814command had required
815.BR \-\-backup\-file=
816option to be set, continuation option will require to have exactly the same
817backup file given as well.
818.IP
819Any other parameter passed together with
820.BR \-\-continue
821option will be ignored.
822
947fd4dd 823.TP
7e23fc43 824.BR \-N ", " \-\-name=
947fd4dd
NB
825Set a
826.B name
827for the array. This is currently only effective when creating an
e0fe762a
N
828array with a version-1 superblock, or an array in a DDF container.
829The name is a simple textual string that can be used to identify array
830components when assembling. If name is needed but not specified, it
831is taken from the basename of the device that is being created.
832e.g. when creating
833.I /dev/md/home
834the
835.B name
836will default to
837.IR home .
947fd4dd 838
dd0781e5 839.TP
7e23fc43 840.BR \-R ", " \-\-run
dd0781e5
NB
841Insist that
842.I mdadm
843run the array, even if some of the components
844appear to be active in another array or filesystem. Normally
845.I mdadm
846will ask for confirmation before including such components in an
847array. This option causes that question to be suppressed.
848
849.TP
7e23fc43 850.BR \-f ", " \-\-force
dd0781e5
NB
851Insist that
852.I mdadm
853accept the geometry and layout specified without question. Normally
854.I mdadm
855will not allow creation of an array with only one device, and will try
e0fe762a 856to create a RAID5 array with one missing drive (as this makes the
dd0781e5 857initial resync work faster). With
7e23fc43 858.BR \-\-force ,
dd0781e5
NB
859.I mdadm
860will not try to be so clever.
861
0ea8f5b1
N
862.TP
863.BR \-o ", " \-\-readonly
864Start the array
865.B read only
866rather than read-write as normal. No writes will be allowed to the
867array, and no resync, recovery, or reshape will be started.
868
dd0781e5 869.TP
257c1dc2
N
870.BR \-a ", " "\-\-auto{=yes,md,mdp,part,p}{NN}"
871Instruct mdadm how to create the device file if needed, possibly allocating
48f7b27a 872an unused minor number. "md" causes a non-partitionable array
257c1dc2
N
873to be used (though since Linux 2.6.28, these array devices are in fact
874partitionable). "mdp", "part" or "p" causes a partitionable array (2.6 and
2ae555c3 875later) to be used. "yes" requires the named md device to have
f9c25f1d 876a 'standard' format, and the type and minor number will be determined
257c1dc2
N
877from this. With mdadm 3.0, device creation is normally left up to
878.I udev
879so this option is unlikely to be needed.
880See DEVICE NAMES below.
48f7b27a 881
a9d69660 882The argument can also come immediately after
7e23fc43 883"\-a". e.g. "\-ap".
dd0781e5 884
53e8b987 885If
7e23fc43 886.B \-\-auto
53e8b987 887is not given on the command line or in the config file, then
75723446 888the default will be
7e23fc43 889.BR \-\-auto=yes .
75723446 890
1337546d 891If
7e23fc43 892.B \-\-scan
1337546d
NB
893is also given, then any
894.I auto=
35cc5be4 895entries in the config file will override the
7e23fc43 896.B \-\-auto
1337546d
NB
897instruction given on the command line.
898
dd0781e5
NB
899For partitionable arrays,
900.I mdadm
901will create the device file for the whole array and for the first 4
902partitions. A different number of partitions can be specified at the
903end of this option (e.g.
7e23fc43 904.BR \-\-auto=p7 ).
2ae555c3 905If the device name ends with a digit, the partition names add a 'p',
e0fe762a
N
906and a number, e.g.
907.IR /dev/md/home1p3 .
908If there is no trailing digit, then the partition names just have a
909number added, e.g.
910.IR /dev/md/scratch3 .
dd0781e5 911
48f7b27a
NB
912If the md device name is in a 'standard' format as described in DEVICE
913NAMES, then it will be created, if necessary, with the appropriate
e0fe762a
N
914device number based on that name. If the device name is not in one of these
915formats, then a unused device number will be allocated. The device
48f7b27a
NB
916number will be considered unused if there is no active array for that
917number, and there is no entry in /dev for that number and with a
e0fe762a 918non-standard name. Names that are not in 'standard' format are only
8fd8d9c4
N
919allowed in "/dev/md/".
920
3c7efacb
NK
921This is meaningful with
922.B \-\-create
923or
924.BR \-\-build .
925
f24e2d6c 926.ig XX
e0fe762a
N
927.\".TP
928.\".BR \-\-symlink = no
929.\"Normally when
930.\".B \-\-auto
931.\"causes
932.\".I mdadm
933.\"to create devices in
934.\".B /dev/md/
935.\"it will also create symlinks from
936.\".B /dev/
937.\"with names starting with
938.\".B md
939.\"or
940.\".BR md_ .
941.\"Use
942.\".B \-\-symlink=no
943.\"to suppress this, or
944.\".B \-\-symlink=yes
945.\"to enforce this even if it is suppressing
946.\".IR mdadm.conf .
947.\"
f24e2d6c 948.XX
38098016 949
3c7efacb
NK
950.TP
951.BR \-a ", " "\-\-add"
952This option can be used in Grow mode in two cases.
953
954If the target array is a Linear array, then
955.B \-\-add
956can be used to add one or more devices to the array. They
957are simply catenated on to the end of the array. Once added, the
958devices cannot be removed.
959
960If the
961.B \-\-raid\-disks
962option is being used to increase the number of devices in an array,
963then
964.B \-\-add
965can be used to add some extra devices to be included in the array.
966In most cases this is not needed as the extra devices can be added as
967spares first, and then the number of raid-disks can be changed.
968However for RAID0, it is not possible to add spares. So to increase
969the number of devices in a RAID0, it is necessary to set the new
970number of devices, and to add the new devices, in the same command.
971
52826846
NB
972.SH For assemble:
973
cd29a5c8 974.TP
7e23fc43 975.BR \-u ", " \-\-uuid=
e0fe762a 976uuid of array to assemble. Devices which don't have this uuid are
cd29a5c8
NB
977excluded
978
979.TP
7e23fc43 980.BR \-m ", " \-\-super\-minor=
cd29a5c8
NB
981Minor number of device that array was created for. Devices which
982don't have this minor number are excluded. If you create an array as
2d465520 983/dev/md1, then all superblocks will contain the minor number 1, even if
cd29a5c8
NB
984the array is later assembled as /dev/md2.
985
d013a55e 986Giving the literal word "dev" for
7e23fc43 987.B \-\-super\-minor
d013a55e
NB
988will cause
989.I mdadm
990to use the minor number of the md device that is being assembled.
991e.g. when assembling
992.BR /dev/md0 ,
51ac42e3 993.B \-\-super\-minor=dev
d013a55e
NB
994will look for super blocks with a minor number of 0.
995
e0fe762a
N
996.B \-\-super\-minor
997is only relevant for v0.90 metadata, and should not normally be used.
998Using
999.B \-\-uuid
1000is much safer.
1001
947fd4dd 1002.TP
7e23fc43 1003.BR \-N ", " \-\-name=
947fd4dd 1004Specify the name of the array to assemble. This must be the name
624920bb 1005that was specified when creating the array. It must either match
93e790af 1006the name stored in the superblock exactly, or it must match
41a3b72a 1007with the current
624920bb 1008.I homehost
93e790af 1009prefixed to the start of the given name.
947fd4dd 1010
cd29a5c8 1011.TP
7e23fc43 1012.BR \-f ", " \-\-force
e0fe762a
N
1013Assemble the array even if the metadata on some devices appears to be
1014out-of-date. If
1015.I mdadm
1016cannot find enough working devices to start the array, but can find
1017some devices that are recorded as having failed, then it will mark
1018those devices as working so that the array can be started.
1019An array which requires
1020.B \-\-force
1021to be started may contain data corruption. Use it carefully.
52826846 1022
cd29a5c8 1023.TP
7e23fc43 1024.BR \-R ", " \-\-run
b8a8ccf9
NB
1025Attempt to start the array even if fewer drives were given than were
1026present last time the array was active. Normally if not all the
1027expected drives are found and
7e23fc43 1028.B \-\-scan
cd29a5c8
NB
1029is not used, then the array will be assembled but not started.
1030With
7e23fc43 1031.B \-\-run
cd29a5c8 1032an attempt will be made to start it anyway.
52826846 1033
b8a8ccf9 1034.TP
7e23fc43 1035.B \-\-no\-degraded
b8a8ccf9 1036This is the reverse of
7e23fc43 1037.B \-\-run
93e790af 1038in that it inhibits the startup of array unless all expected drives
b8a8ccf9 1039are present. This is only needed with
93e790af
SW
1040.B \-\-scan,
1041and can be used if the physical connections to devices are
b8a8ccf9
NB
1042not as reliable as you would like.
1043
dd0781e5 1044.TP
7e23fc43 1045.BR \-a ", " "\-\-auto{=no,yes,md,mdp,part}"
dd0781e5
NB
1046See this option under Create and Build options.
1047
e793c2e5 1048.TP
7e23fc43 1049.BR \-b ", " \-\-bitmap=
2ae555c3
NB
1050Specify the bitmap file that was given when the array was created. If
1051an array has an
1052.B internal
1053bitmap, there is no need to specify this when assembling the array.
1054
1055.TP
7e23fc43 1056.BR \-\-backup\-file=
2ae555c3 1057If
7e23fc43 1058.B \-\-backup\-file
87f26d14
N
1059was used while reshaping an array (e.g. changing number of devices or
1060chunk size) and the system crashed during the critical section, then the same
7e23fc43 1061.B \-\-backup\-file
53e8b987 1062must be presented to
7e23fc43 1063.B \-\-assemble
cd19c0cf
JR
1064to allow possibly corrupted data to be restored, and the reshape
1065to be completed.
e793c2e5 1066
87f26d14
N
1067.TP
1068.BR \-\-invalid\-backup
1069If the file needed for the above option is not available for any
1070reason an empty file can be given together with this option to
1071indicate that the backup file is invalid. In this case the data that
1072was being rearranged at the time of the crash could be irrecoverably
1073lost, but the rest of the array may still be recoverable. This option
1074should only be used as a last resort if there is no way to recover the
1075backup file.
1076
1077
5787fa49 1078.TP
7e23fc43 1079.BR \-U ", " \-\-update=
5787fa49 1080Update the superblock on each device while assembling the array. The
feb716e9
NB
1081argument given to this flag can be one of
1082.BR sparc2.2 ,
1083.BR summaries ,
7d99579f 1084.BR uuid ,
c4f12c13 1085.BR name ,
0237e0ca 1086.BR homehost ,
e5329c37 1087.BR resync ,
586ed405 1088.BR byteorder ,
bee8ec56 1089.BR devicesize ,
5a31170d 1090.BR no\-bitmap ,
688e99a7
N
1091.BR bbl ,
1092.BR no-\bbl ,
5787fa49 1093or
7e23fc43 1094.BR super\-minor .
5787fa49
NB
1095
1096The
1097.B sparc2.2
7d99579f 1098option will adjust the superblock of an array what was created on a Sparc
5787fa49
NB
1099machine running a patched 2.2 Linux kernel. This kernel got the
1100alignment of part of the superblock wrong. You can use the
7e23fc43 1101.B "\-\-examine \-\-sparc2.2"
5787fa49
NB
1102option to
1103.I mdadm
1104to see what effect this would have.
1105
1106The
7e23fc43 1107.B super\-minor
5787fa49 1108option will update the
2ae555c3 1109.B "preferred minor"
5787fa49 1110field on each superblock to match the minor number of the array being
45c073c9
NB
1111assembled.
1112This can be useful if
7e23fc43 1113.B \-\-examine
45c073c9 1114reports a different "Preferred Minor" to
7e23fc43 1115.BR \-\-detail .
45c073c9 1116In some cases this update will be performed automatically
e0fe762a 1117by the kernel driver. In particular the update happens automatically
45c073c9
NB
1118at the first write to an array with redundancy (RAID level 1 or
1119greater) on a 2.6 (or later) kernel.
5787fa49 1120
7d99579f
NB
1121The
1122.B uuid
1123option will change the uuid of the array. If a UUID is given with the
7e23fc43 1124.B \-\-uuid
53e8b987 1125option that UUID will be used as a new UUID and will
7d99579f
NB
1126.B NOT
1127be used to help identify the devices in the array.
53e8b987 1128If no
7e23fc43 1129.B \-\-uuid
53e8b987 1130is given, a random UUID is chosen.
7d99579f 1131
c4f12c13
NB
1132The
1133.B name
1134option will change the
1135.I name
1136of the array as stored in the superblock. This is only supported for
1137version-1 superblocks.
1138
0237e0ca
NB
1139The
1140.B homehost
1141option will change the
1142.I homehost
1143as recorded in the superblock. For version-0 superblocks, this is the
1144same as updating the UUID.
1145For version-1 superblocks, this involves updating the name.
1146
e5329c37
NB
1147The
1148.B resync
1149option will cause the array to be marked
1150.I dirty
e0fe762a
N
1151meaning that any redundancy in the array (e.g. parity for RAID5,
1152copies for RAID1) may be incorrect. This will cause the RAID system
e5329c37
NB
1153to perform a "resync" pass to make sure that all redundant information
1154is correct.
1155
586ed405
NB
1156The
1157.B byteorder
1158option allows arrays to be moved between machines with different
1159byte-order.
2ae555c3 1160When assembling such an array for the first time after a move, giving
7e23fc43 1161.B "\-\-update=byteorder"
586ed405
NB
1162will cause
1163.I mdadm
1164to expect superblocks to have their byteorder reversed, and will
1165correct that order before assembling the array. This is only valid
2ae555c3 1166with original (Version 0.90) superblocks.
586ed405 1167
feb716e9
NB
1168The
1169.B summaries
e0fe762a 1170option will correct the summaries in the superblock. That is the
feb716e9 1171counts of total, working, active, failed, and spare devices.
5787fa49 1172
bee8ec56
NB
1173The
1174.B devicesize
5a31170d 1175option will rarely be of use. It applies to version 1.1 and 1.2 metadata
bee8ec56
NB
1176only (where the metadata is at the start of the device) and is only
1177useful when the component device has changed size (typically become
1178larger). The version 1 metadata records the amount of the device that
1179can be used to store data, so if a device in a version 1.1 or 1.2
1180array becomes larger, the metadata will still be visible, but the
1181extra space will not. In this case it might be useful to assemble the
1182array with
7e23fc43 1183.BR \-\-update=devicesize .
bee8ec56
NB
1184This will cause
1185.I mdadm
1186to determine the maximum usable amount of space on each device and
1187update the relevant field in the metadata.
1188
5a31170d
N
1189The
1190.B no\-bitmap
1191option can be used when an array has an internal bitmap which is
1192corrupt in some way so that assembling the array normally fails. It
1193will cause any internal bitmap to be ignored.
1194
688e99a7
N
1195The
1196.B bbl
1197option will reserve space in each device for a bad block list. This
1198will be 4K in size and positioned near the end of any free space
1199between the superblock and the data.
1200
1201The
1202.B no\-bbl
1203option will cause any reservation of space for a bad block list to be
1204removed. If the bad block list contains entries, this will fail, as
1205removing the list could cause data corruption.
1206
afd0a969
AK
1207.TP
1208.BR \-\-freeze\-reshape
1209Option is intended to be used in start-up scripts during initrd boot phase.
1210When array under reshape is assembled during initrd phase, this option
1211stops reshape after reshape critical section is being restored. This happens
1212before file system pivot operation and avoids loss of file system context.
1213Losing file system context would cause reshape to be broken.
1214
a6482415
N
1215Reshape can be continued later using the
1216.B \-\-continue
1217option for the grow command.
afd0a969 1218
e0d19036 1219.SH For Manage mode:
52826846 1220
3d5279b0
N
1221.TP
1222.BR \-t ", " \-\-test
1223Unless a more serious error occurred,
1224.I mdadm
1225will exit with a status of 2 if no changes were made to the array and
12260 if at least one change was made.
1227This can be useful when an indirect specifier such as
1228.BR missing ,
1229.B detached
1230or
1231.B faulty
1232is used in requesting an operation on the array.
1233.B \-\-test
1234will report failure if these specifiers didn't find any match.
1235
cd29a5c8 1236.TP
7e23fc43 1237.BR \-a ", " \-\-add
3d5279b0
N
1238hot-add listed devices.
1239If a device appears to have recently been part of the array
342460cb 1240(possibly it failed or was removed) the device is re\-added as described
3d5279b0
N
1241in the next point.
1242If that fails or the device was never part of the array, the device is
1243added as a hot-spare.
1244If the array is degraded, it will immediately start to rebuild data
1245onto that spare.
1246
1247Note that this and the following options are only meaningful on array
1248with redundancy. They don't apply to RAID0 or Linear.
52826846 1249
fe80f49b 1250.TP
7e23fc43 1251.BR \-\-re\-add
3d5279b0
N
1252re\-add a device that was previous removed from an array.
1253If the metadata on the device reports that it is a member of the
1254array, and the slot that it used is still vacant, then the device will
1255be added back to the array in the same position. This will normally
1256cause the data for that device to be recovered. However based on the
1257event count on the device, the recovery may only require sections that
1258are flagged a write-intent bitmap to be recovered or may not require
1259any recovery at all.
1260
1261When used on an array that has no metadata (i.e. it was built with
1262.BR \-\-build)
1263it will be assumed that bitmap-based recovery is enough to make the
1264device fully consistent with the array.
fe80f49b 1265
688e99a7 1266When used with v1.x metadata,
833bb0f8
N
1267.B \-\-re\-add
1268can be accompanied by
688e99a7
N
1269.BR \-\-update=devicesize ,
1270.BR \-\-update=bbl ", or"
1271.BR \-\-update=no\-bbl .
1272See the description of these option when used in Assemble mode for an
1273explanation of their use.
833bb0f8 1274
a4e13010
N
1275If the device name given is
1276.B missing
1277then mdadm will try to find any device that looks like it should be
1278part of the array but isn't and will try to re\-add all such devices.
1279
cd29a5c8 1280.TP
7e23fc43 1281.BR \-r ", " \-\-remove
2d465520 1282remove listed devices. They must not be active. i.e. they should
b80da661
NB
1283be failed or spare devices. As well as the name of a device file
1284(e.g.
1285.BR /dev/sda1 )
1286the words
1287.B failed
1288and
1289.B detached
1290can be given to
1291.BR \-\-remove .
1292The first causes all failed device to be removed. The second causes
93e790af 1293any device which is no longer connected to the system (i.e an 'open'
b80da661
NB
1294returns
1295.BR ENXIO )
1296to be removed. This will only succeed for devices that are spares or
1297have already been marked as failed.
52826846 1298
cd29a5c8 1299.TP
7e23fc43 1300.BR \-f ", " \-\-fail
cd29a5c8 1301mark listed devices as faulty.
b80da661
NB
1302As well as the name of a device file, the word
1303.B detached
1304can be given. This will cause any device that has been detached from
1305the system to be marked as failed. It can then be removed.
52826846 1306
cd29a5c8 1307.TP
7e23fc43 1308.BR \-\-set\-faulty
53e8b987 1309same as
7e23fc43 1310.BR \-\-fail .
52826846 1311
b3d31955
N
1312.TP
1313.BR \-\-write\-mostly
a4e13010 1314Subsequent devices that are added or re\-added will have the 'write-mostly'
e0fe762a 1315flag set. This is only valid for RAID1 and means that the 'md' driver
b3d31955
N
1316will avoid reading from these devices if possible.
1317.TP
1318.BR \-\-readwrite
a4e13010 1319Subsequent devices that are added or re\-added will have the 'write-mostly'
b3d31955
N
1320flag cleared.
1321
2ae555c3 1322.P
e0fe762a 1323Each of these options requires that the first device listed is the array
93e790af 1324to be acted upon, and the remainder are component devices to be added,
e0fe762a 1325removed, marked as faulty, etc. Several different operations can be
2ae555c3
NB
1326specified for different devices, e.g.
1327.in +5
7e23fc43 1328mdadm /dev/md0 \-\-add /dev/sda1 \-\-fail /dev/sdb1 \-\-remove /dev/sdb1
2ae555c3
NB
1329.in -5
1330Each operation applies to all devices listed until the next
93e790af 1331operation.
2ae555c3
NB
1332
1333If an array is using a write-intent bitmap, then devices which have
a4e13010 1334been removed can be re\-added in a way that avoids a full
93e790af 1335reconstruction but instead just updates the blocks that have changed
2ae555c3
NB
1336since the device was removed. For arrays with persistent metadata
1337(superblocks) this is done automatically. For arrays created with
7e23fc43 1338.B \-\-build
2ae555c3 1339mdadm needs to be told that this device we removed recently with
7e23fc43 1340.BR \-\-re\-add .
2ae555c3
NB
1341
1342Devices can only be removed from an array if they are not in active
93e790af
SW
1343use, i.e. that must be spares or failed devices. To remove an active
1344device, it must first be marked as
1345.B faulty.
2ae555c3
NB
1346
1347.SH For Misc mode:
1348
1349.TP
7e23fc43 1350.BR \-Q ", " \-\-query
2ae555c3
NB
1351Examine a device to see
1352(1) if it is an md device and (2) if it is a component of an md
1353array.
1354Information about what is discovered is presented.
1355
1356.TP
7e23fc43 1357.BR \-D ", " \-\-detail
e0fe762a 1358Print details of one or more md devices.
5787fa49 1359
4cce4069
DW
1360.TP
1361.BR \-\-detail\-platform
e0fe762a 1362Print details of the platform's RAID capabilities (firmware / hardware
9eafa1de
MN
1363topology) for a given metadata format. If used without argument, mdadm
1364will scan all controllers looking for their capabilities. Otherwise, mdadm
1365will only look at the controller specified by the argument in form of an
1366absolute filepath or a link, e.g.
1367.IR /sys/devices/pci0000:00/0000:00:1f.2 .
4cce4069 1368
54bad364
KS
1369.TP
1370.BR \-Y ", " \-\-export
1371When used with
e50cf220 1372.B \-\-detail , \-\-detail-platform
0d726f17
KS
1373or
1374.BR \-\-examine ,
54bad364
KS
1375output will be formatted as
1376.B key=value
1377pairs for easy import into the environment.
1378
2ae555c3 1379.TP
7e23fc43 1380.BR \-E ", " \-\-examine
e0fe762a
N
1381Print contents of the metadata stored on the named device(s).
1382Note the contrast between
1383.B \-\-examine
1384and
1385.BR \-\-detail .
1386.B \-\-examine
1387applies to devices which are components of an array, while
1388.B \-\-detail
1389applies to a whole array which is currently active.
5787fa49 1390.TP
7e23fc43 1391.B \-\-sparc2.2
e0fe762a
N
1392If an array was created on a SPARC machine with a 2.2 Linux kernel
1393patched with RAID support, the superblock will have been created
1394incorrectly, or at least incompatibly with 2.4 and later kernels.
1395Using the
7e23fc43 1396.B \-\-sparc2.2
5787fa49 1397flag with
7e23fc43 1398.B \-\-examine
5787fa49
NB
1399will fix the superblock before displaying it. If this appears to do
1400the right thing, then the array can be successfully assembled using
7e23fc43 1401.BR "\-\-assemble \-\-update=sparc2.2" .
5787fa49 1402
2ae555c3 1403.TP
7e23fc43 1404.BR \-X ", " \-\-examine\-bitmap
2ae555c3 1405Report information about a bitmap file.
01d9299c 1406The argument is either an external bitmap file or an array component
e0fe762a
N
1407in case of an internal bitmap. Note that running this on an array
1408device (e.g.
1409.BR /dev/md0 )
1410does not report the bitmap for that array.
e0d19036 1411
cd29a5c8 1412.TP
7e23fc43 1413.BR \-R ", " \-\-run
e0fe762a
N
1414start a partially assembled array. If
1415.B \-\-assemble
1416did not find enough devices to fully start the array, it might leaving
1417it partially assembled. If you wish, you can then use
1418.B \-\-run
1419to start the array in degraded mode.
52826846 1420
cd29a5c8 1421.TP
7e23fc43 1422.BR \-S ", " \-\-stop
cd29a5c8 1423deactivate array, releasing all resources.
52826846 1424
cd29a5c8 1425.TP
7e23fc43 1426.BR \-o ", " \-\-readonly
cd29a5c8 1427mark array as readonly.
52826846 1428
cd29a5c8 1429.TP
7e23fc43 1430.BR \-w ", " \-\-readwrite
cd29a5c8 1431mark array as readwrite.
52826846 1432
e0d19036 1433.TP
7e23fc43 1434.B \-\-zero\-superblock
e0d19036 1435If the device contains a valid md superblock, the block is
35cc5be4 1436overwritten with zeros. With
7e23fc43 1437.B \-\-force
35cc5be4 1438the block where the superblock would be is overwritten even if it
e0d19036 1439doesn't appear to be valid.
52826846 1440
33414a01
DW
1441.TP
1442.B \-\-kill\-subarray=
1443If the device is a container and the argument to \-\-kill\-subarray
1444specifies an inactive subarray in the container, then the subarray is
1445deleted. Deleting all subarrays will leave an 'empty-container' or
1446spare superblock on the drives. See \-\-zero\-superblock for completely
1447removing a superblock. Note that some formats depend on the subarray
1448index for generating a UUID, this command will fail if it would change
1449the UUID of an active subarray.
1450
aa534678
DW
1451.TP
1452.B \-\-update\-subarray=
1453If the device is a container and the argument to \-\-update\-subarray
1454specifies a subarray in the container, then attempt to update the given
1455superblock field in the subarray. See below in
1456.B MISC MODE
1457for details.
1458
feb716e9 1459.TP
7e23fc43 1460.BR \-t ", " \-\-test
feb716e9 1461When used with
7e23fc43 1462.BR \-\-detail ,
feb716e9
NB
1463the exit status of
1464.I mdadm
e0fe762a
N
1465is set to reflect the status of the device. See below in
1466.B MISC MODE
1467for details.
feb716e9 1468
b90c0e9a 1469.TP
7e23fc43 1470.BR \-W ", " \-\-wait
b90c0e9a
NB
1471For each md device given, wait for any resync, recovery, or reshape
1472activity to finish before returning.
1473.I mdadm
1474will return with success if it actually waited for every device
1475listed, otherwise it will return failure.
1476
1770662b
DW
1477.TP
1478.BR \-\-wait\-clean
fabbfd48
DW
1479For each md device given, or each device in /proc/mdstat if
1480.B \-\-scan
1481is given, arrange for the array to be marked clean as soon as possible.
7146ec6a
DW
1482.I mdadm
1483will return with success if the array uses external metadata and we
1484successfully waited. For native arrays this returns immediately as the
6a0ee6a0
DW
1485kernel handles dirty-clean transitions at shutdown. No action is taken
1486if safe-mode handling is disabled.
1770662b 1487
8382f19b
NB
1488.SH For Incremental Assembly mode:
1489.TP
7e23fc43 1490.BR \-\-rebuild\-map ", " \-r
8382f19b 1491Rebuild the map file
96fd06ed 1492.RB ( {MAP_PATH} )
8382f19b
NB
1493that
1494.I mdadm
1495uses to help track which arrays are currently being assembled.
1496
1497.TP
7e23fc43 1498.BR \-\-run ", " \-R
8382f19b
NB
1499Run any array assembled as soon as a minimal number of devices are
1500available, rather than waiting until all expected devices are present.
1501
1502.TP
7e23fc43 1503.BR \-\-scan ", " \-s
8382f19b 1504Only meaningful with
7e23fc43 1505.B \-R
8382f19b
NB
1506this will scan the
1507.B map
1508file for arrays that are being incrementally assembled and will try to
1509start any that are not already started. If any such array is listed
1510in
1511.B mdadm.conf
1512as requiring an external bitmap, that bitmap will be attached first.
1513
29ba4804
N
1514.TP
1515.BR \-\-fail ", " \-f
1516This allows the hot-plug system to remove devices that have fully disappeared
1517from the kernel. It will first fail and then remove the device from any
1518array it belongs to.
1519The device name given should be a kernel device name such as "sda",
1520not a name in
1521.IR /dev .
1522
210597d1
PC
1523.TP
1524.BR \-\-path=
87eb4fab
N
1525Only used with \-\-fail. The 'path' given will be recorded so that if
1526a new device appears at the same location it can be automatically
1527added to the same array. This allows the failed device to be
1528automatically replaced by a new device without metadata if it appears
1529at specified path. This option is normally only set by a
1530.I udev
1531script.
210597d1 1532
e0d19036
NB
1533.SH For Monitor mode:
1534.TP
7e23fc43 1535.BR \-m ", " \-\-mail
e0d19036
NB
1536Give a mail address to send alerts to.
1537
1538.TP
7e23fc43 1539.BR \-p ", " \-\-program ", " \-\-alert
e0d19036
NB
1540Give a program to be run whenever an event is detected.
1541
773135f5 1542.TP
7e23fc43 1543.BR \-y ", " \-\-syslog
773135f5
NB
1544Cause all events to be reported through 'syslog'. The messages have
1545facility of 'daemon' and varying priorities.
1546
e0d19036 1547.TP
7e23fc43 1548.BR \-d ", " \-\-delay
e0d19036 1549Give a delay in seconds.
51ac42e3 1550.I mdadm
e0d19036 1551polls the md arrays and then waits this many seconds before polling
e0fe762a
N
1552again. The default is 60 seconds. Since 2.6.16, there is no need to
1553reduce this as the kernel alerts
1554.I mdadm
1555immediately when there is any change.
e0d19036 1556
9a36a9b7
ZB
1557.TP
1558.BR \-r ", " \-\-increment
1559Give a percentage increment.
1560.I mdadm
1561will generate RebuildNN events with the given percentage increment.
1562
d013a55e 1563.TP
7e23fc43 1564.BR \-f ", " \-\-daemonise
d013a55e 1565Tell
51ac42e3 1566.I mdadm
d013a55e 1567to run as a background daemon if it decides to monitor anything. This
e0fe762a 1568causes it to fork and run in the child, and to disconnect from the
d013a55e
NB
1569terminal. The process id of the child is written to stdout.
1570This is useful with
7e23fc43 1571.B \-\-scan
d013a55e
NB
1572which will only continue monitoring if a mail address or alert program
1573is found in the config file.
1574
b5e64645 1575.TP
7e23fc43 1576.BR \-i ", " \-\-pid\-file
b5e64645 1577When
51ac42e3 1578.I mdadm
b5e64645
NB
1579is running in daemon mode, write the pid of the daemon process to
1580the specified file, instead of printing it on standard output.
1581
aa88f531 1582.TP
7e23fc43 1583.BR \-1 ", " \-\-oneshot
aa88f531
NB
1584Check arrays only once. This will generate
1585.B NewArray
1586events and more significantly
1587.B DegradedArray
a9d69660
NB
1588and
1589.B SparesMissing
aa88f531
NB
1590events. Running
1591.in +5
7e23fc43 1592.B " mdadm \-\-monitor \-\-scan \-1"
aa88f531
NB
1593.in -5
1594from a cron script will ensure regular notification of any degraded arrays.
1595
98c6faba 1596.TP
7e23fc43 1597.BR \-t ", " \-\-test
98c6faba
NB
1598Generate a
1599.B TestMessage
1600alert for every array found at startup. This alert gets mailed and
1601passed to the alert program. This can be used for testing that alert
a9d69660 1602message do get through successfully.
98c6faba 1603
210597d1
PC
1604.TP
1605.BR \-\-no\-sharing
87eb4fab 1606This inhibits the functionality for moving spares between arrays.
210597d1
PC
1607Only one monitoring process started with
1608.B \-\-scan
87eb4fab
N
1609but without this flag is allowed, otherwise the two could interfere
1610with each other.
210597d1 1611
e0d19036 1612.SH ASSEMBLE MODE
52826846 1613
cd29a5c8
NB
1614.HP 12
1615Usage:
7e23fc43 1616.B mdadm \-\-assemble
5787fa49
NB
1617.I md-device options-and-component-devices...
1618.HP 12
1619Usage:
7e23fc43 1620.B mdadm \-\-assemble \-\-scan
e0fe762a 1621.I md-devices-and-options...
cd29a5c8
NB
1622.HP 12
1623Usage:
7e23fc43 1624.B mdadm \-\-assemble \-\-scan
e0fe762a 1625.I options...
52826846 1626
cd29a5c8 1627.PP
e0fe762a 1628This usage assembles one or more RAID arrays from pre-existing components.
9a9dab36 1629For each array, mdadm needs to know the md device, the identity of the
e0fe762a 1630array, and a number of component-devices. These can be found in a number of ways.
52826846 1631
5787fa49 1632In the first usage example (without the
7e23fc43 1633.BR \-\-scan )
5787fa49
NB
1634the first device given is the md device.
1635In the second usage example, all devices listed are treated as md
1636devices and assembly is attempted.
1637In the third (where no devices are listed) all md devices that are
cb77f620 1638listed in the configuration file are assembled. If no arrays are
e0fe762a
N
1639described by the configuration file, then any arrays that
1640can be found on unused devices will be assembled.
52826846 1641
d013a55e 1642If precisely one device is listed, but
7e23fc43 1643.B \-\-scan
dd0781e5 1644is not given, then
d013a55e
NB
1645.I mdadm
1646acts as though
7e23fc43 1647.B \-\-scan
93e790af 1648was given and identity information is extracted from the configuration file.
d013a55e 1649
2ae555c3 1650The identity can be given with the
7e23fc43 1651.B \-\-uuid
e0fe762a
N
1652option, the
1653.B \-\-name
1654option, or the
7e23fc43 1655.B \-\-super\-minor
93e790af
SW
1656option, will be taken from the md-device record in the config file, or
1657will be taken from the super block of the first component-device
1658listed on the command line.
52826846 1659
2ae555c3 1660Devices can be given on the
7e23fc43 1661.B \-\-assemble
e0fe762a 1662command line or in the config file. Only devices which have an md
5787fa49
NB
1663superblock which contains the right identity will be considered for
1664any array.
52826846 1665
2ae555c3 1666The config file is only used if explicitly named with
7e23fc43 1667.B \-\-config
d013a55e 1668or requested with (a possibly implicit)
7e23fc43 1669.BR \-\-scan .
52826846 1670In the later case,
9a9dab36 1671.B /etc/mdadm.conf
8fd8d9c4
N
1672or
1673.B /etc/mdadm/mdadm.conf
52826846
NB
1674is used.
1675
2ae555c3 1676If
7e23fc43 1677.B \-\-scan
cd29a5c8
NB
1678is not given, then the config file will only be used to find the
1679identity of md arrays.
52826846 1680
2d465520 1681Normally the array will be started after it is assembled. However if
7e23fc43 1682.B \-\-scan
e0fe762a
N
1683is not given and not all expected drives were listed, then the array
1684is not started (to guard against usage errors). To insist that the
1685array be started in this case (as may work for RAID1, 4, 5, 6, or 10),
1686give the
7e23fc43 1687.B \-\-run
cd29a5c8 1688flag.
52826846 1689
e0fe762a
N
1690If
1691.I udev
1692is active,
1693.I mdadm
1694does not create any entries in
dd0781e5 1695.B /dev
e0fe762a
N
1696but leaves that to
1697.IR udev .
1698It does record information in
96fd06ed 1699.B {MAP_PATH}
e0fe762a
N
1700which will allow
1701.I udev
1702to choose the correct name.
dd0781e5 1703
e0fe762a
N
1704If
1705.I mdadm
1706detects that udev is not configured, it will create the devices in
1707.B /dev
1708itself.
dd0781e5 1709
e0fe762a
N
1710In Linux kernels prior to version 2.6.28 there were two distinctly
1711different types of md devices that could be created: one that could be
1712partitioned using standard partitioning tools and one that could not.
1713Since 2.6.28 that distinction is no longer relevant as both type of
1714devices can be partitioned.
1715.I mdadm
1716will normally create the type that originally could not be partitioned
1717as it has a well defined major number (9).
dd0781e5 1718
e0fe762a
N
1719Prior to 2.6.28, it is important that mdadm chooses the correct type
1720of array device to use. This can be controlled with the
1721.B \-\-auto
1722option. In particular, a value of "mdp" or "part" or "p" tells mdadm
1723to use a partitionable device rather than the default.
dd0781e5 1724
e0fe762a
N
1725In the no-udev case, the value given to
1726.B \-\-auto
1727can be suffixed by a number. This tells
1728.I mdadm
1729to create that number of partition devices rather than the default of 4.
dd0781e5 1730
e0fe762a 1731The value given to
7e23fc43 1732.B \-\-auto
e0fe762a
N
1733can also be given in the configuration file as a word starting
1734.B auto=
1735on the ARRAY line for the relevant array.
52826846 1736
41a3b72a
NB
1737.SS Auto Assembly
1738When
7e23fc43 1739.B \-\-assemble
41a3b72a 1740is used with
7e23fc43 1741.B \-\-scan
41a3b72a
NB
1742and no devices are listed,
1743.I mdadm
1744will first attempt to assemble all the arrays listed in the config
1745file.
1746
cb77f620 1747If no arrays are listed in the config (other than those marked
e0fe762a
N
1748.BR <ignore> )
1749it will look through the available devices for possible arrays and
1750will try to assemble anything that it finds. Arrays which are tagged
1751as belonging to the given homehost will be assembled and started
1752normally. Arrays which do not obviously belong to this host are given
1753names that are expected not to conflict with anything local, and are
1754started "read-auto" so that nothing is written to any device until the
1755array is written to. i.e. automatic resync etc is delayed.
41a3b72a
NB
1756
1757If
1758.I mdadm
1759finds a consistent set of devices that look like they should comprise
1760an array, and if the superblock is tagged as belonging to the given
1761home host, it will automatically choose a device name and try to
1762assemble the array. If the array uses version-0.90 metadata, then the
1763.B minor
1764number as recorded in the superblock is used to create a name in
1765.B /dev/md/
1766so for example
1767.BR /dev/md/3 .
1768If the array uses version-1 metadata, then the
1769.B name
1770from the superblock is used to similarly create a name in
e0fe762a 1771.B /dev/md/
93e790af 1772(the name will have any 'host' prefix stripped first).
41a3b72a 1773
c64ba03a
N
1774This behaviour can be modified by the
1775.I AUTO
1776line in the
1777.I mdadm.conf
1778configuration file. This line can indicate that specific metadata
1779type should, or should not, be automatically assembled. If an array
1780is found which is not listed in
1781.I mdadm.conf
1782and has a metadata format that is denied by the
1783.I AUTO
1784line, then it will not be assembled.
1785The
1786.I AUTO
1787line can also request that all arrays identified as being for this
1788homehost should be assembled regardless of their metadata type.
1789See
1790.IR mdadm.conf (5)
1791for further details.
1792
246cebdb
AK
1793Note: Auto assembly cannot be used for assembling and activating some
1794arrays which are undergoing reshape. In particular as the
1795.B backup\-file
1796cannot be given, any reshape which requires a backup-file to continue
1797cannot be started by auto assembly. An array which is growing to more
1798devices and has passed the critical section can be assembled using
1799auto-assembly.
41a3b72a 1800
cd29a5c8 1801.SH BUILD MODE
52826846 1802
cd29a5c8
NB
1803.HP 12
1804Usage:
7e23fc43 1805.B mdadm \-\-build
93e790af 1806.I md-device
7e23fc43
PS
1807.BI \-\-chunk= X
1808.BI \-\-level= Y
1809.BI \-\-raid\-devices= Z
cd29a5c8
NB
1810.I devices
1811
1812.PP
2ae555c3 1813This usage is similar to
7e23fc43 1814.BR \-\-create .
e0fe762a 1815The difference is that it creates an array without a superblock. With
cd29a5c8 1816these arrays there is no difference between initially creating the array and
52826846
NB
1817subsequently assembling the array, except that hopefully there is useful
1818data there in the second case.
1819
e0fe762a
N
1820The level may raid0, linear, raid1, raid10, multipath, or faulty, or
1821one of their synonyms. All devices must be listed and the array will
1822be started once complete. It will often be appropriate to use
1823.B \-\-assume\-clean
1824with levels raid1 or raid10.
cd29a5c8
NB
1825
1826.SH CREATE MODE
1827
1828.HP 12
1829Usage:
7e23fc43 1830.B mdadm \-\-create
93e790af 1831.I md-device
7e23fc43
PS
1832.BI \-\-chunk= X
1833.BI \-\-level= Y
cd29a5c8 1834.br
7e23fc43 1835.BI \-\-raid\-devices= Z
e0fe762a 1836.I devices
cd29a5c8
NB
1837
1838.PP
1839This usage will initialise a new md array, associate some devices with
1840it, and activate the array.
1841
e0fe762a
N
1842The named device will normally not exist when
1843.I "mdadm \-\-create"
1844is run, but will be created by
1845.I udev
1846once the array becomes active.
dd0781e5 1847
e0fe762a
N
1848As devices are added, they are checked to see if they contain RAID
1849superblocks or filesystems. They are also checked to see if the variance in
cd29a5c8
NB
1850device size exceeds 1%.
1851
1852If any discrepancy is found, the array will not automatically be run, though
2ae555c3 1853the presence of a
7e23fc43 1854.B \-\-run
cd29a5c8
NB
1855can override this caution.
1856
2d465520 1857To create a "degraded" array in which some devices are missing, simply
d013a55e 1858give the word "\fBmissing\fP"
2d465520 1859in place of a device name. This will cause
51ac42e3 1860.I mdadm
2d465520
NB
1861to leave the corresponding slot in the array empty.
1862For a RAID4 or RAID5 array at most one slot can be
98c6faba 1863"\fBmissing\fP"; for a RAID6 array at most two slots.
2d465520
NB
1864For a RAID1 array, only one real device needs to be given. All of the
1865others can be
d013a55e 1866"\fBmissing\fP".
2d465520 1867
feb716e9 1868When creating a RAID5 array,
51ac42e3 1869.I mdadm
feb716e9 1870will automatically create a degraded array with an extra spare drive.
e0fe762a
N
1871This is because building the spare into a degraded array is in general
1872faster than resyncing the parity on a non-degraded, but not clean,
1873array. This feature can be overridden with the
7e23fc43 1874.B \-\-force
feb716e9
NB
1875option.
1876
0ee4da98 1877When creating an array with version-1 metadata a name for the array is
41a3b72a
NB
1878required.
1879If this is not given with the
7e23fc43 1880.B \-\-name
41a3b72a
NB
1881option,
1882.I mdadm
0ee4da98 1883will choose a name based on the last component of the name of the
41a3b72a
NB
1884device being created. So if
1885.B /dev/md3
1886is being created, then the name
1887.B 3
1888will be chosen.
1889If
1890.B /dev/md/home
1891is being created, then the name
1892.B home
1893will be used.
1894
e0fe762a
N
1895When creating a partition based array, using
1896.I mdadm
1897with version-1.x metadata, the partition type should be set to
e0f31f50 1898.B 0xDA
e0fe762a 1899(non fs-data). This type selection allows for greater precision since
e0f31f50
PC
1900using any other [RAID auto-detect (0xFD) or a GNU/Linux partition (0x83)],
1901might create problems in the event of array recovery through a live cdrom.
1902
3d3dd91e
NB
1903A new array will normally get a randomly assigned 128bit UUID which is
1904very likely to be unique. If you have a specific need, you can choose
1905a UUID for the array by giving the
7e23fc43 1906.B \-\-uuid=
3d3dd91e
NB
1907option. Be warned that creating two arrays with the same UUID is a
1908recipe for disaster. Also, using
7e23fc43 1909.B \-\-uuid=
3d3dd91e 1910when creating a v0.90 array will silently override any
7e23fc43 1911.B \-\-homehost=
3d3dd91e 1912setting.
e43d0cda
NB
1913.\"If the
1914.\".B \-\-size
1915.\"option is given, it is not necessary to list any component-devices in this command.
1916.\"They can be added later, before a
1917.\".B \-\-run.
1918.\"If no
1919.\".B \-\-size
1920.\"is given, the apparent size of the smallest drive given is used.
cd29a5c8 1921
bf95d0f3
N
1922If the metadata type supports it (currently only 1.x metadata), space
1923will be allocated to store a bad block list. This allows a modest
1924number of bad blocks to be recorded, allowing the drive to remain in
1925service while only partially functional.
1926
8fd8d9c4
N
1927When creating an array within a
1928.B CONTAINER
1929.I mdadm
1930can be given either the list of devices to use, or simply the name of
1931the container. The former case gives control over which devices in
1932the container will be used for the array. The latter case allows
1933.I mdadm
1934to automatically choose which devices to use based on how much spare
1935space is available.
1936
53e8b987 1937The General Management options that are valid with
7e23fc43 1938.B \-\-create
53e8b987 1939are:
cd29a5c8 1940.TP
7e23fc43 1941.B \-\-run
dd0781e5 1942insist on running the array even if some devices look like they might
cd29a5c8
NB
1943be in use.
1944
1945.TP
7e23fc43 1946.B \-\-readonly
b3f1c093 1947start the array readonly \(em not supported yet.
52826846 1948
e0d19036 1949.SH MANAGE MODE
cd29a5c8
NB
1950.HP 12
1951Usage:
e0d19036
NB
1952.B mdadm
1953.I device
1954.I options... devices...
cd29a5c8
NB
1955.PP
1956
e0d19036
NB
1957This usage will allow individual devices in an array to be failed,
1958removed or added. It is possible to perform multiple operations with
e0fe762a 1959on command. For example:
e0d19036 1960.br
7e23fc43 1961.B " mdadm /dev/md0 \-f /dev/hda1 \-r /dev/hda1 \-a /dev/hda1"
e0d19036
NB
1962.br
1963will firstly mark
1964.B /dev/hda1
1965as faulty in
1966.B /dev/md0
1967and will then remove it from the array and finally add it back
2d465520 1968in as a spare. However only one md array can be affected by a single
2ae555c3 1969command.
e0d19036 1970
e0fe762a
N
1971When a device is added to an active array, mdadm checks to see if it
1972has metadata on it which suggests that it was recently a member of the
a4e13010 1973array. If it does, it tries to "re\-add" the device. If there have
e0fe762a
N
1974been no changes since the device was removed, or if the array has a
1975write-intent bitmap which has recorded whatever changes there were,
1976then the device will immediately become a full member of the array and
1977those differences recorded in the bitmap will be resolved.
1978
e0d19036
NB
1979.SH MISC MODE
1980.HP 12
1981Usage:
9a9dab36 1982.B mdadm
e0d19036 1983.I options ...
e0fe762a 1984.I devices ...
e0d19036 1985.PP
cd29a5c8 1986
b5e64645 1987MISC mode includes a number of distinct operations that
e0d19036
NB
1988operate on distinct devices. The operations are:
1989.TP
962a108f 1990.B \-\-query
e0d19036
NB
1991The device is examined to see if it is
1992(1) an active md array, or
1993(2) a component of an md array.
1994The information discovered is reported.
1995
1996.TP
962a108f 1997.B \-\-detail
2d465520 1998The device should be an active md device.
e0fe762a 1999.B mdadm
2d465520 2000will display a detailed description of the array.
7e23fc43 2001.B \-\-brief
2d465520 2002or
7e23fc43 2003.B \-\-scan
2d465520 2004will cause the output to be less detailed and the format to be
e0d19036 2005suitable for inclusion in
87eb4fab 2006.BR mdadm.conf .
feb716e9
NB
2007The exit status of
2008.I mdadm
2009will normally be 0 unless
2010.I mdadm
93e790af 2011failed to get useful information about the device(s); however, if the
7e23fc43 2012.B \-\-test
feb716e9
NB
2013option is given, then the exit status will be:
2014.RS
2015.TP
20160
2017The array is functioning normally.
2018.TP
20191
2020The array has at least one failed device.
2021.TP
20222
a77be586 2023The array has multiple failed devices such that it is unusable.
feb716e9
NB
2024.TP
20254
2026There was an error while trying to get information about the device.
2027.RE
cd29a5c8 2028
4cce4069
DW
2029.TP
2030.B \-\-detail\-platform
e0fe762a 2031Print detail of the platform's RAID capabilities (firmware / hardware
4cce4069
DW
2032topology). If the metadata is specified with
2033.B \-e
2034or
2035.B \-\-metadata=
2036then the return status will be:
2037.RS
2038.TP
20390
2040metadata successfully enumerated its platform components on this system
2041.TP
20421
2043metadata is platform independent
2044.TP
20452
2046metadata failed to find its platform components on this system
2047.RE
2048
aa534678
DW
2049.TP
2050.B \-\-update\-subarray=
2051If the device is a container and the argument to \-\-update\-subarray
2052specifies a subarray in the container, then attempt to update the given
2053superblock field in the subarray. Similar to updating an array in
2054"assemble" mode, the field to update is selected by
2055.B \-U
2056or
2057.B \-\-update=
2058option. Currently only
2059.B name
2060is supported.
2061
2062The
2063.B name
2064option updates the subarray name in the metadata, it may not affect the
2065device node name or the device node symlink until the subarray is
2066re\-assembled. If updating
2067.B name
2068would change the UUID of an active subarray this operation is blocked,
2069and the command will end in an error.
2070
e0d19036 2071.TP
962a108f 2072.B \-\-examine
2d465520 2073The device should be a component of an md array.
51ac42e3 2074.I mdadm
2d465520 2075will read the md superblock of the device and display the contents.
e0d19036 2076If
7e23fc43 2077.B \-\-brief
93e790af 2078or
7e23fc43 2079.B \-\-scan
93e790af 2080is given, then multiple devices that are components of the one array
e0d19036
NB
2081are grouped together and reported in a single entry suitable
2082for inclusion in
87eb4fab 2083.BR mdadm.conf .
e0d19036 2084
2d465520 2085Having
7e23fc43 2086.B \-\-scan
e0d19036
NB
2087without listing any devices will cause all devices listed in the
2088config file to be examined.
2089
2090.TP
962a108f 2091.B \-\-stop
98c6faba
NB
2092The devices should be active md arrays which will be deactivated, as
2093long as they are not currently in use.
e0d19036
NB
2094
2095.TP
962a108f 2096.B \-\-run
e0d19036
NB
2097This will fully activate a partially assembled md array.
2098
2099.TP
962a108f 2100.B \-\-readonly
e0d19036
NB
2101This will mark an active array as read-only, providing that it is
2102not currently being used.
2103
2104.TP
962a108f 2105.B \-\-readwrite
e0d19036
NB
2106This will change a
2107.B readonly
2108array back to being read/write.
2109
2d465520 2110.TP
962a108f 2111.B \-\-scan
2d465520 2112For all operations except
7e23fc43
PS
2113.BR \-\-examine ,
2114.B \-\-scan
2d465520
NB
2115will cause the operation to be applied to all arrays listed in
2116.BR /proc/mdstat .
2117For
7e23fc43
PS
2118.BR \-\-examine,
2119.B \-\-scan
2d465520
NB
2120causes all devices listed in the config file to be examined.
2121
a1331cc4
N
2122.TP
2123.BR \-b ", " \-\-brief
2124Be less verbose. This is used with
2125.B \-\-detail
2126and
2127.BR \-\-examine .
2128Using
2129.B \-\-brief
2130with
2131.B \-\-verbose
2132gives an intermediate level of verbosity.
2133
e0d19036
NB
2134.SH MONITOR MODE
2135
cd29a5c8
NB
2136.HP 12
2137Usage:
7e23fc43 2138.B mdadm \-\-monitor
e0d19036
NB
2139.I options... devices...
2140
cd29a5c8 2141.PP
e0d19036 2142This usage causes
51ac42e3 2143.I mdadm
e0d19036
NB
2144to periodically poll a number of md arrays and to report on any events
2145noticed.
51ac42e3 2146.I mdadm
e0d19036
NB
2147will never exit once it decides that there are arrays to be checked,
2148so it should normally be run in the background.
2149
2d465520 2150As well as reporting events,
51ac42e3 2151.I mdadm
2d465520
NB
2152may move a spare drive from one array to another if they are in the
2153same
2154.B spare-group
210597d1
PC
2155or
2156.B domain
a9d69660 2157and if the destination array has a failed drive but no spares.
2d465520 2158
e0d19036 2159If any devices are listed on the command line,
51ac42e3 2160.I mdadm
e0fe762a 2161will only monitor those devices. Otherwise all arrays listed in the
e0d19036 2162configuration file will be monitored. Further, if
7e23fc43 2163.B \-\-scan
e0d19036
NB
2164is given, then any other md devices that appear in
2165.B /proc/mdstat
2166will also be monitored.
2167
2168The result of monitoring the arrays is the generation of events.
bd526cee 2169These events are passed to a separate program (if specified) and may
2d465520 2170be mailed to a given E-mail address.
e0d19036 2171
93e790af
SW
2172When passing events to a program, the program is run once for each event,
2173and is given 2 or 3 command-line arguments: the first is the
2174name of the event (see below), the second is the name of the
bd526cee 2175md device which is affected, and the third is the name of a related
93e790af 2176device if relevant (such as a component device that has failed).
cd29a5c8
NB
2177
2178If
7e23fc43 2179.B \-\-scan
e0d19036
NB
2180is given, then a program or an E-mail address must be specified on the
2181command line or in the config file. If neither are available, then
51ac42e3 2182.I mdadm
e0d19036
NB
2183will not monitor anything.
2184Without
93e790af 2185.B \-\-scan,
51ac42e3 2186.I mdadm
2d465520 2187will continue monitoring as long as something was found to monitor. If
e0d19036
NB
2188no program or email is given, then each event is reported to
2189.BR stdout .
cd29a5c8 2190
e0d19036
NB
2191The different events are:
2192
2193.RS 4
2194.TP
2195.B DeviceDisappeared
2d465520 2196An md array which previously was configured appears to no longer be
773135f5 2197configured. (syslog priority: Critical)
e0d19036 2198
b8f72a62
NB
2199If
2200.I mdadm
2201was told to monitor an array which is RAID0 or Linear, then it will
2202report
2203.B DeviceDisappeared
2204with the extra information
2205.BR Wrong-Level .
2206This is because RAID0 and Linear do not support the device-failed,
2207hot-spare and resync operations which are monitored.
2208
e0d19036
NB
2209.TP
2210.B RebuildStarted
773135f5 2211An md array started reconstruction. (syslog priority: Warning)
e0d19036
NB
2212
2213.TP
2214.BI Rebuild NN
2215Where
2216.I NN
9a36a9b7
ZB
2217is a two-digit number (ie. 05, 48). This indicates that rebuild
2218has passed that many percent of the total. The events are generated
2219with fixed increment since 0. Increment size may be specified with
2220a commandline option (default is 20). (syslog priority: Warning)
e0d19036 2221
98c6faba
NB
2222.TP
2223.B RebuildFinished
2224An md array that was rebuilding, isn't any more, either because it
773135f5 2225finished normally or was aborted. (syslog priority: Warning)
98c6faba 2226
e0d19036
NB
2227.TP
2228.B Fail
773135f5
NB
2229An active component device of an array has been marked as
2230faulty. (syslog priority: Critical)
e0d19036
NB
2231
2232.TP
2233.B FailSpare
2234A spare component device which was being rebuilt to replace a faulty
93e790af 2235device has failed. (syslog priority: Critical)
e0d19036
NB
2236
2237.TP
2238.B SpareActive
2239A spare component device which was being rebuilt to replace a faulty
98b24a2a 2240device has been successfully rebuilt and has been made active.
773135f5 2241(syslog priority: Info)
e0d19036
NB
2242
2243.TP
2244.B NewArray
2245A new md array has been detected in the
2246.B /proc/mdstat
e0fe762a 2247file. (syslog priority: Info)
e0d19036 2248
aa88f531
NB
2249.TP
2250.B DegradedArray
2251A newly noticed array appears to be degraded. This message is not
2252generated when
2253.I mdadm
2254notices a drive failure which causes degradation, but only when
2255.I mdadm
2256notices that an array is degraded when it first sees the array.
93e790af 2257(syslog priority: Critical)
aa88f531 2258
e0d19036
NB
2259.TP
2260.B MoveSpare
2261A spare drive has been moved from one array in a
2262.B spare-group
210597d1
PC
2263or
2264.B domain
e0d19036 2265to another to allow a failed drive to be replaced.
773135f5 2266(syslog priority: Info)
e0d19036 2267
b8f72a62
NB
2268.TP
2269.B SparesMissing
2270If
2271.I mdadm
2272has been told, via the config file, that an array should have a certain
2273number of spare devices, and
2274.I mdadm
93e790af 2275detects that it has fewer than this number when it first sees the
b8f72a62
NB
2276array, it will report a
2277.B SparesMissing
2278message.
d1732eeb 2279(syslog priority: Warning)
b8f72a62 2280
98c6faba
NB
2281.TP
2282.B TestMessage
2283An array was found at startup, and the
7e23fc43 2284.B \-\-test
98c6faba 2285flag was given.
773135f5 2286(syslog priority: Info)
e0d19036
NB
2287.RE
2288
2289Only
93e790af
SW
2290.B Fail,
2291.B FailSpare,
2292.B DegradedArray,
2293.B SparesMissing
e0d19036 2294and
98c6faba 2295.B TestMessage
e0d19036 2296cause Email to be sent. All events cause the program to be run.
93e790af 2297The program is run with two or three arguments: the event
e0d19036
NB
2298name, the array device and possibly a second device.
2299
2300Each event has an associated array device (e.g.
2301.BR /dev/md1 )
2302and possibly a second device. For
2303.BR Fail ,
2304.BR FailSpare ,
2305and
2306.B SpareActive
2307the second device is the relevant component device.
2308For
2309.B MoveSpare
2310the second device is the array that the spare was moved from.
2311
2312For
51ac42e3 2313.I mdadm
e0d19036 2314to move spares from one array to another, the different arrays need to
93e790af 2315be labeled with the same
e0d19036 2316.B spare-group
210597d1 2317or the spares must be allowed to migrate through matching POLICY domains
e0d19036
NB
2318in the configuration file. The
2319.B spare-group
93e790af 2320name can be any string; it is only necessary that different spare
2d465520 2321groups use different names.
e0d19036
NB
2322
2323When
51ac42e3 2324.I mdadm
93e790af 2325detects that an array in a spare group has fewer active
e0d19036
NB
2326devices than necessary for the complete array, and has no spare
2327devices, it will look for another array in the same spare group that
2328has a full complement of working drive and a spare. It will then
2329attempt to remove the spare from the second drive and add it to the
2330first.
2331If the removal succeeds but the adding fails, then it is added back to
2332the original array.
2333
210597d1
PC
2334If the spare group for a degraded array is not defined,
2335.I mdadm
2336will look at the rules of spare migration specified by POLICY lines in
87eb4fab 2337.B mdadm.conf
210597d1
PC
2338and then follow similar steps as above if a matching spare is found.
2339
dd0781e5
NB
2340.SH GROW MODE
2341The GROW mode is used for changing the size or shape of an active
2342array.
2343For this to work, the kernel must support the necessary change.
c64881d7 2344Various types of growth are being added during 2.6 development.
dd0781e5 2345
c64881d7 2346Currently the supported changes include
dfd4d8ee 2347.IP \(bu 4
c64881d7 2348change the "size" attribute for RAID1, RAID4, RAID5 and RAID6.
dfd4d8ee 2349.IP \(bu 4
c64881d7
N
2350increase or decrease the "raid\-devices" attribute of RAID0, RAID1, RAID4,
2351RAID5, and RAID6.
cb77f620 2352.IP \(bu 4
c64881d7 2353change the chunk-size and layout of RAID0, RAID4, RAID5 and RAID6.
cb77f620 2354.IP \(bu 4
c64881d7 2355convert between RAID1 and RAID5, between RAID5 and RAID6, between
cb77f620 2356RAID0, RAID4, and RAID5, and between RAID0 and RAID10 (in the near-2 mode).
dfd4d8ee 2357.IP \(bu 4
93e790af 2358add a write-intent bitmap to any array which supports these bitmaps, or
2ae555c3 2359remove a write-intent bitmap from such an array.
dfd4d8ee 2360.PP
dd0781e5 2361
9ab6e80a 2362Using GROW on containers is currently supported only for Intel's IMSM
c64881d7
N
2363container format. The number of devices in a container can be
2364increased - which affects all arrays in the container - or an array
2365in a container can be converted between levels where those levels are
2366supported by the container, and the conversion is on of those listed
9ab6e80a
N
2367above. Resizing arrays in an IMSM container with
2368.B "--grow --size"
2369is not yet supported.
8fd8d9c4 2370
ca24ddb0
AK
2371Grow functionality (e.g. expand a number of raid devices) for Intel's
2372IMSM container format has an experimental status. It is guarded by the
2373.B MDADM_EXPERIMENTAL
2374environment variable which must be set to '1' for a GROW command to
2375succeed.
2376This is for the following reasons:
2377
2378.IP 1.
0de8d44d
AK
2379Intel's native IMSM check-pointing is not fully tested yet.
2380This can causes IMSM incompatibility during the grow process: an array
ca24ddb0
AK
2381which is growing cannot roam between Microsoft Windows(R) and Linux
2382systems.
2383
2384.IP 2.
2385Interrupting a grow operation is not recommended, because it
2386has not been fully tested for Intel's IMSM container format yet.
2387
0de8d44d
AK
2388.PP
2389Note: Intel's native checkpointing doesn't use
2390.B --backup-file
2391option and it is transparent for assembly feature.
2392
2ae555c3 2393.SS SIZE CHANGES
c64881d7 2394Normally when an array is built the "size" is taken from the smallest
dd0781e5
NB
2395of the drives. If all the small drives in an arrays are, one at a
2396time, removed and replaced with larger drives, then you could have an
2397array of large drives with only a small amount used. In this
2398situation, changing the "size" with "GROW" mode will allow the extra
2399space to start being used. If the size is increased in this way, a
2400"resync" process will start to make sure the new parts of the array
2401are synchronised.
2402
2403Note that when an array changes size, any filesystem that may be
cb77f620 2404stored in the array will not automatically grow or shrink to use or
88b496c2 2405vacate the space. The
666bba9b
N
2406filesystem will need to be explicitly told to use the extra space
2407after growing, or to reduce its size
2408.B prior
2409to shrinking the array.
dd0781e5 2410
e0fe762a
N
2411Also the size of an array cannot be changed while it has an active
2412bitmap. If an array has a bitmap, it must be removed before the size
cb77f620 2413can be changed. Once the change is complete a new bitmap can be created.
e0fe762a
N
2414
2415.SS RAID\-DEVICES CHANGES
2ae555c3 2416
dd0781e5
NB
2417A RAID1 array can work with any number of devices from 1 upwards
2418(though 1 is not very useful). There may be times which you want to
2419increase or decrease the number of active devices. Note that this is
2420different to hot-add or hot-remove which changes the number of
2421inactive devices.
2422
2423When reducing the number of devices in a RAID1 array, the slots which
2424are to be removed from the array must already be vacant. That is, the
93e790af 2425devices which were in those slots must be failed and removed.
dd0781e5
NB
2426
2427When the number of devices is increased, any hot spares that are
a9d69660 2428present will be activated immediately.
dd0781e5 2429
f24e2d6c 2430Changing the number of active devices in a RAID5 or RAID6 is much more
2ae555c3 2431effort. Every block in the array will need to be read and written
f24e2d6c 2432back to a new location. From 2.6.17, the Linux Kernel is able to
ca4f89a3
N
2433increase the number of devices in a RAID5 safely, including restarting
2434an interrupted "reshape". From 2.6.31, the Linux Kernel is able to
f24e2d6c
N
2435increase or decrease the number of devices in a RAID5 or RAID6.
2436
c64881d7
N
2437From 2.6.35, the Linux Kernel is able to convert a RAID0 in to a RAID4
2438or RAID5.
2439.I mdadm
2440uses this functionality and the ability to add
2441devices to a RAID4 to allow devices to be added to a RAID0. When
2442requested to do this,
2443.I mdadm
2444will convert the RAID0 to a RAID4, add the necessary disks and make
2445the reshape happen, and then convert the RAID4 back to RAID0.
2446
f24e2d6c
N
2447When decreasing the number of devices, the size of the array will also
2448decrease. If there was data in the array, it could get destroyed and
666bba9b
N
2449this is not reversible, so you should firstly shrink the filesystem on
2450the array to fit within the new size. To help prevent accidents,
f24e2d6c
N
2451.I mdadm
2452requires that the size of the array be decreased first with
2453.BR "mdadm --grow --array-size" .
2454This is a reversible change which simply makes the end of the array
2455inaccessible. The integrity of any data can then be checked before
2456the non-reversible reduction in the number of devices is request.
2ae555c3 2457
cd19c0cf
JR
2458When relocating the first few stripes on a RAID5 or RAID6, it is not
2459possible to keep the data on disk completely consistent and
2460crash-proof. To provide the required safety, mdadm disables writes to
2461the array while this "critical section" is reshaped, and takes a
2462backup of the data that is in that section. For grows, this backup may be
2463stored in any spare devices that the array has, however it can also be
2464stored in a separate file specified with the
7e23fc43 2465.B \-\-backup\-file
cd19c0cf
JR
2466option, and is required to be specified for shrinks, RAID level
2467changes and layout changes. If this option is used, and the system
2468does crash during the critical period, the same file must be passed to
7e23fc43 2469.B \-\-assemble
cd19c0cf
JR
2470to restore the backup and reassemble the array. When shrinking rather
2471than growing the array, the reshape is done from the end towards the
2472beginning, so the "critical section" is at the end of the reshape.
2ae555c3 2473
f24e2d6c
N
2474.SS LEVEL CHANGES
2475
2476Changing the RAID level of any array happens instantaneously. However
cd19c0cf 2477in the RAID5 to RAID6 case this requires a non-standard layout of the
f24e2d6c 2478RAID6 data, and in the RAID6 to RAID5 case that non-standard layout is
cd19c0cf 2479required before the change can be accomplished. So while the level
f24e2d6c 2480change is instant, the accompanying layout change can take quite a
cd19c0cf
JR
2481long time. A
2482.B \-\-backup\-file
2483is required. If the array is not simultaneously being grown or
2484shrunk, so that the array size will remain the same - for example,
2485reshaping a 3-drive RAID5 into a 4-drive RAID6 - the backup file will
2486be used not just for a "cricital section" but throughout the reshape
2487operation, as described below under LAYOUT CHANGES.
f24e2d6c
N
2488
2489.SS CHUNK-SIZE AND LAYOUT CHANGES
2490
2491Changing the chunk-size of layout without also changing the number of
2492devices as the same time will involve re-writing all blocks in-place.
2493To ensure against data loss in the case of a crash, a
2494.B --backup-file
2495must be provided for these changes. Small sections of the array will
cd19c0cf
JR
2496be copied to the backup file while they are being rearranged. This
2497means that all the data is copied twice, once to the backup and once
2498to the new layout on the array, so this type of reshape will go very
2499slowly.
f24e2d6c
N
2500
2501If the reshape is interrupted for any reason, this backup file must be
cd19c0cf 2502made available to
f24e2d6c
N
2503.B "mdadm --assemble"
2504so the array can be reassembled. Consequently the file cannot be
2505stored on the device being reshaped.
2506
2507
2ae555c3
NB
2508.SS BITMAP CHANGES
2509
2510A write-intent bitmap can be added to, or removed from, an active
93e790af 2511array. Either internal bitmaps, or bitmaps stored in a separate file,
fe80f49b 2512can be added. Note that if you add a bitmap stored in a file which is
e0fe762a 2513in a filesystem that is on the RAID array being affected, the system
fe80f49b
NB
2514will deadlock. The bitmap must be on a separate filesystem.
2515
8382f19b
NB
2516.SH INCREMENTAL MODE
2517
2518.HP 12
2519Usage:
7e23fc43
PS
2520.B mdadm \-\-incremental
2521.RB [ \-\-run ]
2522.RB [ \-\-quiet ]
8382f19b
NB
2523.I component-device
2524.HP 12
2525Usage:
29ba4804
N
2526.B mdadm \-\-incremental \-\-fail
2527.I component-device
2528.HP 12
2529Usage:
7e6140e6 2530.B mdadm \-\-incremental \-\-rebuild\-map
8382f19b
NB
2531.HP 12
2532Usage:
7e23fc43 2533.B mdadm \-\-incremental \-\-run \-\-scan
8382f19b 2534
8382f19b
NB
2535.PP
2536This mode is designed to be used in conjunction with a device
2537discovery system. As devices are found in a system, they can be
2538passed to
7e23fc43 2539.B "mdadm \-\-incremental"
8382f19b
NB
2540to be conditionally added to an appropriate array.
2541
29ba4804
N
2542Conversely, it can also be used with the
2543.B \-\-fail
2544flag to do just the opposite and find whatever array a particular device
2545is part of and remove the device from that array.
2546
8fd8d9c4
N
2547If the device passed is a
2548.B CONTAINER
2549device created by a previous call to
2550.IR mdadm ,
2551then rather than trying to add that device to an array, all the arrays
2552described by the metadata of the container will be started.
2553
8382f19b
NB
2554.I mdadm
2555performs a number of tests to determine if the device is part of an
93e790af 2556array, and which array it should be part of. If an appropriate array
8382f19b
NB
2557is found, or can be created,
2558.I mdadm
2559adds the device to the array and conditionally starts the array.
2560
2561Note that
2562.I mdadm
87eb4fab
N
2563will normally only add devices to an array which were previously working
2564(active or spare) parts of that array. The support for automatic
210597d1
PC
2565inclusion of a new drive as a spare in some array requires
2566a configuration through POLICY in config file.
8382f19b 2567
8382f19b
NB
2568The tests that
2569.I mdadm
2570makes are as follow:
2571.IP +
2572Is the device permitted by
2573.BR mdadm.conf ?
2574That is, is it listed in a
2575.B DEVICES
2576line in that file. If
2577.B DEVICES
2578is absent then the default it to allow any device. Similar if
2579.B DEVICES
2580contains the special word
2581.B partitions
2582then any device is allowed. Otherwise the device name given to
2583.I mdadm
2584must match one of the names or patterns in a
2585.B DEVICES
2586line.
2587
2588.IP +
cb77f620
NK
2589Does the device have a valid md superblock? If a specific metadata
2590version is requested with
7e23fc43 2591.B \-\-metadata
8382f19b 2592or
7e23fc43 2593.B \-e
8382f19b
NB
2594then only that style of metadata is accepted, otherwise
2595.I mdadm
2596finds any known version of metadata. If no
2597.I md
210597d1
PC
2598metadata is found, the device may be still added to an array
2599as a spare if POLICY allows.
8382f19b 2600
d1302dd8 2601.ig
8382f19b
NB
2602.IP +
2603Does the metadata match an expected array?
2604The metadata can match in two ways. Either there is an array listed
2605in
2606.B mdadm.conf
2607which identifies the array (either by UUID, by name, by device list,
93e790af 2608or by minor-number), or the array was created with a
8382f19b 2609.B homehost
93e790af 2610specified and that
8382f19b 2611.B homehost
93e790af 2612matches the one in
8382f19b
NB
2613.B mdadm.conf
2614or on the command line.
2615If
2616.I mdadm
2617is not able to positively identify the array as belonging to the
2618current host, the device will be rejected.
d1302dd8 2619..
8382f19b 2620
cb77f620 2621.PP
8382f19b 2622.I mdadm
93e790af 2623keeps a list of arrays that it has partially assembled in
96fd06ed 2624.BR {MAP_PATH} .
e0fe762a 2625If no array exists which matches
8382f19b
NB
2626the metadata on the new device,
2627.I mdadm
2628must choose a device name and unit number. It does this based on any
2629name given in
2630.B mdadm.conf
2631or any name information stored in the metadata. If this name
2632suggests a unit number, that number will be used, otherwise a free
2633unit number will be chosen. Normally
2634.I mdadm
2635will prefer to create a partitionable array, however if the
2636.B CREATE
2637line in
2638.B mdadm.conf
2639suggests that a non-partitionable array is preferred, that will be
2640honoured.
2641
e0fe762a
N
2642If the array is not found in the config file and its metadata does not
2643identify it as belonging to the "homehost", then
2644.I mdadm
2645will choose a name for the array which is certain not to conflict with
2646any array which does belong to this host. It does this be adding an
2647underscore and a small number to the name preferred by the metadata.
2648
8382f19b
NB
2649Once an appropriate array is found or created and the device is added,
2650.I mdadm
2651must decide if the array is ready to be started. It will
2652normally compare the number of available (non-spare) devices to the
2653number of devices that the metadata suggests need to be active. If
2654there are at least that many, the array will be started. This means
2655that if any devices are missing the array will not be restarted.
2656
2657As an alternative,
7e23fc43 2658.B \-\-run
8382f19b 2659may be passed to
51ac42e3 2660.I mdadm
8382f19b 2661in which case the array will be run as soon as there are enough
e0fe762a
N
2662devices present for the data to be accessible. For a RAID1, that
2663means one device will start the array. For a clean RAID5, the array
8382f19b
NB
2664will be started as soon as all but one drive is present.
2665
93e790af 2666Note that neither of these approaches is really ideal. If it can
8382f19b
NB
2667be known that all device discovery has completed, then
2668.br
7e23fc43 2669.B " mdadm \-IRs"
8382f19b
NB
2670.br
2671can be run which will try to start all arrays that are being
2672incrementally assembled. They are started in "read-auto" mode in
2673which they are read-only until the first write request. This means
2674that no metadata updates are made and no attempt at resync or recovery
2675happens. Further devices that are found before the first write can
2676still be added safely.
2677
5545fa6d
DW
2678.SH ENVIRONMENT
2679This section describes environment variables that affect how mdadm
2680operates.
2681
2682.TP
2683.B MDADM_NO_MDMON
2684Setting this value to 1 will prevent mdadm from automatically launching
2685mdmon. This variable is intended primarily for debugging mdadm/mdmon.
2686
8fd8d9c4
N
2687.TP
2688.B MDADM_NO_UDEV
2689Normally,
2690.I mdadm
2691does not create any device nodes in /dev, but leaves that task to
2692.IR udev .
2693If
2694.I udev
2695appears not to be configured, or if this environment variable is set
2696to '1', the
2697.I mdadm
2698will create and devices that are needed.
2699
2d465520
NB
2700.SH EXAMPLES
2701
7e23fc43 2702.B " mdadm \-\-query /dev/name-of-device"
2d465520 2703.br
e0fe762a 2704This will find out if a given device is a RAID array, or is part of
5787fa49 2705one, and will provide brief information about the device.
2d465520 2706
7e23fc43 2707.B " mdadm \-\-assemble \-\-scan"
2d465520 2708.br
93e790af 2709This will assemble and start all arrays listed in the standard config
5787fa49 2710file. This command will typically go in a system startup file.
2d465520 2711
7e23fc43 2712.B " mdadm \-\-stop \-\-scan"
5787fa49 2713.br
93e790af 2714This will shut down all arrays that can be shut down (i.e. are not
19f8b8fc 2715currently in use). This will typically go in a system shutdown script.
2d465520 2716
7e23fc43 2717.B " mdadm \-\-follow \-\-scan \-\-delay=120"
2d465520 2718.br
5787fa49
NB
2719If (and only if) there is an Email address or program given in the
2720standard config file, then
2721monitor the status of all arrays listed in that file by
2722polling them ever 2 minutes.
2d465520 2723
7e23fc43 2724.B " mdadm \-\-create /dev/md0 \-\-level=1 \-\-raid\-devices=2 /dev/hd[ac]1"
2d465520 2725.br
5787fa49 2726Create /dev/md0 as a RAID1 array consisting of /dev/hda1 and /dev/hdc1.
2d465520 2727
2d465520 2728.br
7e23fc43 2729.B " echo 'DEVICE /dev/hd*[0\-9] /dev/sd*[0\-9]' > mdadm.conf"
2d465520 2730.br
7e23fc43 2731.B " mdadm \-\-detail \-\-scan >> mdadm.conf"
2d465520 2732.br
5787fa49
NB
2733This will create a prototype config file that describes currently
2734active arrays that are known to be made from partitions of IDE or SCSI drives.
2d465520
NB
2735This file should be reviewed before being used as it may
2736contain unwanted detail.
2737
7e23fc43 2738.B " echo 'DEVICE /dev/hd[a\-z] /dev/sd*[a\-z]' > mdadm.conf"
2d465520 2739.br
7e23fc43 2740.B " mdadm \-\-examine \-\-scan \-\-config=mdadm.conf >> mdadm.conf"
93e790af
SW
2741.br
2742This will find arrays which could be assembled from existing IDE and
2743SCSI whole drives (not partitions), and store the information in the
5787fa49 2744format of a config file.
2d465520
NB
2745This file is very likely to contain unwanted detail, particularly
2746the
2747.B devices=
5787fa49
NB
2748entries. It should be reviewed and edited before being used as an
2749actual config file.
2d465520 2750
7e23fc43 2751.B " mdadm \-\-examine \-\-brief \-\-scan \-\-config=partitions"
2d465520 2752.br
7e23fc43 2753.B " mdadm \-Ebsc partitions"
5787fa49
NB
2754.br
2755Create a list of devices by reading
2756.BR /proc/partitions ,
2757scan these for RAID superblocks, and printout a brief listing of all
93e790af 2758that were found.
2d465520 2759
7e23fc43 2760.B " mdadm \-Ac partitions \-m 0 /dev/md0"
2d465520 2761.br
5787fa49
NB
2762Scan all partitions and devices listed in
2763.BR /proc/partitions
2764and assemble
2765.B /dev/md0
2766out of all such devices with a RAID superblock with a minor number of 0.
2d465520 2767
96fd06ed 2768.B " mdadm \-\-monitor \-\-scan \-\-daemonise > /run/mdadm/mon.pid"
d013a55e
NB
2769.br
2770If config file contains a mail address or alert program, run mdadm in
2771the background in monitor mode monitoring all md devices. Also write
2772pid of mdadm daemon to
96fd06ed 2773.BR /run/mdadm/mon.pid .
d013a55e 2774
7e23fc43 2775.B " mdadm \-Iq /dev/somedevice"
8382f19b
NB
2776.br
2777Try to incorporate newly discovered device into some array as
2778appropriate.
2779
7e6140e6 2780.B " mdadm \-\-incremental \-\-rebuild\-map \-\-run \-\-scan"
8382f19b
NB
2781.br
2782Rebuild the array map from any current arrays, and then start any that
2783can be started.
2784
b80da661
NB
2785.B " mdadm /dev/md4 --fail detached --remove detached"
2786.br
2787Any devices which are components of /dev/md4 will be marked as faulty
2788and then remove from the array.
2789
cb77f620 2790.B " mdadm --grow /dev/md4 --level=6 --backup-file=/root/backup-md4"
f24e2d6c
N
2791.br
2792The array
2793.B /dev/md4
2794which is currently a RAID5 array will be converted to RAID6. There
2795should normally already be a spare drive attached to the array as a
2796RAID6 needs one more drive than a matching RAID5.
2797
8fd8d9c4
N
2798.B " mdadm --create /dev/md/ddf --metadata=ddf --raid-disks 6 /dev/sd[a-f]"
2799.br
2800Create a DDF array over 6 devices.
2801
2802.B " mdadm --create /dev/md/home -n3 -l5 -z 30000000 /dev/md/ddf"
2803.br
e0fe762a 2804Create a RAID5 array over any 3 devices in the given DDF set. Use
8fd8d9c4
N
2805only 30 gigabytes of each device.
2806
2807.B " mdadm -A /dev/md/ddf1 /dev/sd[a-f]"
2808.br
2809Assemble a pre-exist ddf array.
2810
2811.B " mdadm -I /dev/md/ddf1"
2812.br
2813Assemble all arrays contained in the ddf array, assigning names as
2814appropriate.
2815
7e23fc43 2816.B " mdadm \-\-create \-\-help"
2d465520 2817.br
2ae555c3 2818Provide help about the Create mode.
2d465520 2819
7e23fc43 2820.B " mdadm \-\-config \-\-help"
5787fa49
NB
2821.br
2822Provide help about the format of the config file.
2d465520 2823
7e23fc43 2824.B " mdadm \-\-help"
5787fa49
NB
2825.br
2826Provide general help.
cd29a5c8 2827
cd29a5c8
NB
2828.SH FILES
2829
2830.SS /proc/mdstat
2831
2ae555c3
NB
2832If you're using the
2833.B /proc
cd29a5c8
NB
2834filesystem,
2835.B /proc/mdstat
2d465520 2836lists all active md devices with information about them.
51ac42e3 2837.I mdadm
2d465520 2838uses this to find arrays when
7e23fc43 2839.B \-\-scan
2d465520
NB
2840is given in Misc mode, and to monitor array reconstruction
2841on Monitor mode.
2842
9a9dab36 2843.SS /etc/mdadm.conf
cd29a5c8 2844
11a3e71d
NB
2845The config file lists which devices may be scanned to see if
2846they contain MD super block, and gives identifying information
2847(e.g. UUID) about known MD arrays. See
2848.BR mdadm.conf (5)
2849for more details.
cd29a5c8 2850
96fd06ed 2851.SS {MAP_PATH}
8382f19b 2852When
7e23fc43 2853.B \-\-incremental
93e790af 2854mode is used, this file gets a list of arrays currently being created.
8382f19b 2855
48f7b27a
NB
2856.SH DEVICE NAMES
2857
48f7b27a 2858.I mdadm
8fd8d9c4
N
2859understand two sorts of names for array devices.
2860
2861The first is the so-called 'standard' format name, which matches the
2862names used by the kernel and which appear in
2863.IR /proc/mdstat .
2864
2865The second sort can be freely chosen, but must reside in
2866.IR /dev/md/ .
2867When giving a device name to
2868.I mdadm
2869to create or assemble an array, either full path name such as
2870.I /dev/md0
2871or
2872.I /dev/md/home
2873can be given, or just the suffix of the second sort of name, such as
2874.I home
2875can be given.
2876
2877When
2878.I mdadm
e0fe762a
N
2879chooses device names during auto-assembly or incremental assembly, it
2880will sometimes add a small sequence number to the end of the name to
2881avoid conflicted between multiple arrays that have the same name. If
8fd8d9c4
N
2882.I mdadm
2883can reasonably determine that the array really is meant for this host,
2884either by a hostname in the metadata, or by the presence of the array
87eb4fab
N
2885in
2886.BR mdadm.conf ,
2887then it will leave off the suffix if possible.
e0fe762a
N
2888Also if the homehost is specified as
2889.B <ignore>
2890.I mdadm
2891will only use a suffix if a different array of the same name already
2892exists or is listed in the config file.
48f7b27a
NB
2893
2894The standard names for non-partitioned arrays (the only sort of md
8fd8d9c4 2895array available in 2.4 and earlier) are of the form
48f7b27a
NB
2896.IP
2897/dev/mdNN
48f7b27a
NB
2898.PP
2899where NN is a number.
2900The standard names for partitionable arrays (as available from 2.6
8fd8d9c4 2901onwards) are of the form
48f7b27a 2902.IP
48f7b27a
NB
2903/dev/md_dNN
2904.PP
2905Partition numbers should be indicated by added "pMM" to these, thus "/dev/md/d1p2".
8fd8d9c4
N
2906.PP
2907From kernel version, 2.6.28 the "non-partitioned array" can actually
2908be partitioned. So the "md_dNN" names are no longer needed, and
2909partitions such as "/dev/mdNNpXX" are possible.
52826846 2910
2d465520 2911.SH NOTE
51ac42e3 2912.I mdadm
2d465520 2913was previously known as
51ac42e3 2914.IR mdctl .
a9d69660 2915.P
51ac42e3 2916.I mdadm
a9d69660 2917is completely separate from the
51ac42e3 2918.I raidtools
a9d69660
NB
2919package, and does not use the
2920.I /etc/raidtab
2921configuration file at all.
2922
52826846 2923.SH SEE ALSO
75f74377 2924For further information on mdadm usage, MD and the various levels of
3cdfb6a7 2925RAID, see:
3cdfb6a7 2926.IP
cb77f620 2927.B http://raid.wiki.kernel.org/
75f74377
DG
2928.PP
2929(based upon Jakob \(/Ostergaard's Software\-RAID.HOWTO)
e43d0cda
NB
2930.\".PP
2931.\"for new releases of the RAID driver check out:
2932.\"
2933.\".IP
e0fe762a 2934.\".UR ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
e43d0cda
NB
2935.\"ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
2936.\".UE
2937.\".PP
2938.\"or
2939.\".IP
2940.\".UR http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2941.\"http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2942.\".UE
cd29a5c8 2943.PP
2ae555c3 2944The latest version of
a9d69660
NB
2945.I mdadm
2946should always be available from
cd29a5c8 2947.IP
11cd8b79
N
2948.B http://www.kernel.org/pub/linux/utils/raid/mdadm/
2949.PP
2950Related man pages:
cd29a5c8 2951.PP
e0fe762a 2952.IR mdmon (8),
a9d69660
NB
2953.IR mdadm.conf (5),
2954.IR md (4).
56eb10c0 2955.PP
52826846
NB
2956.IR raidtab (5),
2957.IR raid0run (8),
2958.IR raidstop (8),
a9d69660 2959.IR mkraid (8).