]> git.ipfire.org Git - thirdparty/mdadm.git/blame - mdadm.8.in
Fix "--remove faulty" and similar commands.
[thirdparty/mdadm.git] / mdadm.8.in
CommitLineData
52826846 1.\" -*- nroff -*-
e43d0cda
NB
2.\" Copyright Neil Brown and others.
3.\" This program is free software; you can redistribute it and/or modify
4.\" it under the terms of the GNU General Public License as published by
5.\" the Free Software Foundation; either version 2 of the License, or
6.\" (at your option) any later version.
7.\" See file COPYING in distribution for details.
3b2aad6e 8.TH MDADM 8 "" v3.2.5
52826846 9.SH NAME
9a9dab36 10mdadm \- manage MD devices
cd29a5c8 11.I aka
93e790af 12Linux Software RAID
cd29a5c8 13
52826846
NB
14.SH SYNOPSIS
15
e0d19036 16.BI mdadm " [mode] <raiddevice> [options] <component-devices>"
52826846 17
2ae555c3 18.SH DESCRIPTION
52826846 19RAID devices are virtual devices created from two or more
e0fe762a 20real block devices. This allows multiple devices (typically disk
35cc5be4 21drives or partitions thereof) to be combined into a single device to
cd29a5c8 22hold (for example) a single filesystem.
2d465520 23Some RAID levels include redundancy and so can survive some degree of
cd29a5c8
NB
24device failure.
25
2d465520
NB
26Linux Software RAID devices are implemented through the md (Multiple
27Devices) device driver.
cd29a5c8
NB
28
29Currently, Linux supports
30.B LINEAR
31md devices,
32.B RAID0
33(striping),
34.B RAID1
35(mirroring),
d013a55e
NB
36.BR RAID4 ,
37.BR RAID5 ,
98c6faba 38.BR RAID6 ,
1a7dfc35 39.BR RAID10 ,
b5e64645 40.BR MULTIPATH ,
90c8d668 41.BR FAULTY ,
cd29a5c8 42and
90c8d668 43.BR CONTAINER .
d013a55e 44
a9d69660
NB
45.B MULTIPATH
46is not a Software RAID mechanism, but does involve
93e790af 47multiple devices:
d013a55e 48each device is a path to one common physical storage device.
9652457e
N
49New installations should not use md/multipath as it is not well
50supported and has no ongoing development. Use the Device Mapper based
51multipath-tools instead.
d013a55e 52
a9d69660
NB
53.B FAULTY
54is also not true RAID, and it only involves one device. It
b5e64645 55provides a layer over a true device that can be used to inject faults.
52826846 56
4cce4069 57.B CONTAINER
8fd8d9c4
N
58is different again. A
59.B CONTAINER
60is a collection of devices that are
90c8d668
N
61managed as a set. This is similar to the set of devices connected to
62a hardware RAID controller. The set of devices may contain a number
9652457e 63of different RAID arrays each utilising some (or all) of the blocks from a
90c8d668 64number of the devices in the set. For example, two devices in a 5-device set
9652457e 65might form a RAID1 using the whole devices. The remaining three might
90c8d668
N
66have a RAID5 over the first half of each device, and a RAID0 over the
67second half.
68
8fd8d9c4
N
69With a
70.BR CONTAINER ,
71there is one set of metadata that describes all of
72the arrays in the container. So when
73.I mdadm
74creates a
75.B CONTAINER
9652457e
N
76device, the device just represents the metadata. Other normal arrays (RAID1
77etc) can be created inside the container.
52826846
NB
78
79.SH MODES
8382f19b 80mdadm has several major modes of operation:
cd29a5c8
NB
81.TP
82.B Assemble
93e790af 83Assemble the components of a previously created
e0fe762a 84array into an active array. Components can be explicitly given
2ae555c3 85or can be searched for.
51ac42e3 86.I mdadm
cd29a5c8
NB
87checks that the components
88do form a bona fide array, and can, on request, fiddle superblock
89information so as to assemble a faulty array.
90
91.TP
92.B Build
e0fe762a 93Build an array that doesn't have per-device metadata (superblocks). For these
a9d69660
NB
94sorts of arrays,
95.I mdadm
96cannot differentiate between initial creation and subsequent assembly
97of an array. It also cannot perform any checks that appropriate
93e790af 98components have been requested. Because of this, the
a9d69660
NB
99.B Build
100mode should only be used together with a complete understanding of
101what you are doing.
cd29a5c8
NB
102
103.TP
104.B Create
e0fe762a
N
105Create a new array with per-device metadata (superblocks).
106Appropriate metadata is written to each device, and then the array
107comprising those devices is activated. A 'resync' process is started
108to make sure that the array is consistent (e.g. both sides of a mirror
109contain the same data) but the content of the device is left otherwise
110untouched.
111The array can be used as soon as it has been created. There is no
112need to wait for the initial resync to finish.
cd29a5c8 113
cd29a5c8
NB
114.TP
115.B "Follow or Monitor"
5787fa49 116Monitor one or more md devices and act on any state changes. This is
e0fe762a
N
117only meaningful for RAID1, 4, 5, 6, 10 or multipath arrays, as
118only these have interesting state. RAID0 or Linear never have
98c6faba 119missing, spare, or failed drives, so there is nothing to monitor.
5787fa49 120
dd0781e5
NB
121.TP
122.B "Grow"
123Grow (or shrink) an array, or otherwise reshape it in some way.
124Currently supported growth options including changing the active size
c64881d7
N
125of component devices and changing the number of active devices in
126Linear and RAID levels 0/1/4/5/6,
127changing the RAID level between 0, 1, 5, and 6, and between 0 and 10,
128changing the chunk size and layout for RAID 0,4,5,6, as well as adding or
f24e2d6c 129removing a write-intent bitmap.
cd29a5c8 130
8382f19b
NB
131.TP
132.B "Incremental Assembly"
133Add a single device to an appropriate array. If the addition of the
134device makes the array runnable, the array will be started.
135This provides a convenient interface to a
136.I hot-plug
137system. As each device is detected,
138.I mdadm
139has a chance to include it in some array as appropriate.
29ba4804
N
140Optionally, when the
141.I \-\-fail
142flag is passed in we will remove the device from any active array
143instead of adding it.
9652457e 144
8fd8d9c4
N
145If a
146.B CONTAINER
147is passed to
148.I mdadm
149in this mode, then any arrays within that container will be assembled
150and started.
8382f19b 151
2ae555c3
NB
152.TP
153.B Manage
154This is for doing things to specific components of an array such as
155adding new spares and removing faulty devices.
156
157.TP
158.B Misc
159This is an 'everything else' mode that supports operations on active
160arrays, operations on component devices such as erasing old superblocks, and
161information gathering operations.
e43d0cda
NB
162.\"This mode allows operations on independent devices such as examine MD
163.\"superblocks, erasing old superblocks and stopping active arrays.
2ae555c3 164
1f48664b
NB
165.TP
166.B Auto-detect
167This mode does not act on a specific device or array, but rather it
168requests the Linux Kernel to activate any auto-detected arrays.
52826846
NB
169.SH OPTIONS
170
2ae555c3 171.SH Options for selecting a mode are:
52826846 172
cd29a5c8 173.TP
7e23fc43 174.BR \-A ", " \-\-assemble
2d465520 175Assemble a pre-existing array.
52826846 176
cd29a5c8 177.TP
7e23fc43 178.BR \-B ", " \-\-build
cd29a5c8 179Build a legacy array without superblocks.
52826846 180
cd29a5c8 181.TP
7e23fc43 182.BR \-C ", " \-\-create
cd29a5c8 183Create a new array.
52826846 184
cd29a5c8 185.TP
7e23fc43 186.BR \-F ", " \-\-follow ", " \-\-monitor
cd29a5c8
NB
187Select
188.B Monitor
189mode.
52826846 190
dd0781e5 191.TP
7e23fc43 192.BR \-G ", " \-\-grow
dd0781e5 193Change the size or shape of an active array.
8382f19b
NB
194
195.TP
1f48664b 196.BR \-I ", " \-\-incremental
29ba4804 197Add/remove a single device to/from an appropriate array, and possibly start the array.
8382f19b 198
1f48664b
NB
199.TP
200.B \-\-auto-detect
201Request that the kernel starts any auto-detected arrays. This can only
202work if
203.I md
204is compiled into the kernel \(em not if it is a module.
205Arrays can be auto-detected by the kernel if all the components are in
206primary MS-DOS partitions with partition type
e0fe762a
N
207.BR FD ,
208and all use v0.90 metadata.
1f48664b
NB
209In-kernel autodetect is not recommended for new installations. Using
210.I mdadm
211to detect and assemble arrays \(em possibly in an
212.I initrd
213\(em is substantially more flexible and should be preferred.
214
2ae555c3
NB
215.P
216If a device is given before any options, or if the first option is
7e23fc43
PS
217.BR \-\-add ,
218.BR \-\-fail ,
7e23fc43 219.BR \-\-remove ,
70c55e36
N
220or
221.BR \-\-replace ,
e0fe762a 222then the MANAGE mode is assumed.
2ae555c3
NB
223Anything other than these will cause the
224.B Misc
225mode to be assumed.
dd0781e5 226
2ae555c3 227.SH Options that are not mode-specific are:
e793c2e5 228
cd29a5c8 229.TP
7e23fc43 230.BR \-h ", " \-\-help
a9d69660 231Display general help message or, after one of the above options, a
93e790af 232mode-specific help message.
56eedc1a
NB
233
234.TP
7e23fc43 235.B \-\-help\-options
56eedc1a
NB
236Display more detailed help about command line parsing and some commonly
237used options.
52826846 238
cd29a5c8 239.TP
7e23fc43 240.BR \-V ", " \-\-version
9a9dab36 241Print version information for mdadm.
52826846 242
cd29a5c8 243.TP
7e23fc43 244.BR \-v ", " \-\-verbose
22892d56
NB
245Be more verbose about what is happening. This can be used twice to be
246extra-verbose.
a9d69660 247The extra verbosity currently only affects
7e23fc43 248.B \-\-detail \-\-scan
22892d56 249and
7e23fc43 250.BR "\-\-examine \-\-scan" .
52826846 251
dab6685f 252.TP
7e23fc43 253.BR \-q ", " \-\-quiet
dab6685f 254Avoid printing purely informative messages. With this,
51ac42e3 255.I mdadm
dab6685f
NB
256will be silent unless there is something really important to report.
257
08ca2adf
JS
258.TP
259.BR \-\-offroot
260Set first character of argv[0] to @ to indicate mdadm was launched
261from initrd/initramfs and should not be shutdown by systemd as part of
262the regular shutdown process. This option is normally only used by
263the system's initscripts. Please see here for more details on how
264systemd handled argv[0]:
265.IP
266.B http://www.freedesktop.org/wiki/Software/systemd/RootStorageDaemons
267.PP
268
269
e0d19036 270.TP
7e23fc43 271.BR \-f ", " \-\-force
93e790af 272Be more forceful about certain operations. See the various modes for
e0d19036
NB
273the exact meaning of this option in different contexts.
274
275.TP
7e23fc43 276.BR \-c ", " \-\-config=
2ae555c3
NB
277Specify the config file. Default is to use
278.BR /etc/mdadm.conf ,
93e790af 279or if that is missing then
2ae555c3 280.BR /etc/mdadm/mdadm.conf .
5787fa49 281If the config file given is
93e790af 282.B "partitions"
5787fa49
NB
283then nothing will be read, but
284.I mdadm
285will act as though the config file contained exactly
8fd8d9c4 286.B "DEVICE partitions containers"
5787fa49
NB
287and will read
288.B /proc/partitions
8fd8d9c4
N
289to find a list of devices to scan, and
290.B /proc/mdstat
291to find a list of containers to examine.
d013a55e 292If the word
93e790af 293.B "none"
d013a55e
NB
294is given for the config file, then
295.I mdadm
296will act as though the config file were empty.
e0d19036
NB
297
298.TP
7e23fc43 299.BR \-s ", " \-\-scan
93e790af 300Scan config file or
e0d19036
NB
301.B /proc/mdstat
302for missing information.
303In general, this option gives
51ac42e3 304.I mdadm
93e790af
SW
305permission to get any missing information (like component devices,
306array devices, array identities, and alert destination) from the
307configuration file (see previous option);
308one exception is MISC mode when using
7e23fc43 309.B \-\-detail
e0d19036 310or
93e790af 311.B \-\-stop,
e0d19036 312in which case
7e23fc43 313.B \-\-scan
e0d19036
NB
314says to get a list of array devices from
315.BR /proc/mdstat .
316
570c0542 317.TP
d16c7af6 318.BR \-e ", " \-\-metadata=
e0fe762a 319Declare the style of RAID metadata (superblock) to be used. The
26f467a9 320default is {DEFAULT_METADATA} for
7e23fc43 321.BR \-\-create ,
53e8b987 322and to guess for other operations.
2790ffe3
GB
323The default can be overridden by setting the
324.B metadata
325value for the
326.B CREATE
327keyword in
328.BR mdadm.conf .
570c0542
NB
329
330Options are:
331.RS
26f467a9 332.ie '{DEFAULT_METADATA}'0.90'
333.IP "0, 0.90, default"
334.el
7d5c3964 335.IP "0, 0.90"
570c0542 336Use the original 0.90 format superblock. This format limits arrays to
93e790af 33728 component devices and limits component devices of levels 1 and
cd19c0cf
JR
338greater to 2 terabytes. It is also possible for there to be confusion
339about whether the superblock applies to a whole device or just the
340last partition, if that partition starts on a 64K boundary.
26f467a9 341.ie '{DEFAULT_METADATA}'0.90'
342.IP "1, 1.0, 1.1, 1.2"
343.el
7d5c3964 344.IP "1, 1.0, 1.1, 1.2 default"
cd19c0cf
JR
345Use the new version-1 format superblock. This has fewer restrictions.
346It can easily be moved between hosts with different endian-ness, and a
347recovery operation can be checkpointed and restarted. The different
348sub-versions store the superblock at different locations on the
349device, either at the end (for 1.0), at the start (for 1.1) or 4K from
7050aa3f
N
350the start (for 1.2). "1" is equivalent to "1.2" (the commonly
351preferred 1.x format).
26f467a9 352'if '{DEFAULT_METADATA}'1.2' "default" is equivalent to "1.2".
8fd8d9c4 353.IP ddf
e0fe762a
N
354Use the "Industry Standard" DDF (Disk Data Format) format defined by
355SNIA.
356When creating a DDF array a
8fd8d9c4
N
357.B CONTAINER
358will be created, and normal arrays can be created in that container.
359.IP imsm
4cce4069 360Use the Intel(R) Matrix Storage Manager metadata format. This creates a
8fd8d9c4 361.B CONTAINER
4cce4069
DW
362which is managed in a similar manner to DDF, and is supported by an
363option-rom on some platforms:
364.IP
365.B http://www.intel.com/design/chipsets/matrixstorage_sb.htm
366.PP
570c0542
NB
367.RE
368
41a3b72a 369.TP
7e23fc43 370.B \-\-homehost=
35cc5be4 371This will override any
41a3b72a 372.B HOMEHOST
93e790af 373setting in the config file and provides the identity of the host which
41a3b72a
NB
374should be considered the home for any arrays.
375
376When creating an array, the
377.B homehost
e0fe762a 378will be recorded in the metadata. For version-1 superblocks, it will
93e790af 379be prefixed to the array name. For version-0.90 superblocks, part of
41a3b72a
NB
380the SHA1 hash of the hostname will be stored in the later half of the
381UUID.
382
383When reporting information about an array, any array which is tagged
384for the given homehost will be reported as such.
385
386When using Auto-Assemble, only arrays tagged for the given homehost
0ac91628 387will be allowed to use 'local' names (i.e. not ending in '_' followed
e0fe762a
N
388by a digit string). See below under
389.BR "Auto Assembly" .
41a3b72a 390
c2ecf5f6
N
391.TP
392.B \-\-prefer=
393When
394.I mdadm
395needs to print the name for a device it normally finds the name in
396.B /dev
397which refers to the device and is shortest. When a path component is
398given with
399.B \-\-prefer
400.I mdadm
401will prefer a longer name if it contains that component. For example
402.B \-\-prefer=by-uuid
403will prefer a name in a subdirectory of
404.B /dev
405called
406.BR by-uuid .
407
408This functionality is currently only provided by
409.B \-\-detail
410and
411.BR \-\-monitor .
412
2ae555c3
NB
413.SH For create, build, or grow:
414
415.TP
7e23fc43 416.BR \-n ", " \-\-raid\-devices=
2ae555c3
NB
417Specify the number of active devices in the array. This, plus the
418number of spare devices (see below) must equal the number of
419.I component-devices
420(including "\fBmissing\fP" devices)
421that are listed on the command line for
e0fe762a 422.BR \-\-create .
2ae555c3
NB
423Setting a value of 1 is probably
424a mistake and so requires that
7e23fc43 425.B \-\-force
2ae555c3 426be specified first. A value of 1 will then be allowed for linear,
e0fe762a 427multipath, RAID0 and RAID1. It is never allowed for RAID4, RAID5 or RAID6.
2ae555c3
NB
428.br
429This number can only be changed using
7e23fc43 430.B \-\-grow
e0fe762a
N
431for RAID1, RAID4, RAID5 and RAID6 arrays, and only on kernels which provide
432the necessary support.
2ae555c3
NB
433
434.TP
7e23fc43 435.BR \-x ", " \-\-spare\-devices=
2ae555c3
NB
436Specify the number of spare (eXtra) devices in the initial array.
437Spares can also be added
438and removed later. The number of component devices listed
e0fe762a 439on the command line must equal the number of RAID devices plus the
2ae555c3
NB
440number of spare devices.
441
2ae555c3 442.TP
7e23fc43 443.BR \-z ", " \-\-size=
e0fe762a 444Amount (in Kibibytes) of space to use from each drive in RAID levels 1/4/5/6.
2ae555c3
NB
445This must be a multiple of the chunk size, and must leave about 128Kb
446of space at the end of the drive for the RAID superblock.
447If this is not specified
448(as it normally is not) the smallest drive (or partition) sets the
449size, though if there is a variance among the drives of greater than 1%, a warning is
450issued.
451
36fad8ec
N
452A suffix of 'M' or 'G' can be given to indicate Megabytes or
453Gigabytes respectively.
454
9ab6e80a
N
455Sometimes a replacement drive can be a little smaller than the
456original drives though this should be minimised by IDEMA standards.
457Such a replacement drive will be rejected by
458.IR md .
459To guard against this it can be useful to set the initial size
460slightly smaller than the smaller device with the aim that it will
461still be larger than any replacement.
462
2ae555c3 463This value can be set with
7e23fc43 464.B \-\-grow
9ab6e80a
N
465for RAID level 1/4/5/6 though
466.B CONTAINER
467based arrays such as those with IMSM metadata may not be able to
468support this.
469If the array was created with a size smaller than the currently
470active drives, the extra space can be accessed using
7e23fc43 471.BR \-\-grow .
2ae555c3
NB
472The size can be given as
473.B max
474which means to choose the largest size that fits on all current drives.
52826846 475
c26d78fe
N
476Before reducing the size of the array (with
477.BR "\-\-grow \-\-size=" )
478you should make sure that space isn't needed. If the device holds a
479filesystem, you would need to resize the filesystem to use less space.
480
481After reducing the array size you should check that the data stored in
482the device is still available. If the device holds a filesystem, then
483an 'fsck' of the filesystem is a minimum requirement. If there are
484problems the array can be made bigger again with no loss with another
485.B "\-\-grow \-\-size="
486command.
487
9ab6e80a 488This value cannot be used when creating a
8fd8d9c4 489.B CONTAINER
9ab6e80a
N
490such as with DDF and IMSM metadata, though it perfectly valid when
491creating an array inside a container.
8fd8d9c4 492
f24e2d6c 493.TP
c26d78fe 494.BR \-Z ", " \-\-array\-size=
f24e2d6c
N
495This is only meaningful with
496.B \-\-grow
36fad8ec 497and its effect is not persistent: when the array is stopped and
f24e2d6c
N
498restarted the default array size will be restored.
499
500Setting the array-size causes the array to appear smaller to programs
501that access the data. This is particularly needed before reshaping an
502array so that it will be smaller. As the reshape is not reversible,
503but setting the size with
504.B \-\-array-size
505is, it is required that the array size is reduced as appropriate
506before the number of devices in the array is reduced.
507
c26d78fe
N
508Before reducing the size of the array you should make sure that space
509isn't needed. If the device holds a filesystem, you would need to
510resize the filesystem to use less space.
511
512After reducing the array size you should check that the data stored in
513the device is still available. If the device holds a filesystem, then
514an 'fsck' of the filesystem is a minimum requirement. If there are
515problems the array can be made bigger again with no loss with another
516.B "\-\-grow \-\-array\-size="
517command.
518
36fad8ec
N
519A suffix of 'M' or 'G' can be given to indicate Megabytes or
520Gigabytes respectively.
521A value of
522.B max
523restores the apparent size of the array to be whatever the real
524amount of available space is.
525
cd29a5c8 526.TP
7e23fc43 527.BR \-c ", " \-\-chunk=
5f175898
N
528Specify chunk size of kibibytes. The default when creating an
529array is 512KB. To ensure compatibility with earlier versions, the
530default when Building and array with no persistent metadata is 64KB.
e0fe762a 531This is only meaningful for RAID0, RAID4, RAID5, RAID6, and RAID10.
52826846 532
a252c078
N
533RAID4, RAID5, RAID6, and RAID10 require the chunk size to be a power
534of 2. In any case it must be a multiple of 4KB.
535
36fad8ec
N
536A suffix of 'M' or 'G' can be given to indicate Megabytes or
537Gigabytes respectively.
538
cd29a5c8 539.TP
7e23fc43 540.BR \-\-rounding=
e0fe762a
N
541Specify rounding factor for a Linear array. The size of each
542component will be rounded down to a multiple of this size.
543This is a synonym for
544.B \-\-chunk
545but highlights the different meaning for Linear as compared to other
5f175898
N
546RAID levels. The default is 64K if a kernel earlier than 2.6.16 is in
547use, and is 0K (i.e. no rounding) in later kernels.
52826846 548
cd29a5c8 549.TP
7e23fc43 550.BR \-l ", " \-\-level=
e0fe762a 551Set RAID level. When used with
7e23fc43 552.BR \-\-create ,
98c6faba 553options are: linear, raid0, 0, stripe, raid1, 1, mirror, raid4, 4,
8fd8d9c4
N
554raid5, 5, raid6, 6, raid10, 10, multipath, mp, faulty, container.
555Obviously some of these are synonymous.
556
557When a
558.B CONTAINER
559metadata type is requested, only the
560.B container
561level is permitted, and it does not need to be explicitly given.
aa88f531
NB
562
563When used with
7e23fc43 564.BR \-\-build ,
a9d69660 565only linear, stripe, raid0, 0, raid1, multipath, mp, and faulty are valid.
52826846 566
fd547b50
N
567Can be used with
568.B \-\-grow
569to change the RAID level in some cases. See LEVEL CHANGES below.
2ae555c3 570
cd29a5c8 571.TP
7e23fc43 572.BR \-p ", " \-\-layout=
f24e2d6c
N
573This option configures the fine details of data layout for RAID5, RAID6,
574and RAID10 arrays, and controls the failure modes for
1a7dfc35
NB
575.IR faulty .
576
e0fe762a 577The layout of the RAID5 parity block can be one of
7e23fc43
PS
578.BR left\-asymmetric ,
579.BR left\-symmetric ,
580.BR right\-asymmetric ,
581.BR right\-symmetric ,
53e8b987
PS
582.BR la ", " ra ", " ls ", " rs .
583The default is
7e23fc43 584.BR left\-symmetric .
52826846 585
cd19c0cf 586It is also possible to cause RAID5 to use a RAID4-like layout by
e0fe762a
N
587choosing
588.BR parity\-first ,
589or
590.BR parity\-last .
591
592Finally for RAID5 there are DDF\-compatible layouts,
593.BR ddf\-zero\-restart ,
594.BR ddf\-N\-restart ,
595and
596.BR ddf\-N\-continue .
597
598These same layouts are available for RAID6. There are also 4 layouts
599that will provide an intermediate stage for converting between RAID5
600and RAID6. These provide a layout which is identical to the
601corresponding RAID5 layout on the first N\-1 devices, and has the 'Q'
602syndrome (the second 'parity' block used by RAID6) on the last device.
603These layouts are:
604.BR left\-symmetric\-6 ,
605.BR right\-symmetric\-6 ,
606.BR left\-asymmetric\-6 ,
607.BR right\-asymmetric\-6 ,
608and
10adfe9a 609.BR parity\-first\-6 .
e0fe762a 610
93e790af
SW
611When setting the failure mode for level
612.I faulty,
1a7dfc35 613the options are:
7e23fc43
PS
614.BR write\-transient ", " wt ,
615.BR read\-transient ", " rt ,
616.BR write\-persistent ", " wp ,
617.BR read\-persistent ", " rp ,
618.BR write\-all ,
619.BR read\-fixable ", " rf ,
53e8b987 620.BR clear ", " flush ", " none .
b5e64645 621
93e790af 622Each failure mode can be followed by a number, which is used as a period
b5e64645
NB
623between fault generation. Without a number, the fault is generated
624once on the first relevant request. With a number, the fault will be
93e790af 625generated after that many requests, and will continue to be generated
b5e64645
NB
626every time the period elapses.
627
628Multiple failure modes can be current simultaneously by using the
7e23fc43 629.B \-\-grow
53e8b987 630option to set subsequent failure modes.
b5e64645
NB
631
632"clear" or "none" will remove any pending or periodic failure modes,
2ae555c3 633and "flush" will clear any persistent faults.
b5e64645 634
6f9a21a7 635Finally, the layout options for RAID10 are one of 'n', 'o' or 'f' followed
93e790af 636by a small number. The default is 'n2'. The supported options are:
1a7dfc35 637
93e790af 638.I 'n'
e0fe762a 639signals 'near' copies. Multiple copies of one data block are at
b578481c
NB
640similar offsets in different devices.
641
93e790af 642.I 'o'
b578481c
NB
643signals 'offset' copies. Rather than the chunks being duplicated
644within a stripe, whole stripes are duplicated but are rotated by one
645device so duplicate blocks are on different devices. Thus subsequent
646copies of a block are in the next drive, and are one chunk further
647down.
648
93e790af 649.I 'f'
1a7dfc35 650signals 'far' copies
93e790af 651(multiple copies have very different offsets).
e0fe762a 652See md(4) for more detail about 'near', 'offset', and 'far'.
1a7dfc35
NB
653
654The number is the number of copies of each datablock. 2 is normal, 3
655can be useful. This number can be at most equal to the number of
656devices in the array. It does not need to divide evenly into that
657number (e.g. it is perfectly legal to have an 'n2' layout for an array
658with an odd number of devices).
659
f24e2d6c
N
660When an array is converted between RAID5 and RAID6 an intermediate
661RAID6 layout is used in which the second parity block (Q) is always on
662the last device. To convert a RAID5 to RAID6 and leave it in this new
663layout (which does not require re-striping) use
664.BR \-\-layout=preserve .
665This will try to avoid any restriping.
666
667The converse of this is
668.B \-\-layout=normalise
669which will change a non-standard RAID6 layout into a more standard
670arrangement.
671
cd29a5c8 672.TP
7e23fc43 673.BR \-\-parity=
53e8b987 674same as
7e23fc43 675.B \-\-layout
53e8b987 676(thus explaining the p of
7e23fc43 677.BR \-p ).
52826846 678
e793c2e5 679.TP
7e23fc43 680.BR \-b ", " \-\-bitmap=
e793c2e5 681Specify a file to store a write-intent bitmap in. The file should not
53e8b987 682exist unless
7e23fc43 683.B \-\-force
53e8b987 684is also given. The same file should be provided
2ae555c3 685when assembling the array. If the word
93e790af 686.B "internal"
2ae555c3
NB
687is given, then the bitmap is stored with the metadata on the array,
688and so is replicated on all devices. If the word
93e790af 689.B "none"
2ae555c3 690is given with
7e23fc43 691.B \-\-grow
2ae555c3 692mode, then any bitmap that is present is removed.
e793c2e5 693
2ae555c3
NB
694To help catch typing errors, the filename must contain at least one
695slash ('/') if it is a real file (not 'internal' or 'none').
696
697Note: external bitmaps are only known to work on ext2 and ext3.
698Storing bitmap files on other filesystems may result in serious problems.
e793c2e5 699
cd29a5c8 700.TP
7e23fc43 701.BR \-\-bitmap\-chunk=
e0fe762a 702Set the chunksize of the bitmap. Each bit corresponds to that many
1bfdbe01
NB
703Kilobytes of storage.
704When using a file based bitmap, the default is to use the smallest
93e790af 705size that is at-least 4 and requires no more than 2^21 chunks.
2ae555c3
NB
706When using an
707.B internal
b8ab2a50
N
708bitmap, the chunksize defaults to 64Meg, or larger if necessary to
709fit the bitmap into the available space.
5787fa49 710
36fad8ec
N
711A suffix of 'M' or 'G' can be given to indicate Megabytes or
712Gigabytes respectively.
713
cd29a5c8 714.TP
7e23fc43 715.BR \-W ", " \-\-write\-mostly
e0fe762a 716subsequent devices listed in a
7e23fc43
PS
717.BR \-\-build ,
718.BR \-\-create ,
2ae555c3 719or
7e23fc43 720.B \-\-add
2ae555c3
NB
721command will be flagged as 'write-mostly'. This is valid for RAID1
722only and means that the 'md' driver will avoid reading from these
723devices if at all possible. This can be useful if mirroring over a
724slow link.
52826846 725
2ae555c3 726.TP
7e23fc43 727.BR \-\-write\-behind=
2ae555c3 728Specify that write-behind mode should be enabled (valid for RAID1
e0fe762a
N
729only). If an argument is specified, it will set the maximum number
730of outstanding writes allowed. The default value is 256.
2ae555c3
NB
731A write-intent bitmap is required in order to use write-behind
732mode, and write-behind is only attempted on drives marked as
733.IR write-mostly .
dd0781e5
NB
734
735.TP
7e23fc43 736.BR \-\-assume\-clean
dd0781e5
NB
737Tell
738.I mdadm
47d79ef8
NB
739that the array pre-existed and is known to be clean. It can be useful
740when trying to recover from a major failure as you can be sure that no
741data will be affected unless you actually write to the array. It can
742also be used when creating a RAID1 or RAID10 if you want to avoid the
b3f1c093 743initial resync, however this practice \(em while normally safe \(em is not
e0fe762a 744recommended. Use this only if you really know what you are doing.
6acad481
ME
745.IP
746When the devices that will be part of a new array were filled
747with zeros before creation the operator knows the array is
748actually clean. If that is the case, such as after running
749badblocks, this argument can be used to tell mdadm the
750facts the operator knows.
ce52f92f
N
751.IP
752When an array is resized to a larger size with
753.B "\-\-grow \-\-size="
754the new space is normally resynced in that same way that the whole
6cbf8fb8 755array is resynced at creation. From Linux version 3.0,
ce52f92f
N
756.B \-\-assume\-clean
757can be used with that command to avoid the automatic resync.
dd0781e5 758
2ae555c3 759.TP
7e23fc43 760.BR \-\-backup\-file=
53e8b987 761This is needed when
7e23fc43 762.B \-\-grow
cd19c0cf
JR
763is used to increase the number of raid-devices in a RAID5 or RAID6 if
764there are no spare devices available, or to shrink, change RAID level
765or layout. See the GROW MODE section below on RAID\-DEVICES CHANGES.
766The file must be stored on a separate device, not on the RAID array
767being reshaped.
2ae555c3 768
40c9a66a
N
769.TP
770.B \-\-data\-offset=
771Arrays with 1.x metadata can leave a gap between the start of the
772device and the start of array data. This gap can be used for various
773metadata. The start of data is known as the
774.IR data\-offset .
775Normally an appropriate data offset is computed automatically.
776However it can be useful to set it explicitly such as when re-creating
777an array which was originally created using a different version of
778.I mdadm
779which computed a different offset.
780
781Setting the offset explicitly over-rides the default. The value given
782is in Kilobytes unless an 'M' or 'G' suffix is given.
783
784Since Linux 3.4,
785.B \-\-data\-offset
786can also be used with
787.B --grow
788for some RAID levels (initially on RAID10). This allows the
72ca9bcf 789data\-offset to be changed as part of the reshape process. When the
40c9a66a
N
790data offset is changed, no backup file is required as the difference
791in offsets is used to provide the same functionality.
792
793When the new offset is earlier than the old offset, the number of
794devices in the array cannot shrink. When it is after the old offset,
795the number of devices in the array cannot increase.
796
72ca9bcf
N
797When creating an array,
798.B \-\-data\-offset
799can be specified as
800.BR variable .
801In the case each member device is expected to have a offset appended
802to the name, separated by a colon. This makes it possible to recreate
803exactly an array which has varying data offsets (as can happen when
804different versions of
805.I mdadm
806are used to add different devices).
807
f211a137
AK
808.TP
809.BR \-\-continue
810This option is complementary to the
811.B \-\-freeze-reshape
812option for assembly. It is needed when
813.B \-\-grow
814operation is interrupted and it is not restarted automatically due to
815.B \-\-freeze-reshape
816usage during array assembly. This option is used together with
817.BR \-G
818, (
819.BR \-\-grow
820) command and device for a pending reshape to be continued.
821All parameters required for reshape continuation will be read from array metadata.
822If initial
823.BR \-\-grow
824command had required
825.BR \-\-backup\-file=
826option to be set, continuation option will require to have exactly the same
827backup file given as well.
828.IP
829Any other parameter passed together with
830.BR \-\-continue
831option will be ignored.
832
947fd4dd 833.TP
7e23fc43 834.BR \-N ", " \-\-name=
947fd4dd
NB
835Set a
836.B name
837for the array. This is currently only effective when creating an
e0fe762a
N
838array with a version-1 superblock, or an array in a DDF container.
839The name is a simple textual string that can be used to identify array
840components when assembling. If name is needed but not specified, it
841is taken from the basename of the device that is being created.
842e.g. when creating
843.I /dev/md/home
844the
845.B name
846will default to
847.IR home .
947fd4dd 848
dd0781e5 849.TP
7e23fc43 850.BR \-R ", " \-\-run
dd0781e5
NB
851Insist that
852.I mdadm
853run the array, even if some of the components
854appear to be active in another array or filesystem. Normally
855.I mdadm
856will ask for confirmation before including such components in an
857array. This option causes that question to be suppressed.
858
859.TP
7e23fc43 860.BR \-f ", " \-\-force
dd0781e5
NB
861Insist that
862.I mdadm
863accept the geometry and layout specified without question. Normally
864.I mdadm
865will not allow creation of an array with only one device, and will try
e0fe762a 866to create a RAID5 array with one missing drive (as this makes the
dd0781e5 867initial resync work faster). With
7e23fc43 868.BR \-\-force ,
dd0781e5
NB
869.I mdadm
870will not try to be so clever.
871
0ea8f5b1
N
872.TP
873.BR \-o ", " \-\-readonly
874Start the array
875.B read only
876rather than read-write as normal. No writes will be allowed to the
877array, and no resync, recovery, or reshape will be started.
878
dd0781e5 879.TP
257c1dc2
N
880.BR \-a ", " "\-\-auto{=yes,md,mdp,part,p}{NN}"
881Instruct mdadm how to create the device file if needed, possibly allocating
48f7b27a 882an unused minor number. "md" causes a non-partitionable array
257c1dc2
N
883to be used (though since Linux 2.6.28, these array devices are in fact
884partitionable). "mdp", "part" or "p" causes a partitionable array (2.6 and
2ae555c3 885later) to be used. "yes" requires the named md device to have
f9c25f1d 886a 'standard' format, and the type and minor number will be determined
257c1dc2
N
887from this. With mdadm 3.0, device creation is normally left up to
888.I udev
889so this option is unlikely to be needed.
890See DEVICE NAMES below.
48f7b27a 891
a9d69660 892The argument can also come immediately after
7e23fc43 893"\-a". e.g. "\-ap".
dd0781e5 894
53e8b987 895If
7e23fc43 896.B \-\-auto
53e8b987 897is not given on the command line or in the config file, then
75723446 898the default will be
7e23fc43 899.BR \-\-auto=yes .
75723446 900
1337546d 901If
7e23fc43 902.B \-\-scan
1337546d
NB
903is also given, then any
904.I auto=
35cc5be4 905entries in the config file will override the
7e23fc43 906.B \-\-auto
1337546d
NB
907instruction given on the command line.
908
dd0781e5
NB
909For partitionable arrays,
910.I mdadm
911will create the device file for the whole array and for the first 4
912partitions. A different number of partitions can be specified at the
913end of this option (e.g.
7e23fc43 914.BR \-\-auto=p7 ).
2ae555c3 915If the device name ends with a digit, the partition names add a 'p',
e0fe762a
N
916and a number, e.g.
917.IR /dev/md/home1p3 .
918If there is no trailing digit, then the partition names just have a
919number added, e.g.
920.IR /dev/md/scratch3 .
dd0781e5 921
48f7b27a
NB
922If the md device name is in a 'standard' format as described in DEVICE
923NAMES, then it will be created, if necessary, with the appropriate
e0fe762a
N
924device number based on that name. If the device name is not in one of these
925formats, then a unused device number will be allocated. The device
48f7b27a
NB
926number will be considered unused if there is no active array for that
927number, and there is no entry in /dev for that number and with a
e0fe762a 928non-standard name. Names that are not in 'standard' format are only
8fd8d9c4
N
929allowed in "/dev/md/".
930
3c7efacb
NK
931This is meaningful with
932.B \-\-create
933or
934.BR \-\-build .
935
3c7efacb
NK
936.TP
937.BR \-a ", " "\-\-add"
938This option can be used in Grow mode in two cases.
939
940If the target array is a Linear array, then
941.B \-\-add
942can be used to add one or more devices to the array. They
943are simply catenated on to the end of the array. Once added, the
944devices cannot be removed.
945
946If the
947.B \-\-raid\-disks
948option is being used to increase the number of devices in an array,
949then
950.B \-\-add
951can be used to add some extra devices to be included in the array.
952In most cases this is not needed as the extra devices can be added as
953spares first, and then the number of raid-disks can be changed.
954However for RAID0, it is not possible to add spares. So to increase
955the number of devices in a RAID0, it is necessary to set the new
956number of devices, and to add the new devices, in the same command.
957
52826846
NB
958.SH For assemble:
959
cd29a5c8 960.TP
7e23fc43 961.BR \-u ", " \-\-uuid=
e0fe762a 962uuid of array to assemble. Devices which don't have this uuid are
cd29a5c8
NB
963excluded
964
965.TP
7e23fc43 966.BR \-m ", " \-\-super\-minor=
cd29a5c8
NB
967Minor number of device that array was created for. Devices which
968don't have this minor number are excluded. If you create an array as
2d465520 969/dev/md1, then all superblocks will contain the minor number 1, even if
cd29a5c8
NB
970the array is later assembled as /dev/md2.
971
d013a55e 972Giving the literal word "dev" for
7e23fc43 973.B \-\-super\-minor
d013a55e
NB
974will cause
975.I mdadm
976to use the minor number of the md device that is being assembled.
977e.g. when assembling
978.BR /dev/md0 ,
51ac42e3 979.B \-\-super\-minor=dev
d013a55e
NB
980will look for super blocks with a minor number of 0.
981
e0fe762a
N
982.B \-\-super\-minor
983is only relevant for v0.90 metadata, and should not normally be used.
984Using
985.B \-\-uuid
986is much safer.
987
947fd4dd 988.TP
7e23fc43 989.BR \-N ", " \-\-name=
947fd4dd 990Specify the name of the array to assemble. This must be the name
624920bb 991that was specified when creating the array. It must either match
93e790af 992the name stored in the superblock exactly, or it must match
41a3b72a 993with the current
624920bb 994.I homehost
93e790af 995prefixed to the start of the given name.
947fd4dd 996
cd29a5c8 997.TP
7e23fc43 998.BR \-f ", " \-\-force
e0fe762a
N
999Assemble the array even if the metadata on some devices appears to be
1000out-of-date. If
1001.I mdadm
1002cannot find enough working devices to start the array, but can find
1003some devices that are recorded as having failed, then it will mark
1004those devices as working so that the array can be started.
1005An array which requires
1006.B \-\-force
1007to be started may contain data corruption. Use it carefully.
52826846 1008
cd29a5c8 1009.TP
7e23fc43 1010.BR \-R ", " \-\-run
b8a8ccf9
NB
1011Attempt to start the array even if fewer drives were given than were
1012present last time the array was active. Normally if not all the
1013expected drives are found and
7e23fc43 1014.B \-\-scan
cd29a5c8
NB
1015is not used, then the array will be assembled but not started.
1016With
7e23fc43 1017.B \-\-run
cd29a5c8 1018an attempt will be made to start it anyway.
52826846 1019
b8a8ccf9 1020.TP
7e23fc43 1021.B \-\-no\-degraded
b8a8ccf9 1022This is the reverse of
7e23fc43 1023.B \-\-run
93e790af 1024in that it inhibits the startup of array unless all expected drives
b8a8ccf9 1025are present. This is only needed with
93e790af
SW
1026.B \-\-scan,
1027and can be used if the physical connections to devices are
b8a8ccf9
NB
1028not as reliable as you would like.
1029
dd0781e5 1030.TP
7e23fc43 1031.BR \-a ", " "\-\-auto{=no,yes,md,mdp,part}"
dd0781e5
NB
1032See this option under Create and Build options.
1033
e793c2e5 1034.TP
7e23fc43 1035.BR \-b ", " \-\-bitmap=
2ae555c3
NB
1036Specify the bitmap file that was given when the array was created. If
1037an array has an
1038.B internal
1039bitmap, there is no need to specify this when assembling the array.
1040
1041.TP
7e23fc43 1042.BR \-\-backup\-file=
2ae555c3 1043If
7e23fc43 1044.B \-\-backup\-file
87f26d14
N
1045was used while reshaping an array (e.g. changing number of devices or
1046chunk size) and the system crashed during the critical section, then the same
7e23fc43 1047.B \-\-backup\-file
53e8b987 1048must be presented to
7e23fc43 1049.B \-\-assemble
cd19c0cf
JR
1050to allow possibly corrupted data to be restored, and the reshape
1051to be completed.
e793c2e5 1052
87f26d14
N
1053.TP
1054.BR \-\-invalid\-backup
1055If the file needed for the above option is not available for any
1056reason an empty file can be given together with this option to
1057indicate that the backup file is invalid. In this case the data that
1058was being rearranged at the time of the crash could be irrecoverably
1059lost, but the rest of the array may still be recoverable. This option
1060should only be used as a last resort if there is no way to recover the
1061backup file.
1062
1063
5787fa49 1064.TP
7e23fc43 1065.BR \-U ", " \-\-update=
5787fa49 1066Update the superblock on each device while assembling the array. The
feb716e9
NB
1067argument given to this flag can be one of
1068.BR sparc2.2 ,
1069.BR summaries ,
7d99579f 1070.BR uuid ,
c4f12c13 1071.BR name ,
0237e0ca 1072.BR homehost ,
e5329c37 1073.BR resync ,
586ed405 1074.BR byteorder ,
bee8ec56 1075.BR devicesize ,
5a31170d 1076.BR no\-bitmap ,
688e99a7
N
1077.BR bbl ,
1078.BR no-\bbl ,
5787fa49 1079or
7e23fc43 1080.BR super\-minor .
5787fa49
NB
1081
1082The
1083.B sparc2.2
7d99579f 1084option will adjust the superblock of an array what was created on a Sparc
5787fa49
NB
1085machine running a patched 2.2 Linux kernel. This kernel got the
1086alignment of part of the superblock wrong. You can use the
7e23fc43 1087.B "\-\-examine \-\-sparc2.2"
5787fa49
NB
1088option to
1089.I mdadm
1090to see what effect this would have.
1091
1092The
7e23fc43 1093.B super\-minor
5787fa49 1094option will update the
2ae555c3 1095.B "preferred minor"
5787fa49 1096field on each superblock to match the minor number of the array being
45c073c9
NB
1097assembled.
1098This can be useful if
7e23fc43 1099.B \-\-examine
45c073c9 1100reports a different "Preferred Minor" to
7e23fc43 1101.BR \-\-detail .
45c073c9 1102In some cases this update will be performed automatically
e0fe762a 1103by the kernel driver. In particular the update happens automatically
45c073c9
NB
1104at the first write to an array with redundancy (RAID level 1 or
1105greater) on a 2.6 (or later) kernel.
5787fa49 1106
7d99579f
NB
1107The
1108.B uuid
1109option will change the uuid of the array. If a UUID is given with the
7e23fc43 1110.B \-\-uuid
53e8b987 1111option that UUID will be used as a new UUID and will
7d99579f
NB
1112.B NOT
1113be used to help identify the devices in the array.
53e8b987 1114If no
7e23fc43 1115.B \-\-uuid
53e8b987 1116is given, a random UUID is chosen.
7d99579f 1117
c4f12c13
NB
1118The
1119.B name
1120option will change the
1121.I name
1122of the array as stored in the superblock. This is only supported for
1123version-1 superblocks.
1124
0237e0ca
NB
1125The
1126.B homehost
1127option will change the
1128.I homehost
1129as recorded in the superblock. For version-0 superblocks, this is the
1130same as updating the UUID.
1131For version-1 superblocks, this involves updating the name.
1132
e5329c37
NB
1133The
1134.B resync
1135option will cause the array to be marked
1136.I dirty
e0fe762a
N
1137meaning that any redundancy in the array (e.g. parity for RAID5,
1138copies for RAID1) may be incorrect. This will cause the RAID system
e5329c37
NB
1139to perform a "resync" pass to make sure that all redundant information
1140is correct.
1141
586ed405
NB
1142The
1143.B byteorder
1144option allows arrays to be moved between machines with different
1145byte-order.
2ae555c3 1146When assembling such an array for the first time after a move, giving
7e23fc43 1147.B "\-\-update=byteorder"
586ed405
NB
1148will cause
1149.I mdadm
1150to expect superblocks to have their byteorder reversed, and will
1151correct that order before assembling the array. This is only valid
2ae555c3 1152with original (Version 0.90) superblocks.
586ed405 1153
feb716e9
NB
1154The
1155.B summaries
e0fe762a 1156option will correct the summaries in the superblock. That is the
feb716e9 1157counts of total, working, active, failed, and spare devices.
5787fa49 1158
bee8ec56
NB
1159The
1160.B devicesize
5a31170d 1161option will rarely be of use. It applies to version 1.1 and 1.2 metadata
bee8ec56
NB
1162only (where the metadata is at the start of the device) and is only
1163useful when the component device has changed size (typically become
1164larger). The version 1 metadata records the amount of the device that
1165can be used to store data, so if a device in a version 1.1 or 1.2
1166array becomes larger, the metadata will still be visible, but the
1167extra space will not. In this case it might be useful to assemble the
1168array with
7e23fc43 1169.BR \-\-update=devicesize .
bee8ec56
NB
1170This will cause
1171.I mdadm
1172to determine the maximum usable amount of space on each device and
1173update the relevant field in the metadata.
1174
5a31170d
N
1175The
1176.B no\-bitmap
1177option can be used when an array has an internal bitmap which is
1178corrupt in some way so that assembling the array normally fails. It
1179will cause any internal bitmap to be ignored.
1180
688e99a7
N
1181The
1182.B bbl
1183option will reserve space in each device for a bad block list. This
1184will be 4K in size and positioned near the end of any free space
1185between the superblock and the data.
1186
1187The
1188.B no\-bbl
1189option will cause any reservation of space for a bad block list to be
1190removed. If the bad block list contains entries, this will fail, as
1191removing the list could cause data corruption.
1192
afd0a969
AK
1193.TP
1194.BR \-\-freeze\-reshape
1195Option is intended to be used in start-up scripts during initrd boot phase.
1196When array under reshape is assembled during initrd phase, this option
1197stops reshape after reshape critical section is being restored. This happens
1198before file system pivot operation and avoids loss of file system context.
1199Losing file system context would cause reshape to be broken.
1200
a6482415
N
1201Reshape can be continued later using the
1202.B \-\-continue
1203option for the grow command.
afd0a969 1204
e0d19036 1205.SH For Manage mode:
52826846 1206
3d5279b0
N
1207.TP
1208.BR \-t ", " \-\-test
1209Unless a more serious error occurred,
1210.I mdadm
1211will exit with a status of 2 if no changes were made to the array and
12120 if at least one change was made.
1213This can be useful when an indirect specifier such as
1214.BR missing ,
1215.B detached
1216or
1217.B faulty
1218is used in requesting an operation on the array.
1219.B \-\-test
1220will report failure if these specifiers didn't find any match.
1221
cd29a5c8 1222.TP
7e23fc43 1223.BR \-a ", " \-\-add
3d5279b0
N
1224hot-add listed devices.
1225If a device appears to have recently been part of the array
342460cb 1226(possibly it failed or was removed) the device is re\-added as described
3d5279b0
N
1227in the next point.
1228If that fails or the device was never part of the array, the device is
1229added as a hot-spare.
1230If the array is degraded, it will immediately start to rebuild data
1231onto that spare.
1232
1233Note that this and the following options are only meaningful on array
1234with redundancy. They don't apply to RAID0 or Linear.
52826846 1235
fe80f49b 1236.TP
7e23fc43 1237.BR \-\-re\-add
3d5279b0
N
1238re\-add a device that was previous removed from an array.
1239If the metadata on the device reports that it is a member of the
1240array, and the slot that it used is still vacant, then the device will
1241be added back to the array in the same position. This will normally
1242cause the data for that device to be recovered. However based on the
1243event count on the device, the recovery may only require sections that
1244are flagged a write-intent bitmap to be recovered or may not require
1245any recovery at all.
1246
1247When used on an array that has no metadata (i.e. it was built with
1248.BR \-\-build)
1249it will be assumed that bitmap-based recovery is enough to make the
1250device fully consistent with the array.
fe80f49b 1251
688e99a7 1252When used with v1.x metadata,
833bb0f8
N
1253.B \-\-re\-add
1254can be accompanied by
688e99a7
N
1255.BR \-\-update=devicesize ,
1256.BR \-\-update=bbl ", or"
1257.BR \-\-update=no\-bbl .
1258See the description of these option when used in Assemble mode for an
1259explanation of their use.
833bb0f8 1260
a4e13010
N
1261If the device name given is
1262.B missing
1263then mdadm will try to find any device that looks like it should be
1264part of the array but isn't and will try to re\-add all such devices.
1265
cd29a5c8 1266.TP
7e23fc43 1267.BR \-r ", " \-\-remove
2d465520 1268remove listed devices. They must not be active. i.e. they should
b80da661
NB
1269be failed or spare devices. As well as the name of a device file
1270(e.g.
1271.BR /dev/sda1 )
1272the words
1273.B failed
1274and
1275.B detached
1276can be given to
1277.BR \-\-remove .
1278The first causes all failed device to be removed. The second causes
93e790af 1279any device which is no longer connected to the system (i.e an 'open'
b80da661
NB
1280returns
1281.BR ENXIO )
1282to be removed. This will only succeed for devices that are spares or
1283have already been marked as failed.
52826846 1284
cd29a5c8 1285.TP
7e23fc43 1286.BR \-f ", " \-\-fail
70c55e36 1287Mark listed devices as faulty.
b80da661
NB
1288As well as the name of a device file, the word
1289.B detached
1290can be given. This will cause any device that has been detached from
1291the system to be marked as failed. It can then be removed.
52826846 1292
cd29a5c8 1293.TP
7e23fc43 1294.BR \-\-set\-faulty
53e8b987 1295same as
7e23fc43 1296.BR \-\-fail .
52826846 1297
70c55e36
N
1298.TP
1299.B \-\-replace
1300Mark listed devices as requiring replacement. As soon as a spare is
1301available, it will be rebuilt and will replace the marked device.
1302This is similar to marking a device as faulty, but the device remains
1303in service during the recovery process to increase resilience against
1304multiple failures. When the replacement process finishes, the
1305replaced device will be marked as faulty.
1306
1307.TP
1308.B \-\-with
1309This can follow a list of
1310.B \-\-replace
1311devices. The devices listed after
1312.B \-\-with
1313will be preferentially used to replace the devices listed after
1314.BR \-\-replace .
1315These device must already be spare devices in the array.
1316
b3d31955
N
1317.TP
1318.BR \-\-write\-mostly
a4e13010 1319Subsequent devices that are added or re\-added will have the 'write-mostly'
e0fe762a 1320flag set. This is only valid for RAID1 and means that the 'md' driver
b3d31955
N
1321will avoid reading from these devices if possible.
1322.TP
1323.BR \-\-readwrite
a4e13010 1324Subsequent devices that are added or re\-added will have the 'write-mostly'
b3d31955
N
1325flag cleared.
1326
2ae555c3 1327.P
e0fe762a 1328Each of these options requires that the first device listed is the array
93e790af 1329to be acted upon, and the remainder are component devices to be added,
e0fe762a 1330removed, marked as faulty, etc. Several different operations can be
2ae555c3
NB
1331specified for different devices, e.g.
1332.in +5
7e23fc43 1333mdadm /dev/md0 \-\-add /dev/sda1 \-\-fail /dev/sdb1 \-\-remove /dev/sdb1
2ae555c3
NB
1334.in -5
1335Each operation applies to all devices listed until the next
93e790af 1336operation.
2ae555c3
NB
1337
1338If an array is using a write-intent bitmap, then devices which have
a4e13010 1339been removed can be re\-added in a way that avoids a full
93e790af 1340reconstruction but instead just updates the blocks that have changed
2ae555c3
NB
1341since the device was removed. For arrays with persistent metadata
1342(superblocks) this is done automatically. For arrays created with
7e23fc43 1343.B \-\-build
2ae555c3 1344mdadm needs to be told that this device we removed recently with
7e23fc43 1345.BR \-\-re\-add .
2ae555c3
NB
1346
1347Devices can only be removed from an array if they are not in active
93e790af
SW
1348use, i.e. that must be spares or failed devices. To remove an active
1349device, it must first be marked as
1350.B faulty.
2ae555c3
NB
1351
1352.SH For Misc mode:
1353
1354.TP
7e23fc43 1355.BR \-Q ", " \-\-query
2ae555c3
NB
1356Examine a device to see
1357(1) if it is an md device and (2) if it is a component of an md
1358array.
1359Information about what is discovered is presented.
1360
1361.TP
7e23fc43 1362.BR \-D ", " \-\-detail
e0fe762a 1363Print details of one or more md devices.
5787fa49 1364
4cce4069
DW
1365.TP
1366.BR \-\-detail\-platform
e0fe762a 1367Print details of the platform's RAID capabilities (firmware / hardware
9eafa1de
MN
1368topology) for a given metadata format. If used without argument, mdadm
1369will scan all controllers looking for their capabilities. Otherwise, mdadm
1370will only look at the controller specified by the argument in form of an
1371absolute filepath or a link, e.g.
1372.IR /sys/devices/pci0000:00/0000:00:1f.2 .
4cce4069 1373
54bad364
KS
1374.TP
1375.BR \-Y ", " \-\-export
1376When used with
e50cf220 1377.B \-\-detail , \-\-detail-platform
0d726f17
KS
1378or
1379.BR \-\-examine ,
54bad364
KS
1380output will be formatted as
1381.B key=value
1382pairs for easy import into the environment.
1383
2ae555c3 1384.TP
7e23fc43 1385.BR \-E ", " \-\-examine
e0fe762a
N
1386Print contents of the metadata stored on the named device(s).
1387Note the contrast between
1388.B \-\-examine
1389and
1390.BR \-\-detail .
1391.B \-\-examine
1392applies to devices which are components of an array, while
1393.B \-\-detail
1394applies to a whole array which is currently active.
5787fa49 1395.TP
7e23fc43 1396.B \-\-sparc2.2
e0fe762a
N
1397If an array was created on a SPARC machine with a 2.2 Linux kernel
1398patched with RAID support, the superblock will have been created
1399incorrectly, or at least incompatibly with 2.4 and later kernels.
1400Using the
7e23fc43 1401.B \-\-sparc2.2
5787fa49 1402flag with
7e23fc43 1403.B \-\-examine
5787fa49
NB
1404will fix the superblock before displaying it. If this appears to do
1405the right thing, then the array can be successfully assembled using
7e23fc43 1406.BR "\-\-assemble \-\-update=sparc2.2" .
5787fa49 1407
2ae555c3 1408.TP
7e23fc43 1409.BR \-X ", " \-\-examine\-bitmap
2ae555c3 1410Report information about a bitmap file.
01d9299c 1411The argument is either an external bitmap file or an array component
e0fe762a
N
1412in case of an internal bitmap. Note that running this on an array
1413device (e.g.
1414.BR /dev/md0 )
1415does not report the bitmap for that array.
e0d19036 1416
cd29a5c8 1417.TP
7e23fc43 1418.BR \-R ", " \-\-run
e0fe762a
N
1419start a partially assembled array. If
1420.B \-\-assemble
1421did not find enough devices to fully start the array, it might leaving
1422it partially assembled. If you wish, you can then use
1423.B \-\-run
1424to start the array in degraded mode.
52826846 1425
cd29a5c8 1426.TP
7e23fc43 1427.BR \-S ", " \-\-stop
cd29a5c8 1428deactivate array, releasing all resources.
52826846 1429
cd29a5c8 1430.TP
7e23fc43 1431.BR \-o ", " \-\-readonly
cd29a5c8 1432mark array as readonly.
52826846 1433
cd29a5c8 1434.TP
7e23fc43 1435.BR \-w ", " \-\-readwrite
cd29a5c8 1436mark array as readwrite.
52826846 1437
e0d19036 1438.TP
7e23fc43 1439.B \-\-zero\-superblock
e0d19036 1440If the device contains a valid md superblock, the block is
35cc5be4 1441overwritten with zeros. With
7e23fc43 1442.B \-\-force
35cc5be4 1443the block where the superblock would be is overwritten even if it
e0d19036 1444doesn't appear to be valid.
52826846 1445
33414a01
DW
1446.TP
1447.B \-\-kill\-subarray=
1448If the device is a container and the argument to \-\-kill\-subarray
1449specifies an inactive subarray in the container, then the subarray is
1450deleted. Deleting all subarrays will leave an 'empty-container' or
1451spare superblock on the drives. See \-\-zero\-superblock for completely
1452removing a superblock. Note that some formats depend on the subarray
1453index for generating a UUID, this command will fail if it would change
1454the UUID of an active subarray.
1455
aa534678
DW
1456.TP
1457.B \-\-update\-subarray=
1458If the device is a container and the argument to \-\-update\-subarray
1459specifies a subarray in the container, then attempt to update the given
1460superblock field in the subarray. See below in
1461.B MISC MODE
1462for details.
1463
feb716e9 1464.TP
7e23fc43 1465.BR \-t ", " \-\-test
feb716e9 1466When used with
7e23fc43 1467.BR \-\-detail ,
feb716e9
NB
1468the exit status of
1469.I mdadm
e0fe762a
N
1470is set to reflect the status of the device. See below in
1471.B MISC MODE
1472for details.
feb716e9 1473
b90c0e9a 1474.TP
7e23fc43 1475.BR \-W ", " \-\-wait
b90c0e9a
NB
1476For each md device given, wait for any resync, recovery, or reshape
1477activity to finish before returning.
1478.I mdadm
1479will return with success if it actually waited for every device
1480listed, otherwise it will return failure.
1481
1770662b
DW
1482.TP
1483.BR \-\-wait\-clean
fabbfd48
DW
1484For each md device given, or each device in /proc/mdstat if
1485.B \-\-scan
1486is given, arrange for the array to be marked clean as soon as possible.
7146ec6a
DW
1487.I mdadm
1488will return with success if the array uses external metadata and we
1489successfully waited. For native arrays this returns immediately as the
6a0ee6a0
DW
1490kernel handles dirty-clean transitions at shutdown. No action is taken
1491if safe-mode handling is disabled.
1770662b 1492
8382f19b
NB
1493.SH For Incremental Assembly mode:
1494.TP
7e23fc43 1495.BR \-\-rebuild\-map ", " \-r
8382f19b 1496Rebuild the map file
96fd06ed 1497.RB ( {MAP_PATH} )
8382f19b
NB
1498that
1499.I mdadm
1500uses to help track which arrays are currently being assembled.
1501
1502.TP
7e23fc43 1503.BR \-\-run ", " \-R
8382f19b
NB
1504Run any array assembled as soon as a minimal number of devices are
1505available, rather than waiting until all expected devices are present.
1506
1507.TP
7e23fc43 1508.BR \-\-scan ", " \-s
8382f19b 1509Only meaningful with
7e23fc43 1510.B \-R
8382f19b
NB
1511this will scan the
1512.B map
1513file for arrays that are being incrementally assembled and will try to
1514start any that are not already started. If any such array is listed
1515in
1516.B mdadm.conf
1517as requiring an external bitmap, that bitmap will be attached first.
1518
29ba4804
N
1519.TP
1520.BR \-\-fail ", " \-f
1521This allows the hot-plug system to remove devices that have fully disappeared
1522from the kernel. It will first fail and then remove the device from any
1523array it belongs to.
1524The device name given should be a kernel device name such as "sda",
1525not a name in
1526.IR /dev .
1527
210597d1
PC
1528.TP
1529.BR \-\-path=
87eb4fab
N
1530Only used with \-\-fail. The 'path' given will be recorded so that if
1531a new device appears at the same location it can be automatically
1532added to the same array. This allows the failed device to be
1533automatically replaced by a new device without metadata if it appears
1534at specified path. This option is normally only set by a
1535.I udev
1536script.
210597d1 1537
e0d19036
NB
1538.SH For Monitor mode:
1539.TP
7e23fc43 1540.BR \-m ", " \-\-mail
e0d19036
NB
1541Give a mail address to send alerts to.
1542
1543.TP
7e23fc43 1544.BR \-p ", " \-\-program ", " \-\-alert
e0d19036
NB
1545Give a program to be run whenever an event is detected.
1546
773135f5 1547.TP
7e23fc43 1548.BR \-y ", " \-\-syslog
773135f5
NB
1549Cause all events to be reported through 'syslog'. The messages have
1550facility of 'daemon' and varying priorities.
1551
e0d19036 1552.TP
7e23fc43 1553.BR \-d ", " \-\-delay
e0d19036 1554Give a delay in seconds.
51ac42e3 1555.I mdadm
e0d19036 1556polls the md arrays and then waits this many seconds before polling
e0fe762a
N
1557again. The default is 60 seconds. Since 2.6.16, there is no need to
1558reduce this as the kernel alerts
1559.I mdadm
1560immediately when there is any change.
e0d19036 1561
9a36a9b7
ZB
1562.TP
1563.BR \-r ", " \-\-increment
1564Give a percentage increment.
1565.I mdadm
1566will generate RebuildNN events with the given percentage increment.
1567
d013a55e 1568.TP
7e23fc43 1569.BR \-f ", " \-\-daemonise
d013a55e 1570Tell
51ac42e3 1571.I mdadm
d013a55e 1572to run as a background daemon if it decides to monitor anything. This
e0fe762a 1573causes it to fork and run in the child, and to disconnect from the
d013a55e
NB
1574terminal. The process id of the child is written to stdout.
1575This is useful with
7e23fc43 1576.B \-\-scan
d013a55e
NB
1577which will only continue monitoring if a mail address or alert program
1578is found in the config file.
1579
b5e64645 1580.TP
7e23fc43 1581.BR \-i ", " \-\-pid\-file
b5e64645 1582When
51ac42e3 1583.I mdadm
b5e64645
NB
1584is running in daemon mode, write the pid of the daemon process to
1585the specified file, instead of printing it on standard output.
1586
aa88f531 1587.TP
7e23fc43 1588.BR \-1 ", " \-\-oneshot
aa88f531
NB
1589Check arrays only once. This will generate
1590.B NewArray
1591events and more significantly
1592.B DegradedArray
a9d69660
NB
1593and
1594.B SparesMissing
aa88f531
NB
1595events. Running
1596.in +5
7e23fc43 1597.B " mdadm \-\-monitor \-\-scan \-1"
aa88f531
NB
1598.in -5
1599from a cron script will ensure regular notification of any degraded arrays.
1600
98c6faba 1601.TP
7e23fc43 1602.BR \-t ", " \-\-test
98c6faba
NB
1603Generate a
1604.B TestMessage
1605alert for every array found at startup. This alert gets mailed and
1606passed to the alert program. This can be used for testing that alert
a9d69660 1607message do get through successfully.
98c6faba 1608
210597d1
PC
1609.TP
1610.BR \-\-no\-sharing
87eb4fab 1611This inhibits the functionality for moving spares between arrays.
210597d1
PC
1612Only one monitoring process started with
1613.B \-\-scan
87eb4fab
N
1614but without this flag is allowed, otherwise the two could interfere
1615with each other.
210597d1 1616
e0d19036 1617.SH ASSEMBLE MODE
52826846 1618
cd29a5c8
NB
1619.HP 12
1620Usage:
7e23fc43 1621.B mdadm \-\-assemble
5787fa49
NB
1622.I md-device options-and-component-devices...
1623.HP 12
1624Usage:
7e23fc43 1625.B mdadm \-\-assemble \-\-scan
e0fe762a 1626.I md-devices-and-options...
cd29a5c8
NB
1627.HP 12
1628Usage:
7e23fc43 1629.B mdadm \-\-assemble \-\-scan
e0fe762a 1630.I options...
52826846 1631
cd29a5c8 1632.PP
e0fe762a 1633This usage assembles one or more RAID arrays from pre-existing components.
9a9dab36 1634For each array, mdadm needs to know the md device, the identity of the
e0fe762a 1635array, and a number of component-devices. These can be found in a number of ways.
52826846 1636
5787fa49 1637In the first usage example (without the
7e23fc43 1638.BR \-\-scan )
5787fa49
NB
1639the first device given is the md device.
1640In the second usage example, all devices listed are treated as md
1641devices and assembly is attempted.
1642In the third (where no devices are listed) all md devices that are
cb77f620 1643listed in the configuration file are assembled. If no arrays are
e0fe762a
N
1644described by the configuration file, then any arrays that
1645can be found on unused devices will be assembled.
52826846 1646
d013a55e 1647If precisely one device is listed, but
7e23fc43 1648.B \-\-scan
dd0781e5 1649is not given, then
d013a55e
NB
1650.I mdadm
1651acts as though
7e23fc43 1652.B \-\-scan
93e790af 1653was given and identity information is extracted from the configuration file.
d013a55e 1654
2ae555c3 1655The identity can be given with the
7e23fc43 1656.B \-\-uuid
e0fe762a
N
1657option, the
1658.B \-\-name
1659option, or the
7e23fc43 1660.B \-\-super\-minor
93e790af
SW
1661option, will be taken from the md-device record in the config file, or
1662will be taken from the super block of the first component-device
1663listed on the command line.
52826846 1664
2ae555c3 1665Devices can be given on the
7e23fc43 1666.B \-\-assemble
e0fe762a 1667command line or in the config file. Only devices which have an md
5787fa49
NB
1668superblock which contains the right identity will be considered for
1669any array.
52826846 1670
2ae555c3 1671The config file is only used if explicitly named with
7e23fc43 1672.B \-\-config
d013a55e 1673or requested with (a possibly implicit)
7e23fc43 1674.BR \-\-scan .
52826846 1675In the later case,
9a9dab36 1676.B /etc/mdadm.conf
8fd8d9c4
N
1677or
1678.B /etc/mdadm/mdadm.conf
52826846
NB
1679is used.
1680
2ae555c3 1681If
7e23fc43 1682.B \-\-scan
cd29a5c8
NB
1683is not given, then the config file will only be used to find the
1684identity of md arrays.
52826846 1685
2d465520 1686Normally the array will be started after it is assembled. However if
7e23fc43 1687.B \-\-scan
e0fe762a
N
1688is not given and not all expected drives were listed, then the array
1689is not started (to guard against usage errors). To insist that the
1690array be started in this case (as may work for RAID1, 4, 5, 6, or 10),
1691give the
7e23fc43 1692.B \-\-run
cd29a5c8 1693flag.
52826846 1694
e0fe762a
N
1695If
1696.I udev
1697is active,
1698.I mdadm
1699does not create any entries in
dd0781e5 1700.B /dev
e0fe762a
N
1701but leaves that to
1702.IR udev .
1703It does record information in
96fd06ed 1704.B {MAP_PATH}
e0fe762a
N
1705which will allow
1706.I udev
1707to choose the correct name.
dd0781e5 1708
e0fe762a
N
1709If
1710.I mdadm
1711detects that udev is not configured, it will create the devices in
1712.B /dev
1713itself.
dd0781e5 1714
e0fe762a
N
1715In Linux kernels prior to version 2.6.28 there were two distinctly
1716different types of md devices that could be created: one that could be
1717partitioned using standard partitioning tools and one that could not.
1718Since 2.6.28 that distinction is no longer relevant as both type of
1719devices can be partitioned.
1720.I mdadm
1721will normally create the type that originally could not be partitioned
1722as it has a well defined major number (9).
dd0781e5 1723
e0fe762a
N
1724Prior to 2.6.28, it is important that mdadm chooses the correct type
1725of array device to use. This can be controlled with the
1726.B \-\-auto
1727option. In particular, a value of "mdp" or "part" or "p" tells mdadm
1728to use a partitionable device rather than the default.
dd0781e5 1729
e0fe762a
N
1730In the no-udev case, the value given to
1731.B \-\-auto
1732can be suffixed by a number. This tells
1733.I mdadm
1734to create that number of partition devices rather than the default of 4.
dd0781e5 1735
e0fe762a 1736The value given to
7e23fc43 1737.B \-\-auto
e0fe762a
N
1738can also be given in the configuration file as a word starting
1739.B auto=
1740on the ARRAY line for the relevant array.
52826846 1741
41a3b72a
NB
1742.SS Auto Assembly
1743When
7e23fc43 1744.B \-\-assemble
41a3b72a 1745is used with
7e23fc43 1746.B \-\-scan
41a3b72a
NB
1747and no devices are listed,
1748.I mdadm
1749will first attempt to assemble all the arrays listed in the config
1750file.
1751
cb77f620 1752If no arrays are listed in the config (other than those marked
e0fe762a
N
1753.BR <ignore> )
1754it will look through the available devices for possible arrays and
1755will try to assemble anything that it finds. Arrays which are tagged
1756as belonging to the given homehost will be assembled and started
1757normally. Arrays which do not obviously belong to this host are given
1758names that are expected not to conflict with anything local, and are
1759started "read-auto" so that nothing is written to any device until the
1760array is written to. i.e. automatic resync etc is delayed.
41a3b72a
NB
1761
1762If
1763.I mdadm
1764finds a consistent set of devices that look like they should comprise
1765an array, and if the superblock is tagged as belonging to the given
1766home host, it will automatically choose a device name and try to
1767assemble the array. If the array uses version-0.90 metadata, then the
1768.B minor
1769number as recorded in the superblock is used to create a name in
1770.B /dev/md/
1771so for example
1772.BR /dev/md/3 .
1773If the array uses version-1 metadata, then the
1774.B name
1775from the superblock is used to similarly create a name in
e0fe762a 1776.B /dev/md/
93e790af 1777(the name will have any 'host' prefix stripped first).
41a3b72a 1778
c64ba03a
N
1779This behaviour can be modified by the
1780.I AUTO
1781line in the
1782.I mdadm.conf
1783configuration file. This line can indicate that specific metadata
1784type should, or should not, be automatically assembled. If an array
1785is found which is not listed in
1786.I mdadm.conf
1787and has a metadata format that is denied by the
1788.I AUTO
1789line, then it will not be assembled.
1790The
1791.I AUTO
1792line can also request that all arrays identified as being for this
1793homehost should be assembled regardless of their metadata type.
1794See
1795.IR mdadm.conf (5)
1796for further details.
1797
246cebdb
AK
1798Note: Auto assembly cannot be used for assembling and activating some
1799arrays which are undergoing reshape. In particular as the
1800.B backup\-file
1801cannot be given, any reshape which requires a backup-file to continue
1802cannot be started by auto assembly. An array which is growing to more
1803devices and has passed the critical section can be assembled using
1804auto-assembly.
41a3b72a 1805
cd29a5c8 1806.SH BUILD MODE
52826846 1807
cd29a5c8
NB
1808.HP 12
1809Usage:
7e23fc43 1810.B mdadm \-\-build
93e790af 1811.I md-device
7e23fc43
PS
1812.BI \-\-chunk= X
1813.BI \-\-level= Y
1814.BI \-\-raid\-devices= Z
cd29a5c8
NB
1815.I devices
1816
1817.PP
2ae555c3 1818This usage is similar to
7e23fc43 1819.BR \-\-create .
e0fe762a 1820The difference is that it creates an array without a superblock. With
cd29a5c8 1821these arrays there is no difference between initially creating the array and
52826846
NB
1822subsequently assembling the array, except that hopefully there is useful
1823data there in the second case.
1824
e0fe762a
N
1825The level may raid0, linear, raid1, raid10, multipath, or faulty, or
1826one of their synonyms. All devices must be listed and the array will
1827be started once complete. It will often be appropriate to use
1828.B \-\-assume\-clean
1829with levels raid1 or raid10.
cd29a5c8
NB
1830
1831.SH CREATE MODE
1832
1833.HP 12
1834Usage:
7e23fc43 1835.B mdadm \-\-create
93e790af 1836.I md-device
7e23fc43
PS
1837.BI \-\-chunk= X
1838.BI \-\-level= Y
cd29a5c8 1839.br
7e23fc43 1840.BI \-\-raid\-devices= Z
e0fe762a 1841.I devices
cd29a5c8
NB
1842
1843.PP
1844This usage will initialise a new md array, associate some devices with
1845it, and activate the array.
1846
e0fe762a
N
1847The named device will normally not exist when
1848.I "mdadm \-\-create"
1849is run, but will be created by
1850.I udev
1851once the array becomes active.
dd0781e5 1852
e0fe762a
N
1853As devices are added, they are checked to see if they contain RAID
1854superblocks or filesystems. They are also checked to see if the variance in
cd29a5c8
NB
1855device size exceeds 1%.
1856
1857If any discrepancy is found, the array will not automatically be run, though
2ae555c3 1858the presence of a
7e23fc43 1859.B \-\-run
cd29a5c8
NB
1860can override this caution.
1861
2d465520 1862To create a "degraded" array in which some devices are missing, simply
d013a55e 1863give the word "\fBmissing\fP"
2d465520 1864in place of a device name. This will cause
51ac42e3 1865.I mdadm
2d465520
NB
1866to leave the corresponding slot in the array empty.
1867For a RAID4 or RAID5 array at most one slot can be
98c6faba 1868"\fBmissing\fP"; for a RAID6 array at most two slots.
2d465520
NB
1869For a RAID1 array, only one real device needs to be given. All of the
1870others can be
d013a55e 1871"\fBmissing\fP".
2d465520 1872
feb716e9 1873When creating a RAID5 array,
51ac42e3 1874.I mdadm
feb716e9 1875will automatically create a degraded array with an extra spare drive.
e0fe762a
N
1876This is because building the spare into a degraded array is in general
1877faster than resyncing the parity on a non-degraded, but not clean,
1878array. This feature can be overridden with the
7e23fc43 1879.B \-\-force
feb716e9
NB
1880option.
1881
0ee4da98 1882When creating an array with version-1 metadata a name for the array is
41a3b72a
NB
1883required.
1884If this is not given with the
7e23fc43 1885.B \-\-name
41a3b72a
NB
1886option,
1887.I mdadm
0ee4da98 1888will choose a name based on the last component of the name of the
41a3b72a
NB
1889device being created. So if
1890.B /dev/md3
1891is being created, then the name
1892.B 3
1893will be chosen.
1894If
1895.B /dev/md/home
1896is being created, then the name
1897.B home
1898will be used.
1899
e0fe762a
N
1900When creating a partition based array, using
1901.I mdadm
1902with version-1.x metadata, the partition type should be set to
e0f31f50 1903.B 0xDA
e0fe762a 1904(non fs-data). This type selection allows for greater precision since
e0f31f50
PC
1905using any other [RAID auto-detect (0xFD) or a GNU/Linux partition (0x83)],
1906might create problems in the event of array recovery through a live cdrom.
1907
3d3dd91e
NB
1908A new array will normally get a randomly assigned 128bit UUID which is
1909very likely to be unique. If you have a specific need, you can choose
1910a UUID for the array by giving the
7e23fc43 1911.B \-\-uuid=
3d3dd91e
NB
1912option. Be warned that creating two arrays with the same UUID is a
1913recipe for disaster. Also, using
7e23fc43 1914.B \-\-uuid=
3d3dd91e 1915when creating a v0.90 array will silently override any
7e23fc43 1916.B \-\-homehost=
3d3dd91e 1917setting.
e43d0cda
NB
1918.\"If the
1919.\".B \-\-size
1920.\"option is given, it is not necessary to list any component-devices in this command.
1921.\"They can be added later, before a
1922.\".B \-\-run.
1923.\"If no
1924.\".B \-\-size
1925.\"is given, the apparent size of the smallest drive given is used.
cd29a5c8 1926
bf95d0f3
N
1927If the metadata type supports it (currently only 1.x metadata), space
1928will be allocated to store a bad block list. This allows a modest
1929number of bad blocks to be recorded, allowing the drive to remain in
1930service while only partially functional.
1931
8fd8d9c4
N
1932When creating an array within a
1933.B CONTAINER
1934.I mdadm
1935can be given either the list of devices to use, or simply the name of
1936the container. The former case gives control over which devices in
1937the container will be used for the array. The latter case allows
1938.I mdadm
1939to automatically choose which devices to use based on how much spare
1940space is available.
1941
53e8b987 1942The General Management options that are valid with
7e23fc43 1943.B \-\-create
53e8b987 1944are:
cd29a5c8 1945.TP
7e23fc43 1946.B \-\-run
dd0781e5 1947insist on running the array even if some devices look like they might
cd29a5c8
NB
1948be in use.
1949
1950.TP
7e23fc43 1951.B \-\-readonly
b3f1c093 1952start the array readonly \(em not supported yet.
52826846 1953
e0d19036 1954.SH MANAGE MODE
cd29a5c8
NB
1955.HP 12
1956Usage:
e0d19036
NB
1957.B mdadm
1958.I device
1959.I options... devices...
cd29a5c8
NB
1960.PP
1961
e0d19036
NB
1962This usage will allow individual devices in an array to be failed,
1963removed or added. It is possible to perform multiple operations with
e0fe762a 1964on command. For example:
e0d19036 1965.br
7e23fc43 1966.B " mdadm /dev/md0 \-f /dev/hda1 \-r /dev/hda1 \-a /dev/hda1"
e0d19036
NB
1967.br
1968will firstly mark
1969.B /dev/hda1
1970as faulty in
1971.B /dev/md0
1972and will then remove it from the array and finally add it back
2d465520 1973in as a spare. However only one md array can be affected by a single
2ae555c3 1974command.
e0d19036 1975
e0fe762a
N
1976When a device is added to an active array, mdadm checks to see if it
1977has metadata on it which suggests that it was recently a member of the
a4e13010 1978array. If it does, it tries to "re\-add" the device. If there have
e0fe762a
N
1979been no changes since the device was removed, or if the array has a
1980write-intent bitmap which has recorded whatever changes there were,
1981then the device will immediately become a full member of the array and
1982those differences recorded in the bitmap will be resolved.
1983
e0d19036
NB
1984.SH MISC MODE
1985.HP 12
1986Usage:
9a9dab36 1987.B mdadm
e0d19036 1988.I options ...
e0fe762a 1989.I devices ...
e0d19036 1990.PP
cd29a5c8 1991
b5e64645 1992MISC mode includes a number of distinct operations that
e0d19036
NB
1993operate on distinct devices. The operations are:
1994.TP
962a108f 1995.B \-\-query
e0d19036
NB
1996The device is examined to see if it is
1997(1) an active md array, or
1998(2) a component of an md array.
1999The information discovered is reported.
2000
2001.TP
962a108f 2002.B \-\-detail
2d465520 2003The device should be an active md device.
e0fe762a 2004.B mdadm
2d465520 2005will display a detailed description of the array.
7e23fc43 2006.B \-\-brief
2d465520 2007or
7e23fc43 2008.B \-\-scan
2d465520 2009will cause the output to be less detailed and the format to be
e0d19036 2010suitable for inclusion in
87eb4fab 2011.BR mdadm.conf .
feb716e9
NB
2012The exit status of
2013.I mdadm
2014will normally be 0 unless
2015.I mdadm
93e790af 2016failed to get useful information about the device(s); however, if the
7e23fc43 2017.B \-\-test
feb716e9
NB
2018option is given, then the exit status will be:
2019.RS
2020.TP
20210
2022The array is functioning normally.
2023.TP
20241
2025The array has at least one failed device.
2026.TP
20272
a77be586 2028The array has multiple failed devices such that it is unusable.
feb716e9
NB
2029.TP
20304
2031There was an error while trying to get information about the device.
2032.RE
cd29a5c8 2033
4cce4069
DW
2034.TP
2035.B \-\-detail\-platform
e0fe762a 2036Print detail of the platform's RAID capabilities (firmware / hardware
4cce4069
DW
2037topology). If the metadata is specified with
2038.B \-e
2039or
2040.B \-\-metadata=
2041then the return status will be:
2042.RS
2043.TP
20440
2045metadata successfully enumerated its platform components on this system
2046.TP
20471
2048metadata is platform independent
2049.TP
20502
2051metadata failed to find its platform components on this system
2052.RE
2053
aa534678
DW
2054.TP
2055.B \-\-update\-subarray=
2056If the device is a container and the argument to \-\-update\-subarray
2057specifies a subarray in the container, then attempt to update the given
2058superblock field in the subarray. Similar to updating an array in
2059"assemble" mode, the field to update is selected by
2060.B \-U
2061or
2062.B \-\-update=
2063option. Currently only
2064.B name
2065is supported.
2066
2067The
2068.B name
2069option updates the subarray name in the metadata, it may not affect the
2070device node name or the device node symlink until the subarray is
2071re\-assembled. If updating
2072.B name
2073would change the UUID of an active subarray this operation is blocked,
2074and the command will end in an error.
2075
e0d19036 2076.TP
962a108f 2077.B \-\-examine
2d465520 2078The device should be a component of an md array.
51ac42e3 2079.I mdadm
2d465520 2080will read the md superblock of the device and display the contents.
e0d19036 2081If
7e23fc43 2082.B \-\-brief
93e790af 2083or
7e23fc43 2084.B \-\-scan
93e790af 2085is given, then multiple devices that are components of the one array
e0d19036
NB
2086are grouped together and reported in a single entry suitable
2087for inclusion in
87eb4fab 2088.BR mdadm.conf .
e0d19036 2089
2d465520 2090Having
7e23fc43 2091.B \-\-scan
e0d19036
NB
2092without listing any devices will cause all devices listed in the
2093config file to be examined.
2094
2095.TP
962a108f 2096.B \-\-stop
98c6faba
NB
2097The devices should be active md arrays which will be deactivated, as
2098long as they are not currently in use.
e0d19036
NB
2099
2100.TP
962a108f 2101.B \-\-run
e0d19036
NB
2102This will fully activate a partially assembled md array.
2103
2104.TP
962a108f 2105.B \-\-readonly
e0d19036
NB
2106This will mark an active array as read-only, providing that it is
2107not currently being used.
2108
2109.TP
962a108f 2110.B \-\-readwrite
e0d19036
NB
2111This will change a
2112.B readonly
2113array back to being read/write.
2114
2d465520 2115.TP
962a108f 2116.B \-\-scan
2d465520 2117For all operations except
7e23fc43
PS
2118.BR \-\-examine ,
2119.B \-\-scan
2d465520
NB
2120will cause the operation to be applied to all arrays listed in
2121.BR /proc/mdstat .
2122For
7e23fc43
PS
2123.BR \-\-examine,
2124.B \-\-scan
2d465520
NB
2125causes all devices listed in the config file to be examined.
2126
a1331cc4
N
2127.TP
2128.BR \-b ", " \-\-brief
2129Be less verbose. This is used with
2130.B \-\-detail
2131and
2132.BR \-\-examine .
2133Using
2134.B \-\-brief
2135with
2136.B \-\-verbose
2137gives an intermediate level of verbosity.
2138
e0d19036
NB
2139.SH MONITOR MODE
2140
cd29a5c8
NB
2141.HP 12
2142Usage:
7e23fc43 2143.B mdadm \-\-monitor
e0d19036
NB
2144.I options... devices...
2145
cd29a5c8 2146.PP
e0d19036 2147This usage causes
51ac42e3 2148.I mdadm
e0d19036
NB
2149to periodically poll a number of md arrays and to report on any events
2150noticed.
51ac42e3 2151.I mdadm
e0d19036
NB
2152will never exit once it decides that there are arrays to be checked,
2153so it should normally be run in the background.
2154
2d465520 2155As well as reporting events,
51ac42e3 2156.I mdadm
2d465520
NB
2157may move a spare drive from one array to another if they are in the
2158same
2159.B spare-group
210597d1
PC
2160or
2161.B domain
a9d69660 2162and if the destination array has a failed drive but no spares.
2d465520 2163
e0d19036 2164If any devices are listed on the command line,
51ac42e3 2165.I mdadm
e0fe762a 2166will only monitor those devices. Otherwise all arrays listed in the
e0d19036 2167configuration file will be monitored. Further, if
7e23fc43 2168.B \-\-scan
e0d19036
NB
2169is given, then any other md devices that appear in
2170.B /proc/mdstat
2171will also be monitored.
2172
2173The result of monitoring the arrays is the generation of events.
bd526cee 2174These events are passed to a separate program (if specified) and may
2d465520 2175be mailed to a given E-mail address.
e0d19036 2176
93e790af
SW
2177When passing events to a program, the program is run once for each event,
2178and is given 2 or 3 command-line arguments: the first is the
2179name of the event (see below), the second is the name of the
bd526cee 2180md device which is affected, and the third is the name of a related
93e790af 2181device if relevant (such as a component device that has failed).
cd29a5c8
NB
2182
2183If
7e23fc43 2184.B \-\-scan
e0d19036
NB
2185is given, then a program or an E-mail address must be specified on the
2186command line or in the config file. If neither are available, then
51ac42e3 2187.I mdadm
e0d19036
NB
2188will not monitor anything.
2189Without
93e790af 2190.B \-\-scan,
51ac42e3 2191.I mdadm
2d465520 2192will continue monitoring as long as something was found to monitor. If
e0d19036
NB
2193no program or email is given, then each event is reported to
2194.BR stdout .
cd29a5c8 2195
e0d19036
NB
2196The different events are:
2197
2198.RS 4
2199.TP
2200.B DeviceDisappeared
2d465520 2201An md array which previously was configured appears to no longer be
773135f5 2202configured. (syslog priority: Critical)
e0d19036 2203
b8f72a62
NB
2204If
2205.I mdadm
2206was told to monitor an array which is RAID0 or Linear, then it will
2207report
2208.B DeviceDisappeared
2209with the extra information
2210.BR Wrong-Level .
2211This is because RAID0 and Linear do not support the device-failed,
2212hot-spare and resync operations which are monitored.
2213
e0d19036
NB
2214.TP
2215.B RebuildStarted
773135f5 2216An md array started reconstruction. (syslog priority: Warning)
e0d19036
NB
2217
2218.TP
2219.BI Rebuild NN
2220Where
2221.I NN
9a36a9b7
ZB
2222is a two-digit number (ie. 05, 48). This indicates that rebuild
2223has passed that many percent of the total. The events are generated
2224with fixed increment since 0. Increment size may be specified with
2225a commandline option (default is 20). (syslog priority: Warning)
e0d19036 2226
98c6faba
NB
2227.TP
2228.B RebuildFinished
2229An md array that was rebuilding, isn't any more, either because it
773135f5 2230finished normally or was aborted. (syslog priority: Warning)
98c6faba 2231
e0d19036
NB
2232.TP
2233.B Fail
773135f5
NB
2234An active component device of an array has been marked as
2235faulty. (syslog priority: Critical)
e0d19036
NB
2236
2237.TP
2238.B FailSpare
2239A spare component device which was being rebuilt to replace a faulty
93e790af 2240device has failed. (syslog priority: Critical)
e0d19036
NB
2241
2242.TP
2243.B SpareActive
2244A spare component device which was being rebuilt to replace a faulty
98b24a2a 2245device has been successfully rebuilt and has been made active.
773135f5 2246(syslog priority: Info)
e0d19036
NB
2247
2248.TP
2249.B NewArray
2250A new md array has been detected in the
2251.B /proc/mdstat
e0fe762a 2252file. (syslog priority: Info)
e0d19036 2253
aa88f531
NB
2254.TP
2255.B DegradedArray
2256A newly noticed array appears to be degraded. This message is not
2257generated when
2258.I mdadm
2259notices a drive failure which causes degradation, but only when
2260.I mdadm
2261notices that an array is degraded when it first sees the array.
93e790af 2262(syslog priority: Critical)
aa88f531 2263
e0d19036
NB
2264.TP
2265.B MoveSpare
2266A spare drive has been moved from one array in a
2267.B spare-group
210597d1
PC
2268or
2269.B domain
e0d19036 2270to another to allow a failed drive to be replaced.
773135f5 2271(syslog priority: Info)
e0d19036 2272
b8f72a62
NB
2273.TP
2274.B SparesMissing
2275If
2276.I mdadm
2277has been told, via the config file, that an array should have a certain
2278number of spare devices, and
2279.I mdadm
93e790af 2280detects that it has fewer than this number when it first sees the
b8f72a62
NB
2281array, it will report a
2282.B SparesMissing
2283message.
d1732eeb 2284(syslog priority: Warning)
b8f72a62 2285
98c6faba
NB
2286.TP
2287.B TestMessage
2288An array was found at startup, and the
7e23fc43 2289.B \-\-test
98c6faba 2290flag was given.
773135f5 2291(syslog priority: Info)
e0d19036
NB
2292.RE
2293
2294Only
93e790af
SW
2295.B Fail,
2296.B FailSpare,
2297.B DegradedArray,
2298.B SparesMissing
e0d19036 2299and
98c6faba 2300.B TestMessage
e0d19036 2301cause Email to be sent. All events cause the program to be run.
93e790af 2302The program is run with two or three arguments: the event
e0d19036
NB
2303name, the array device and possibly a second device.
2304
2305Each event has an associated array device (e.g.
2306.BR /dev/md1 )
2307and possibly a second device. For
2308.BR Fail ,
2309.BR FailSpare ,
2310and
2311.B SpareActive
2312the second device is the relevant component device.
2313For
2314.B MoveSpare
2315the second device is the array that the spare was moved from.
2316
2317For
51ac42e3 2318.I mdadm
e0d19036 2319to move spares from one array to another, the different arrays need to
93e790af 2320be labeled with the same
e0d19036 2321.B spare-group
210597d1 2322or the spares must be allowed to migrate through matching POLICY domains
e0d19036
NB
2323in the configuration file. The
2324.B spare-group
93e790af 2325name can be any string; it is only necessary that different spare
2d465520 2326groups use different names.
e0d19036
NB
2327
2328When
51ac42e3 2329.I mdadm
93e790af 2330detects that an array in a spare group has fewer active
e0d19036
NB
2331devices than necessary for the complete array, and has no spare
2332devices, it will look for another array in the same spare group that
2333has a full complement of working drive and a spare. It will then
2334attempt to remove the spare from the second drive and add it to the
2335first.
2336If the removal succeeds but the adding fails, then it is added back to
2337the original array.
2338
210597d1
PC
2339If the spare group for a degraded array is not defined,
2340.I mdadm
2341will look at the rules of spare migration specified by POLICY lines in
87eb4fab 2342.B mdadm.conf
210597d1
PC
2343and then follow similar steps as above if a matching spare is found.
2344
dd0781e5
NB
2345.SH GROW MODE
2346The GROW mode is used for changing the size or shape of an active
2347array.
2348For this to work, the kernel must support the necessary change.
c64881d7 2349Various types of growth are being added during 2.6 development.
dd0781e5 2350
c64881d7 2351Currently the supported changes include
dfd4d8ee 2352.IP \(bu 4
c64881d7 2353change the "size" attribute for RAID1, RAID4, RAID5 and RAID6.
dfd4d8ee 2354.IP \(bu 4
c64881d7
N
2355increase or decrease the "raid\-devices" attribute of RAID0, RAID1, RAID4,
2356RAID5, and RAID6.
cb77f620 2357.IP \(bu 4
c64881d7 2358change the chunk-size and layout of RAID0, RAID4, RAID5 and RAID6.
cb77f620 2359.IP \(bu 4
c64881d7 2360convert between RAID1 and RAID5, between RAID5 and RAID6, between
cb77f620 2361RAID0, RAID4, and RAID5, and between RAID0 and RAID10 (in the near-2 mode).
dfd4d8ee 2362.IP \(bu 4
93e790af 2363add a write-intent bitmap to any array which supports these bitmaps, or
2ae555c3 2364remove a write-intent bitmap from such an array.
dfd4d8ee 2365.PP
dd0781e5 2366
9ab6e80a 2367Using GROW on containers is currently supported only for Intel's IMSM
c64881d7
N
2368container format. The number of devices in a container can be
2369increased - which affects all arrays in the container - or an array
2370in a container can be converted between levels where those levels are
2371supported by the container, and the conversion is on of those listed
9ab6e80a
N
2372above. Resizing arrays in an IMSM container with
2373.B "--grow --size"
2374is not yet supported.
8fd8d9c4 2375
ca24ddb0
AK
2376Grow functionality (e.g. expand a number of raid devices) for Intel's
2377IMSM container format has an experimental status. It is guarded by the
2378.B MDADM_EXPERIMENTAL
2379environment variable which must be set to '1' for a GROW command to
2380succeed.
2381This is for the following reasons:
2382
2383.IP 1.
0de8d44d
AK
2384Intel's native IMSM check-pointing is not fully tested yet.
2385This can causes IMSM incompatibility during the grow process: an array
ca24ddb0
AK
2386which is growing cannot roam between Microsoft Windows(R) and Linux
2387systems.
2388
2389.IP 2.
2390Interrupting a grow operation is not recommended, because it
2391has not been fully tested for Intel's IMSM container format yet.
2392
0de8d44d
AK
2393.PP
2394Note: Intel's native checkpointing doesn't use
2395.B --backup-file
2396option and it is transparent for assembly feature.
2397
2ae555c3 2398.SS SIZE CHANGES
c64881d7 2399Normally when an array is built the "size" is taken from the smallest
dd0781e5
NB
2400of the drives. If all the small drives in an arrays are, one at a
2401time, removed and replaced with larger drives, then you could have an
2402array of large drives with only a small amount used. In this
2403situation, changing the "size" with "GROW" mode will allow the extra
2404space to start being used. If the size is increased in this way, a
2405"resync" process will start to make sure the new parts of the array
2406are synchronised.
2407
2408Note that when an array changes size, any filesystem that may be
cb77f620 2409stored in the array will not automatically grow or shrink to use or
88b496c2 2410vacate the space. The
666bba9b
N
2411filesystem will need to be explicitly told to use the extra space
2412after growing, or to reduce its size
2413.B prior
2414to shrinking the array.
dd0781e5 2415
e0fe762a
N
2416Also the size of an array cannot be changed while it has an active
2417bitmap. If an array has a bitmap, it must be removed before the size
cb77f620 2418can be changed. Once the change is complete a new bitmap can be created.
e0fe762a
N
2419
2420.SS RAID\-DEVICES CHANGES
2ae555c3 2421
dd0781e5
NB
2422A RAID1 array can work with any number of devices from 1 upwards
2423(though 1 is not very useful). There may be times which you want to
2424increase or decrease the number of active devices. Note that this is
2425different to hot-add or hot-remove which changes the number of
2426inactive devices.
2427
2428When reducing the number of devices in a RAID1 array, the slots which
2429are to be removed from the array must already be vacant. That is, the
93e790af 2430devices which were in those slots must be failed and removed.
dd0781e5
NB
2431
2432When the number of devices is increased, any hot spares that are
a9d69660 2433present will be activated immediately.
dd0781e5 2434
f24e2d6c 2435Changing the number of active devices in a RAID5 or RAID6 is much more
2ae555c3 2436effort. Every block in the array will need to be read and written
f24e2d6c 2437back to a new location. From 2.6.17, the Linux Kernel is able to
ca4f89a3
N
2438increase the number of devices in a RAID5 safely, including restarting
2439an interrupted "reshape". From 2.6.31, the Linux Kernel is able to
f24e2d6c
N
2440increase or decrease the number of devices in a RAID5 or RAID6.
2441
c64881d7
N
2442From 2.6.35, the Linux Kernel is able to convert a RAID0 in to a RAID4
2443or RAID5.
2444.I mdadm
2445uses this functionality and the ability to add
2446devices to a RAID4 to allow devices to be added to a RAID0. When
2447requested to do this,
2448.I mdadm
2449will convert the RAID0 to a RAID4, add the necessary disks and make
2450the reshape happen, and then convert the RAID4 back to RAID0.
2451
f24e2d6c
N
2452When decreasing the number of devices, the size of the array will also
2453decrease. If there was data in the array, it could get destroyed and
666bba9b
N
2454this is not reversible, so you should firstly shrink the filesystem on
2455the array to fit within the new size. To help prevent accidents,
f24e2d6c
N
2456.I mdadm
2457requires that the size of the array be decreased first with
2458.BR "mdadm --grow --array-size" .
2459This is a reversible change which simply makes the end of the array
2460inaccessible. The integrity of any data can then be checked before
2461the non-reversible reduction in the number of devices is request.
2ae555c3 2462
cd19c0cf
JR
2463When relocating the first few stripes on a RAID5 or RAID6, it is not
2464possible to keep the data on disk completely consistent and
2465crash-proof. To provide the required safety, mdadm disables writes to
2466the array while this "critical section" is reshaped, and takes a
2467backup of the data that is in that section. For grows, this backup may be
2468stored in any spare devices that the array has, however it can also be
2469stored in a separate file specified with the
7e23fc43 2470.B \-\-backup\-file
cd19c0cf
JR
2471option, and is required to be specified for shrinks, RAID level
2472changes and layout changes. If this option is used, and the system
2473does crash during the critical period, the same file must be passed to
7e23fc43 2474.B \-\-assemble
cd19c0cf
JR
2475to restore the backup and reassemble the array. When shrinking rather
2476than growing the array, the reshape is done from the end towards the
2477beginning, so the "critical section" is at the end of the reshape.
2ae555c3 2478
f24e2d6c
N
2479.SS LEVEL CHANGES
2480
2481Changing the RAID level of any array happens instantaneously. However
cd19c0cf 2482in the RAID5 to RAID6 case this requires a non-standard layout of the
f24e2d6c 2483RAID6 data, and in the RAID6 to RAID5 case that non-standard layout is
cd19c0cf 2484required before the change can be accomplished. So while the level
f24e2d6c 2485change is instant, the accompanying layout change can take quite a
cd19c0cf
JR
2486long time. A
2487.B \-\-backup\-file
2488is required. If the array is not simultaneously being grown or
2489shrunk, so that the array size will remain the same - for example,
2490reshaping a 3-drive RAID5 into a 4-drive RAID6 - the backup file will
2491be used not just for a "cricital section" but throughout the reshape
2492operation, as described below under LAYOUT CHANGES.
f24e2d6c
N
2493
2494.SS CHUNK-SIZE AND LAYOUT CHANGES
2495
2496Changing the chunk-size of layout without also changing the number of
2497devices as the same time will involve re-writing all blocks in-place.
2498To ensure against data loss in the case of a crash, a
2499.B --backup-file
2500must be provided for these changes. Small sections of the array will
cd19c0cf
JR
2501be copied to the backup file while they are being rearranged. This
2502means that all the data is copied twice, once to the backup and once
2503to the new layout on the array, so this type of reshape will go very
2504slowly.
f24e2d6c
N
2505
2506If the reshape is interrupted for any reason, this backup file must be
cd19c0cf 2507made available to
f24e2d6c
N
2508.B "mdadm --assemble"
2509so the array can be reassembled. Consequently the file cannot be
2510stored on the device being reshaped.
2511
2512
2ae555c3
NB
2513.SS BITMAP CHANGES
2514
2515A write-intent bitmap can be added to, or removed from, an active
93e790af 2516array. Either internal bitmaps, or bitmaps stored in a separate file,
fe80f49b 2517can be added. Note that if you add a bitmap stored in a file which is
e0fe762a 2518in a filesystem that is on the RAID array being affected, the system
fe80f49b
NB
2519will deadlock. The bitmap must be on a separate filesystem.
2520
8382f19b
NB
2521.SH INCREMENTAL MODE
2522
2523.HP 12
2524Usage:
7e23fc43
PS
2525.B mdadm \-\-incremental
2526.RB [ \-\-run ]
2527.RB [ \-\-quiet ]
8382f19b
NB
2528.I component-device
2529.HP 12
2530Usage:
29ba4804
N
2531.B mdadm \-\-incremental \-\-fail
2532.I component-device
2533.HP 12
2534Usage:
7e6140e6 2535.B mdadm \-\-incremental \-\-rebuild\-map
8382f19b
NB
2536.HP 12
2537Usage:
7e23fc43 2538.B mdadm \-\-incremental \-\-run \-\-scan
8382f19b 2539
8382f19b
NB
2540.PP
2541This mode is designed to be used in conjunction with a device
2542discovery system. As devices are found in a system, they can be
2543passed to
7e23fc43 2544.B "mdadm \-\-incremental"
8382f19b
NB
2545to be conditionally added to an appropriate array.
2546
29ba4804
N
2547Conversely, it can also be used with the
2548.B \-\-fail
2549flag to do just the opposite and find whatever array a particular device
2550is part of and remove the device from that array.
2551
8fd8d9c4
N
2552If the device passed is a
2553.B CONTAINER
2554device created by a previous call to
2555.IR mdadm ,
2556then rather than trying to add that device to an array, all the arrays
2557described by the metadata of the container will be started.
2558
8382f19b
NB
2559.I mdadm
2560performs a number of tests to determine if the device is part of an
93e790af 2561array, and which array it should be part of. If an appropriate array
8382f19b
NB
2562is found, or can be created,
2563.I mdadm
2564adds the device to the array and conditionally starts the array.
2565
2566Note that
2567.I mdadm
87eb4fab
N
2568will normally only add devices to an array which were previously working
2569(active or spare) parts of that array. The support for automatic
210597d1
PC
2570inclusion of a new drive as a spare in some array requires
2571a configuration through POLICY in config file.
8382f19b 2572
8382f19b
NB
2573The tests that
2574.I mdadm
2575makes are as follow:
2576.IP +
2577Is the device permitted by
2578.BR mdadm.conf ?
2579That is, is it listed in a
2580.B DEVICES
2581line in that file. If
2582.B DEVICES
2583is absent then the default it to allow any device. Similar if
2584.B DEVICES
2585contains the special word
2586.B partitions
2587then any device is allowed. Otherwise the device name given to
2588.I mdadm
2589must match one of the names or patterns in a
2590.B DEVICES
2591line.
2592
2593.IP +
cb77f620
NK
2594Does the device have a valid md superblock? If a specific metadata
2595version is requested with
7e23fc43 2596.B \-\-metadata
8382f19b 2597or
7e23fc43 2598.B \-e
8382f19b
NB
2599then only that style of metadata is accepted, otherwise
2600.I mdadm
2601finds any known version of metadata. If no
2602.I md
210597d1
PC
2603metadata is found, the device may be still added to an array
2604as a spare if POLICY allows.
8382f19b 2605
d1302dd8 2606.ig
8382f19b
NB
2607.IP +
2608Does the metadata match an expected array?
2609The metadata can match in two ways. Either there is an array listed
2610in
2611.B mdadm.conf
2612which identifies the array (either by UUID, by name, by device list,
93e790af 2613or by minor-number), or the array was created with a
8382f19b 2614.B homehost
93e790af 2615specified and that
8382f19b 2616.B homehost
93e790af 2617matches the one in
8382f19b
NB
2618.B mdadm.conf
2619or on the command line.
2620If
2621.I mdadm
2622is not able to positively identify the array as belonging to the
2623current host, the device will be rejected.
d1302dd8 2624..
8382f19b 2625
cb77f620 2626.PP
8382f19b 2627.I mdadm
93e790af 2628keeps a list of arrays that it has partially assembled in
96fd06ed 2629.BR {MAP_PATH} .
e0fe762a 2630If no array exists which matches
8382f19b
NB
2631the metadata on the new device,
2632.I mdadm
2633must choose a device name and unit number. It does this based on any
2634name given in
2635.B mdadm.conf
2636or any name information stored in the metadata. If this name
2637suggests a unit number, that number will be used, otherwise a free
2638unit number will be chosen. Normally
2639.I mdadm
2640will prefer to create a partitionable array, however if the
2641.B CREATE
2642line in
2643.B mdadm.conf
2644suggests that a non-partitionable array is preferred, that will be
2645honoured.
2646
e0fe762a
N
2647If the array is not found in the config file and its metadata does not
2648identify it as belonging to the "homehost", then
2649.I mdadm
2650will choose a name for the array which is certain not to conflict with
2651any array which does belong to this host. It does this be adding an
2652underscore and a small number to the name preferred by the metadata.
2653
8382f19b
NB
2654Once an appropriate array is found or created and the device is added,
2655.I mdadm
2656must decide if the array is ready to be started. It will
2657normally compare the number of available (non-spare) devices to the
2658number of devices that the metadata suggests need to be active. If
2659there are at least that many, the array will be started. This means
2660that if any devices are missing the array will not be restarted.
2661
2662As an alternative,
7e23fc43 2663.B \-\-run
8382f19b 2664may be passed to
51ac42e3 2665.I mdadm
8382f19b 2666in which case the array will be run as soon as there are enough
e0fe762a
N
2667devices present for the data to be accessible. For a RAID1, that
2668means one device will start the array. For a clean RAID5, the array
8382f19b
NB
2669will be started as soon as all but one drive is present.
2670
93e790af 2671Note that neither of these approaches is really ideal. If it can
8382f19b
NB
2672be known that all device discovery has completed, then
2673.br
7e23fc43 2674.B " mdadm \-IRs"
8382f19b
NB
2675.br
2676can be run which will try to start all arrays that are being
2677incrementally assembled. They are started in "read-auto" mode in
2678which they are read-only until the first write request. This means
2679that no metadata updates are made and no attempt at resync or recovery
2680happens. Further devices that are found before the first write can
2681still be added safely.
2682
5545fa6d
DW
2683.SH ENVIRONMENT
2684This section describes environment variables that affect how mdadm
2685operates.
2686
2687.TP
2688.B MDADM_NO_MDMON
2689Setting this value to 1 will prevent mdadm from automatically launching
2690mdmon. This variable is intended primarily for debugging mdadm/mdmon.
2691
8fd8d9c4
N
2692.TP
2693.B MDADM_NO_UDEV
2694Normally,
2695.I mdadm
2696does not create any device nodes in /dev, but leaves that task to
2697.IR udev .
2698If
2699.I udev
2700appears not to be configured, or if this environment variable is set
2701to '1', the
2702.I mdadm
2703will create and devices that are needed.
2704
2d465520
NB
2705.SH EXAMPLES
2706
7e23fc43 2707.B " mdadm \-\-query /dev/name-of-device"
2d465520 2708.br
e0fe762a 2709This will find out if a given device is a RAID array, or is part of
5787fa49 2710one, and will provide brief information about the device.
2d465520 2711
7e23fc43 2712.B " mdadm \-\-assemble \-\-scan"
2d465520 2713.br
93e790af 2714This will assemble and start all arrays listed in the standard config
5787fa49 2715file. This command will typically go in a system startup file.
2d465520 2716
7e23fc43 2717.B " mdadm \-\-stop \-\-scan"
5787fa49 2718.br
93e790af 2719This will shut down all arrays that can be shut down (i.e. are not
19f8b8fc 2720currently in use). This will typically go in a system shutdown script.
2d465520 2721
7e23fc43 2722.B " mdadm \-\-follow \-\-scan \-\-delay=120"
2d465520 2723.br
5787fa49
NB
2724If (and only if) there is an Email address or program given in the
2725standard config file, then
2726monitor the status of all arrays listed in that file by
2727polling them ever 2 minutes.
2d465520 2728
7e23fc43 2729.B " mdadm \-\-create /dev/md0 \-\-level=1 \-\-raid\-devices=2 /dev/hd[ac]1"
2d465520 2730.br
5787fa49 2731Create /dev/md0 as a RAID1 array consisting of /dev/hda1 and /dev/hdc1.
2d465520 2732
2d465520 2733.br
7e23fc43 2734.B " echo 'DEVICE /dev/hd*[0\-9] /dev/sd*[0\-9]' > mdadm.conf"
2d465520 2735.br
7e23fc43 2736.B " mdadm \-\-detail \-\-scan >> mdadm.conf"
2d465520 2737.br
5787fa49
NB
2738This will create a prototype config file that describes currently
2739active arrays that are known to be made from partitions of IDE or SCSI drives.
2d465520
NB
2740This file should be reviewed before being used as it may
2741contain unwanted detail.
2742
7e23fc43 2743.B " echo 'DEVICE /dev/hd[a\-z] /dev/sd*[a\-z]' > mdadm.conf"
2d465520 2744.br
7e23fc43 2745.B " mdadm \-\-examine \-\-scan \-\-config=mdadm.conf >> mdadm.conf"
93e790af
SW
2746.br
2747This will find arrays which could be assembled from existing IDE and
2748SCSI whole drives (not partitions), and store the information in the
5787fa49 2749format of a config file.
2d465520
NB
2750This file is very likely to contain unwanted detail, particularly
2751the
2752.B devices=
5787fa49
NB
2753entries. It should be reviewed and edited before being used as an
2754actual config file.
2d465520 2755
7e23fc43 2756.B " mdadm \-\-examine \-\-brief \-\-scan \-\-config=partitions"
2d465520 2757.br
7e23fc43 2758.B " mdadm \-Ebsc partitions"
5787fa49
NB
2759.br
2760Create a list of devices by reading
2761.BR /proc/partitions ,
2762scan these for RAID superblocks, and printout a brief listing of all
93e790af 2763that were found.
2d465520 2764
7e23fc43 2765.B " mdadm \-Ac partitions \-m 0 /dev/md0"
2d465520 2766.br
5787fa49
NB
2767Scan all partitions and devices listed in
2768.BR /proc/partitions
2769and assemble
2770.B /dev/md0
2771out of all such devices with a RAID superblock with a minor number of 0.
2d465520 2772
96fd06ed 2773.B " mdadm \-\-monitor \-\-scan \-\-daemonise > /run/mdadm/mon.pid"
d013a55e
NB
2774.br
2775If config file contains a mail address or alert program, run mdadm in
2776the background in monitor mode monitoring all md devices. Also write
2777pid of mdadm daemon to
96fd06ed 2778.BR /run/mdadm/mon.pid .
d013a55e 2779
7e23fc43 2780.B " mdadm \-Iq /dev/somedevice"
8382f19b
NB
2781.br
2782Try to incorporate newly discovered device into some array as
2783appropriate.
2784
7e6140e6 2785.B " mdadm \-\-incremental \-\-rebuild\-map \-\-run \-\-scan"
8382f19b
NB
2786.br
2787Rebuild the array map from any current arrays, and then start any that
2788can be started.
2789
b80da661
NB
2790.B " mdadm /dev/md4 --fail detached --remove detached"
2791.br
2792Any devices which are components of /dev/md4 will be marked as faulty
2793and then remove from the array.
2794
cb77f620 2795.B " mdadm --grow /dev/md4 --level=6 --backup-file=/root/backup-md4"
f24e2d6c
N
2796.br
2797The array
2798.B /dev/md4
2799which is currently a RAID5 array will be converted to RAID6. There
2800should normally already be a spare drive attached to the array as a
2801RAID6 needs one more drive than a matching RAID5.
2802
8fd8d9c4
N
2803.B " mdadm --create /dev/md/ddf --metadata=ddf --raid-disks 6 /dev/sd[a-f]"
2804.br
2805Create a DDF array over 6 devices.
2806
2807.B " mdadm --create /dev/md/home -n3 -l5 -z 30000000 /dev/md/ddf"
2808.br
e0fe762a 2809Create a RAID5 array over any 3 devices in the given DDF set. Use
8fd8d9c4
N
2810only 30 gigabytes of each device.
2811
2812.B " mdadm -A /dev/md/ddf1 /dev/sd[a-f]"
2813.br
2814Assemble a pre-exist ddf array.
2815
2816.B " mdadm -I /dev/md/ddf1"
2817.br
2818Assemble all arrays contained in the ddf array, assigning names as
2819appropriate.
2820
7e23fc43 2821.B " mdadm \-\-create \-\-help"
2d465520 2822.br
2ae555c3 2823Provide help about the Create mode.
2d465520 2824
7e23fc43 2825.B " mdadm \-\-config \-\-help"
5787fa49
NB
2826.br
2827Provide help about the format of the config file.
2d465520 2828
7e23fc43 2829.B " mdadm \-\-help"
5787fa49
NB
2830.br
2831Provide general help.
cd29a5c8 2832
cd29a5c8
NB
2833.SH FILES
2834
2835.SS /proc/mdstat
2836
2ae555c3
NB
2837If you're using the
2838.B /proc
cd29a5c8
NB
2839filesystem,
2840.B /proc/mdstat
2d465520 2841lists all active md devices with information about them.
51ac42e3 2842.I mdadm
2d465520 2843uses this to find arrays when
7e23fc43 2844.B \-\-scan
2d465520
NB
2845is given in Misc mode, and to monitor array reconstruction
2846on Monitor mode.
2847
9a9dab36 2848.SS /etc/mdadm.conf
cd29a5c8 2849
11a3e71d
NB
2850The config file lists which devices may be scanned to see if
2851they contain MD super block, and gives identifying information
2852(e.g. UUID) about known MD arrays. See
2853.BR mdadm.conf (5)
2854for more details.
cd29a5c8 2855
96fd06ed 2856.SS {MAP_PATH}
8382f19b 2857When
7e23fc43 2858.B \-\-incremental
93e790af 2859mode is used, this file gets a list of arrays currently being created.
8382f19b 2860
48f7b27a
NB
2861.SH DEVICE NAMES
2862
48f7b27a 2863.I mdadm
8fd8d9c4
N
2864understand two sorts of names for array devices.
2865
2866The first is the so-called 'standard' format name, which matches the
2867names used by the kernel and which appear in
2868.IR /proc/mdstat .
2869
2870The second sort can be freely chosen, but must reside in
2871.IR /dev/md/ .
2872When giving a device name to
2873.I mdadm
2874to create or assemble an array, either full path name such as
2875.I /dev/md0
2876or
2877.I /dev/md/home
2878can be given, or just the suffix of the second sort of name, such as
2879.I home
2880can be given.
2881
2882When
2883.I mdadm
e0fe762a
N
2884chooses device names during auto-assembly or incremental assembly, it
2885will sometimes add a small sequence number to the end of the name to
2886avoid conflicted between multiple arrays that have the same name. If
8fd8d9c4
N
2887.I mdadm
2888can reasonably determine that the array really is meant for this host,
2889either by a hostname in the metadata, or by the presence of the array
87eb4fab
N
2890in
2891.BR mdadm.conf ,
2892then it will leave off the suffix if possible.
e0fe762a
N
2893Also if the homehost is specified as
2894.B <ignore>
2895.I mdadm
2896will only use a suffix if a different array of the same name already
2897exists or is listed in the config file.
48f7b27a
NB
2898
2899The standard names for non-partitioned arrays (the only sort of md
8fd8d9c4 2900array available in 2.4 and earlier) are of the form
48f7b27a
NB
2901.IP
2902/dev/mdNN
48f7b27a
NB
2903.PP
2904where NN is a number.
2905The standard names for partitionable arrays (as available from 2.6
8fd8d9c4 2906onwards) are of the form
48f7b27a 2907.IP
48f7b27a
NB
2908/dev/md_dNN
2909.PP
2910Partition numbers should be indicated by added "pMM" to these, thus "/dev/md/d1p2".
8fd8d9c4
N
2911.PP
2912From kernel version, 2.6.28 the "non-partitioned array" can actually
2913be partitioned. So the "md_dNN" names are no longer needed, and
2914partitions such as "/dev/mdNNpXX" are possible.
52826846 2915
2d465520 2916.SH NOTE
51ac42e3 2917.I mdadm
2d465520 2918was previously known as
51ac42e3 2919.IR mdctl .
a9d69660 2920.P
51ac42e3 2921.I mdadm
a9d69660 2922is completely separate from the
51ac42e3 2923.I raidtools
a9d69660
NB
2924package, and does not use the
2925.I /etc/raidtab
2926configuration file at all.
2927
52826846 2928.SH SEE ALSO
75f74377 2929For further information on mdadm usage, MD and the various levels of
3cdfb6a7 2930RAID, see:
3cdfb6a7 2931.IP
cb77f620 2932.B http://raid.wiki.kernel.org/
75f74377
DG
2933.PP
2934(based upon Jakob \(/Ostergaard's Software\-RAID.HOWTO)
e43d0cda
NB
2935.\".PP
2936.\"for new releases of the RAID driver check out:
2937.\"
2938.\".IP
e0fe762a 2939.\".UR ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
e43d0cda
NB
2940.\"ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
2941.\".UE
2942.\".PP
2943.\"or
2944.\".IP
2945.\".UR http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2946.\"http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2947.\".UE
cd29a5c8 2948.PP
2ae555c3 2949The latest version of
a9d69660
NB
2950.I mdadm
2951should always be available from
cd29a5c8 2952.IP
11cd8b79
N
2953.B http://www.kernel.org/pub/linux/utils/raid/mdadm/
2954.PP
2955Related man pages:
cd29a5c8 2956.PP
e0fe762a 2957.IR mdmon (8),
a9d69660
NB
2958.IR mdadm.conf (5),
2959.IR md (4).
56eb10c0 2960.PP
52826846
NB
2961.IR raidtab (5),
2962.IR raid0run (8),
2963.IR raidstop (8),
a9d69660 2964.IR mkraid (8).