]> git.ipfire.org Git - thirdparty/mdadm.git/blame - mdadm.8.in
super1: fix some casts of signed superblock fields.
[thirdparty/mdadm.git] / mdadm.8.in
CommitLineData
52826846 1.\" -*- nroff -*-
e43d0cda
NB
2.\" Copyright Neil Brown and others.
3.\" This program is free software; you can redistribute it and/or modify
4.\" it under the terms of the GNU General Public License as published by
5.\" the Free Software Foundation; either version 2 of the License, or
6.\" (at your option) any later version.
7.\" See file COPYING in distribution for details.
3b2aad6e 8.TH MDADM 8 "" v3.2.5
52826846 9.SH NAME
9a9dab36 10mdadm \- manage MD devices
cd29a5c8 11.I aka
93e790af 12Linux Software RAID
cd29a5c8 13
52826846
NB
14.SH SYNOPSIS
15
e0d19036 16.BI mdadm " [mode] <raiddevice> [options] <component-devices>"
52826846 17
2ae555c3 18.SH DESCRIPTION
52826846 19RAID devices are virtual devices created from two or more
e0fe762a 20real block devices. This allows multiple devices (typically disk
35cc5be4 21drives or partitions thereof) to be combined into a single device to
cd29a5c8 22hold (for example) a single filesystem.
2d465520 23Some RAID levels include redundancy and so can survive some degree of
cd29a5c8
NB
24device failure.
25
2d465520
NB
26Linux Software RAID devices are implemented through the md (Multiple
27Devices) device driver.
cd29a5c8
NB
28
29Currently, Linux supports
30.B LINEAR
31md devices,
32.B RAID0
33(striping),
34.B RAID1
35(mirroring),
d013a55e
NB
36.BR RAID4 ,
37.BR RAID5 ,
98c6faba 38.BR RAID6 ,
1a7dfc35 39.BR RAID10 ,
b5e64645 40.BR MULTIPATH ,
90c8d668 41.BR FAULTY ,
cd29a5c8 42and
90c8d668 43.BR CONTAINER .
d013a55e 44
a9d69660
NB
45.B MULTIPATH
46is not a Software RAID mechanism, but does involve
93e790af 47multiple devices:
d013a55e 48each device is a path to one common physical storage device.
9652457e
N
49New installations should not use md/multipath as it is not well
50supported and has no ongoing development. Use the Device Mapper based
51multipath-tools instead.
d013a55e 52
a9d69660
NB
53.B FAULTY
54is also not true RAID, and it only involves one device. It
b5e64645 55provides a layer over a true device that can be used to inject faults.
52826846 56
4cce4069 57.B CONTAINER
8fd8d9c4
N
58is different again. A
59.B CONTAINER
60is a collection of devices that are
90c8d668
N
61managed as a set. This is similar to the set of devices connected to
62a hardware RAID controller. The set of devices may contain a number
9652457e 63of different RAID arrays each utilising some (or all) of the blocks from a
90c8d668 64number of the devices in the set. For example, two devices in a 5-device set
9652457e 65might form a RAID1 using the whole devices. The remaining three might
90c8d668
N
66have a RAID5 over the first half of each device, and a RAID0 over the
67second half.
68
8fd8d9c4
N
69With a
70.BR CONTAINER ,
71there is one set of metadata that describes all of
72the arrays in the container. So when
73.I mdadm
74creates a
75.B CONTAINER
9652457e
N
76device, the device just represents the metadata. Other normal arrays (RAID1
77etc) can be created inside the container.
52826846
NB
78
79.SH MODES
8382f19b 80mdadm has several major modes of operation:
cd29a5c8
NB
81.TP
82.B Assemble
93e790af 83Assemble the components of a previously created
e0fe762a 84array into an active array. Components can be explicitly given
2ae555c3 85or can be searched for.
51ac42e3 86.I mdadm
cd29a5c8
NB
87checks that the components
88do form a bona fide array, and can, on request, fiddle superblock
89information so as to assemble a faulty array.
90
91.TP
92.B Build
e0fe762a 93Build an array that doesn't have per-device metadata (superblocks). For these
a9d69660
NB
94sorts of arrays,
95.I mdadm
96cannot differentiate between initial creation and subsequent assembly
97of an array. It also cannot perform any checks that appropriate
93e790af 98components have been requested. Because of this, the
a9d69660
NB
99.B Build
100mode should only be used together with a complete understanding of
101what you are doing.
cd29a5c8
NB
102
103.TP
104.B Create
e0fe762a
N
105Create a new array with per-device metadata (superblocks).
106Appropriate metadata is written to each device, and then the array
107comprising those devices is activated. A 'resync' process is started
108to make sure that the array is consistent (e.g. both sides of a mirror
109contain the same data) but the content of the device is left otherwise
110untouched.
111The array can be used as soon as it has been created. There is no
112need to wait for the initial resync to finish.
cd29a5c8 113
cd29a5c8
NB
114.TP
115.B "Follow or Monitor"
5787fa49 116Monitor one or more md devices and act on any state changes. This is
e0fe762a
N
117only meaningful for RAID1, 4, 5, 6, 10 or multipath arrays, as
118only these have interesting state. RAID0 or Linear never have
98c6faba 119missing, spare, or failed drives, so there is nothing to monitor.
5787fa49 120
dd0781e5
NB
121.TP
122.B "Grow"
123Grow (or shrink) an array, or otherwise reshape it in some way.
124Currently supported growth options including changing the active size
c64881d7
N
125of component devices and changing the number of active devices in
126Linear and RAID levels 0/1/4/5/6,
127changing the RAID level between 0, 1, 5, and 6, and between 0 and 10,
128changing the chunk size and layout for RAID 0,4,5,6, as well as adding or
f24e2d6c 129removing a write-intent bitmap.
cd29a5c8 130
8382f19b
NB
131.TP
132.B "Incremental Assembly"
133Add a single device to an appropriate array. If the addition of the
134device makes the array runnable, the array will be started.
135This provides a convenient interface to a
136.I hot-plug
137system. As each device is detected,
138.I mdadm
139has a chance to include it in some array as appropriate.
29ba4804
N
140Optionally, when the
141.I \-\-fail
142flag is passed in we will remove the device from any active array
143instead of adding it.
9652457e 144
8fd8d9c4
N
145If a
146.B CONTAINER
147is passed to
148.I mdadm
149in this mode, then any arrays within that container will be assembled
150and started.
8382f19b 151
2ae555c3
NB
152.TP
153.B Manage
154This is for doing things to specific components of an array such as
155adding new spares and removing faulty devices.
156
157.TP
158.B Misc
159This is an 'everything else' mode that supports operations on active
160arrays, operations on component devices such as erasing old superblocks, and
161information gathering operations.
e43d0cda
NB
162.\"This mode allows operations on independent devices such as examine MD
163.\"superblocks, erasing old superblocks and stopping active arrays.
2ae555c3 164
1f48664b
NB
165.TP
166.B Auto-detect
167This mode does not act on a specific device or array, but rather it
168requests the Linux Kernel to activate any auto-detected arrays.
52826846
NB
169.SH OPTIONS
170
2ae555c3 171.SH Options for selecting a mode are:
52826846 172
cd29a5c8 173.TP
7e23fc43 174.BR \-A ", " \-\-assemble
2d465520 175Assemble a pre-existing array.
52826846 176
cd29a5c8 177.TP
7e23fc43 178.BR \-B ", " \-\-build
cd29a5c8 179Build a legacy array without superblocks.
52826846 180
cd29a5c8 181.TP
7e23fc43 182.BR \-C ", " \-\-create
cd29a5c8 183Create a new array.
52826846 184
cd29a5c8 185.TP
7e23fc43 186.BR \-F ", " \-\-follow ", " \-\-monitor
cd29a5c8
NB
187Select
188.B Monitor
189mode.
52826846 190
dd0781e5 191.TP
7e23fc43 192.BR \-G ", " \-\-grow
dd0781e5 193Change the size or shape of an active array.
8382f19b
NB
194
195.TP
1f48664b 196.BR \-I ", " \-\-incremental
29ba4804 197Add/remove a single device to/from an appropriate array, and possibly start the array.
8382f19b 198
1f48664b
NB
199.TP
200.B \-\-auto-detect
201Request that the kernel starts any auto-detected arrays. This can only
202work if
203.I md
204is compiled into the kernel \(em not if it is a module.
205Arrays can be auto-detected by the kernel if all the components are in
206primary MS-DOS partitions with partition type
e0fe762a
N
207.BR FD ,
208and all use v0.90 metadata.
1f48664b
NB
209In-kernel autodetect is not recommended for new installations. Using
210.I mdadm
211to detect and assemble arrays \(em possibly in an
212.I initrd
213\(em is substantially more flexible and should be preferred.
214
2ae555c3
NB
215.P
216If a device is given before any options, or if the first option is
7e23fc43
PS
217.BR \-\-add ,
218.BR \-\-fail ,
7e23fc43 219.BR \-\-remove ,
70c55e36
N
220or
221.BR \-\-replace ,
e0fe762a 222then the MANAGE mode is assumed.
2ae555c3
NB
223Anything other than these will cause the
224.B Misc
225mode to be assumed.
dd0781e5 226
2ae555c3 227.SH Options that are not mode-specific are:
e793c2e5 228
cd29a5c8 229.TP
7e23fc43 230.BR \-h ", " \-\-help
a9d69660 231Display general help message or, after one of the above options, a
93e790af 232mode-specific help message.
56eedc1a
NB
233
234.TP
7e23fc43 235.B \-\-help\-options
56eedc1a
NB
236Display more detailed help about command line parsing and some commonly
237used options.
52826846 238
cd29a5c8 239.TP
7e23fc43 240.BR \-V ", " \-\-version
9a9dab36 241Print version information for mdadm.
52826846 242
cd29a5c8 243.TP
7e23fc43 244.BR \-v ", " \-\-verbose
22892d56
NB
245Be more verbose about what is happening. This can be used twice to be
246extra-verbose.
a9d69660 247The extra verbosity currently only affects
7e23fc43 248.B \-\-detail \-\-scan
22892d56 249and
7e23fc43 250.BR "\-\-examine \-\-scan" .
52826846 251
dab6685f 252.TP
7e23fc43 253.BR \-q ", " \-\-quiet
dab6685f 254Avoid printing purely informative messages. With this,
51ac42e3 255.I mdadm
dab6685f
NB
256will be silent unless there is something really important to report.
257
08ca2adf 258
e0d19036 259.TP
7e23fc43 260.BR \-f ", " \-\-force
93e790af 261Be more forceful about certain operations. See the various modes for
e0d19036
NB
262the exact meaning of this option in different contexts.
263
264.TP
7e23fc43 265.BR \-c ", " \-\-config=
2ae555c3
NB
266Specify the config file. Default is to use
267.BR /etc/mdadm.conf ,
93e790af 268or if that is missing then
2ae555c3 269.BR /etc/mdadm/mdadm.conf .
5787fa49 270If the config file given is
93e790af 271.B "partitions"
5787fa49
NB
272then nothing will be read, but
273.I mdadm
274will act as though the config file contained exactly
8fd8d9c4 275.B "DEVICE partitions containers"
5787fa49
NB
276and will read
277.B /proc/partitions
8fd8d9c4
N
278to find a list of devices to scan, and
279.B /proc/mdstat
280to find a list of containers to examine.
d013a55e 281If the word
93e790af 282.B "none"
d013a55e
NB
283is given for the config file, then
284.I mdadm
285will act as though the config file were empty.
e0d19036
NB
286
287.TP
7e23fc43 288.BR \-s ", " \-\-scan
93e790af 289Scan config file or
e0d19036
NB
290.B /proc/mdstat
291for missing information.
292In general, this option gives
51ac42e3 293.I mdadm
93e790af
SW
294permission to get any missing information (like component devices,
295array devices, array identities, and alert destination) from the
296configuration file (see previous option);
297one exception is MISC mode when using
7e23fc43 298.B \-\-detail
e0d19036 299or
93e790af 300.B \-\-stop,
e0d19036 301in which case
7e23fc43 302.B \-\-scan
e0d19036
NB
303says to get a list of array devices from
304.BR /proc/mdstat .
305
570c0542 306.TP
d16c7af6 307.BR \-e ", " \-\-metadata=
e0fe762a 308Declare the style of RAID metadata (superblock) to be used. The
26f467a9 309default is {DEFAULT_METADATA} for
7e23fc43 310.BR \-\-create ,
53e8b987 311and to guess for other operations.
2790ffe3
GB
312The default can be overridden by setting the
313.B metadata
314value for the
315.B CREATE
316keyword in
317.BR mdadm.conf .
570c0542
NB
318
319Options are:
320.RS
26f467a9 321.ie '{DEFAULT_METADATA}'0.90'
322.IP "0, 0.90, default"
323.el
7d5c3964 324.IP "0, 0.90"
570c0542 325Use the original 0.90 format superblock. This format limits arrays to
93e790af 32628 component devices and limits component devices of levels 1 and
cd19c0cf
JR
327greater to 2 terabytes. It is also possible for there to be confusion
328about whether the superblock applies to a whole device or just the
329last partition, if that partition starts on a 64K boundary.
26f467a9 330.ie '{DEFAULT_METADATA}'0.90'
331.IP "1, 1.0, 1.1, 1.2"
332.el
7d5c3964 333.IP "1, 1.0, 1.1, 1.2 default"
cd19c0cf
JR
334Use the new version-1 format superblock. This has fewer restrictions.
335It can easily be moved between hosts with different endian-ness, and a
336recovery operation can be checkpointed and restarted. The different
337sub-versions store the superblock at different locations on the
338device, either at the end (for 1.0), at the start (for 1.1) or 4K from
7050aa3f
N
339the start (for 1.2). "1" is equivalent to "1.2" (the commonly
340preferred 1.x format).
26f467a9 341'if '{DEFAULT_METADATA}'1.2' "default" is equivalent to "1.2".
8fd8d9c4 342.IP ddf
e0fe762a
N
343Use the "Industry Standard" DDF (Disk Data Format) format defined by
344SNIA.
345When creating a DDF array a
8fd8d9c4
N
346.B CONTAINER
347will be created, and normal arrays can be created in that container.
348.IP imsm
4cce4069 349Use the Intel(R) Matrix Storage Manager metadata format. This creates a
8fd8d9c4 350.B CONTAINER
4cce4069
DW
351which is managed in a similar manner to DDF, and is supported by an
352option-rom on some platforms:
353.IP
354.B http://www.intel.com/design/chipsets/matrixstorage_sb.htm
355.PP
570c0542
NB
356.RE
357
41a3b72a 358.TP
7e23fc43 359.B \-\-homehost=
35cc5be4 360This will override any
41a3b72a 361.B HOMEHOST
93e790af 362setting in the config file and provides the identity of the host which
41a3b72a
NB
363should be considered the home for any arrays.
364
365When creating an array, the
366.B homehost
e0fe762a 367will be recorded in the metadata. For version-1 superblocks, it will
93e790af 368be prefixed to the array name. For version-0.90 superblocks, part of
41a3b72a
NB
369the SHA1 hash of the hostname will be stored in the later half of the
370UUID.
371
372When reporting information about an array, any array which is tagged
373for the given homehost will be reported as such.
374
375When using Auto-Assemble, only arrays tagged for the given homehost
0ac91628 376will be allowed to use 'local' names (i.e. not ending in '_' followed
e0fe762a
N
377by a digit string). See below under
378.BR "Auto Assembly" .
41a3b72a 379
c2ecf5f6
N
380.TP
381.B \-\-prefer=
382When
383.I mdadm
384needs to print the name for a device it normally finds the name in
385.B /dev
386which refers to the device and is shortest. When a path component is
387given with
388.B \-\-prefer
389.I mdadm
390will prefer a longer name if it contains that component. For example
391.B \-\-prefer=by-uuid
392will prefer a name in a subdirectory of
393.B /dev
394called
395.BR by-uuid .
396
397This functionality is currently only provided by
398.B \-\-detail
399and
400.BR \-\-monitor .
401
2ae555c3
NB
402.SH For create, build, or grow:
403
404.TP
7e23fc43 405.BR \-n ", " \-\-raid\-devices=
2ae555c3
NB
406Specify the number of active devices in the array. This, plus the
407number of spare devices (see below) must equal the number of
408.I component-devices
409(including "\fBmissing\fP" devices)
410that are listed on the command line for
e0fe762a 411.BR \-\-create .
2ae555c3
NB
412Setting a value of 1 is probably
413a mistake and so requires that
7e23fc43 414.B \-\-force
2ae555c3 415be specified first. A value of 1 will then be allowed for linear,
e0fe762a 416multipath, RAID0 and RAID1. It is never allowed for RAID4, RAID5 or RAID6.
2ae555c3
NB
417.br
418This number can only be changed using
7e23fc43 419.B \-\-grow
e0fe762a
N
420for RAID1, RAID4, RAID5 and RAID6 arrays, and only on kernels which provide
421the necessary support.
2ae555c3
NB
422
423.TP
7e23fc43 424.BR \-x ", " \-\-spare\-devices=
2ae555c3
NB
425Specify the number of spare (eXtra) devices in the initial array.
426Spares can also be added
427and removed later. The number of component devices listed
e0fe762a 428on the command line must equal the number of RAID devices plus the
2ae555c3
NB
429number of spare devices.
430
2ae555c3 431.TP
7e23fc43 432.BR \-z ", " \-\-size=
e0fe762a 433Amount (in Kibibytes) of space to use from each drive in RAID levels 1/4/5/6.
2ae555c3
NB
434This must be a multiple of the chunk size, and must leave about 128Kb
435of space at the end of the drive for the RAID superblock.
436If this is not specified
437(as it normally is not) the smallest drive (or partition) sets the
438size, though if there is a variance among the drives of greater than 1%, a warning is
439issued.
440
36fad8ec
N
441A suffix of 'M' or 'G' can be given to indicate Megabytes or
442Gigabytes respectively.
443
9ab6e80a
N
444Sometimes a replacement drive can be a little smaller than the
445original drives though this should be minimised by IDEMA standards.
446Such a replacement drive will be rejected by
447.IR md .
448To guard against this it can be useful to set the initial size
449slightly smaller than the smaller device with the aim that it will
450still be larger than any replacement.
451
2ae555c3 452This value can be set with
7e23fc43 453.B \-\-grow
9ab6e80a
N
454for RAID level 1/4/5/6 though
455.B CONTAINER
456based arrays such as those with IMSM metadata may not be able to
457support this.
458If the array was created with a size smaller than the currently
459active drives, the extra space can be accessed using
7e23fc43 460.BR \-\-grow .
2ae555c3
NB
461The size can be given as
462.B max
463which means to choose the largest size that fits on all current drives.
52826846 464
c26d78fe
N
465Before reducing the size of the array (with
466.BR "\-\-grow \-\-size=" )
467you should make sure that space isn't needed. If the device holds a
468filesystem, you would need to resize the filesystem to use less space.
469
470After reducing the array size you should check that the data stored in
471the device is still available. If the device holds a filesystem, then
472an 'fsck' of the filesystem is a minimum requirement. If there are
473problems the array can be made bigger again with no loss with another
474.B "\-\-grow \-\-size="
475command.
476
9ab6e80a 477This value cannot be used when creating a
8fd8d9c4 478.B CONTAINER
9ab6e80a
N
479such as with DDF and IMSM metadata, though it perfectly valid when
480creating an array inside a container.
8fd8d9c4 481
f24e2d6c 482.TP
c26d78fe 483.BR \-Z ", " \-\-array\-size=
f24e2d6c
N
484This is only meaningful with
485.B \-\-grow
36fad8ec 486and its effect is not persistent: when the array is stopped and
f24e2d6c
N
487restarted the default array size will be restored.
488
489Setting the array-size causes the array to appear smaller to programs
490that access the data. This is particularly needed before reshaping an
491array so that it will be smaller. As the reshape is not reversible,
492but setting the size with
493.B \-\-array-size
494is, it is required that the array size is reduced as appropriate
495before the number of devices in the array is reduced.
496
c26d78fe
N
497Before reducing the size of the array you should make sure that space
498isn't needed. If the device holds a filesystem, you would need to
499resize the filesystem to use less space.
500
501After reducing the array size you should check that the data stored in
502the device is still available. If the device holds a filesystem, then
503an 'fsck' of the filesystem is a minimum requirement. If there are
504problems the array can be made bigger again with no loss with another
505.B "\-\-grow \-\-array\-size="
506command.
507
36fad8ec
N
508A suffix of 'M' or 'G' can be given to indicate Megabytes or
509Gigabytes respectively.
510A value of
511.B max
512restores the apparent size of the array to be whatever the real
513amount of available space is.
514
cd29a5c8 515.TP
7e23fc43 516.BR \-c ", " \-\-chunk=
5f175898
N
517Specify chunk size of kibibytes. The default when creating an
518array is 512KB. To ensure compatibility with earlier versions, the
519default when Building and array with no persistent metadata is 64KB.
e0fe762a 520This is only meaningful for RAID0, RAID4, RAID5, RAID6, and RAID10.
52826846 521
a252c078
N
522RAID4, RAID5, RAID6, and RAID10 require the chunk size to be a power
523of 2. In any case it must be a multiple of 4KB.
524
36fad8ec
N
525A suffix of 'M' or 'G' can be given to indicate Megabytes or
526Gigabytes respectively.
527
cd29a5c8 528.TP
7e23fc43 529.BR \-\-rounding=
e0fe762a
N
530Specify rounding factor for a Linear array. The size of each
531component will be rounded down to a multiple of this size.
532This is a synonym for
533.B \-\-chunk
534but highlights the different meaning for Linear as compared to other
5f175898
N
535RAID levels. The default is 64K if a kernel earlier than 2.6.16 is in
536use, and is 0K (i.e. no rounding) in later kernels.
52826846 537
cd29a5c8 538.TP
7e23fc43 539.BR \-l ", " \-\-level=
e0fe762a 540Set RAID level. When used with
7e23fc43 541.BR \-\-create ,
98c6faba 542options are: linear, raid0, 0, stripe, raid1, 1, mirror, raid4, 4,
8fd8d9c4
N
543raid5, 5, raid6, 6, raid10, 10, multipath, mp, faulty, container.
544Obviously some of these are synonymous.
545
546When a
547.B CONTAINER
548metadata type is requested, only the
549.B container
550level is permitted, and it does not need to be explicitly given.
aa88f531
NB
551
552When used with
7e23fc43 553.BR \-\-build ,
a9d69660 554only linear, stripe, raid0, 0, raid1, multipath, mp, and faulty are valid.
52826846 555
fd547b50
N
556Can be used with
557.B \-\-grow
558to change the RAID level in some cases. See LEVEL CHANGES below.
2ae555c3 559
cd29a5c8 560.TP
7e23fc43 561.BR \-p ", " \-\-layout=
f24e2d6c
N
562This option configures the fine details of data layout for RAID5, RAID6,
563and RAID10 arrays, and controls the failure modes for
1a7dfc35
NB
564.IR faulty .
565
e0fe762a 566The layout of the RAID5 parity block can be one of
7e23fc43
PS
567.BR left\-asymmetric ,
568.BR left\-symmetric ,
569.BR right\-asymmetric ,
570.BR right\-symmetric ,
53e8b987
PS
571.BR la ", " ra ", " ls ", " rs .
572The default is
7e23fc43 573.BR left\-symmetric .
52826846 574
cd19c0cf 575It is also possible to cause RAID5 to use a RAID4-like layout by
e0fe762a
N
576choosing
577.BR parity\-first ,
578or
579.BR parity\-last .
580
581Finally for RAID5 there are DDF\-compatible layouts,
582.BR ddf\-zero\-restart ,
583.BR ddf\-N\-restart ,
584and
585.BR ddf\-N\-continue .
586
587These same layouts are available for RAID6. There are also 4 layouts
588that will provide an intermediate stage for converting between RAID5
589and RAID6. These provide a layout which is identical to the
590corresponding RAID5 layout on the first N\-1 devices, and has the 'Q'
591syndrome (the second 'parity' block used by RAID6) on the last device.
592These layouts are:
593.BR left\-symmetric\-6 ,
594.BR right\-symmetric\-6 ,
595.BR left\-asymmetric\-6 ,
596.BR right\-asymmetric\-6 ,
597and
10adfe9a 598.BR parity\-first\-6 .
e0fe762a 599
93e790af
SW
600When setting the failure mode for level
601.I faulty,
1a7dfc35 602the options are:
7e23fc43
PS
603.BR write\-transient ", " wt ,
604.BR read\-transient ", " rt ,
605.BR write\-persistent ", " wp ,
606.BR read\-persistent ", " rp ,
607.BR write\-all ,
608.BR read\-fixable ", " rf ,
53e8b987 609.BR clear ", " flush ", " none .
b5e64645 610
93e790af 611Each failure mode can be followed by a number, which is used as a period
b5e64645
NB
612between fault generation. Without a number, the fault is generated
613once on the first relevant request. With a number, the fault will be
93e790af 614generated after that many requests, and will continue to be generated
b5e64645
NB
615every time the period elapses.
616
617Multiple failure modes can be current simultaneously by using the
7e23fc43 618.B \-\-grow
53e8b987 619option to set subsequent failure modes.
b5e64645
NB
620
621"clear" or "none" will remove any pending or periodic failure modes,
2ae555c3 622and "flush" will clear any persistent faults.
b5e64645 623
6f9a21a7 624Finally, the layout options for RAID10 are one of 'n', 'o' or 'f' followed
93e790af 625by a small number. The default is 'n2'. The supported options are:
1a7dfc35 626
93e790af 627.I 'n'
e0fe762a 628signals 'near' copies. Multiple copies of one data block are at
b578481c
NB
629similar offsets in different devices.
630
93e790af 631.I 'o'
b578481c
NB
632signals 'offset' copies. Rather than the chunks being duplicated
633within a stripe, whole stripes are duplicated but are rotated by one
634device so duplicate blocks are on different devices. Thus subsequent
635copies of a block are in the next drive, and are one chunk further
636down.
637
93e790af 638.I 'f'
1a7dfc35 639signals 'far' copies
93e790af 640(multiple copies have very different offsets).
e0fe762a 641See md(4) for more detail about 'near', 'offset', and 'far'.
1a7dfc35
NB
642
643The number is the number of copies of each datablock. 2 is normal, 3
644can be useful. This number can be at most equal to the number of
645devices in the array. It does not need to divide evenly into that
646number (e.g. it is perfectly legal to have an 'n2' layout for an array
647with an odd number of devices).
648
f24e2d6c
N
649When an array is converted between RAID5 and RAID6 an intermediate
650RAID6 layout is used in which the second parity block (Q) is always on
651the last device. To convert a RAID5 to RAID6 and leave it in this new
652layout (which does not require re-striping) use
653.BR \-\-layout=preserve .
654This will try to avoid any restriping.
655
656The converse of this is
657.B \-\-layout=normalise
658which will change a non-standard RAID6 layout into a more standard
659arrangement.
660
cd29a5c8 661.TP
7e23fc43 662.BR \-\-parity=
53e8b987 663same as
7e23fc43 664.B \-\-layout
53e8b987 665(thus explaining the p of
7e23fc43 666.BR \-p ).
52826846 667
e793c2e5 668.TP
7e23fc43 669.BR \-b ", " \-\-bitmap=
e793c2e5 670Specify a file to store a write-intent bitmap in. The file should not
53e8b987 671exist unless
7e23fc43 672.B \-\-force
53e8b987 673is also given. The same file should be provided
2ae555c3 674when assembling the array. If the word
93e790af 675.B "internal"
2ae555c3
NB
676is given, then the bitmap is stored with the metadata on the array,
677and so is replicated on all devices. If the word
93e790af 678.B "none"
2ae555c3 679is given with
7e23fc43 680.B \-\-grow
2ae555c3 681mode, then any bitmap that is present is removed.
e793c2e5 682
2ae555c3
NB
683To help catch typing errors, the filename must contain at least one
684slash ('/') if it is a real file (not 'internal' or 'none').
685
686Note: external bitmaps are only known to work on ext2 and ext3.
687Storing bitmap files on other filesystems may result in serious problems.
e793c2e5 688
748952f7
N
689When creating an array on devices which are 100G or larger,
690.I mdadm
691automatically adds an internal bitmap as it will usually be
692beneficial. This can be suppressed with
693.B "\-\-bitmap=none".
694
cd29a5c8 695.TP
7e23fc43 696.BR \-\-bitmap\-chunk=
e0fe762a 697Set the chunksize of the bitmap. Each bit corresponds to that many
1bfdbe01
NB
698Kilobytes of storage.
699When using a file based bitmap, the default is to use the smallest
93e790af 700size that is at-least 4 and requires no more than 2^21 chunks.
2ae555c3
NB
701When using an
702.B internal
b8ab2a50
N
703bitmap, the chunksize defaults to 64Meg, or larger if necessary to
704fit the bitmap into the available space.
5787fa49 705
36fad8ec
N
706A suffix of 'M' or 'G' can be given to indicate Megabytes or
707Gigabytes respectively.
708
cd29a5c8 709.TP
7e23fc43 710.BR \-W ", " \-\-write\-mostly
e0fe762a 711subsequent devices listed in a
7e23fc43
PS
712.BR \-\-build ,
713.BR \-\-create ,
2ae555c3 714or
7e23fc43 715.B \-\-add
2ae555c3
NB
716command will be flagged as 'write-mostly'. This is valid for RAID1
717only and means that the 'md' driver will avoid reading from these
718devices if at all possible. This can be useful if mirroring over a
719slow link.
52826846 720
2ae555c3 721.TP
7e23fc43 722.BR \-\-write\-behind=
2ae555c3 723Specify that write-behind mode should be enabled (valid for RAID1
e0fe762a
N
724only). If an argument is specified, it will set the maximum number
725of outstanding writes allowed. The default value is 256.
2ae555c3
NB
726A write-intent bitmap is required in order to use write-behind
727mode, and write-behind is only attempted on drives marked as
728.IR write-mostly .
dd0781e5
NB
729
730.TP
7e23fc43 731.BR \-\-assume\-clean
dd0781e5
NB
732Tell
733.I mdadm
47d79ef8
NB
734that the array pre-existed and is known to be clean. It can be useful
735when trying to recover from a major failure as you can be sure that no
736data will be affected unless you actually write to the array. It can
737also be used when creating a RAID1 or RAID10 if you want to avoid the
b3f1c093 738initial resync, however this practice \(em while normally safe \(em is not
e0fe762a 739recommended. Use this only if you really know what you are doing.
6acad481
ME
740.IP
741When the devices that will be part of a new array were filled
742with zeros before creation the operator knows the array is
743actually clean. If that is the case, such as after running
744badblocks, this argument can be used to tell mdadm the
745facts the operator knows.
ce52f92f
N
746.IP
747When an array is resized to a larger size with
748.B "\-\-grow \-\-size="
749the new space is normally resynced in that same way that the whole
6cbf8fb8 750array is resynced at creation. From Linux version 3.0,
ce52f92f
N
751.B \-\-assume\-clean
752can be used with that command to avoid the automatic resync.
dd0781e5 753
2ae555c3 754.TP
7e23fc43 755.BR \-\-backup\-file=
53e8b987 756This is needed when
7e23fc43 757.B \-\-grow
cd19c0cf
JR
758is used to increase the number of raid-devices in a RAID5 or RAID6 if
759there are no spare devices available, or to shrink, change RAID level
760or layout. See the GROW MODE section below on RAID\-DEVICES CHANGES.
761The file must be stored on a separate device, not on the RAID array
762being reshaped.
2ae555c3 763
40c9a66a
N
764.TP
765.B \-\-data\-offset=
766Arrays with 1.x metadata can leave a gap between the start of the
767device and the start of array data. This gap can be used for various
768metadata. The start of data is known as the
769.IR data\-offset .
770Normally an appropriate data offset is computed automatically.
771However it can be useful to set it explicitly such as when re-creating
772an array which was originally created using a different version of
773.I mdadm
774which computed a different offset.
775
776Setting the offset explicitly over-rides the default. The value given
777is in Kilobytes unless an 'M' or 'G' suffix is given.
778
779Since Linux 3.4,
780.B \-\-data\-offset
781can also be used with
782.B --grow
783for some RAID levels (initially on RAID10). This allows the
72ca9bcf 784data\-offset to be changed as part of the reshape process. When the
40c9a66a
N
785data offset is changed, no backup file is required as the difference
786in offsets is used to provide the same functionality.
787
788When the new offset is earlier than the old offset, the number of
789devices in the array cannot shrink. When it is after the old offset,
790the number of devices in the array cannot increase.
791
72ca9bcf
N
792When creating an array,
793.B \-\-data\-offset
794can be specified as
795.BR variable .
796In the case each member device is expected to have a offset appended
797to the name, separated by a colon. This makes it possible to recreate
798exactly an array which has varying data offsets (as can happen when
799different versions of
800.I mdadm
801are used to add different devices).
802
f211a137
AK
803.TP
804.BR \-\-continue
805This option is complementary to the
806.B \-\-freeze-reshape
807option for assembly. It is needed when
808.B \-\-grow
809operation is interrupted and it is not restarted automatically due to
810.B \-\-freeze-reshape
811usage during array assembly. This option is used together with
812.BR \-G
813, (
814.BR \-\-grow
815) command and device for a pending reshape to be continued.
816All parameters required for reshape continuation will be read from array metadata.
817If initial
818.BR \-\-grow
819command had required
820.BR \-\-backup\-file=
821option to be set, continuation option will require to have exactly the same
822backup file given as well.
823.IP
824Any other parameter passed together with
825.BR \-\-continue
826option will be ignored.
827
947fd4dd 828.TP
7e23fc43 829.BR \-N ", " \-\-name=
947fd4dd
NB
830Set a
831.B name
832for the array. This is currently only effective when creating an
e0fe762a
N
833array with a version-1 superblock, or an array in a DDF container.
834The name is a simple textual string that can be used to identify array
835components when assembling. If name is needed but not specified, it
836is taken from the basename of the device that is being created.
837e.g. when creating
838.I /dev/md/home
839the
840.B name
841will default to
842.IR home .
947fd4dd 843
dd0781e5 844.TP
7e23fc43 845.BR \-R ", " \-\-run
dd0781e5
NB
846Insist that
847.I mdadm
848run the array, even if some of the components
849appear to be active in another array or filesystem. Normally
850.I mdadm
851will ask for confirmation before including such components in an
852array. This option causes that question to be suppressed.
853
854.TP
7e23fc43 855.BR \-f ", " \-\-force
dd0781e5
NB
856Insist that
857.I mdadm
858accept the geometry and layout specified without question. Normally
859.I mdadm
860will not allow creation of an array with only one device, and will try
e0fe762a 861to create a RAID5 array with one missing drive (as this makes the
dd0781e5 862initial resync work faster). With
7e23fc43 863.BR \-\-force ,
dd0781e5
NB
864.I mdadm
865will not try to be so clever.
866
0ea8f5b1
N
867.TP
868.BR \-o ", " \-\-readonly
869Start the array
870.B read only
871rather than read-write as normal. No writes will be allowed to the
872array, and no resync, recovery, or reshape will be started.
873
dd0781e5 874.TP
257c1dc2
N
875.BR \-a ", " "\-\-auto{=yes,md,mdp,part,p}{NN}"
876Instruct mdadm how to create the device file if needed, possibly allocating
48f7b27a 877an unused minor number. "md" causes a non-partitionable array
257c1dc2
N
878to be used (though since Linux 2.6.28, these array devices are in fact
879partitionable). "mdp", "part" or "p" causes a partitionable array (2.6 and
2ae555c3 880later) to be used. "yes" requires the named md device to have
f9c25f1d 881a 'standard' format, and the type and minor number will be determined
257c1dc2
N
882from this. With mdadm 3.0, device creation is normally left up to
883.I udev
884so this option is unlikely to be needed.
885See DEVICE NAMES below.
48f7b27a 886
a9d69660 887The argument can also come immediately after
7e23fc43 888"\-a". e.g. "\-ap".
dd0781e5 889
53e8b987 890If
7e23fc43 891.B \-\-auto
53e8b987 892is not given on the command line or in the config file, then
75723446 893the default will be
7e23fc43 894.BR \-\-auto=yes .
75723446 895
1337546d 896If
7e23fc43 897.B \-\-scan
1337546d
NB
898is also given, then any
899.I auto=
35cc5be4 900entries in the config file will override the
7e23fc43 901.B \-\-auto
1337546d
NB
902instruction given on the command line.
903
dd0781e5
NB
904For partitionable arrays,
905.I mdadm
906will create the device file for the whole array and for the first 4
907partitions. A different number of partitions can be specified at the
908end of this option (e.g.
7e23fc43 909.BR \-\-auto=p7 ).
2ae555c3 910If the device name ends with a digit, the partition names add a 'p',
e0fe762a
N
911and a number, e.g.
912.IR /dev/md/home1p3 .
913If there is no trailing digit, then the partition names just have a
914number added, e.g.
915.IR /dev/md/scratch3 .
dd0781e5 916
48f7b27a
NB
917If the md device name is in a 'standard' format as described in DEVICE
918NAMES, then it will be created, if necessary, with the appropriate
e0fe762a
N
919device number based on that name. If the device name is not in one of these
920formats, then a unused device number will be allocated. The device
48f7b27a
NB
921number will be considered unused if there is no active array for that
922number, and there is no entry in /dev for that number and with a
e0fe762a 923non-standard name. Names that are not in 'standard' format are only
8fd8d9c4
N
924allowed in "/dev/md/".
925
3c7efacb
NK
926This is meaningful with
927.B \-\-create
928or
929.BR \-\-build .
930
3c7efacb
NK
931.TP
932.BR \-a ", " "\-\-add"
933This option can be used in Grow mode in two cases.
934
935If the target array is a Linear array, then
936.B \-\-add
937can be used to add one or more devices to the array. They
938are simply catenated on to the end of the array. Once added, the
939devices cannot be removed.
940
941If the
942.B \-\-raid\-disks
943option is being used to increase the number of devices in an array,
944then
945.B \-\-add
946can be used to add some extra devices to be included in the array.
947In most cases this is not needed as the extra devices can be added as
948spares first, and then the number of raid-disks can be changed.
949However for RAID0, it is not possible to add spares. So to increase
950the number of devices in a RAID0, it is necessary to set the new
951number of devices, and to add the new devices, in the same command.
952
52826846
NB
953.SH For assemble:
954
cd29a5c8 955.TP
7e23fc43 956.BR \-u ", " \-\-uuid=
e0fe762a 957uuid of array to assemble. Devices which don't have this uuid are
cd29a5c8
NB
958excluded
959
960.TP
7e23fc43 961.BR \-m ", " \-\-super\-minor=
cd29a5c8
NB
962Minor number of device that array was created for. Devices which
963don't have this minor number are excluded. If you create an array as
2d465520 964/dev/md1, then all superblocks will contain the minor number 1, even if
cd29a5c8
NB
965the array is later assembled as /dev/md2.
966
d013a55e 967Giving the literal word "dev" for
7e23fc43 968.B \-\-super\-minor
d013a55e
NB
969will cause
970.I mdadm
971to use the minor number of the md device that is being assembled.
972e.g. when assembling
973.BR /dev/md0 ,
51ac42e3 974.B \-\-super\-minor=dev
d013a55e
NB
975will look for super blocks with a minor number of 0.
976
e0fe762a
N
977.B \-\-super\-minor
978is only relevant for v0.90 metadata, and should not normally be used.
979Using
980.B \-\-uuid
981is much safer.
982
947fd4dd 983.TP
7e23fc43 984.BR \-N ", " \-\-name=
947fd4dd 985Specify the name of the array to assemble. This must be the name
624920bb 986that was specified when creating the array. It must either match
93e790af 987the name stored in the superblock exactly, or it must match
41a3b72a 988with the current
624920bb 989.I homehost
93e790af 990prefixed to the start of the given name.
947fd4dd 991
cd29a5c8 992.TP
7e23fc43 993.BR \-f ", " \-\-force
e0fe762a
N
994Assemble the array even if the metadata on some devices appears to be
995out-of-date. If
996.I mdadm
997cannot find enough working devices to start the array, but can find
998some devices that are recorded as having failed, then it will mark
999those devices as working so that the array can be started.
1000An array which requires
1001.B \-\-force
1002to be started may contain data corruption. Use it carefully.
52826846 1003
cd29a5c8 1004.TP
7e23fc43 1005.BR \-R ", " \-\-run
b8a8ccf9
NB
1006Attempt to start the array even if fewer drives were given than were
1007present last time the array was active. Normally if not all the
1008expected drives are found and
7e23fc43 1009.B \-\-scan
cd29a5c8
NB
1010is not used, then the array will be assembled but not started.
1011With
7e23fc43 1012.B \-\-run
cd29a5c8 1013an attempt will be made to start it anyway.
52826846 1014
b8a8ccf9 1015.TP
7e23fc43 1016.B \-\-no\-degraded
b8a8ccf9 1017This is the reverse of
7e23fc43 1018.B \-\-run
93e790af 1019in that it inhibits the startup of array unless all expected drives
b8a8ccf9 1020are present. This is only needed with
93e790af
SW
1021.B \-\-scan,
1022and can be used if the physical connections to devices are
b8a8ccf9
NB
1023not as reliable as you would like.
1024
dd0781e5 1025.TP
7e23fc43 1026.BR \-a ", " "\-\-auto{=no,yes,md,mdp,part}"
dd0781e5
NB
1027See this option under Create and Build options.
1028
e793c2e5 1029.TP
7e23fc43 1030.BR \-b ", " \-\-bitmap=
2ae555c3
NB
1031Specify the bitmap file that was given when the array was created. If
1032an array has an
1033.B internal
1034bitmap, there is no need to specify this when assembling the array.
1035
1036.TP
7e23fc43 1037.BR \-\-backup\-file=
2ae555c3 1038If
7e23fc43 1039.B \-\-backup\-file
87f26d14
N
1040was used while reshaping an array (e.g. changing number of devices or
1041chunk size) and the system crashed during the critical section, then the same
7e23fc43 1042.B \-\-backup\-file
53e8b987 1043must be presented to
7e23fc43 1044.B \-\-assemble
cd19c0cf
JR
1045to allow possibly corrupted data to be restored, and the reshape
1046to be completed.
e793c2e5 1047
87f26d14
N
1048.TP
1049.BR \-\-invalid\-backup
1050If the file needed for the above option is not available for any
1051reason an empty file can be given together with this option to
1052indicate that the backup file is invalid. In this case the data that
1053was being rearranged at the time of the crash could be irrecoverably
1054lost, but the rest of the array may still be recoverable. This option
1055should only be used as a last resort if there is no way to recover the
1056backup file.
1057
1058
5787fa49 1059.TP
7e23fc43 1060.BR \-U ", " \-\-update=
5787fa49 1061Update the superblock on each device while assembling the array. The
feb716e9
NB
1062argument given to this flag can be one of
1063.BR sparc2.2 ,
1064.BR summaries ,
7d99579f 1065.BR uuid ,
c4f12c13 1066.BR name ,
0237e0ca 1067.BR homehost ,
e5329c37 1068.BR resync ,
586ed405 1069.BR byteorder ,
bee8ec56 1070.BR devicesize ,
5a31170d 1071.BR no\-bitmap ,
688e99a7
N
1072.BR bbl ,
1073.BR no-\bbl ,
5787fa49 1074or
7e23fc43 1075.BR super\-minor .
5787fa49
NB
1076
1077The
1078.B sparc2.2
7d99579f 1079option will adjust the superblock of an array what was created on a Sparc
5787fa49
NB
1080machine running a patched 2.2 Linux kernel. This kernel got the
1081alignment of part of the superblock wrong. You can use the
7e23fc43 1082.B "\-\-examine \-\-sparc2.2"
5787fa49
NB
1083option to
1084.I mdadm
1085to see what effect this would have.
1086
1087The
7e23fc43 1088.B super\-minor
5787fa49 1089option will update the
2ae555c3 1090.B "preferred minor"
5787fa49 1091field on each superblock to match the minor number of the array being
45c073c9
NB
1092assembled.
1093This can be useful if
7e23fc43 1094.B \-\-examine
45c073c9 1095reports a different "Preferred Minor" to
7e23fc43 1096.BR \-\-detail .
45c073c9 1097In some cases this update will be performed automatically
e0fe762a 1098by the kernel driver. In particular the update happens automatically
45c073c9
NB
1099at the first write to an array with redundancy (RAID level 1 or
1100greater) on a 2.6 (or later) kernel.
5787fa49 1101
7d99579f
NB
1102The
1103.B uuid
1104option will change the uuid of the array. If a UUID is given with the
7e23fc43 1105.B \-\-uuid
53e8b987 1106option that UUID will be used as a new UUID and will
7d99579f
NB
1107.B NOT
1108be used to help identify the devices in the array.
53e8b987 1109If no
7e23fc43 1110.B \-\-uuid
53e8b987 1111is given, a random UUID is chosen.
7d99579f 1112
c4f12c13
NB
1113The
1114.B name
1115option will change the
1116.I name
1117of the array as stored in the superblock. This is only supported for
1118version-1 superblocks.
1119
0237e0ca
NB
1120The
1121.B homehost
1122option will change the
1123.I homehost
1124as recorded in the superblock. For version-0 superblocks, this is the
1125same as updating the UUID.
1126For version-1 superblocks, this involves updating the name.
1127
e5329c37
NB
1128The
1129.B resync
1130option will cause the array to be marked
1131.I dirty
e0fe762a
N
1132meaning that any redundancy in the array (e.g. parity for RAID5,
1133copies for RAID1) may be incorrect. This will cause the RAID system
e5329c37
NB
1134to perform a "resync" pass to make sure that all redundant information
1135is correct.
1136
586ed405
NB
1137The
1138.B byteorder
1139option allows arrays to be moved between machines with different
1140byte-order.
2ae555c3 1141When assembling such an array for the first time after a move, giving
7e23fc43 1142.B "\-\-update=byteorder"
586ed405
NB
1143will cause
1144.I mdadm
1145to expect superblocks to have their byteorder reversed, and will
1146correct that order before assembling the array. This is only valid
2ae555c3 1147with original (Version 0.90) superblocks.
586ed405 1148
feb716e9
NB
1149The
1150.B summaries
e0fe762a 1151option will correct the summaries in the superblock. That is the
feb716e9 1152counts of total, working, active, failed, and spare devices.
5787fa49 1153
bee8ec56
NB
1154The
1155.B devicesize
5a31170d 1156option will rarely be of use. It applies to version 1.1 and 1.2 metadata
bee8ec56
NB
1157only (where the metadata is at the start of the device) and is only
1158useful when the component device has changed size (typically become
1159larger). The version 1 metadata records the amount of the device that
1160can be used to store data, so if a device in a version 1.1 or 1.2
1161array becomes larger, the metadata will still be visible, but the
1162extra space will not. In this case it might be useful to assemble the
1163array with
7e23fc43 1164.BR \-\-update=devicesize .
bee8ec56
NB
1165This will cause
1166.I mdadm
1167to determine the maximum usable amount of space on each device and
1168update the relevant field in the metadata.
1169
5a31170d
N
1170The
1171.B no\-bitmap
1172option can be used when an array has an internal bitmap which is
1173corrupt in some way so that assembling the array normally fails. It
1174will cause any internal bitmap to be ignored.
1175
688e99a7
N
1176The
1177.B bbl
1178option will reserve space in each device for a bad block list. This
1179will be 4K in size and positioned near the end of any free space
1180between the superblock and the data.
1181
1182The
1183.B no\-bbl
1184option will cause any reservation of space for a bad block list to be
1185removed. If the bad block list contains entries, this will fail, as
1186removing the list could cause data corruption.
1187
afd0a969
AK
1188.TP
1189.BR \-\-freeze\-reshape
1190Option is intended to be used in start-up scripts during initrd boot phase.
1191When array under reshape is assembled during initrd phase, this option
1192stops reshape after reshape critical section is being restored. This happens
1193before file system pivot operation and avoids loss of file system context.
1194Losing file system context would cause reshape to be broken.
1195
a6482415
N
1196Reshape can be continued later using the
1197.B \-\-continue
1198option for the grow command.
afd0a969 1199
e0d19036 1200.SH For Manage mode:
52826846 1201
3d5279b0
N
1202.TP
1203.BR \-t ", " \-\-test
1204Unless a more serious error occurred,
1205.I mdadm
1206will exit with a status of 2 if no changes were made to the array and
12070 if at least one change was made.
1208This can be useful when an indirect specifier such as
1209.BR missing ,
1210.B detached
1211or
1212.B faulty
1213is used in requesting an operation on the array.
1214.B \-\-test
1215will report failure if these specifiers didn't find any match.
1216
cd29a5c8 1217.TP
7e23fc43 1218.BR \-a ", " \-\-add
3d5279b0
N
1219hot-add listed devices.
1220If a device appears to have recently been part of the array
342460cb 1221(possibly it failed or was removed) the device is re\-added as described
3d5279b0
N
1222in the next point.
1223If that fails or the device was never part of the array, the device is
1224added as a hot-spare.
1225If the array is degraded, it will immediately start to rebuild data
1226onto that spare.
1227
1228Note that this and the following options are only meaningful on array
1229with redundancy. They don't apply to RAID0 or Linear.
52826846 1230
fe80f49b 1231.TP
7e23fc43 1232.BR \-\-re\-add
3d5279b0
N
1233re\-add a device that was previous removed from an array.
1234If the metadata on the device reports that it is a member of the
1235array, and the slot that it used is still vacant, then the device will
1236be added back to the array in the same position. This will normally
1237cause the data for that device to be recovered. However based on the
1238event count on the device, the recovery may only require sections that
1239are flagged a write-intent bitmap to be recovered or may not require
1240any recovery at all.
1241
1242When used on an array that has no metadata (i.e. it was built with
1243.BR \-\-build)
1244it will be assumed that bitmap-based recovery is enough to make the
1245device fully consistent with the array.
fe80f49b 1246
688e99a7 1247When used with v1.x metadata,
833bb0f8
N
1248.B \-\-re\-add
1249can be accompanied by
688e99a7
N
1250.BR \-\-update=devicesize ,
1251.BR \-\-update=bbl ", or"
1252.BR \-\-update=no\-bbl .
1253See the description of these option when used in Assemble mode for an
1254explanation of their use.
833bb0f8 1255
a4e13010
N
1256If the device name given is
1257.B missing
262e3b7f
N
1258then
1259.I mdadm
1260will try to find any device that looks like it should be
a4e13010
N
1261part of the array but isn't and will try to re\-add all such devices.
1262
262e3b7f
N
1263If the device name given is
1264.B faulty
1265then
1266.I mdadm
1267will find all devices in the array that are marked
1268.BR faulty ,
1269remove them and attempt to immediately re\-add them. This can be
1270useful if you are certain that the reason for failure has been
1271resolved.
1272
cd29a5c8 1273.TP
7e23fc43 1274.BR \-r ", " \-\-remove
2d465520 1275remove listed devices. They must not be active. i.e. they should
64a78416
N
1276be failed or spare devices.
1277
1278As well as the name of a device file
b80da661
NB
1279(e.g.
1280.BR /dev/sda1 )
1281the words
64a78416 1282.BR failed ,
b80da661 1283.B detached
64a78416
N
1284and names like
1285.B set-A
b80da661
NB
1286can be given to
1287.BR \-\-remove .
1288The first causes all failed device to be removed. The second causes
93e790af 1289any device which is no longer connected to the system (i.e an 'open'
b80da661
NB
1290returns
1291.BR ENXIO )
64a78416
N
1292to be removed.
1293The third will remove a set as describe below under
1294.BR \-\-fail .
52826846 1295
cd29a5c8 1296.TP
7e23fc43 1297.BR \-f ", " \-\-fail
70c55e36 1298Mark listed devices as faulty.
b80da661
NB
1299As well as the name of a device file, the word
1300.B detached
64a78416
N
1301or a set name like
1302.B set\-A
1303can be given. The former will cause any device that has been detached from
b80da661 1304the system to be marked as failed. It can then be removed.
52826846 1305
64a78416
N
1306For RAID10 arrays where the number of copies evenly divides the number
1307of devices, the devices can be conceptually divided into sets where
1308each set contains a single complete copy of the data on the array.
1309Sometimes a RAID10 array will be configured so that these sets are on
1310separate controllers. In this case all the devices in one set can be
1311failed by giving a name like
1312.B set\-A
1313or
1314.B set\-B
1315to
1316.BR \-\-fail .
1317The appropriate set names are reported by
1318.BR \-\-detail .
1319
cd29a5c8 1320.TP
7e23fc43 1321.BR \-\-set\-faulty
53e8b987 1322same as
7e23fc43 1323.BR \-\-fail .
52826846 1324
70c55e36
N
1325.TP
1326.B \-\-replace
1327Mark listed devices as requiring replacement. As soon as a spare is
1328available, it will be rebuilt and will replace the marked device.
1329This is similar to marking a device as faulty, but the device remains
1330in service during the recovery process to increase resilience against
1331multiple failures. When the replacement process finishes, the
1332replaced device will be marked as faulty.
1333
1334.TP
1335.B \-\-with
1336This can follow a list of
1337.B \-\-replace
1338devices. The devices listed after
1339.B \-\-with
1340will be preferentially used to replace the devices listed after
1341.BR \-\-replace .
1342These device must already be spare devices in the array.
1343
b3d31955
N
1344.TP
1345.BR \-\-write\-mostly
a4e13010 1346Subsequent devices that are added or re\-added will have the 'write-mostly'
e0fe762a 1347flag set. This is only valid for RAID1 and means that the 'md' driver
b3d31955
N
1348will avoid reading from these devices if possible.
1349.TP
1350.BR \-\-readwrite
a4e13010 1351Subsequent devices that are added or re\-added will have the 'write-mostly'
b3d31955
N
1352flag cleared.
1353
2ae555c3 1354.P
e0fe762a 1355Each of these options requires that the first device listed is the array
93e790af 1356to be acted upon, and the remainder are component devices to be added,
e0fe762a 1357removed, marked as faulty, etc. Several different operations can be
2ae555c3
NB
1358specified for different devices, e.g.
1359.in +5
7e23fc43 1360mdadm /dev/md0 \-\-add /dev/sda1 \-\-fail /dev/sdb1 \-\-remove /dev/sdb1
2ae555c3
NB
1361.in -5
1362Each operation applies to all devices listed until the next
93e790af 1363operation.
2ae555c3
NB
1364
1365If an array is using a write-intent bitmap, then devices which have
a4e13010 1366been removed can be re\-added in a way that avoids a full
93e790af 1367reconstruction but instead just updates the blocks that have changed
2ae555c3
NB
1368since the device was removed. For arrays with persistent metadata
1369(superblocks) this is done automatically. For arrays created with
7e23fc43 1370.B \-\-build
2ae555c3 1371mdadm needs to be told that this device we removed recently with
7e23fc43 1372.BR \-\-re\-add .
2ae555c3
NB
1373
1374Devices can only be removed from an array if they are not in active
93e790af
SW
1375use, i.e. that must be spares or failed devices. To remove an active
1376device, it must first be marked as
1377.B faulty.
2ae555c3
NB
1378
1379.SH For Misc mode:
1380
1381.TP
7e23fc43 1382.BR \-Q ", " \-\-query
2ae555c3
NB
1383Examine a device to see
1384(1) if it is an md device and (2) if it is a component of an md
1385array.
1386Information about what is discovered is presented.
1387
1388.TP
7e23fc43 1389.BR \-D ", " \-\-detail
e0fe762a 1390Print details of one or more md devices.
5787fa49 1391
4cce4069
DW
1392.TP
1393.BR \-\-detail\-platform
e0fe762a 1394Print details of the platform's RAID capabilities (firmware / hardware
9eafa1de
MN
1395topology) for a given metadata format. If used without argument, mdadm
1396will scan all controllers looking for their capabilities. Otherwise, mdadm
1397will only look at the controller specified by the argument in form of an
1398absolute filepath or a link, e.g.
1399.IR /sys/devices/pci0000:00/0000:00:1f.2 .
4cce4069 1400
54bad364
KS
1401.TP
1402.BR \-Y ", " \-\-export
1403When used with
e50cf220 1404.B \-\-detail , \-\-detail-platform
0d726f17
KS
1405or
1406.BR \-\-examine ,
54bad364
KS
1407output will be formatted as
1408.B key=value
1409pairs for easy import into the environment.
1410
2ae555c3 1411.TP
7e23fc43 1412.BR \-E ", " \-\-examine
e0fe762a
N
1413Print contents of the metadata stored on the named device(s).
1414Note the contrast between
1415.B \-\-examine
1416and
1417.BR \-\-detail .
1418.B \-\-examine
1419applies to devices which are components of an array, while
1420.B \-\-detail
1421applies to a whole array which is currently active.
5787fa49 1422.TP
7e23fc43 1423.B \-\-sparc2.2
e0fe762a
N
1424If an array was created on a SPARC machine with a 2.2 Linux kernel
1425patched with RAID support, the superblock will have been created
1426incorrectly, or at least incompatibly with 2.4 and later kernels.
1427Using the
7e23fc43 1428.B \-\-sparc2.2
5787fa49 1429flag with
7e23fc43 1430.B \-\-examine
5787fa49
NB
1431will fix the superblock before displaying it. If this appears to do
1432the right thing, then the array can be successfully assembled using
7e23fc43 1433.BR "\-\-assemble \-\-update=sparc2.2" .
5787fa49 1434
2ae555c3 1435.TP
7e23fc43 1436.BR \-X ", " \-\-examine\-bitmap
2ae555c3 1437Report information about a bitmap file.
01d9299c 1438The argument is either an external bitmap file or an array component
e0fe762a
N
1439in case of an internal bitmap. Note that running this on an array
1440device (e.g.
1441.BR /dev/md0 )
1442does not report the bitmap for that array.
e0d19036 1443
6d388a88
N
1444.TP
1445.B \-\-examine\-badblocks
1446List the bad-blocks recorded for the device, if a bad-blocks list has
1447been configured. Currently only
1448.B 1.x
1449metadata supports bad-blocks lists.
1450
74db60b0
N
1451.TP
1452.BI \-\-dump= directory
1453.TP
1454.BI \-\-restore= directory
1455Save metadata from lists devices, or restore metadata to listed devices.
1456
cd29a5c8 1457.TP
7e23fc43 1458.BR \-R ", " \-\-run
e0fe762a
N
1459start a partially assembled array. If
1460.B \-\-assemble
1461did not find enough devices to fully start the array, it might leaving
1462it partially assembled. If you wish, you can then use
1463.B \-\-run
1464to start the array in degraded mode.
52826846 1465
cd29a5c8 1466.TP
7e23fc43 1467.BR \-S ", " \-\-stop
cd29a5c8 1468deactivate array, releasing all resources.
52826846 1469
cd29a5c8 1470.TP
7e23fc43 1471.BR \-o ", " \-\-readonly
cd29a5c8 1472mark array as readonly.
52826846 1473
cd29a5c8 1474.TP
7e23fc43 1475.BR \-w ", " \-\-readwrite
cd29a5c8 1476mark array as readwrite.
52826846 1477
e0d19036 1478.TP
7e23fc43 1479.B \-\-zero\-superblock
e0d19036 1480If the device contains a valid md superblock, the block is
35cc5be4 1481overwritten with zeros. With
7e23fc43 1482.B \-\-force
35cc5be4 1483the block where the superblock would be is overwritten even if it
e0d19036 1484doesn't appear to be valid.
52826846 1485
33414a01
DW
1486.TP
1487.B \-\-kill\-subarray=
1488If the device is a container and the argument to \-\-kill\-subarray
1489specifies an inactive subarray in the container, then the subarray is
1490deleted. Deleting all subarrays will leave an 'empty-container' or
1491spare superblock on the drives. See \-\-zero\-superblock for completely
1492removing a superblock. Note that some formats depend on the subarray
1493index for generating a UUID, this command will fail if it would change
1494the UUID of an active subarray.
1495
aa534678
DW
1496.TP
1497.B \-\-update\-subarray=
1498If the device is a container and the argument to \-\-update\-subarray
1499specifies a subarray in the container, then attempt to update the given
1500superblock field in the subarray. See below in
1501.B MISC MODE
1502for details.
1503
feb716e9 1504.TP
7e23fc43 1505.BR \-t ", " \-\-test
feb716e9 1506When used with
7e23fc43 1507.BR \-\-detail ,
feb716e9
NB
1508the exit status of
1509.I mdadm
e0fe762a
N
1510is set to reflect the status of the device. See below in
1511.B MISC MODE
1512for details.
feb716e9 1513
b90c0e9a 1514.TP
7e23fc43 1515.BR \-W ", " \-\-wait
b90c0e9a
NB
1516For each md device given, wait for any resync, recovery, or reshape
1517activity to finish before returning.
1518.I mdadm
1519will return with success if it actually waited for every device
1520listed, otherwise it will return failure.
1521
1770662b
DW
1522.TP
1523.BR \-\-wait\-clean
fabbfd48
DW
1524For each md device given, or each device in /proc/mdstat if
1525.B \-\-scan
1526is given, arrange for the array to be marked clean as soon as possible.
7146ec6a
DW
1527.I mdadm
1528will return with success if the array uses external metadata and we
1529successfully waited. For native arrays this returns immediately as the
6a0ee6a0
DW
1530kernel handles dirty-clean transitions at shutdown. No action is taken
1531if safe-mode handling is disabled.
1770662b 1532
8382f19b
NB
1533.SH For Incremental Assembly mode:
1534.TP
7e23fc43 1535.BR \-\-rebuild\-map ", " \-r
8382f19b 1536Rebuild the map file
96fd06ed 1537.RB ( {MAP_PATH} )
8382f19b
NB
1538that
1539.I mdadm
1540uses to help track which arrays are currently being assembled.
1541
1542.TP
7e23fc43 1543.BR \-\-run ", " \-R
8382f19b
NB
1544Run any array assembled as soon as a minimal number of devices are
1545available, rather than waiting until all expected devices are present.
1546
1547.TP
7e23fc43 1548.BR \-\-scan ", " \-s
8382f19b 1549Only meaningful with
7e23fc43 1550.B \-R
8382f19b
NB
1551this will scan the
1552.B map
1553file for arrays that are being incrementally assembled and will try to
1554start any that are not already started. If any such array is listed
1555in
1556.B mdadm.conf
1557as requiring an external bitmap, that bitmap will be attached first.
1558
29ba4804
N
1559.TP
1560.BR \-\-fail ", " \-f
1561This allows the hot-plug system to remove devices that have fully disappeared
1562from the kernel. It will first fail and then remove the device from any
1563array it belongs to.
1564The device name given should be a kernel device name such as "sda",
1565not a name in
1566.IR /dev .
1567
210597d1
PC
1568.TP
1569.BR \-\-path=
87eb4fab
N
1570Only used with \-\-fail. The 'path' given will be recorded so that if
1571a new device appears at the same location it can be automatically
1572added to the same array. This allows the failed device to be
1573automatically replaced by a new device without metadata if it appears
1574at specified path. This option is normally only set by a
1575.I udev
1576script.
210597d1 1577
e0d19036
NB
1578.SH For Monitor mode:
1579.TP
7e23fc43 1580.BR \-m ", " \-\-mail
e0d19036
NB
1581Give a mail address to send alerts to.
1582
1583.TP
7e23fc43 1584.BR \-p ", " \-\-program ", " \-\-alert
e0d19036
NB
1585Give a program to be run whenever an event is detected.
1586
773135f5 1587.TP
7e23fc43 1588.BR \-y ", " \-\-syslog
773135f5
NB
1589Cause all events to be reported through 'syslog'. The messages have
1590facility of 'daemon' and varying priorities.
1591
e0d19036 1592.TP
7e23fc43 1593.BR \-d ", " \-\-delay
e0d19036 1594Give a delay in seconds.
51ac42e3 1595.I mdadm
e0d19036 1596polls the md arrays and then waits this many seconds before polling
e0fe762a
N
1597again. The default is 60 seconds. Since 2.6.16, there is no need to
1598reduce this as the kernel alerts
1599.I mdadm
1600immediately when there is any change.
e0d19036 1601
9a36a9b7
ZB
1602.TP
1603.BR \-r ", " \-\-increment
1604Give a percentage increment.
1605.I mdadm
1606will generate RebuildNN events with the given percentage increment.
1607
d013a55e 1608.TP
7e23fc43 1609.BR \-f ", " \-\-daemonise
d013a55e 1610Tell
51ac42e3 1611.I mdadm
d013a55e 1612to run as a background daemon if it decides to monitor anything. This
e0fe762a 1613causes it to fork and run in the child, and to disconnect from the
d013a55e
NB
1614terminal. The process id of the child is written to stdout.
1615This is useful with
7e23fc43 1616.B \-\-scan
d013a55e
NB
1617which will only continue monitoring if a mail address or alert program
1618is found in the config file.
1619
b5e64645 1620.TP
7e23fc43 1621.BR \-i ", " \-\-pid\-file
b5e64645 1622When
51ac42e3 1623.I mdadm
b5e64645
NB
1624is running in daemon mode, write the pid of the daemon process to
1625the specified file, instead of printing it on standard output.
1626
aa88f531 1627.TP
7e23fc43 1628.BR \-1 ", " \-\-oneshot
aa88f531
NB
1629Check arrays only once. This will generate
1630.B NewArray
1631events and more significantly
1632.B DegradedArray
a9d69660
NB
1633and
1634.B SparesMissing
aa88f531
NB
1635events. Running
1636.in +5
7e23fc43 1637.B " mdadm \-\-monitor \-\-scan \-1"
aa88f531
NB
1638.in -5
1639from a cron script will ensure regular notification of any degraded arrays.
1640
98c6faba 1641.TP
7e23fc43 1642.BR \-t ", " \-\-test
98c6faba
NB
1643Generate a
1644.B TestMessage
1645alert for every array found at startup. This alert gets mailed and
1646passed to the alert program. This can be used for testing that alert
a9d69660 1647message do get through successfully.
98c6faba 1648
210597d1
PC
1649.TP
1650.BR \-\-no\-sharing
87eb4fab 1651This inhibits the functionality for moving spares between arrays.
210597d1
PC
1652Only one monitoring process started with
1653.B \-\-scan
87eb4fab
N
1654but without this flag is allowed, otherwise the two could interfere
1655with each other.
210597d1 1656
e0d19036 1657.SH ASSEMBLE MODE
52826846 1658
cd29a5c8
NB
1659.HP 12
1660Usage:
7e23fc43 1661.B mdadm \-\-assemble
5787fa49
NB
1662.I md-device options-and-component-devices...
1663.HP 12
1664Usage:
7e23fc43 1665.B mdadm \-\-assemble \-\-scan
e0fe762a 1666.I md-devices-and-options...
cd29a5c8
NB
1667.HP 12
1668Usage:
7e23fc43 1669.B mdadm \-\-assemble \-\-scan
e0fe762a 1670.I options...
52826846 1671
cd29a5c8 1672.PP
e0fe762a 1673This usage assembles one or more RAID arrays from pre-existing components.
9a9dab36 1674For each array, mdadm needs to know the md device, the identity of the
e0fe762a 1675array, and a number of component-devices. These can be found in a number of ways.
52826846 1676
5787fa49 1677In the first usage example (without the
7e23fc43 1678.BR \-\-scan )
5787fa49
NB
1679the first device given is the md device.
1680In the second usage example, all devices listed are treated as md
1681devices and assembly is attempted.
1682In the third (where no devices are listed) all md devices that are
cb77f620 1683listed in the configuration file are assembled. If no arrays are
e0fe762a
N
1684described by the configuration file, then any arrays that
1685can be found on unused devices will be assembled.
52826846 1686
d013a55e 1687If precisely one device is listed, but
7e23fc43 1688.B \-\-scan
dd0781e5 1689is not given, then
d013a55e
NB
1690.I mdadm
1691acts as though
7e23fc43 1692.B \-\-scan
93e790af 1693was given and identity information is extracted from the configuration file.
d013a55e 1694
2ae555c3 1695The identity can be given with the
7e23fc43 1696.B \-\-uuid
e0fe762a
N
1697option, the
1698.B \-\-name
1699option, or the
7e23fc43 1700.B \-\-super\-minor
93e790af
SW
1701option, will be taken from the md-device record in the config file, or
1702will be taken from the super block of the first component-device
1703listed on the command line.
52826846 1704
2ae555c3 1705Devices can be given on the
7e23fc43 1706.B \-\-assemble
e0fe762a 1707command line or in the config file. Only devices which have an md
5787fa49
NB
1708superblock which contains the right identity will be considered for
1709any array.
52826846 1710
2ae555c3 1711The config file is only used if explicitly named with
7e23fc43 1712.B \-\-config
d013a55e 1713or requested with (a possibly implicit)
7e23fc43 1714.BR \-\-scan .
52826846 1715In the later case,
9a9dab36 1716.B /etc/mdadm.conf
8fd8d9c4
N
1717or
1718.B /etc/mdadm/mdadm.conf
52826846
NB
1719is used.
1720
2ae555c3 1721If
7e23fc43 1722.B \-\-scan
cd29a5c8
NB
1723is not given, then the config file will only be used to find the
1724identity of md arrays.
52826846 1725
2d465520 1726Normally the array will be started after it is assembled. However if
7e23fc43 1727.B \-\-scan
e0fe762a
N
1728is not given and not all expected drives were listed, then the array
1729is not started (to guard against usage errors). To insist that the
1730array be started in this case (as may work for RAID1, 4, 5, 6, or 10),
1731give the
7e23fc43 1732.B \-\-run
cd29a5c8 1733flag.
52826846 1734
e0fe762a
N
1735If
1736.I udev
1737is active,
1738.I mdadm
1739does not create any entries in
dd0781e5 1740.B /dev
e0fe762a
N
1741but leaves that to
1742.IR udev .
1743It does record information in
96fd06ed 1744.B {MAP_PATH}
e0fe762a
N
1745which will allow
1746.I udev
1747to choose the correct name.
dd0781e5 1748
e0fe762a
N
1749If
1750.I mdadm
1751detects that udev is not configured, it will create the devices in
1752.B /dev
1753itself.
dd0781e5 1754
e0fe762a
N
1755In Linux kernels prior to version 2.6.28 there were two distinctly
1756different types of md devices that could be created: one that could be
1757partitioned using standard partitioning tools and one that could not.
1758Since 2.6.28 that distinction is no longer relevant as both type of
1759devices can be partitioned.
1760.I mdadm
1761will normally create the type that originally could not be partitioned
1762as it has a well defined major number (9).
dd0781e5 1763
e0fe762a
N
1764Prior to 2.6.28, it is important that mdadm chooses the correct type
1765of array device to use. This can be controlled with the
1766.B \-\-auto
1767option. In particular, a value of "mdp" or "part" or "p" tells mdadm
1768to use a partitionable device rather than the default.
dd0781e5 1769
e0fe762a
N
1770In the no-udev case, the value given to
1771.B \-\-auto
1772can be suffixed by a number. This tells
1773.I mdadm
1774to create that number of partition devices rather than the default of 4.
dd0781e5 1775
e0fe762a 1776The value given to
7e23fc43 1777.B \-\-auto
e0fe762a
N
1778can also be given in the configuration file as a word starting
1779.B auto=
1780on the ARRAY line for the relevant array.
52826846 1781
41a3b72a
NB
1782.SS Auto Assembly
1783When
7e23fc43 1784.B \-\-assemble
41a3b72a 1785is used with
7e23fc43 1786.B \-\-scan
41a3b72a
NB
1787and no devices are listed,
1788.I mdadm
1789will first attempt to assemble all the arrays listed in the config
1790file.
1791
cb77f620 1792If no arrays are listed in the config (other than those marked
e0fe762a
N
1793.BR <ignore> )
1794it will look through the available devices for possible arrays and
1795will try to assemble anything that it finds. Arrays which are tagged
1796as belonging to the given homehost will be assembled and started
1797normally. Arrays which do not obviously belong to this host are given
1798names that are expected not to conflict with anything local, and are
1799started "read-auto" so that nothing is written to any device until the
1800array is written to. i.e. automatic resync etc is delayed.
41a3b72a
NB
1801
1802If
1803.I mdadm
1804finds a consistent set of devices that look like they should comprise
1805an array, and if the superblock is tagged as belonging to the given
1806home host, it will automatically choose a device name and try to
1807assemble the array. If the array uses version-0.90 metadata, then the
1808.B minor
1809number as recorded in the superblock is used to create a name in
1810.B /dev/md/
1811so for example
1812.BR /dev/md/3 .
1813If the array uses version-1 metadata, then the
1814.B name
1815from the superblock is used to similarly create a name in
e0fe762a 1816.B /dev/md/
93e790af 1817(the name will have any 'host' prefix stripped first).
41a3b72a 1818
c64ba03a
N
1819This behaviour can be modified by the
1820.I AUTO
1821line in the
1822.I mdadm.conf
1823configuration file. This line can indicate that specific metadata
1824type should, or should not, be automatically assembled. If an array
1825is found which is not listed in
1826.I mdadm.conf
1827and has a metadata format that is denied by the
1828.I AUTO
1829line, then it will not be assembled.
1830The
1831.I AUTO
1832line can also request that all arrays identified as being for this
1833homehost should be assembled regardless of their metadata type.
1834See
1835.IR mdadm.conf (5)
1836for further details.
1837
246cebdb
AK
1838Note: Auto assembly cannot be used for assembling and activating some
1839arrays which are undergoing reshape. In particular as the
1840.B backup\-file
1841cannot be given, any reshape which requires a backup-file to continue
1842cannot be started by auto assembly. An array which is growing to more
1843devices and has passed the critical section can be assembled using
1844auto-assembly.
41a3b72a 1845
cd29a5c8 1846.SH BUILD MODE
52826846 1847
cd29a5c8
NB
1848.HP 12
1849Usage:
7e23fc43 1850.B mdadm \-\-build
93e790af 1851.I md-device
7e23fc43
PS
1852.BI \-\-chunk= X
1853.BI \-\-level= Y
1854.BI \-\-raid\-devices= Z
cd29a5c8
NB
1855.I devices
1856
1857.PP
2ae555c3 1858This usage is similar to
7e23fc43 1859.BR \-\-create .
e0fe762a 1860The difference is that it creates an array without a superblock. With
cd29a5c8 1861these arrays there is no difference between initially creating the array and
52826846
NB
1862subsequently assembling the array, except that hopefully there is useful
1863data there in the second case.
1864
e0fe762a
N
1865The level may raid0, linear, raid1, raid10, multipath, or faulty, or
1866one of their synonyms. All devices must be listed and the array will
1867be started once complete. It will often be appropriate to use
1868.B \-\-assume\-clean
1869with levels raid1 or raid10.
cd29a5c8
NB
1870
1871.SH CREATE MODE
1872
1873.HP 12
1874Usage:
7e23fc43 1875.B mdadm \-\-create
93e790af 1876.I md-device
7e23fc43
PS
1877.BI \-\-chunk= X
1878.BI \-\-level= Y
cd29a5c8 1879.br
7e23fc43 1880.BI \-\-raid\-devices= Z
e0fe762a 1881.I devices
cd29a5c8
NB
1882
1883.PP
1884This usage will initialise a new md array, associate some devices with
1885it, and activate the array.
1886
e0fe762a
N
1887The named device will normally not exist when
1888.I "mdadm \-\-create"
1889is run, but will be created by
1890.I udev
1891once the array becomes active.
dd0781e5 1892
e0fe762a
N
1893As devices are added, they are checked to see if they contain RAID
1894superblocks or filesystems. They are also checked to see if the variance in
cd29a5c8
NB
1895device size exceeds 1%.
1896
1897If any discrepancy is found, the array will not automatically be run, though
2ae555c3 1898the presence of a
7e23fc43 1899.B \-\-run
cd29a5c8
NB
1900can override this caution.
1901
2d465520 1902To create a "degraded" array in which some devices are missing, simply
d013a55e 1903give the word "\fBmissing\fP"
2d465520 1904in place of a device name. This will cause
51ac42e3 1905.I mdadm
2d465520
NB
1906to leave the corresponding slot in the array empty.
1907For a RAID4 or RAID5 array at most one slot can be
98c6faba 1908"\fBmissing\fP"; for a RAID6 array at most two slots.
2d465520
NB
1909For a RAID1 array, only one real device needs to be given. All of the
1910others can be
d013a55e 1911"\fBmissing\fP".
2d465520 1912
feb716e9 1913When creating a RAID5 array,
51ac42e3 1914.I mdadm
feb716e9 1915will automatically create a degraded array with an extra spare drive.
e0fe762a
N
1916This is because building the spare into a degraded array is in general
1917faster than resyncing the parity on a non-degraded, but not clean,
1918array. This feature can be overridden with the
7e23fc43 1919.B \-\-force
feb716e9
NB
1920option.
1921
0ee4da98 1922When creating an array with version-1 metadata a name for the array is
41a3b72a
NB
1923required.
1924If this is not given with the
7e23fc43 1925.B \-\-name
41a3b72a
NB
1926option,
1927.I mdadm
0ee4da98 1928will choose a name based on the last component of the name of the
41a3b72a
NB
1929device being created. So if
1930.B /dev/md3
1931is being created, then the name
1932.B 3
1933will be chosen.
1934If
1935.B /dev/md/home
1936is being created, then the name
1937.B home
1938will be used.
1939
e0fe762a
N
1940When creating a partition based array, using
1941.I mdadm
1942with version-1.x metadata, the partition type should be set to
e0f31f50 1943.B 0xDA
e0fe762a 1944(non fs-data). This type selection allows for greater precision since
e0f31f50
PC
1945using any other [RAID auto-detect (0xFD) or a GNU/Linux partition (0x83)],
1946might create problems in the event of array recovery through a live cdrom.
1947
3d3dd91e
NB
1948A new array will normally get a randomly assigned 128bit UUID which is
1949very likely to be unique. If you have a specific need, you can choose
1950a UUID for the array by giving the
7e23fc43 1951.B \-\-uuid=
3d3dd91e
NB
1952option. Be warned that creating two arrays with the same UUID is a
1953recipe for disaster. Also, using
7e23fc43 1954.B \-\-uuid=
3d3dd91e 1955when creating a v0.90 array will silently override any
7e23fc43 1956.B \-\-homehost=
3d3dd91e 1957setting.
e43d0cda
NB
1958.\"If the
1959.\".B \-\-size
1960.\"option is given, it is not necessary to list any component-devices in this command.
1961.\"They can be added later, before a
1962.\".B \-\-run.
1963.\"If no
1964.\".B \-\-size
1965.\"is given, the apparent size of the smallest drive given is used.
cd29a5c8 1966
748952f7
N
1967If the array type supports a write-intent bitmap, and if the devices
1968in the array exceed 100G is size, an internal write-intent bitmap
1969will automatically be added unless some other option is explicitly
1970requested with the
1971.B \-\-bitmap
1972option. In any case space for a bitmap will be reserved so that one
1973can be added layer with
1974.BR "\-\-grow \-\-bitmap=internal" .
1975
bf95d0f3
N
1976If the metadata type supports it (currently only 1.x metadata), space
1977will be allocated to store a bad block list. This allows a modest
1978number of bad blocks to be recorded, allowing the drive to remain in
1979service while only partially functional.
1980
8fd8d9c4
N
1981When creating an array within a
1982.B CONTAINER
1983.I mdadm
1984can be given either the list of devices to use, or simply the name of
1985the container. The former case gives control over which devices in
1986the container will be used for the array. The latter case allows
1987.I mdadm
1988to automatically choose which devices to use based on how much spare
1989space is available.
1990
53e8b987 1991The General Management options that are valid with
7e23fc43 1992.B \-\-create
53e8b987 1993are:
cd29a5c8 1994.TP
7e23fc43 1995.B \-\-run
dd0781e5 1996insist on running the array even if some devices look like they might
cd29a5c8
NB
1997be in use.
1998
1999.TP
7e23fc43 2000.B \-\-readonly
b3f1c093 2001start the array readonly \(em not supported yet.
52826846 2002
e0d19036 2003.SH MANAGE MODE
cd29a5c8
NB
2004.HP 12
2005Usage:
e0d19036
NB
2006.B mdadm
2007.I device
2008.I options... devices...
cd29a5c8
NB
2009.PP
2010
e0d19036
NB
2011This usage will allow individual devices in an array to be failed,
2012removed or added. It is possible to perform multiple operations with
e0fe762a 2013on command. For example:
e0d19036 2014.br
7e23fc43 2015.B " mdadm /dev/md0 \-f /dev/hda1 \-r /dev/hda1 \-a /dev/hda1"
e0d19036
NB
2016.br
2017will firstly mark
2018.B /dev/hda1
2019as faulty in
2020.B /dev/md0
2021and will then remove it from the array and finally add it back
2d465520 2022in as a spare. However only one md array can be affected by a single
2ae555c3 2023command.
e0d19036 2024
e0fe762a
N
2025When a device is added to an active array, mdadm checks to see if it
2026has metadata on it which suggests that it was recently a member of the
a4e13010 2027array. If it does, it tries to "re\-add" the device. If there have
e0fe762a
N
2028been no changes since the device was removed, or if the array has a
2029write-intent bitmap which has recorded whatever changes there were,
2030then the device will immediately become a full member of the array and
2031those differences recorded in the bitmap will be resolved.
2032
e0d19036
NB
2033.SH MISC MODE
2034.HP 12
2035Usage:
9a9dab36 2036.B mdadm
e0d19036 2037.I options ...
e0fe762a 2038.I devices ...
e0d19036 2039.PP
cd29a5c8 2040
b5e64645 2041MISC mode includes a number of distinct operations that
e0d19036
NB
2042operate on distinct devices. The operations are:
2043.TP
962a108f 2044.B \-\-query
e0d19036
NB
2045The device is examined to see if it is
2046(1) an active md array, or
2047(2) a component of an md array.
2048The information discovered is reported.
2049
2050.TP
962a108f 2051.B \-\-detail
2d465520 2052The device should be an active md device.
e0fe762a 2053.B mdadm
2d465520 2054will display a detailed description of the array.
7e23fc43 2055.B \-\-brief
2d465520 2056or
7e23fc43 2057.B \-\-scan
2d465520 2058will cause the output to be less detailed and the format to be
e0d19036 2059suitable for inclusion in
87eb4fab 2060.BR mdadm.conf .
feb716e9
NB
2061The exit status of
2062.I mdadm
2063will normally be 0 unless
2064.I mdadm
93e790af 2065failed to get useful information about the device(s); however, if the
7e23fc43 2066.B \-\-test
feb716e9
NB
2067option is given, then the exit status will be:
2068.RS
2069.TP
20700
2071The array is functioning normally.
2072.TP
20731
2074The array has at least one failed device.
2075.TP
20762
a77be586 2077The array has multiple failed devices such that it is unusable.
feb716e9
NB
2078.TP
20794
2080There was an error while trying to get information about the device.
2081.RE
cd29a5c8 2082
4cce4069
DW
2083.TP
2084.B \-\-detail\-platform
e0fe762a 2085Print detail of the platform's RAID capabilities (firmware / hardware
4cce4069
DW
2086topology). If the metadata is specified with
2087.B \-e
2088or
2089.B \-\-metadata=
2090then the return status will be:
2091.RS
2092.TP
20930
2094metadata successfully enumerated its platform components on this system
2095.TP
20961
2097metadata is platform independent
2098.TP
20992
2100metadata failed to find its platform components on this system
2101.RE
2102
aa534678
DW
2103.TP
2104.B \-\-update\-subarray=
2105If the device is a container and the argument to \-\-update\-subarray
2106specifies a subarray in the container, then attempt to update the given
2107superblock field in the subarray. Similar to updating an array in
2108"assemble" mode, the field to update is selected by
2109.B \-U
2110or
2111.B \-\-update=
2112option. Currently only
2113.B name
2114is supported.
2115
2116The
2117.B name
2118option updates the subarray name in the metadata, it may not affect the
2119device node name or the device node symlink until the subarray is
2120re\-assembled. If updating
2121.B name
2122would change the UUID of an active subarray this operation is blocked,
2123and the command will end in an error.
2124
e0d19036 2125.TP
962a108f 2126.B \-\-examine
2d465520 2127The device should be a component of an md array.
51ac42e3 2128.I mdadm
2d465520 2129will read the md superblock of the device and display the contents.
e0d19036 2130If
7e23fc43 2131.B \-\-brief
93e790af 2132or
7e23fc43 2133.B \-\-scan
93e790af 2134is given, then multiple devices that are components of the one array
e0d19036
NB
2135are grouped together and reported in a single entry suitable
2136for inclusion in
87eb4fab 2137.BR mdadm.conf .
e0d19036 2138
2d465520 2139Having
7e23fc43 2140.B \-\-scan
e0d19036
NB
2141without listing any devices will cause all devices listed in the
2142config file to be examined.
2143
74db60b0
N
2144.TP
2145.BI \-\-dump= directory
2146If the device contains RAID metadata, a file will be created in the
2147.I directory
2148and the metadata will be written to it. The file will be the same
2149size as the device and have the metadata written in the file at the
2150same locate that it exists in the device. However the file will be "sparse" so
2151that only those blocks containing metadata will be allocated. The
2152total space used will be small.
2153
2154The file name used in the
2155.I directory
2156will be the base name of the device. Further if any links appear in
2157.I /dev/disk/by-id
2158which point to the device, then hard links to the file will be created
2159in
2160.I directory
2161based on these
2162.I by-id
2163names.
2164
2165Multiple devices can be listed and their metadata will all be stored
2166in the one directory.
2167
2168.TP
2169.BI \-\-restore= directory
2170This is the reverse of
2171.BR \-\-dump .
2172.I mdadm
2173will locate a file in the directory that has a name appropriate for
2174the given device and will restore metadata from it. Names that match
2175.I /dev/disk/by-id
2176names are preferred, however if two of those refer to different files,
2177.I mdadm
2178will not choose between them but will abort the operation.
2179
2180If a file name is given instead of a
2181.I directory
2182then
2183.I mdadm
2184will restore from that file to a single device, always provided the
2185size of the file matches that of the device, and the file contains
2186valid metadata.
e0d19036 2187.TP
962a108f 2188.B \-\-stop
98c6faba
NB
2189The devices should be active md arrays which will be deactivated, as
2190long as they are not currently in use.
e0d19036
NB
2191
2192.TP
962a108f 2193.B \-\-run
e0d19036
NB
2194This will fully activate a partially assembled md array.
2195
2196.TP
962a108f 2197.B \-\-readonly
e0d19036
NB
2198This will mark an active array as read-only, providing that it is
2199not currently being used.
2200
2201.TP
962a108f 2202.B \-\-readwrite
e0d19036
NB
2203This will change a
2204.B readonly
2205array back to being read/write.
2206
2d465520 2207.TP
962a108f 2208.B \-\-scan
2d465520 2209For all operations except
7e23fc43
PS
2210.BR \-\-examine ,
2211.B \-\-scan
2d465520
NB
2212will cause the operation to be applied to all arrays listed in
2213.BR /proc/mdstat .
2214For
7e23fc43
PS
2215.BR \-\-examine,
2216.B \-\-scan
2d465520
NB
2217causes all devices listed in the config file to be examined.
2218
a1331cc4
N
2219.TP
2220.BR \-b ", " \-\-brief
2221Be less verbose. This is used with
2222.B \-\-detail
2223and
2224.BR \-\-examine .
2225Using
2226.B \-\-brief
2227with
2228.B \-\-verbose
2229gives an intermediate level of verbosity.
2230
e0d19036
NB
2231.SH MONITOR MODE
2232
cd29a5c8
NB
2233.HP 12
2234Usage:
7e23fc43 2235.B mdadm \-\-monitor
e0d19036
NB
2236.I options... devices...
2237
cd29a5c8 2238.PP
e0d19036 2239This usage causes
51ac42e3 2240.I mdadm
e0d19036
NB
2241to periodically poll a number of md arrays and to report on any events
2242noticed.
51ac42e3 2243.I mdadm
e0d19036
NB
2244will never exit once it decides that there are arrays to be checked,
2245so it should normally be run in the background.
2246
2d465520 2247As well as reporting events,
51ac42e3 2248.I mdadm
2d465520
NB
2249may move a spare drive from one array to another if they are in the
2250same
2251.B spare-group
210597d1
PC
2252or
2253.B domain
a9d69660 2254and if the destination array has a failed drive but no spares.
2d465520 2255
e0d19036 2256If any devices are listed on the command line,
51ac42e3 2257.I mdadm
e0fe762a 2258will only monitor those devices. Otherwise all arrays listed in the
e0d19036 2259configuration file will be monitored. Further, if
7e23fc43 2260.B \-\-scan
e0d19036
NB
2261is given, then any other md devices that appear in
2262.B /proc/mdstat
2263will also be monitored.
2264
2265The result of monitoring the arrays is the generation of events.
bd526cee 2266These events are passed to a separate program (if specified) and may
2d465520 2267be mailed to a given E-mail address.
e0d19036 2268
93e790af
SW
2269When passing events to a program, the program is run once for each event,
2270and is given 2 or 3 command-line arguments: the first is the
2271name of the event (see below), the second is the name of the
bd526cee 2272md device which is affected, and the third is the name of a related
93e790af 2273device if relevant (such as a component device that has failed).
cd29a5c8
NB
2274
2275If
7e23fc43 2276.B \-\-scan
e0d19036
NB
2277is given, then a program or an E-mail address must be specified on the
2278command line or in the config file. If neither are available, then
51ac42e3 2279.I mdadm
e0d19036
NB
2280will not monitor anything.
2281Without
93e790af 2282.B \-\-scan,
51ac42e3 2283.I mdadm
2d465520 2284will continue monitoring as long as something was found to monitor. If
e0d19036
NB
2285no program or email is given, then each event is reported to
2286.BR stdout .
cd29a5c8 2287
e0d19036
NB
2288The different events are:
2289
2290.RS 4
2291.TP
2292.B DeviceDisappeared
2d465520 2293An md array which previously was configured appears to no longer be
773135f5 2294configured. (syslog priority: Critical)
e0d19036 2295
b8f72a62
NB
2296If
2297.I mdadm
2298was told to monitor an array which is RAID0 or Linear, then it will
2299report
2300.B DeviceDisappeared
2301with the extra information
2302.BR Wrong-Level .
2303This is because RAID0 and Linear do not support the device-failed,
2304hot-spare and resync operations which are monitored.
2305
e0d19036
NB
2306.TP
2307.B RebuildStarted
773135f5 2308An md array started reconstruction. (syslog priority: Warning)
e0d19036
NB
2309
2310.TP
2311.BI Rebuild NN
2312Where
2313.I NN
9a36a9b7
ZB
2314is a two-digit number (ie. 05, 48). This indicates that rebuild
2315has passed that many percent of the total. The events are generated
2316with fixed increment since 0. Increment size may be specified with
2317a commandline option (default is 20). (syslog priority: Warning)
e0d19036 2318
98c6faba
NB
2319.TP
2320.B RebuildFinished
2321An md array that was rebuilding, isn't any more, either because it
773135f5 2322finished normally or was aborted. (syslog priority: Warning)
98c6faba 2323
e0d19036
NB
2324.TP
2325.B Fail
773135f5
NB
2326An active component device of an array has been marked as
2327faulty. (syslog priority: Critical)
e0d19036
NB
2328
2329.TP
2330.B FailSpare
2331A spare component device which was being rebuilt to replace a faulty
93e790af 2332device has failed. (syslog priority: Critical)
e0d19036
NB
2333
2334.TP
2335.B SpareActive
2336A spare component device which was being rebuilt to replace a faulty
98b24a2a 2337device has been successfully rebuilt and has been made active.
773135f5 2338(syslog priority: Info)
e0d19036
NB
2339
2340.TP
2341.B NewArray
2342A new md array has been detected in the
2343.B /proc/mdstat
e0fe762a 2344file. (syslog priority: Info)
e0d19036 2345
aa88f531
NB
2346.TP
2347.B DegradedArray
2348A newly noticed array appears to be degraded. This message is not
2349generated when
2350.I mdadm
2351notices a drive failure which causes degradation, but only when
2352.I mdadm
2353notices that an array is degraded when it first sees the array.
93e790af 2354(syslog priority: Critical)
aa88f531 2355
e0d19036
NB
2356.TP
2357.B MoveSpare
2358A spare drive has been moved from one array in a
2359.B spare-group
210597d1
PC
2360or
2361.B domain
e0d19036 2362to another to allow a failed drive to be replaced.
773135f5 2363(syslog priority: Info)
e0d19036 2364
b8f72a62
NB
2365.TP
2366.B SparesMissing
2367If
2368.I mdadm
2369has been told, via the config file, that an array should have a certain
2370number of spare devices, and
2371.I mdadm
93e790af 2372detects that it has fewer than this number when it first sees the
b8f72a62
NB
2373array, it will report a
2374.B SparesMissing
2375message.
d1732eeb 2376(syslog priority: Warning)
b8f72a62 2377
98c6faba
NB
2378.TP
2379.B TestMessage
2380An array was found at startup, and the
7e23fc43 2381.B \-\-test
98c6faba 2382flag was given.
773135f5 2383(syslog priority: Info)
e0d19036
NB
2384.RE
2385
2386Only
93e790af
SW
2387.B Fail,
2388.B FailSpare,
2389.B DegradedArray,
2390.B SparesMissing
e0d19036 2391and
98c6faba 2392.B TestMessage
e0d19036 2393cause Email to be sent. All events cause the program to be run.
93e790af 2394The program is run with two or three arguments: the event
e0d19036
NB
2395name, the array device and possibly a second device.
2396
2397Each event has an associated array device (e.g.
2398.BR /dev/md1 )
2399and possibly a second device. For
2400.BR Fail ,
2401.BR FailSpare ,
2402and
2403.B SpareActive
2404the second device is the relevant component device.
2405For
2406.B MoveSpare
2407the second device is the array that the spare was moved from.
2408
2409For
51ac42e3 2410.I mdadm
e0d19036 2411to move spares from one array to another, the different arrays need to
93e790af 2412be labeled with the same
e0d19036 2413.B spare-group
210597d1 2414or the spares must be allowed to migrate through matching POLICY domains
e0d19036
NB
2415in the configuration file. The
2416.B spare-group
93e790af 2417name can be any string; it is only necessary that different spare
2d465520 2418groups use different names.
e0d19036
NB
2419
2420When
51ac42e3 2421.I mdadm
93e790af 2422detects that an array in a spare group has fewer active
e0d19036
NB
2423devices than necessary for the complete array, and has no spare
2424devices, it will look for another array in the same spare group that
2425has a full complement of working drive and a spare. It will then
2426attempt to remove the spare from the second drive and add it to the
2427first.
2428If the removal succeeds but the adding fails, then it is added back to
2429the original array.
2430
210597d1
PC
2431If the spare group for a degraded array is not defined,
2432.I mdadm
2433will look at the rules of spare migration specified by POLICY lines in
87eb4fab 2434.B mdadm.conf
210597d1
PC
2435and then follow similar steps as above if a matching spare is found.
2436
dd0781e5
NB
2437.SH GROW MODE
2438The GROW mode is used for changing the size or shape of an active
2439array.
2440For this to work, the kernel must support the necessary change.
c64881d7 2441Various types of growth are being added during 2.6 development.
dd0781e5 2442
c64881d7 2443Currently the supported changes include
dfd4d8ee 2444.IP \(bu 4
c64881d7 2445change the "size" attribute for RAID1, RAID4, RAID5 and RAID6.
dfd4d8ee 2446.IP \(bu 4
c64881d7
N
2447increase or decrease the "raid\-devices" attribute of RAID0, RAID1, RAID4,
2448RAID5, and RAID6.
cb77f620 2449.IP \(bu 4
c64881d7 2450change the chunk-size and layout of RAID0, RAID4, RAID5 and RAID6.
cb77f620 2451.IP \(bu 4
c64881d7 2452convert between RAID1 and RAID5, between RAID5 and RAID6, between
cb77f620 2453RAID0, RAID4, and RAID5, and between RAID0 and RAID10 (in the near-2 mode).
dfd4d8ee 2454.IP \(bu 4
93e790af 2455add a write-intent bitmap to any array which supports these bitmaps, or
2ae555c3 2456remove a write-intent bitmap from such an array.
dfd4d8ee 2457.PP
dd0781e5 2458
9ab6e80a 2459Using GROW on containers is currently supported only for Intel's IMSM
c64881d7
N
2460container format. The number of devices in a container can be
2461increased - which affects all arrays in the container - or an array
2462in a container can be converted between levels where those levels are
2463supported by the container, and the conversion is on of those listed
9ab6e80a
N
2464above. Resizing arrays in an IMSM container with
2465.B "--grow --size"
2466is not yet supported.
8fd8d9c4 2467
ca24ddb0
AK
2468Grow functionality (e.g. expand a number of raid devices) for Intel's
2469IMSM container format has an experimental status. It is guarded by the
2470.B MDADM_EXPERIMENTAL
2471environment variable which must be set to '1' for a GROW command to
2472succeed.
2473This is for the following reasons:
2474
2475.IP 1.
0de8d44d
AK
2476Intel's native IMSM check-pointing is not fully tested yet.
2477This can causes IMSM incompatibility during the grow process: an array
ca24ddb0
AK
2478which is growing cannot roam between Microsoft Windows(R) and Linux
2479systems.
2480
2481.IP 2.
2482Interrupting a grow operation is not recommended, because it
2483has not been fully tested for Intel's IMSM container format yet.
2484
0de8d44d
AK
2485.PP
2486Note: Intel's native checkpointing doesn't use
2487.B --backup-file
2488option and it is transparent for assembly feature.
2489
2ae555c3 2490.SS SIZE CHANGES
c64881d7 2491Normally when an array is built the "size" is taken from the smallest
dd0781e5
NB
2492of the drives. If all the small drives in an arrays are, one at a
2493time, removed and replaced with larger drives, then you could have an
2494array of large drives with only a small amount used. In this
2495situation, changing the "size" with "GROW" mode will allow the extra
2496space to start being used. If the size is increased in this way, a
2497"resync" process will start to make sure the new parts of the array
2498are synchronised.
2499
2500Note that when an array changes size, any filesystem that may be
cb77f620 2501stored in the array will not automatically grow or shrink to use or
88b496c2 2502vacate the space. The
666bba9b
N
2503filesystem will need to be explicitly told to use the extra space
2504after growing, or to reduce its size
2505.B prior
2506to shrinking the array.
dd0781e5 2507
e0fe762a
N
2508Also the size of an array cannot be changed while it has an active
2509bitmap. If an array has a bitmap, it must be removed before the size
cb77f620 2510can be changed. Once the change is complete a new bitmap can be created.
e0fe762a
N
2511
2512.SS RAID\-DEVICES CHANGES
2ae555c3 2513
dd0781e5
NB
2514A RAID1 array can work with any number of devices from 1 upwards
2515(though 1 is not very useful). There may be times which you want to
2516increase or decrease the number of active devices. Note that this is
2517different to hot-add or hot-remove which changes the number of
2518inactive devices.
2519
2520When reducing the number of devices in a RAID1 array, the slots which
2521are to be removed from the array must already be vacant. That is, the
93e790af 2522devices which were in those slots must be failed and removed.
dd0781e5
NB
2523
2524When the number of devices is increased, any hot spares that are
a9d69660 2525present will be activated immediately.
dd0781e5 2526
f24e2d6c 2527Changing the number of active devices in a RAID5 or RAID6 is much more
2ae555c3 2528effort. Every block in the array will need to be read and written
f24e2d6c 2529back to a new location. From 2.6.17, the Linux Kernel is able to
ca4f89a3
N
2530increase the number of devices in a RAID5 safely, including restarting
2531an interrupted "reshape". From 2.6.31, the Linux Kernel is able to
f24e2d6c
N
2532increase or decrease the number of devices in a RAID5 or RAID6.
2533
c64881d7
N
2534From 2.6.35, the Linux Kernel is able to convert a RAID0 in to a RAID4
2535or RAID5.
2536.I mdadm
2537uses this functionality and the ability to add
2538devices to a RAID4 to allow devices to be added to a RAID0. When
2539requested to do this,
2540.I mdadm
2541will convert the RAID0 to a RAID4, add the necessary disks and make
2542the reshape happen, and then convert the RAID4 back to RAID0.
2543
f24e2d6c
N
2544When decreasing the number of devices, the size of the array will also
2545decrease. If there was data in the array, it could get destroyed and
666bba9b
N
2546this is not reversible, so you should firstly shrink the filesystem on
2547the array to fit within the new size. To help prevent accidents,
f24e2d6c
N
2548.I mdadm
2549requires that the size of the array be decreased first with
2550.BR "mdadm --grow --array-size" .
2551This is a reversible change which simply makes the end of the array
2552inaccessible. The integrity of any data can then be checked before
2553the non-reversible reduction in the number of devices is request.
2ae555c3 2554
cd19c0cf
JR
2555When relocating the first few stripes on a RAID5 or RAID6, it is not
2556possible to keep the data on disk completely consistent and
2557crash-proof. To provide the required safety, mdadm disables writes to
2558the array while this "critical section" is reshaped, and takes a
2559backup of the data that is in that section. For grows, this backup may be
2560stored in any spare devices that the array has, however it can also be
2561stored in a separate file specified with the
7e23fc43 2562.B \-\-backup\-file
cd19c0cf
JR
2563option, and is required to be specified for shrinks, RAID level
2564changes and layout changes. If this option is used, and the system
2565does crash during the critical period, the same file must be passed to
7e23fc43 2566.B \-\-assemble
cd19c0cf
JR
2567to restore the backup and reassemble the array. When shrinking rather
2568than growing the array, the reshape is done from the end towards the
2569beginning, so the "critical section" is at the end of the reshape.
2ae555c3 2570
f24e2d6c
N
2571.SS LEVEL CHANGES
2572
2573Changing the RAID level of any array happens instantaneously. However
cd19c0cf 2574in the RAID5 to RAID6 case this requires a non-standard layout of the
f24e2d6c 2575RAID6 data, and in the RAID6 to RAID5 case that non-standard layout is
cd19c0cf 2576required before the change can be accomplished. So while the level
f24e2d6c 2577change is instant, the accompanying layout change can take quite a
cd19c0cf
JR
2578long time. A
2579.B \-\-backup\-file
2580is required. If the array is not simultaneously being grown or
2581shrunk, so that the array size will remain the same - for example,
2582reshaping a 3-drive RAID5 into a 4-drive RAID6 - the backup file will
2583be used not just for a "cricital section" but throughout the reshape
2584operation, as described below under LAYOUT CHANGES.
f24e2d6c
N
2585
2586.SS CHUNK-SIZE AND LAYOUT CHANGES
2587
2588Changing the chunk-size of layout without also changing the number of
2589devices as the same time will involve re-writing all blocks in-place.
2590To ensure against data loss in the case of a crash, a
2591.B --backup-file
2592must be provided for these changes. Small sections of the array will
cd19c0cf
JR
2593be copied to the backup file while they are being rearranged. This
2594means that all the data is copied twice, once to the backup and once
2595to the new layout on the array, so this type of reshape will go very
2596slowly.
f24e2d6c
N
2597
2598If the reshape is interrupted for any reason, this backup file must be
cd19c0cf 2599made available to
f24e2d6c
N
2600.B "mdadm --assemble"
2601so the array can be reassembled. Consequently the file cannot be
2602stored on the device being reshaped.
2603
2604
2ae555c3
NB
2605.SS BITMAP CHANGES
2606
2607A write-intent bitmap can be added to, or removed from, an active
93e790af 2608array. Either internal bitmaps, or bitmaps stored in a separate file,
fe80f49b 2609can be added. Note that if you add a bitmap stored in a file which is
e0fe762a 2610in a filesystem that is on the RAID array being affected, the system
fe80f49b
NB
2611will deadlock. The bitmap must be on a separate filesystem.
2612
8382f19b
NB
2613.SH INCREMENTAL MODE
2614
2615.HP 12
2616Usage:
7e23fc43
PS
2617.B mdadm \-\-incremental
2618.RB [ \-\-run ]
2619.RB [ \-\-quiet ]
8382f19b
NB
2620.I component-device
2621.HP 12
2622Usage:
29ba4804
N
2623.B mdadm \-\-incremental \-\-fail
2624.I component-device
2625.HP 12
2626Usage:
7e6140e6 2627.B mdadm \-\-incremental \-\-rebuild\-map
8382f19b
NB
2628.HP 12
2629Usage:
7e23fc43 2630.B mdadm \-\-incremental \-\-run \-\-scan
8382f19b 2631
8382f19b
NB
2632.PP
2633This mode is designed to be used in conjunction with a device
2634discovery system. As devices are found in a system, they can be
2635passed to
7e23fc43 2636.B "mdadm \-\-incremental"
8382f19b
NB
2637to be conditionally added to an appropriate array.
2638
29ba4804
N
2639Conversely, it can also be used with the
2640.B \-\-fail
2641flag to do just the opposite and find whatever array a particular device
2642is part of and remove the device from that array.
2643
8fd8d9c4
N
2644If the device passed is a
2645.B CONTAINER
2646device created by a previous call to
2647.IR mdadm ,
2648then rather than trying to add that device to an array, all the arrays
2649described by the metadata of the container will be started.
2650
8382f19b
NB
2651.I mdadm
2652performs a number of tests to determine if the device is part of an
93e790af 2653array, and which array it should be part of. If an appropriate array
8382f19b
NB
2654is found, or can be created,
2655.I mdadm
2656adds the device to the array and conditionally starts the array.
2657
2658Note that
2659.I mdadm
87eb4fab
N
2660will normally only add devices to an array which were previously working
2661(active or spare) parts of that array. The support for automatic
210597d1
PC
2662inclusion of a new drive as a spare in some array requires
2663a configuration through POLICY in config file.
8382f19b 2664
8382f19b
NB
2665The tests that
2666.I mdadm
2667makes are as follow:
2668.IP +
2669Is the device permitted by
2670.BR mdadm.conf ?
2671That is, is it listed in a
2672.B DEVICES
2673line in that file. If
2674.B DEVICES
2675is absent then the default it to allow any device. Similar if
2676.B DEVICES
2677contains the special word
2678.B partitions
2679then any device is allowed. Otherwise the device name given to
2680.I mdadm
2681must match one of the names or patterns in a
2682.B DEVICES
2683line.
2684
2685.IP +
cb77f620
NK
2686Does the device have a valid md superblock? If a specific metadata
2687version is requested with
7e23fc43 2688.B \-\-metadata
8382f19b 2689or
7e23fc43 2690.B \-e
8382f19b
NB
2691then only that style of metadata is accepted, otherwise
2692.I mdadm
2693finds any known version of metadata. If no
2694.I md
210597d1
PC
2695metadata is found, the device may be still added to an array
2696as a spare if POLICY allows.
8382f19b 2697
d1302dd8 2698.ig
8382f19b
NB
2699.IP +
2700Does the metadata match an expected array?
2701The metadata can match in two ways. Either there is an array listed
2702in
2703.B mdadm.conf
2704which identifies the array (either by UUID, by name, by device list,
93e790af 2705or by minor-number), or the array was created with a
8382f19b 2706.B homehost
93e790af 2707specified and that
8382f19b 2708.B homehost
93e790af 2709matches the one in
8382f19b
NB
2710.B mdadm.conf
2711or on the command line.
2712If
2713.I mdadm
2714is not able to positively identify the array as belonging to the
2715current host, the device will be rejected.
d1302dd8 2716..
8382f19b 2717
cb77f620 2718.PP
8382f19b 2719.I mdadm
93e790af 2720keeps a list of arrays that it has partially assembled in
96fd06ed 2721.BR {MAP_PATH} .
e0fe762a 2722If no array exists which matches
8382f19b
NB
2723the metadata on the new device,
2724.I mdadm
2725must choose a device name and unit number. It does this based on any
2726name given in
2727.B mdadm.conf
2728or any name information stored in the metadata. If this name
2729suggests a unit number, that number will be used, otherwise a free
2730unit number will be chosen. Normally
2731.I mdadm
2732will prefer to create a partitionable array, however if the
2733.B CREATE
2734line in
2735.B mdadm.conf
2736suggests that a non-partitionable array is preferred, that will be
2737honoured.
2738
e0fe762a
N
2739If the array is not found in the config file and its metadata does not
2740identify it as belonging to the "homehost", then
2741.I mdadm
2742will choose a name for the array which is certain not to conflict with
2743any array which does belong to this host. It does this be adding an
2744underscore and a small number to the name preferred by the metadata.
2745
8382f19b
NB
2746Once an appropriate array is found or created and the device is added,
2747.I mdadm
2748must decide if the array is ready to be started. It will
2749normally compare the number of available (non-spare) devices to the
2750number of devices that the metadata suggests need to be active. If
2751there are at least that many, the array will be started. This means
2752that if any devices are missing the array will not be restarted.
2753
2754As an alternative,
7e23fc43 2755.B \-\-run
8382f19b 2756may be passed to
51ac42e3 2757.I mdadm
8382f19b 2758in which case the array will be run as soon as there are enough
e0fe762a
N
2759devices present for the data to be accessible. For a RAID1, that
2760means one device will start the array. For a clean RAID5, the array
8382f19b
NB
2761will be started as soon as all but one drive is present.
2762
93e790af 2763Note that neither of these approaches is really ideal. If it can
8382f19b
NB
2764be known that all device discovery has completed, then
2765.br
7e23fc43 2766.B " mdadm \-IRs"
8382f19b
NB
2767.br
2768can be run which will try to start all arrays that are being
2769incrementally assembled. They are started in "read-auto" mode in
2770which they are read-only until the first write request. This means
2771that no metadata updates are made and no attempt at resync or recovery
2772happens. Further devices that are found before the first write can
2773still be added safely.
2774
5545fa6d
DW
2775.SH ENVIRONMENT
2776This section describes environment variables that affect how mdadm
2777operates.
2778
2779.TP
2780.B MDADM_NO_MDMON
2781Setting this value to 1 will prevent mdadm from automatically launching
2782mdmon. This variable is intended primarily for debugging mdadm/mdmon.
2783
8fd8d9c4
N
2784.TP
2785.B MDADM_NO_UDEV
2786Normally,
2787.I mdadm
2788does not create any device nodes in /dev, but leaves that task to
2789.IR udev .
2790If
2791.I udev
2792appears not to be configured, or if this environment variable is set
2793to '1', the
2794.I mdadm
2795will create and devices that are needed.
2796
401f095c
N
2797.TP
2798.B IMSM_NO_PLATFORM
2799A key value of IMSM metadata is that it allows interoperability with
2800boot ROMs on Intel platforms, and with other major operating systems.
2801Consequently,
2802.I mdadm
2803will only allow an IMSM array to be created or modified if detects
2804that it is running on an Intel platform which supports IMSM, and
2805supports the particular configuration of IMSM that is being requested
2806(some functionality requires newer OROM support).
2807
2808These checks can be suppressed by setting IMSM_NO_PLATFORM=1 in the
2809environment. This can be useful for testing or for disaster
2810recovery. You should be aware that interoperability may be
2811compromised by setting this value.
2d465520
NB
2812.SH EXAMPLES
2813
7e23fc43 2814.B " mdadm \-\-query /dev/name-of-device"
2d465520 2815.br
e0fe762a 2816This will find out if a given device is a RAID array, or is part of
5787fa49 2817one, and will provide brief information about the device.
2d465520 2818
7e23fc43 2819.B " mdadm \-\-assemble \-\-scan"
2d465520 2820.br
93e790af 2821This will assemble and start all arrays listed in the standard config
5787fa49 2822file. This command will typically go in a system startup file.
2d465520 2823
7e23fc43 2824.B " mdadm \-\-stop \-\-scan"
5787fa49 2825.br
93e790af 2826This will shut down all arrays that can be shut down (i.e. are not
19f8b8fc 2827currently in use). This will typically go in a system shutdown script.
2d465520 2828
7e23fc43 2829.B " mdadm \-\-follow \-\-scan \-\-delay=120"
2d465520 2830.br
5787fa49
NB
2831If (and only if) there is an Email address or program given in the
2832standard config file, then
2833monitor the status of all arrays listed in that file by
2834polling them ever 2 minutes.
2d465520 2835
7e23fc43 2836.B " mdadm \-\-create /dev/md0 \-\-level=1 \-\-raid\-devices=2 /dev/hd[ac]1"
2d465520 2837.br
5787fa49 2838Create /dev/md0 as a RAID1 array consisting of /dev/hda1 and /dev/hdc1.
2d465520 2839
2d465520 2840.br
7e23fc43 2841.B " echo 'DEVICE /dev/hd*[0\-9] /dev/sd*[0\-9]' > mdadm.conf"
2d465520 2842.br
7e23fc43 2843.B " mdadm \-\-detail \-\-scan >> mdadm.conf"
2d465520 2844.br
5787fa49
NB
2845This will create a prototype config file that describes currently
2846active arrays that are known to be made from partitions of IDE or SCSI drives.
2d465520
NB
2847This file should be reviewed before being used as it may
2848contain unwanted detail.
2849
7e23fc43 2850.B " echo 'DEVICE /dev/hd[a\-z] /dev/sd*[a\-z]' > mdadm.conf"
2d465520 2851.br
7e23fc43 2852.B " mdadm \-\-examine \-\-scan \-\-config=mdadm.conf >> mdadm.conf"
93e790af
SW
2853.br
2854This will find arrays which could be assembled from existing IDE and
2855SCSI whole drives (not partitions), and store the information in the
5787fa49 2856format of a config file.
2d465520
NB
2857This file is very likely to contain unwanted detail, particularly
2858the
2859.B devices=
5787fa49
NB
2860entries. It should be reviewed and edited before being used as an
2861actual config file.
2d465520 2862
7e23fc43 2863.B " mdadm \-\-examine \-\-brief \-\-scan \-\-config=partitions"
2d465520 2864.br
7e23fc43 2865.B " mdadm \-Ebsc partitions"
5787fa49
NB
2866.br
2867Create a list of devices by reading
2868.BR /proc/partitions ,
2869scan these for RAID superblocks, and printout a brief listing of all
93e790af 2870that were found.
2d465520 2871
7e23fc43 2872.B " mdadm \-Ac partitions \-m 0 /dev/md0"
2d465520 2873.br
5787fa49
NB
2874Scan all partitions and devices listed in
2875.BR /proc/partitions
2876and assemble
2877.B /dev/md0
2878out of all such devices with a RAID superblock with a minor number of 0.
2d465520 2879
96fd06ed 2880.B " mdadm \-\-monitor \-\-scan \-\-daemonise > /run/mdadm/mon.pid"
d013a55e
NB
2881.br
2882If config file contains a mail address or alert program, run mdadm in
2883the background in monitor mode monitoring all md devices. Also write
2884pid of mdadm daemon to
96fd06ed 2885.BR /run/mdadm/mon.pid .
d013a55e 2886
7e23fc43 2887.B " mdadm \-Iq /dev/somedevice"
8382f19b
NB
2888.br
2889Try to incorporate newly discovered device into some array as
2890appropriate.
2891
7e6140e6 2892.B " mdadm \-\-incremental \-\-rebuild\-map \-\-run \-\-scan"
8382f19b
NB
2893.br
2894Rebuild the array map from any current arrays, and then start any that
2895can be started.
2896
b80da661
NB
2897.B " mdadm /dev/md4 --fail detached --remove detached"
2898.br
2899Any devices which are components of /dev/md4 will be marked as faulty
2900and then remove from the array.
2901
cb77f620 2902.B " mdadm --grow /dev/md4 --level=6 --backup-file=/root/backup-md4"
f24e2d6c
N
2903.br
2904The array
2905.B /dev/md4
2906which is currently a RAID5 array will be converted to RAID6. There
2907should normally already be a spare drive attached to the array as a
2908RAID6 needs one more drive than a matching RAID5.
2909
8fd8d9c4
N
2910.B " mdadm --create /dev/md/ddf --metadata=ddf --raid-disks 6 /dev/sd[a-f]"
2911.br
2912Create a DDF array over 6 devices.
2913
2914.B " mdadm --create /dev/md/home -n3 -l5 -z 30000000 /dev/md/ddf"
2915.br
e0fe762a 2916Create a RAID5 array over any 3 devices in the given DDF set. Use
8fd8d9c4
N
2917only 30 gigabytes of each device.
2918
2919.B " mdadm -A /dev/md/ddf1 /dev/sd[a-f]"
2920.br
2921Assemble a pre-exist ddf array.
2922
2923.B " mdadm -I /dev/md/ddf1"
2924.br
2925Assemble all arrays contained in the ddf array, assigning names as
2926appropriate.
2927
7e23fc43 2928.B " mdadm \-\-create \-\-help"
2d465520 2929.br
2ae555c3 2930Provide help about the Create mode.
2d465520 2931
7e23fc43 2932.B " mdadm \-\-config \-\-help"
5787fa49
NB
2933.br
2934Provide help about the format of the config file.
2d465520 2935
7e23fc43 2936.B " mdadm \-\-help"
5787fa49
NB
2937.br
2938Provide general help.
cd29a5c8 2939
cd29a5c8
NB
2940.SH FILES
2941
2942.SS /proc/mdstat
2943
2ae555c3
NB
2944If you're using the
2945.B /proc
cd29a5c8
NB
2946filesystem,
2947.B /proc/mdstat
2d465520 2948lists all active md devices with information about them.
51ac42e3 2949.I mdadm
2d465520 2950uses this to find arrays when
7e23fc43 2951.B \-\-scan
2d465520
NB
2952is given in Misc mode, and to monitor array reconstruction
2953on Monitor mode.
2954
9a9dab36 2955.SS /etc/mdadm.conf
cd29a5c8 2956
11a3e71d
NB
2957The config file lists which devices may be scanned to see if
2958they contain MD super block, and gives identifying information
2959(e.g. UUID) about known MD arrays. See
2960.BR mdadm.conf (5)
2961for more details.
cd29a5c8 2962
96fd06ed 2963.SS {MAP_PATH}
8382f19b 2964When
7e23fc43 2965.B \-\-incremental
93e790af 2966mode is used, this file gets a list of arrays currently being created.
8382f19b 2967
48f7b27a
NB
2968.SH DEVICE NAMES
2969
48f7b27a 2970.I mdadm
8fd8d9c4
N
2971understand two sorts of names for array devices.
2972
2973The first is the so-called 'standard' format name, which matches the
2974names used by the kernel and which appear in
2975.IR /proc/mdstat .
2976
2977The second sort can be freely chosen, but must reside in
2978.IR /dev/md/ .
2979When giving a device name to
2980.I mdadm
2981to create or assemble an array, either full path name such as
2982.I /dev/md0
2983or
2984.I /dev/md/home
2985can be given, or just the suffix of the second sort of name, such as
2986.I home
2987can be given.
2988
2989When
2990.I mdadm
e0fe762a
N
2991chooses device names during auto-assembly or incremental assembly, it
2992will sometimes add a small sequence number to the end of the name to
2993avoid conflicted between multiple arrays that have the same name. If
8fd8d9c4
N
2994.I mdadm
2995can reasonably determine that the array really is meant for this host,
2996either by a hostname in the metadata, or by the presence of the array
87eb4fab
N
2997in
2998.BR mdadm.conf ,
2999then it will leave off the suffix if possible.
e0fe762a
N
3000Also if the homehost is specified as
3001.B <ignore>
3002.I mdadm
3003will only use a suffix if a different array of the same name already
3004exists or is listed in the config file.
48f7b27a
NB
3005
3006The standard names for non-partitioned arrays (the only sort of md
8fd8d9c4 3007array available in 2.4 and earlier) are of the form
48f7b27a 3008.IP
eca944fa 3009.RB /dev/md NN
48f7b27a
NB
3010.PP
3011where NN is a number.
3012The standard names for partitionable arrays (as available from 2.6
eca944fa 3013onwards) are of the form:
48f7b27a 3014.IP
eca944fa 3015.RB /dev/md_d NN
48f7b27a 3016.PP
eca944fa 3017Partition numbers should be indicated by adding "pMM" to these, thus "/dev/md/d1p2".
8fd8d9c4 3018.PP
eca944fa
N
3019From kernel version 2.6.28 the "non-partitioned array" can actually
3020be partitioned. So the "md_d\fBNN\fP"
3021names are no longer needed, and
3022partitions such as "/dev/md\fBNN\fPp\fBXX\fp"
3023are possible.
3024.PP
3025From kernel version 2.6.29 standard names can be non-numeric following
3026the form:
3027.IP
3028.RB /dev/md_ XXX
3029.PP
3030where
3031.B XXX
3032is any string. These names are supported by
3033.I mdadm
3034since version 3.3 provided they are enabled in
3035.IR mdadm.conf .
52826846 3036
2d465520 3037.SH NOTE
51ac42e3 3038.I mdadm
2d465520 3039was previously known as
51ac42e3 3040.IR mdctl .
a9d69660 3041
52826846 3042.SH SEE ALSO
75f74377 3043For further information on mdadm usage, MD and the various levels of
3cdfb6a7 3044RAID, see:
3cdfb6a7 3045.IP
cb77f620 3046.B http://raid.wiki.kernel.org/
75f74377
DG
3047.PP
3048(based upon Jakob \(/Ostergaard's Software\-RAID.HOWTO)
cd29a5c8 3049.PP
2ae555c3 3050The latest version of
a9d69660
NB
3051.I mdadm
3052should always be available from
cd29a5c8 3053.IP
11cd8b79
N
3054.B http://www.kernel.org/pub/linux/utils/raid/mdadm/
3055.PP
3056Related man pages:
cd29a5c8 3057.PP
e0fe762a 3058.IR mdmon (8),
a9d69660
NB
3059.IR mdadm.conf (5),
3060.IR md (4).