]> git.ipfire.org Git - thirdparty/mdadm.git/blame - mdadm.8.in
Assemble: fix spelling: report_missmatch -> report_mismatch
[thirdparty/mdadm.git] / mdadm.8.in
CommitLineData
52826846 1.\" -*- nroff -*-
e43d0cda
NB
2.\" Copyright Neil Brown and others.
3.\" This program is free software; you can redistribute it and/or modify
4.\" it under the terms of the GNU General Public License as published by
5.\" the Free Software Foundation; either version 2 of the License, or
6.\" (at your option) any later version.
7.\" See file COPYING in distribution for details.
3b2aad6e 8.TH MDADM 8 "" v3.2.5
52826846 9.SH NAME
9a9dab36 10mdadm \- manage MD devices
cd29a5c8 11.I aka
93e790af 12Linux Software RAID
cd29a5c8 13
52826846
NB
14.SH SYNOPSIS
15
e0d19036 16.BI mdadm " [mode] <raiddevice> [options] <component-devices>"
52826846 17
2ae555c3 18.SH DESCRIPTION
52826846 19RAID devices are virtual devices created from two or more
e0fe762a 20real block devices. This allows multiple devices (typically disk
35cc5be4 21drives or partitions thereof) to be combined into a single device to
cd29a5c8 22hold (for example) a single filesystem.
2d465520 23Some RAID levels include redundancy and so can survive some degree of
cd29a5c8
NB
24device failure.
25
2d465520
NB
26Linux Software RAID devices are implemented through the md (Multiple
27Devices) device driver.
cd29a5c8
NB
28
29Currently, Linux supports
30.B LINEAR
31md devices,
32.B RAID0
33(striping),
34.B RAID1
35(mirroring),
d013a55e
NB
36.BR RAID4 ,
37.BR RAID5 ,
98c6faba 38.BR RAID6 ,
1a7dfc35 39.BR RAID10 ,
b5e64645 40.BR MULTIPATH ,
90c8d668 41.BR FAULTY ,
cd29a5c8 42and
90c8d668 43.BR CONTAINER .
d013a55e 44
a9d69660
NB
45.B MULTIPATH
46is not a Software RAID mechanism, but does involve
93e790af 47multiple devices:
d013a55e 48each device is a path to one common physical storage device.
9652457e
N
49New installations should not use md/multipath as it is not well
50supported and has no ongoing development. Use the Device Mapper based
51multipath-tools instead.
d013a55e 52
a9d69660
NB
53.B FAULTY
54is also not true RAID, and it only involves one device. It
b5e64645 55provides a layer over a true device that can be used to inject faults.
52826846 56
4cce4069 57.B CONTAINER
8fd8d9c4
N
58is different again. A
59.B CONTAINER
60is a collection of devices that are
90c8d668
N
61managed as a set. This is similar to the set of devices connected to
62a hardware RAID controller. The set of devices may contain a number
9652457e 63of different RAID arrays each utilising some (or all) of the blocks from a
90c8d668 64number of the devices in the set. For example, two devices in a 5-device set
9652457e 65might form a RAID1 using the whole devices. The remaining three might
90c8d668
N
66have a RAID5 over the first half of each device, and a RAID0 over the
67second half.
68
8fd8d9c4
N
69With a
70.BR CONTAINER ,
71there is one set of metadata that describes all of
72the arrays in the container. So when
73.I mdadm
74creates a
75.B CONTAINER
9652457e
N
76device, the device just represents the metadata. Other normal arrays (RAID1
77etc) can be created inside the container.
52826846
NB
78
79.SH MODES
8382f19b 80mdadm has several major modes of operation:
cd29a5c8
NB
81.TP
82.B Assemble
93e790af 83Assemble the components of a previously created
e0fe762a 84array into an active array. Components can be explicitly given
2ae555c3 85or can be searched for.
51ac42e3 86.I mdadm
cd29a5c8
NB
87checks that the components
88do form a bona fide array, and can, on request, fiddle superblock
89information so as to assemble a faulty array.
90
91.TP
92.B Build
e0fe762a 93Build an array that doesn't have per-device metadata (superblocks). For these
a9d69660
NB
94sorts of arrays,
95.I mdadm
96cannot differentiate between initial creation and subsequent assembly
97of an array. It also cannot perform any checks that appropriate
93e790af 98components have been requested. Because of this, the
a9d69660
NB
99.B Build
100mode should only be used together with a complete understanding of
101what you are doing.
cd29a5c8
NB
102
103.TP
104.B Create
e0fe762a
N
105Create a new array with per-device metadata (superblocks).
106Appropriate metadata is written to each device, and then the array
107comprising those devices is activated. A 'resync' process is started
108to make sure that the array is consistent (e.g. both sides of a mirror
109contain the same data) but the content of the device is left otherwise
110untouched.
111The array can be used as soon as it has been created. There is no
112need to wait for the initial resync to finish.
cd29a5c8 113
cd29a5c8
NB
114.TP
115.B "Follow or Monitor"
5787fa49 116Monitor one or more md devices and act on any state changes. This is
e0fe762a
N
117only meaningful for RAID1, 4, 5, 6, 10 or multipath arrays, as
118only these have interesting state. RAID0 or Linear never have
98c6faba 119missing, spare, or failed drives, so there is nothing to monitor.
5787fa49 120
dd0781e5
NB
121.TP
122.B "Grow"
123Grow (or shrink) an array, or otherwise reshape it in some way.
124Currently supported growth options including changing the active size
c64881d7
N
125of component devices and changing the number of active devices in
126Linear and RAID levels 0/1/4/5/6,
127changing the RAID level between 0, 1, 5, and 6, and between 0 and 10,
128changing the chunk size and layout for RAID 0,4,5,6, as well as adding or
f24e2d6c 129removing a write-intent bitmap.
cd29a5c8 130
8382f19b
NB
131.TP
132.B "Incremental Assembly"
133Add a single device to an appropriate array. If the addition of the
134device makes the array runnable, the array will be started.
135This provides a convenient interface to a
136.I hot-plug
137system. As each device is detected,
138.I mdadm
139has a chance to include it in some array as appropriate.
29ba4804
N
140Optionally, when the
141.I \-\-fail
142flag is passed in we will remove the device from any active array
143instead of adding it.
9652457e 144
8fd8d9c4
N
145If a
146.B CONTAINER
147is passed to
148.I mdadm
149in this mode, then any arrays within that container will be assembled
150and started.
8382f19b 151
2ae555c3
NB
152.TP
153.B Manage
154This is for doing things to specific components of an array such as
155adding new spares and removing faulty devices.
156
157.TP
158.B Misc
159This is an 'everything else' mode that supports operations on active
160arrays, operations on component devices such as erasing old superblocks, and
161information gathering operations.
e43d0cda
NB
162.\"This mode allows operations on independent devices such as examine MD
163.\"superblocks, erasing old superblocks and stopping active arrays.
2ae555c3 164
1f48664b
NB
165.TP
166.B Auto-detect
167This mode does not act on a specific device or array, but rather it
168requests the Linux Kernel to activate any auto-detected arrays.
52826846
NB
169.SH OPTIONS
170
2ae555c3 171.SH Options for selecting a mode are:
52826846 172
cd29a5c8 173.TP
7e23fc43 174.BR \-A ", " \-\-assemble
2d465520 175Assemble a pre-existing array.
52826846 176
cd29a5c8 177.TP
7e23fc43 178.BR \-B ", " \-\-build
cd29a5c8 179Build a legacy array without superblocks.
52826846 180
cd29a5c8 181.TP
7e23fc43 182.BR \-C ", " \-\-create
cd29a5c8 183Create a new array.
52826846 184
cd29a5c8 185.TP
7e23fc43 186.BR \-F ", " \-\-follow ", " \-\-monitor
cd29a5c8
NB
187Select
188.B Monitor
189mode.
52826846 190
dd0781e5 191.TP
7e23fc43 192.BR \-G ", " \-\-grow
dd0781e5 193Change the size or shape of an active array.
8382f19b
NB
194
195.TP
1f48664b 196.BR \-I ", " \-\-incremental
29ba4804 197Add/remove a single device to/from an appropriate array, and possibly start the array.
8382f19b 198
1f48664b
NB
199.TP
200.B \-\-auto-detect
201Request that the kernel starts any auto-detected arrays. This can only
202work if
203.I md
204is compiled into the kernel \(em not if it is a module.
205Arrays can be auto-detected by the kernel if all the components are in
206primary MS-DOS partitions with partition type
e0fe762a
N
207.BR FD ,
208and all use v0.90 metadata.
1f48664b
NB
209In-kernel autodetect is not recommended for new installations. Using
210.I mdadm
211to detect and assemble arrays \(em possibly in an
212.I initrd
213\(em is substantially more flexible and should be preferred.
214
2ae555c3
NB
215.P
216If a device is given before any options, or if the first option is
7e23fc43
PS
217.BR \-\-add ,
218.BR \-\-fail ,
7e23fc43 219.BR \-\-remove ,
70c55e36
N
220or
221.BR \-\-replace ,
e0fe762a 222then the MANAGE mode is assumed.
2ae555c3
NB
223Anything other than these will cause the
224.B Misc
225mode to be assumed.
dd0781e5 226
2ae555c3 227.SH Options that are not mode-specific are:
e793c2e5 228
cd29a5c8 229.TP
7e23fc43 230.BR \-h ", " \-\-help
a9d69660 231Display general help message or, after one of the above options, a
93e790af 232mode-specific help message.
56eedc1a
NB
233
234.TP
7e23fc43 235.B \-\-help\-options
56eedc1a
NB
236Display more detailed help about command line parsing and some commonly
237used options.
52826846 238
cd29a5c8 239.TP
7e23fc43 240.BR \-V ", " \-\-version
9a9dab36 241Print version information for mdadm.
52826846 242
cd29a5c8 243.TP
7e23fc43 244.BR \-v ", " \-\-verbose
22892d56
NB
245Be more verbose about what is happening. This can be used twice to be
246extra-verbose.
a9d69660 247The extra verbosity currently only affects
7e23fc43 248.B \-\-detail \-\-scan
22892d56 249and
7e23fc43 250.BR "\-\-examine \-\-scan" .
52826846 251
dab6685f 252.TP
7e23fc43 253.BR \-q ", " \-\-quiet
dab6685f 254Avoid printing purely informative messages. With this,
51ac42e3 255.I mdadm
dab6685f
NB
256will be silent unless there is something really important to report.
257
08ca2adf
JS
258.TP
259.BR \-\-offroot
260Set first character of argv[0] to @ to indicate mdadm was launched
261from initrd/initramfs and should not be shutdown by systemd as part of
262the regular shutdown process. This option is normally only used by
263the system's initscripts. Please see here for more details on how
264systemd handled argv[0]:
265.IP
266.B http://www.freedesktop.org/wiki/Software/systemd/RootStorageDaemons
267.PP
268
269
e0d19036 270.TP
7e23fc43 271.BR \-f ", " \-\-force
93e790af 272Be more forceful about certain operations. See the various modes for
e0d19036
NB
273the exact meaning of this option in different contexts.
274
275.TP
7e23fc43 276.BR \-c ", " \-\-config=
2ae555c3
NB
277Specify the config file. Default is to use
278.BR /etc/mdadm.conf ,
93e790af 279or if that is missing then
2ae555c3 280.BR /etc/mdadm/mdadm.conf .
5787fa49 281If the config file given is
93e790af 282.B "partitions"
5787fa49
NB
283then nothing will be read, but
284.I mdadm
285will act as though the config file contained exactly
8fd8d9c4 286.B "DEVICE partitions containers"
5787fa49
NB
287and will read
288.B /proc/partitions
8fd8d9c4
N
289to find a list of devices to scan, and
290.B /proc/mdstat
291to find a list of containers to examine.
d013a55e 292If the word
93e790af 293.B "none"
d013a55e
NB
294is given for the config file, then
295.I mdadm
296will act as though the config file were empty.
e0d19036
NB
297
298.TP
7e23fc43 299.BR \-s ", " \-\-scan
93e790af 300Scan config file or
e0d19036
NB
301.B /proc/mdstat
302for missing information.
303In general, this option gives
51ac42e3 304.I mdadm
93e790af
SW
305permission to get any missing information (like component devices,
306array devices, array identities, and alert destination) from the
307configuration file (see previous option);
308one exception is MISC mode when using
7e23fc43 309.B \-\-detail
e0d19036 310or
93e790af 311.B \-\-stop,
e0d19036 312in which case
7e23fc43 313.B \-\-scan
e0d19036
NB
314says to get a list of array devices from
315.BR /proc/mdstat .
316
570c0542 317.TP
d16c7af6 318.BR \-e ", " \-\-metadata=
e0fe762a 319Declare the style of RAID metadata (superblock) to be used. The
26f467a9 320default is {DEFAULT_METADATA} for
7e23fc43 321.BR \-\-create ,
53e8b987 322and to guess for other operations.
2790ffe3
GB
323The default can be overridden by setting the
324.B metadata
325value for the
326.B CREATE
327keyword in
328.BR mdadm.conf .
570c0542
NB
329
330Options are:
331.RS
26f467a9 332.ie '{DEFAULT_METADATA}'0.90'
333.IP "0, 0.90, default"
334.el
7d5c3964 335.IP "0, 0.90"
570c0542 336Use the original 0.90 format superblock. This format limits arrays to
93e790af 33728 component devices and limits component devices of levels 1 and
cd19c0cf
JR
338greater to 2 terabytes. It is also possible for there to be confusion
339about whether the superblock applies to a whole device or just the
340last partition, if that partition starts on a 64K boundary.
26f467a9 341.ie '{DEFAULT_METADATA}'0.90'
342.IP "1, 1.0, 1.1, 1.2"
343.el
7d5c3964 344.IP "1, 1.0, 1.1, 1.2 default"
cd19c0cf
JR
345Use the new version-1 format superblock. This has fewer restrictions.
346It can easily be moved between hosts with different endian-ness, and a
347recovery operation can be checkpointed and restarted. The different
348sub-versions store the superblock at different locations on the
349device, either at the end (for 1.0), at the start (for 1.1) or 4K from
7050aa3f
N
350the start (for 1.2). "1" is equivalent to "1.2" (the commonly
351preferred 1.x format).
26f467a9 352'if '{DEFAULT_METADATA}'1.2' "default" is equivalent to "1.2".
8fd8d9c4 353.IP ddf
e0fe762a
N
354Use the "Industry Standard" DDF (Disk Data Format) format defined by
355SNIA.
356When creating a DDF array a
8fd8d9c4
N
357.B CONTAINER
358will be created, and normal arrays can be created in that container.
359.IP imsm
4cce4069 360Use the Intel(R) Matrix Storage Manager metadata format. This creates a
8fd8d9c4 361.B CONTAINER
4cce4069
DW
362which is managed in a similar manner to DDF, and is supported by an
363option-rom on some platforms:
364.IP
365.B http://www.intel.com/design/chipsets/matrixstorage_sb.htm
366.PP
570c0542
NB
367.RE
368
41a3b72a 369.TP
7e23fc43 370.B \-\-homehost=
35cc5be4 371This will override any
41a3b72a 372.B HOMEHOST
93e790af 373setting in the config file and provides the identity of the host which
41a3b72a
NB
374should be considered the home for any arrays.
375
376When creating an array, the
377.B homehost
e0fe762a 378will be recorded in the metadata. For version-1 superblocks, it will
93e790af 379be prefixed to the array name. For version-0.90 superblocks, part of
41a3b72a
NB
380the SHA1 hash of the hostname will be stored in the later half of the
381UUID.
382
383When reporting information about an array, any array which is tagged
384for the given homehost will be reported as such.
385
386When using Auto-Assemble, only arrays tagged for the given homehost
0ac91628 387will be allowed to use 'local' names (i.e. not ending in '_' followed
e0fe762a
N
388by a digit string). See below under
389.BR "Auto Assembly" .
41a3b72a 390
c2ecf5f6
N
391.TP
392.B \-\-prefer=
393When
394.I mdadm
395needs to print the name for a device it normally finds the name in
396.B /dev
397which refers to the device and is shortest. When a path component is
398given with
399.B \-\-prefer
400.I mdadm
401will prefer a longer name if it contains that component. For example
402.B \-\-prefer=by-uuid
403will prefer a name in a subdirectory of
404.B /dev
405called
406.BR by-uuid .
407
408This functionality is currently only provided by
409.B \-\-detail
410and
411.BR \-\-monitor .
412
2ae555c3
NB
413.SH For create, build, or grow:
414
415.TP
7e23fc43 416.BR \-n ", " \-\-raid\-devices=
2ae555c3
NB
417Specify the number of active devices in the array. This, plus the
418number of spare devices (see below) must equal the number of
419.I component-devices
420(including "\fBmissing\fP" devices)
421that are listed on the command line for
e0fe762a 422.BR \-\-create .
2ae555c3
NB
423Setting a value of 1 is probably
424a mistake and so requires that
7e23fc43 425.B \-\-force
2ae555c3 426be specified first. A value of 1 will then be allowed for linear,
e0fe762a 427multipath, RAID0 and RAID1. It is never allowed for RAID4, RAID5 or RAID6.
2ae555c3
NB
428.br
429This number can only be changed using
7e23fc43 430.B \-\-grow
e0fe762a
N
431for RAID1, RAID4, RAID5 and RAID6 arrays, and only on kernels which provide
432the necessary support.
2ae555c3
NB
433
434.TP
7e23fc43 435.BR \-x ", " \-\-spare\-devices=
2ae555c3
NB
436Specify the number of spare (eXtra) devices in the initial array.
437Spares can also be added
438and removed later. The number of component devices listed
e0fe762a 439on the command line must equal the number of RAID devices plus the
2ae555c3
NB
440number of spare devices.
441
2ae555c3 442.TP
7e23fc43 443.BR \-z ", " \-\-size=
e0fe762a 444Amount (in Kibibytes) of space to use from each drive in RAID levels 1/4/5/6.
2ae555c3
NB
445This must be a multiple of the chunk size, and must leave about 128Kb
446of space at the end of the drive for the RAID superblock.
447If this is not specified
448(as it normally is not) the smallest drive (or partition) sets the
449size, though if there is a variance among the drives of greater than 1%, a warning is
450issued.
451
36fad8ec
N
452A suffix of 'M' or 'G' can be given to indicate Megabytes or
453Gigabytes respectively.
454
9ab6e80a
N
455Sometimes a replacement drive can be a little smaller than the
456original drives though this should be minimised by IDEMA standards.
457Such a replacement drive will be rejected by
458.IR md .
459To guard against this it can be useful to set the initial size
460slightly smaller than the smaller device with the aim that it will
461still be larger than any replacement.
462
2ae555c3 463This value can be set with
7e23fc43 464.B \-\-grow
9ab6e80a
N
465for RAID level 1/4/5/6 though
466.B CONTAINER
467based arrays such as those with IMSM metadata may not be able to
468support this.
469If the array was created with a size smaller than the currently
470active drives, the extra space can be accessed using
7e23fc43 471.BR \-\-grow .
2ae555c3
NB
472The size can be given as
473.B max
474which means to choose the largest size that fits on all current drives.
52826846 475
c26d78fe
N
476Before reducing the size of the array (with
477.BR "\-\-grow \-\-size=" )
478you should make sure that space isn't needed. If the device holds a
479filesystem, you would need to resize the filesystem to use less space.
480
481After reducing the array size you should check that the data stored in
482the device is still available. If the device holds a filesystem, then
483an 'fsck' of the filesystem is a minimum requirement. If there are
484problems the array can be made bigger again with no loss with another
485.B "\-\-grow \-\-size="
486command.
487
9ab6e80a 488This value cannot be used when creating a
8fd8d9c4 489.B CONTAINER
9ab6e80a
N
490such as with DDF and IMSM metadata, though it perfectly valid when
491creating an array inside a container.
8fd8d9c4 492
f24e2d6c 493.TP
c26d78fe 494.BR \-Z ", " \-\-array\-size=
f24e2d6c
N
495This is only meaningful with
496.B \-\-grow
36fad8ec 497and its effect is not persistent: when the array is stopped and
f24e2d6c
N
498restarted the default array size will be restored.
499
500Setting the array-size causes the array to appear smaller to programs
501that access the data. This is particularly needed before reshaping an
502array so that it will be smaller. As the reshape is not reversible,
503but setting the size with
504.B \-\-array-size
505is, it is required that the array size is reduced as appropriate
506before the number of devices in the array is reduced.
507
c26d78fe
N
508Before reducing the size of the array you should make sure that space
509isn't needed. If the device holds a filesystem, you would need to
510resize the filesystem to use less space.
511
512After reducing the array size you should check that the data stored in
513the device is still available. If the device holds a filesystem, then
514an 'fsck' of the filesystem is a minimum requirement. If there are
515problems the array can be made bigger again with no loss with another
516.B "\-\-grow \-\-array\-size="
517command.
518
36fad8ec
N
519A suffix of 'M' or 'G' can be given to indicate Megabytes or
520Gigabytes respectively.
521A value of
522.B max
523restores the apparent size of the array to be whatever the real
524amount of available space is.
525
cd29a5c8 526.TP
7e23fc43 527.BR \-c ", " \-\-chunk=
5f175898
N
528Specify chunk size of kibibytes. The default when creating an
529array is 512KB. To ensure compatibility with earlier versions, the
530default when Building and array with no persistent metadata is 64KB.
e0fe762a 531This is only meaningful for RAID0, RAID4, RAID5, RAID6, and RAID10.
52826846 532
a252c078
N
533RAID4, RAID5, RAID6, and RAID10 require the chunk size to be a power
534of 2. In any case it must be a multiple of 4KB.
535
36fad8ec
N
536A suffix of 'M' or 'G' can be given to indicate Megabytes or
537Gigabytes respectively.
538
cd29a5c8 539.TP
7e23fc43 540.BR \-\-rounding=
e0fe762a
N
541Specify rounding factor for a Linear array. The size of each
542component will be rounded down to a multiple of this size.
543This is a synonym for
544.B \-\-chunk
545but highlights the different meaning for Linear as compared to other
5f175898
N
546RAID levels. The default is 64K if a kernel earlier than 2.6.16 is in
547use, and is 0K (i.e. no rounding) in later kernels.
52826846 548
cd29a5c8 549.TP
7e23fc43 550.BR \-l ", " \-\-level=
e0fe762a 551Set RAID level. When used with
7e23fc43 552.BR \-\-create ,
98c6faba 553options are: linear, raid0, 0, stripe, raid1, 1, mirror, raid4, 4,
8fd8d9c4
N
554raid5, 5, raid6, 6, raid10, 10, multipath, mp, faulty, container.
555Obviously some of these are synonymous.
556
557When a
558.B CONTAINER
559metadata type is requested, only the
560.B container
561level is permitted, and it does not need to be explicitly given.
aa88f531
NB
562
563When used with
7e23fc43 564.BR \-\-build ,
a9d69660 565only linear, stripe, raid0, 0, raid1, multipath, mp, and faulty are valid.
52826846 566
fd547b50
N
567Can be used with
568.B \-\-grow
569to change the RAID level in some cases. See LEVEL CHANGES below.
2ae555c3 570
cd29a5c8 571.TP
7e23fc43 572.BR \-p ", " \-\-layout=
f24e2d6c
N
573This option configures the fine details of data layout for RAID5, RAID6,
574and RAID10 arrays, and controls the failure modes for
1a7dfc35
NB
575.IR faulty .
576
e0fe762a 577The layout of the RAID5 parity block can be one of
7e23fc43
PS
578.BR left\-asymmetric ,
579.BR left\-symmetric ,
580.BR right\-asymmetric ,
581.BR right\-symmetric ,
53e8b987
PS
582.BR la ", " ra ", " ls ", " rs .
583The default is
7e23fc43 584.BR left\-symmetric .
52826846 585
cd19c0cf 586It is also possible to cause RAID5 to use a RAID4-like layout by
e0fe762a
N
587choosing
588.BR parity\-first ,
589or
590.BR parity\-last .
591
592Finally for RAID5 there are DDF\-compatible layouts,
593.BR ddf\-zero\-restart ,
594.BR ddf\-N\-restart ,
595and
596.BR ddf\-N\-continue .
597
598These same layouts are available for RAID6. There are also 4 layouts
599that will provide an intermediate stage for converting between RAID5
600and RAID6. These provide a layout which is identical to the
601corresponding RAID5 layout on the first N\-1 devices, and has the 'Q'
602syndrome (the second 'parity' block used by RAID6) on the last device.
603These layouts are:
604.BR left\-symmetric\-6 ,
605.BR right\-symmetric\-6 ,
606.BR left\-asymmetric\-6 ,
607.BR right\-asymmetric\-6 ,
608and
10adfe9a 609.BR parity\-first\-6 .
e0fe762a 610
93e790af
SW
611When setting the failure mode for level
612.I faulty,
1a7dfc35 613the options are:
7e23fc43
PS
614.BR write\-transient ", " wt ,
615.BR read\-transient ", " rt ,
616.BR write\-persistent ", " wp ,
617.BR read\-persistent ", " rp ,
618.BR write\-all ,
619.BR read\-fixable ", " rf ,
53e8b987 620.BR clear ", " flush ", " none .
b5e64645 621
93e790af 622Each failure mode can be followed by a number, which is used as a period
b5e64645
NB
623between fault generation. Without a number, the fault is generated
624once on the first relevant request. With a number, the fault will be
93e790af 625generated after that many requests, and will continue to be generated
b5e64645
NB
626every time the period elapses.
627
628Multiple failure modes can be current simultaneously by using the
7e23fc43 629.B \-\-grow
53e8b987 630option to set subsequent failure modes.
b5e64645
NB
631
632"clear" or "none" will remove any pending or periodic failure modes,
2ae555c3 633and "flush" will clear any persistent faults.
b5e64645 634
6f9a21a7 635Finally, the layout options for RAID10 are one of 'n', 'o' or 'f' followed
93e790af 636by a small number. The default is 'n2'. The supported options are:
1a7dfc35 637
93e790af 638.I 'n'
e0fe762a 639signals 'near' copies. Multiple copies of one data block are at
b578481c
NB
640similar offsets in different devices.
641
93e790af 642.I 'o'
b578481c
NB
643signals 'offset' copies. Rather than the chunks being duplicated
644within a stripe, whole stripes are duplicated but are rotated by one
645device so duplicate blocks are on different devices. Thus subsequent
646copies of a block are in the next drive, and are one chunk further
647down.
648
93e790af 649.I 'f'
1a7dfc35 650signals 'far' copies
93e790af 651(multiple copies have very different offsets).
e0fe762a 652See md(4) for more detail about 'near', 'offset', and 'far'.
1a7dfc35
NB
653
654The number is the number of copies of each datablock. 2 is normal, 3
655can be useful. This number can be at most equal to the number of
656devices in the array. It does not need to divide evenly into that
657number (e.g. it is perfectly legal to have an 'n2' layout for an array
658with an odd number of devices).
659
f24e2d6c
N
660When an array is converted between RAID5 and RAID6 an intermediate
661RAID6 layout is used in which the second parity block (Q) is always on
662the last device. To convert a RAID5 to RAID6 and leave it in this new
663layout (which does not require re-striping) use
664.BR \-\-layout=preserve .
665This will try to avoid any restriping.
666
667The converse of this is
668.B \-\-layout=normalise
669which will change a non-standard RAID6 layout into a more standard
670arrangement.
671
cd29a5c8 672.TP
7e23fc43 673.BR \-\-parity=
53e8b987 674same as
7e23fc43 675.B \-\-layout
53e8b987 676(thus explaining the p of
7e23fc43 677.BR \-p ).
52826846 678
e793c2e5 679.TP
7e23fc43 680.BR \-b ", " \-\-bitmap=
e793c2e5 681Specify a file to store a write-intent bitmap in. The file should not
53e8b987 682exist unless
7e23fc43 683.B \-\-force
53e8b987 684is also given. The same file should be provided
2ae555c3 685when assembling the array. If the word
93e790af 686.B "internal"
2ae555c3
NB
687is given, then the bitmap is stored with the metadata on the array,
688and so is replicated on all devices. If the word
93e790af 689.B "none"
2ae555c3 690is given with
7e23fc43 691.B \-\-grow
2ae555c3 692mode, then any bitmap that is present is removed.
e793c2e5 693
2ae555c3
NB
694To help catch typing errors, the filename must contain at least one
695slash ('/') if it is a real file (not 'internal' or 'none').
696
697Note: external bitmaps are only known to work on ext2 and ext3.
698Storing bitmap files on other filesystems may result in serious problems.
e793c2e5 699
cd29a5c8 700.TP
7e23fc43 701.BR \-\-bitmap\-chunk=
e0fe762a 702Set the chunksize of the bitmap. Each bit corresponds to that many
1bfdbe01
NB
703Kilobytes of storage.
704When using a file based bitmap, the default is to use the smallest
93e790af 705size that is at-least 4 and requires no more than 2^21 chunks.
2ae555c3
NB
706When using an
707.B internal
b8ab2a50
N
708bitmap, the chunksize defaults to 64Meg, or larger if necessary to
709fit the bitmap into the available space.
5787fa49 710
36fad8ec
N
711A suffix of 'M' or 'G' can be given to indicate Megabytes or
712Gigabytes respectively.
713
cd29a5c8 714.TP
7e23fc43 715.BR \-W ", " \-\-write\-mostly
e0fe762a 716subsequent devices listed in a
7e23fc43
PS
717.BR \-\-build ,
718.BR \-\-create ,
2ae555c3 719or
7e23fc43 720.B \-\-add
2ae555c3
NB
721command will be flagged as 'write-mostly'. This is valid for RAID1
722only and means that the 'md' driver will avoid reading from these
723devices if at all possible. This can be useful if mirroring over a
724slow link.
52826846 725
2ae555c3 726.TP
7e23fc43 727.BR \-\-write\-behind=
2ae555c3 728Specify that write-behind mode should be enabled (valid for RAID1
e0fe762a
N
729only). If an argument is specified, it will set the maximum number
730of outstanding writes allowed. The default value is 256.
2ae555c3
NB
731A write-intent bitmap is required in order to use write-behind
732mode, and write-behind is only attempted on drives marked as
733.IR write-mostly .
dd0781e5
NB
734
735.TP
7e23fc43 736.BR \-\-assume\-clean
dd0781e5
NB
737Tell
738.I mdadm
47d79ef8
NB
739that the array pre-existed and is known to be clean. It can be useful
740when trying to recover from a major failure as you can be sure that no
741data will be affected unless you actually write to the array. It can
742also be used when creating a RAID1 or RAID10 if you want to avoid the
b3f1c093 743initial resync, however this practice \(em while normally safe \(em is not
e0fe762a 744recommended. Use this only if you really know what you are doing.
6acad481
ME
745.IP
746When the devices that will be part of a new array were filled
747with zeros before creation the operator knows the array is
748actually clean. If that is the case, such as after running
749badblocks, this argument can be used to tell mdadm the
750facts the operator knows.
ce52f92f
N
751.IP
752When an array is resized to a larger size with
753.B "\-\-grow \-\-size="
754the new space is normally resynced in that same way that the whole
6cbf8fb8 755array is resynced at creation. From Linux version 3.0,
ce52f92f
N
756.B \-\-assume\-clean
757can be used with that command to avoid the automatic resync.
dd0781e5 758
2ae555c3 759.TP
7e23fc43 760.BR \-\-backup\-file=
53e8b987 761This is needed when
7e23fc43 762.B \-\-grow
cd19c0cf
JR
763is used to increase the number of raid-devices in a RAID5 or RAID6 if
764there are no spare devices available, or to shrink, change RAID level
765or layout. See the GROW MODE section below on RAID\-DEVICES CHANGES.
766The file must be stored on a separate device, not on the RAID array
767being reshaped.
2ae555c3 768
40c9a66a
N
769.TP
770.B \-\-data\-offset=
771Arrays with 1.x metadata can leave a gap between the start of the
772device and the start of array data. This gap can be used for various
773metadata. The start of data is known as the
774.IR data\-offset .
775Normally an appropriate data offset is computed automatically.
776However it can be useful to set it explicitly such as when re-creating
777an array which was originally created using a different version of
778.I mdadm
779which computed a different offset.
780
781Setting the offset explicitly over-rides the default. The value given
782is in Kilobytes unless an 'M' or 'G' suffix is given.
783
784Since Linux 3.4,
785.B \-\-data\-offset
786can also be used with
787.B --grow
788for some RAID levels (initially on RAID10). This allows the
72ca9bcf 789data\-offset to be changed as part of the reshape process. When the
40c9a66a
N
790data offset is changed, no backup file is required as the difference
791in offsets is used to provide the same functionality.
792
793When the new offset is earlier than the old offset, the number of
794devices in the array cannot shrink. When it is after the old offset,
795the number of devices in the array cannot increase.
796
72ca9bcf
N
797When creating an array,
798.B \-\-data\-offset
799can be specified as
800.BR variable .
801In the case each member device is expected to have a offset appended
802to the name, separated by a colon. This makes it possible to recreate
803exactly an array which has varying data offsets (as can happen when
804different versions of
805.I mdadm
806are used to add different devices).
807
f211a137
AK
808.TP
809.BR \-\-continue
810This option is complementary to the
811.B \-\-freeze-reshape
812option for assembly. It is needed when
813.B \-\-grow
814operation is interrupted and it is not restarted automatically due to
815.B \-\-freeze-reshape
816usage during array assembly. This option is used together with
817.BR \-G
818, (
819.BR \-\-grow
820) command and device for a pending reshape to be continued.
821All parameters required for reshape continuation will be read from array metadata.
822If initial
823.BR \-\-grow
824command had required
825.BR \-\-backup\-file=
826option to be set, continuation option will require to have exactly the same
827backup file given as well.
828.IP
829Any other parameter passed together with
830.BR \-\-continue
831option will be ignored.
832
947fd4dd 833.TP
7e23fc43 834.BR \-N ", " \-\-name=
947fd4dd
NB
835Set a
836.B name
837for the array. This is currently only effective when creating an
e0fe762a
N
838array with a version-1 superblock, or an array in a DDF container.
839The name is a simple textual string that can be used to identify array
840components when assembling. If name is needed but not specified, it
841is taken from the basename of the device that is being created.
842e.g. when creating
843.I /dev/md/home
844the
845.B name
846will default to
847.IR home .
947fd4dd 848
dd0781e5 849.TP
7e23fc43 850.BR \-R ", " \-\-run
dd0781e5
NB
851Insist that
852.I mdadm
853run the array, even if some of the components
854appear to be active in another array or filesystem. Normally
855.I mdadm
856will ask for confirmation before including such components in an
857array. This option causes that question to be suppressed.
858
859.TP
7e23fc43 860.BR \-f ", " \-\-force
dd0781e5
NB
861Insist that
862.I mdadm
863accept the geometry and layout specified without question. Normally
864.I mdadm
865will not allow creation of an array with only one device, and will try
e0fe762a 866to create a RAID5 array with one missing drive (as this makes the
dd0781e5 867initial resync work faster). With
7e23fc43 868.BR \-\-force ,
dd0781e5
NB
869.I mdadm
870will not try to be so clever.
871
0ea8f5b1
N
872.TP
873.BR \-o ", " \-\-readonly
874Start the array
875.B read only
876rather than read-write as normal. No writes will be allowed to the
877array, and no resync, recovery, or reshape will be started.
878
dd0781e5 879.TP
257c1dc2
N
880.BR \-a ", " "\-\-auto{=yes,md,mdp,part,p}{NN}"
881Instruct mdadm how to create the device file if needed, possibly allocating
48f7b27a 882an unused minor number. "md" causes a non-partitionable array
257c1dc2
N
883to be used (though since Linux 2.6.28, these array devices are in fact
884partitionable). "mdp", "part" or "p" causes a partitionable array (2.6 and
2ae555c3 885later) to be used. "yes" requires the named md device to have
f9c25f1d 886a 'standard' format, and the type and minor number will be determined
257c1dc2
N
887from this. With mdadm 3.0, device creation is normally left up to
888.I udev
889so this option is unlikely to be needed.
890See DEVICE NAMES below.
48f7b27a 891
a9d69660 892The argument can also come immediately after
7e23fc43 893"\-a". e.g. "\-ap".
dd0781e5 894
53e8b987 895If
7e23fc43 896.B \-\-auto
53e8b987 897is not given on the command line or in the config file, then
75723446 898the default will be
7e23fc43 899.BR \-\-auto=yes .
75723446 900
1337546d 901If
7e23fc43 902.B \-\-scan
1337546d
NB
903is also given, then any
904.I auto=
35cc5be4 905entries in the config file will override the
7e23fc43 906.B \-\-auto
1337546d
NB
907instruction given on the command line.
908
dd0781e5
NB
909For partitionable arrays,
910.I mdadm
911will create the device file for the whole array and for the first 4
912partitions. A different number of partitions can be specified at the
913end of this option (e.g.
7e23fc43 914.BR \-\-auto=p7 ).
2ae555c3 915If the device name ends with a digit, the partition names add a 'p',
e0fe762a
N
916and a number, e.g.
917.IR /dev/md/home1p3 .
918If there is no trailing digit, then the partition names just have a
919number added, e.g.
920.IR /dev/md/scratch3 .
dd0781e5 921
48f7b27a
NB
922If the md device name is in a 'standard' format as described in DEVICE
923NAMES, then it will be created, if necessary, with the appropriate
e0fe762a
N
924device number based on that name. If the device name is not in one of these
925formats, then a unused device number will be allocated. The device
48f7b27a
NB
926number will be considered unused if there is no active array for that
927number, and there is no entry in /dev for that number and with a
e0fe762a 928non-standard name. Names that are not in 'standard' format are only
8fd8d9c4
N
929allowed in "/dev/md/".
930
3c7efacb
NK
931This is meaningful with
932.B \-\-create
933or
934.BR \-\-build .
935
3c7efacb
NK
936.TP
937.BR \-a ", " "\-\-add"
938This option can be used in Grow mode in two cases.
939
940If the target array is a Linear array, then
941.B \-\-add
942can be used to add one or more devices to the array. They
943are simply catenated on to the end of the array. Once added, the
944devices cannot be removed.
945
946If the
947.B \-\-raid\-disks
948option is being used to increase the number of devices in an array,
949then
950.B \-\-add
951can be used to add some extra devices to be included in the array.
952In most cases this is not needed as the extra devices can be added as
953spares first, and then the number of raid-disks can be changed.
954However for RAID0, it is not possible to add spares. So to increase
955the number of devices in a RAID0, it is necessary to set the new
956number of devices, and to add the new devices, in the same command.
957
52826846
NB
958.SH For assemble:
959
cd29a5c8 960.TP
7e23fc43 961.BR \-u ", " \-\-uuid=
e0fe762a 962uuid of array to assemble. Devices which don't have this uuid are
cd29a5c8
NB
963excluded
964
965.TP
7e23fc43 966.BR \-m ", " \-\-super\-minor=
cd29a5c8
NB
967Minor number of device that array was created for. Devices which
968don't have this minor number are excluded. If you create an array as
2d465520 969/dev/md1, then all superblocks will contain the minor number 1, even if
cd29a5c8
NB
970the array is later assembled as /dev/md2.
971
d013a55e 972Giving the literal word "dev" for
7e23fc43 973.B \-\-super\-minor
d013a55e
NB
974will cause
975.I mdadm
976to use the minor number of the md device that is being assembled.
977e.g. when assembling
978.BR /dev/md0 ,
51ac42e3 979.B \-\-super\-minor=dev
d013a55e
NB
980will look for super blocks with a minor number of 0.
981
e0fe762a
N
982.B \-\-super\-minor
983is only relevant for v0.90 metadata, and should not normally be used.
984Using
985.B \-\-uuid
986is much safer.
987
947fd4dd 988.TP
7e23fc43 989.BR \-N ", " \-\-name=
947fd4dd 990Specify the name of the array to assemble. This must be the name
624920bb 991that was specified when creating the array. It must either match
93e790af 992the name stored in the superblock exactly, or it must match
41a3b72a 993with the current
624920bb 994.I homehost
93e790af 995prefixed to the start of the given name.
947fd4dd 996
cd29a5c8 997.TP
7e23fc43 998.BR \-f ", " \-\-force
e0fe762a
N
999Assemble the array even if the metadata on some devices appears to be
1000out-of-date. If
1001.I mdadm
1002cannot find enough working devices to start the array, but can find
1003some devices that are recorded as having failed, then it will mark
1004those devices as working so that the array can be started.
1005An array which requires
1006.B \-\-force
1007to be started may contain data corruption. Use it carefully.
52826846 1008
cd29a5c8 1009.TP
7e23fc43 1010.BR \-R ", " \-\-run
b8a8ccf9
NB
1011Attempt to start the array even if fewer drives were given than were
1012present last time the array was active. Normally if not all the
1013expected drives are found and
7e23fc43 1014.B \-\-scan
cd29a5c8
NB
1015is not used, then the array will be assembled but not started.
1016With
7e23fc43 1017.B \-\-run
cd29a5c8 1018an attempt will be made to start it anyway.
52826846 1019
b8a8ccf9 1020.TP
7e23fc43 1021.B \-\-no\-degraded
b8a8ccf9 1022This is the reverse of
7e23fc43 1023.B \-\-run
93e790af 1024in that it inhibits the startup of array unless all expected drives
b8a8ccf9 1025are present. This is only needed with
93e790af
SW
1026.B \-\-scan,
1027and can be used if the physical connections to devices are
b8a8ccf9
NB
1028not as reliable as you would like.
1029
dd0781e5 1030.TP
7e23fc43 1031.BR \-a ", " "\-\-auto{=no,yes,md,mdp,part}"
dd0781e5
NB
1032See this option under Create and Build options.
1033
e793c2e5 1034.TP
7e23fc43 1035.BR \-b ", " \-\-bitmap=
2ae555c3
NB
1036Specify the bitmap file that was given when the array was created. If
1037an array has an
1038.B internal
1039bitmap, there is no need to specify this when assembling the array.
1040
1041.TP
7e23fc43 1042.BR \-\-backup\-file=
2ae555c3 1043If
7e23fc43 1044.B \-\-backup\-file
87f26d14
N
1045was used while reshaping an array (e.g. changing number of devices or
1046chunk size) and the system crashed during the critical section, then the same
7e23fc43 1047.B \-\-backup\-file
53e8b987 1048must be presented to
7e23fc43 1049.B \-\-assemble
cd19c0cf
JR
1050to allow possibly corrupted data to be restored, and the reshape
1051to be completed.
e793c2e5 1052
87f26d14
N
1053.TP
1054.BR \-\-invalid\-backup
1055If the file needed for the above option is not available for any
1056reason an empty file can be given together with this option to
1057indicate that the backup file is invalid. In this case the data that
1058was being rearranged at the time of the crash could be irrecoverably
1059lost, but the rest of the array may still be recoverable. This option
1060should only be used as a last resort if there is no way to recover the
1061backup file.
1062
1063
5787fa49 1064.TP
7e23fc43 1065.BR \-U ", " \-\-update=
5787fa49 1066Update the superblock on each device while assembling the array. The
feb716e9
NB
1067argument given to this flag can be one of
1068.BR sparc2.2 ,
1069.BR summaries ,
7d99579f 1070.BR uuid ,
c4f12c13 1071.BR name ,
0237e0ca 1072.BR homehost ,
e5329c37 1073.BR resync ,
586ed405 1074.BR byteorder ,
bee8ec56 1075.BR devicesize ,
5a31170d 1076.BR no\-bitmap ,
688e99a7
N
1077.BR bbl ,
1078.BR no-\bbl ,
5787fa49 1079or
7e23fc43 1080.BR super\-minor .
5787fa49
NB
1081
1082The
1083.B sparc2.2
7d99579f 1084option will adjust the superblock of an array what was created on a Sparc
5787fa49
NB
1085machine running a patched 2.2 Linux kernel. This kernel got the
1086alignment of part of the superblock wrong. You can use the
7e23fc43 1087.B "\-\-examine \-\-sparc2.2"
5787fa49
NB
1088option to
1089.I mdadm
1090to see what effect this would have.
1091
1092The
7e23fc43 1093.B super\-minor
5787fa49 1094option will update the
2ae555c3 1095.B "preferred minor"
5787fa49 1096field on each superblock to match the minor number of the array being
45c073c9
NB
1097assembled.
1098This can be useful if
7e23fc43 1099.B \-\-examine
45c073c9 1100reports a different "Preferred Minor" to
7e23fc43 1101.BR \-\-detail .
45c073c9 1102In some cases this update will be performed automatically
e0fe762a 1103by the kernel driver. In particular the update happens automatically
45c073c9
NB
1104at the first write to an array with redundancy (RAID level 1 or
1105greater) on a 2.6 (or later) kernel.
5787fa49 1106
7d99579f
NB
1107The
1108.B uuid
1109option will change the uuid of the array. If a UUID is given with the
7e23fc43 1110.B \-\-uuid
53e8b987 1111option that UUID will be used as a new UUID and will
7d99579f
NB
1112.B NOT
1113be used to help identify the devices in the array.
53e8b987 1114If no
7e23fc43 1115.B \-\-uuid
53e8b987 1116is given, a random UUID is chosen.
7d99579f 1117
c4f12c13
NB
1118The
1119.B name
1120option will change the
1121.I name
1122of the array as stored in the superblock. This is only supported for
1123version-1 superblocks.
1124
0237e0ca
NB
1125The
1126.B homehost
1127option will change the
1128.I homehost
1129as recorded in the superblock. For version-0 superblocks, this is the
1130same as updating the UUID.
1131For version-1 superblocks, this involves updating the name.
1132
e5329c37
NB
1133The
1134.B resync
1135option will cause the array to be marked
1136.I dirty
e0fe762a
N
1137meaning that any redundancy in the array (e.g. parity for RAID5,
1138copies for RAID1) may be incorrect. This will cause the RAID system
e5329c37
NB
1139to perform a "resync" pass to make sure that all redundant information
1140is correct.
1141
586ed405
NB
1142The
1143.B byteorder
1144option allows arrays to be moved between machines with different
1145byte-order.
2ae555c3 1146When assembling such an array for the first time after a move, giving
7e23fc43 1147.B "\-\-update=byteorder"
586ed405
NB
1148will cause
1149.I mdadm
1150to expect superblocks to have their byteorder reversed, and will
1151correct that order before assembling the array. This is only valid
2ae555c3 1152with original (Version 0.90) superblocks.
586ed405 1153
feb716e9
NB
1154The
1155.B summaries
e0fe762a 1156option will correct the summaries in the superblock. That is the
feb716e9 1157counts of total, working, active, failed, and spare devices.
5787fa49 1158
bee8ec56
NB
1159The
1160.B devicesize
5a31170d 1161option will rarely be of use. It applies to version 1.1 and 1.2 metadata
bee8ec56
NB
1162only (where the metadata is at the start of the device) and is only
1163useful when the component device has changed size (typically become
1164larger). The version 1 metadata records the amount of the device that
1165can be used to store data, so if a device in a version 1.1 or 1.2
1166array becomes larger, the metadata will still be visible, but the
1167extra space will not. In this case it might be useful to assemble the
1168array with
7e23fc43 1169.BR \-\-update=devicesize .
bee8ec56
NB
1170This will cause
1171.I mdadm
1172to determine the maximum usable amount of space on each device and
1173update the relevant field in the metadata.
1174
5a31170d
N
1175The
1176.B no\-bitmap
1177option can be used when an array has an internal bitmap which is
1178corrupt in some way so that assembling the array normally fails. It
1179will cause any internal bitmap to be ignored.
1180
688e99a7
N
1181The
1182.B bbl
1183option will reserve space in each device for a bad block list. This
1184will be 4K in size and positioned near the end of any free space
1185between the superblock and the data.
1186
1187The
1188.B no\-bbl
1189option will cause any reservation of space for a bad block list to be
1190removed. If the bad block list contains entries, this will fail, as
1191removing the list could cause data corruption.
1192
afd0a969
AK
1193.TP
1194.BR \-\-freeze\-reshape
1195Option is intended to be used in start-up scripts during initrd boot phase.
1196When array under reshape is assembled during initrd phase, this option
1197stops reshape after reshape critical section is being restored. This happens
1198before file system pivot operation and avoids loss of file system context.
1199Losing file system context would cause reshape to be broken.
1200
a6482415
N
1201Reshape can be continued later using the
1202.B \-\-continue
1203option for the grow command.
afd0a969 1204
e0d19036 1205.SH For Manage mode:
52826846 1206
3d5279b0
N
1207.TP
1208.BR \-t ", " \-\-test
1209Unless a more serious error occurred,
1210.I mdadm
1211will exit with a status of 2 if no changes were made to the array and
12120 if at least one change was made.
1213This can be useful when an indirect specifier such as
1214.BR missing ,
1215.B detached
1216or
1217.B faulty
1218is used in requesting an operation on the array.
1219.B \-\-test
1220will report failure if these specifiers didn't find any match.
1221
cd29a5c8 1222.TP
7e23fc43 1223.BR \-a ", " \-\-add
3d5279b0
N
1224hot-add listed devices.
1225If a device appears to have recently been part of the array
342460cb 1226(possibly it failed or was removed) the device is re\-added as described
3d5279b0
N
1227in the next point.
1228If that fails or the device was never part of the array, the device is
1229added as a hot-spare.
1230If the array is degraded, it will immediately start to rebuild data
1231onto that spare.
1232
1233Note that this and the following options are only meaningful on array
1234with redundancy. They don't apply to RAID0 or Linear.
52826846 1235
fe80f49b 1236.TP
7e23fc43 1237.BR \-\-re\-add
3d5279b0
N
1238re\-add a device that was previous removed from an array.
1239If the metadata on the device reports that it is a member of the
1240array, and the slot that it used is still vacant, then the device will
1241be added back to the array in the same position. This will normally
1242cause the data for that device to be recovered. However based on the
1243event count on the device, the recovery may only require sections that
1244are flagged a write-intent bitmap to be recovered or may not require
1245any recovery at all.
1246
1247When used on an array that has no metadata (i.e. it was built with
1248.BR \-\-build)
1249it will be assumed that bitmap-based recovery is enough to make the
1250device fully consistent with the array.
fe80f49b 1251
688e99a7 1252When used with v1.x metadata,
833bb0f8
N
1253.B \-\-re\-add
1254can be accompanied by
688e99a7
N
1255.BR \-\-update=devicesize ,
1256.BR \-\-update=bbl ", or"
1257.BR \-\-update=no\-bbl .
1258See the description of these option when used in Assemble mode for an
1259explanation of their use.
833bb0f8 1260
a4e13010
N
1261If the device name given is
1262.B missing
262e3b7f
N
1263then
1264.I mdadm
1265will try to find any device that looks like it should be
a4e13010
N
1266part of the array but isn't and will try to re\-add all such devices.
1267
262e3b7f
N
1268If the device name given is
1269.B faulty
1270then
1271.I mdadm
1272will find all devices in the array that are marked
1273.BR faulty ,
1274remove them and attempt to immediately re\-add them. This can be
1275useful if you are certain that the reason for failure has been
1276resolved.
1277
cd29a5c8 1278.TP
7e23fc43 1279.BR \-r ", " \-\-remove
2d465520 1280remove listed devices. They must not be active. i.e. they should
b80da661
NB
1281be failed or spare devices. As well as the name of a device file
1282(e.g.
1283.BR /dev/sda1 )
1284the words
1285.B failed
1286and
1287.B detached
1288can be given to
1289.BR \-\-remove .
1290The first causes all failed device to be removed. The second causes
93e790af 1291any device which is no longer connected to the system (i.e an 'open'
b80da661
NB
1292returns
1293.BR ENXIO )
1294to be removed. This will only succeed for devices that are spares or
1295have already been marked as failed.
52826846 1296
cd29a5c8 1297.TP
7e23fc43 1298.BR \-f ", " \-\-fail
70c55e36 1299Mark listed devices as faulty.
b80da661
NB
1300As well as the name of a device file, the word
1301.B detached
1302can be given. This will cause any device that has been detached from
1303the system to be marked as failed. It can then be removed.
52826846 1304
cd29a5c8 1305.TP
7e23fc43 1306.BR \-\-set\-faulty
53e8b987 1307same as
7e23fc43 1308.BR \-\-fail .
52826846 1309
70c55e36
N
1310.TP
1311.B \-\-replace
1312Mark listed devices as requiring replacement. As soon as a spare is
1313available, it will be rebuilt and will replace the marked device.
1314This is similar to marking a device as faulty, but the device remains
1315in service during the recovery process to increase resilience against
1316multiple failures. When the replacement process finishes, the
1317replaced device will be marked as faulty.
1318
1319.TP
1320.B \-\-with
1321This can follow a list of
1322.B \-\-replace
1323devices. The devices listed after
1324.B \-\-with
1325will be preferentially used to replace the devices listed after
1326.BR \-\-replace .
1327These device must already be spare devices in the array.
1328
b3d31955
N
1329.TP
1330.BR \-\-write\-mostly
a4e13010 1331Subsequent devices that are added or re\-added will have the 'write-mostly'
e0fe762a 1332flag set. This is only valid for RAID1 and means that the 'md' driver
b3d31955
N
1333will avoid reading from these devices if possible.
1334.TP
1335.BR \-\-readwrite
a4e13010 1336Subsequent devices that are added or re\-added will have the 'write-mostly'
b3d31955
N
1337flag cleared.
1338
2ae555c3 1339.P
e0fe762a 1340Each of these options requires that the first device listed is the array
93e790af 1341to be acted upon, and the remainder are component devices to be added,
e0fe762a 1342removed, marked as faulty, etc. Several different operations can be
2ae555c3
NB
1343specified for different devices, e.g.
1344.in +5
7e23fc43 1345mdadm /dev/md0 \-\-add /dev/sda1 \-\-fail /dev/sdb1 \-\-remove /dev/sdb1
2ae555c3
NB
1346.in -5
1347Each operation applies to all devices listed until the next
93e790af 1348operation.
2ae555c3
NB
1349
1350If an array is using a write-intent bitmap, then devices which have
a4e13010 1351been removed can be re\-added in a way that avoids a full
93e790af 1352reconstruction but instead just updates the blocks that have changed
2ae555c3
NB
1353since the device was removed. For arrays with persistent metadata
1354(superblocks) this is done automatically. For arrays created with
7e23fc43 1355.B \-\-build
2ae555c3 1356mdadm needs to be told that this device we removed recently with
7e23fc43 1357.BR \-\-re\-add .
2ae555c3
NB
1358
1359Devices can only be removed from an array if they are not in active
93e790af
SW
1360use, i.e. that must be spares or failed devices. To remove an active
1361device, it must first be marked as
1362.B faulty.
2ae555c3
NB
1363
1364.SH For Misc mode:
1365
1366.TP
7e23fc43 1367.BR \-Q ", " \-\-query
2ae555c3
NB
1368Examine a device to see
1369(1) if it is an md device and (2) if it is a component of an md
1370array.
1371Information about what is discovered is presented.
1372
1373.TP
7e23fc43 1374.BR \-D ", " \-\-detail
e0fe762a 1375Print details of one or more md devices.
5787fa49 1376
4cce4069
DW
1377.TP
1378.BR \-\-detail\-platform
e0fe762a 1379Print details of the platform's RAID capabilities (firmware / hardware
9eafa1de
MN
1380topology) for a given metadata format. If used without argument, mdadm
1381will scan all controllers looking for their capabilities. Otherwise, mdadm
1382will only look at the controller specified by the argument in form of an
1383absolute filepath or a link, e.g.
1384.IR /sys/devices/pci0000:00/0000:00:1f.2 .
4cce4069 1385
54bad364
KS
1386.TP
1387.BR \-Y ", " \-\-export
1388When used with
e50cf220 1389.B \-\-detail , \-\-detail-platform
0d726f17
KS
1390or
1391.BR \-\-examine ,
54bad364
KS
1392output will be formatted as
1393.B key=value
1394pairs for easy import into the environment.
1395
2ae555c3 1396.TP
7e23fc43 1397.BR \-E ", " \-\-examine
e0fe762a
N
1398Print contents of the metadata stored on the named device(s).
1399Note the contrast between
1400.B \-\-examine
1401and
1402.BR \-\-detail .
1403.B \-\-examine
1404applies to devices which are components of an array, while
1405.B \-\-detail
1406applies to a whole array which is currently active.
5787fa49 1407.TP
7e23fc43 1408.B \-\-sparc2.2
e0fe762a
N
1409If an array was created on a SPARC machine with a 2.2 Linux kernel
1410patched with RAID support, the superblock will have been created
1411incorrectly, or at least incompatibly with 2.4 and later kernels.
1412Using the
7e23fc43 1413.B \-\-sparc2.2
5787fa49 1414flag with
7e23fc43 1415.B \-\-examine
5787fa49
NB
1416will fix the superblock before displaying it. If this appears to do
1417the right thing, then the array can be successfully assembled using
7e23fc43 1418.BR "\-\-assemble \-\-update=sparc2.2" .
5787fa49 1419
2ae555c3 1420.TP
7e23fc43 1421.BR \-X ", " \-\-examine\-bitmap
2ae555c3 1422Report information about a bitmap file.
01d9299c 1423The argument is either an external bitmap file or an array component
e0fe762a
N
1424in case of an internal bitmap. Note that running this on an array
1425device (e.g.
1426.BR /dev/md0 )
1427does not report the bitmap for that array.
e0d19036 1428
cd29a5c8 1429.TP
7e23fc43 1430.BR \-R ", " \-\-run
e0fe762a
N
1431start a partially assembled array. If
1432.B \-\-assemble
1433did not find enough devices to fully start the array, it might leaving
1434it partially assembled. If you wish, you can then use
1435.B \-\-run
1436to start the array in degraded mode.
52826846 1437
cd29a5c8 1438.TP
7e23fc43 1439.BR \-S ", " \-\-stop
cd29a5c8 1440deactivate array, releasing all resources.
52826846 1441
cd29a5c8 1442.TP
7e23fc43 1443.BR \-o ", " \-\-readonly
cd29a5c8 1444mark array as readonly.
52826846 1445
cd29a5c8 1446.TP
7e23fc43 1447.BR \-w ", " \-\-readwrite
cd29a5c8 1448mark array as readwrite.
52826846 1449
e0d19036 1450.TP
7e23fc43 1451.B \-\-zero\-superblock
e0d19036 1452If the device contains a valid md superblock, the block is
35cc5be4 1453overwritten with zeros. With
7e23fc43 1454.B \-\-force
35cc5be4 1455the block where the superblock would be is overwritten even if it
e0d19036 1456doesn't appear to be valid.
52826846 1457
33414a01
DW
1458.TP
1459.B \-\-kill\-subarray=
1460If the device is a container and the argument to \-\-kill\-subarray
1461specifies an inactive subarray in the container, then the subarray is
1462deleted. Deleting all subarrays will leave an 'empty-container' or
1463spare superblock on the drives. See \-\-zero\-superblock for completely
1464removing a superblock. Note that some formats depend on the subarray
1465index for generating a UUID, this command will fail if it would change
1466the UUID of an active subarray.
1467
aa534678
DW
1468.TP
1469.B \-\-update\-subarray=
1470If the device is a container and the argument to \-\-update\-subarray
1471specifies a subarray in the container, then attempt to update the given
1472superblock field in the subarray. See below in
1473.B MISC MODE
1474for details.
1475
feb716e9 1476.TP
7e23fc43 1477.BR \-t ", " \-\-test
feb716e9 1478When used with
7e23fc43 1479.BR \-\-detail ,
feb716e9
NB
1480the exit status of
1481.I mdadm
e0fe762a
N
1482is set to reflect the status of the device. See below in
1483.B MISC MODE
1484for details.
feb716e9 1485
b90c0e9a 1486.TP
7e23fc43 1487.BR \-W ", " \-\-wait
b90c0e9a
NB
1488For each md device given, wait for any resync, recovery, or reshape
1489activity to finish before returning.
1490.I mdadm
1491will return with success if it actually waited for every device
1492listed, otherwise it will return failure.
1493
1770662b
DW
1494.TP
1495.BR \-\-wait\-clean
fabbfd48
DW
1496For each md device given, or each device in /proc/mdstat if
1497.B \-\-scan
1498is given, arrange for the array to be marked clean as soon as possible.
7146ec6a
DW
1499.I mdadm
1500will return with success if the array uses external metadata and we
1501successfully waited. For native arrays this returns immediately as the
6a0ee6a0
DW
1502kernel handles dirty-clean transitions at shutdown. No action is taken
1503if safe-mode handling is disabled.
1770662b 1504
8382f19b
NB
1505.SH For Incremental Assembly mode:
1506.TP
7e23fc43 1507.BR \-\-rebuild\-map ", " \-r
8382f19b 1508Rebuild the map file
96fd06ed 1509.RB ( {MAP_PATH} )
8382f19b
NB
1510that
1511.I mdadm
1512uses to help track which arrays are currently being assembled.
1513
1514.TP
7e23fc43 1515.BR \-\-run ", " \-R
8382f19b
NB
1516Run any array assembled as soon as a minimal number of devices are
1517available, rather than waiting until all expected devices are present.
1518
1519.TP
7e23fc43 1520.BR \-\-scan ", " \-s
8382f19b 1521Only meaningful with
7e23fc43 1522.B \-R
8382f19b
NB
1523this will scan the
1524.B map
1525file for arrays that are being incrementally assembled and will try to
1526start any that are not already started. If any such array is listed
1527in
1528.B mdadm.conf
1529as requiring an external bitmap, that bitmap will be attached first.
1530
29ba4804
N
1531.TP
1532.BR \-\-fail ", " \-f
1533This allows the hot-plug system to remove devices that have fully disappeared
1534from the kernel. It will first fail and then remove the device from any
1535array it belongs to.
1536The device name given should be a kernel device name such as "sda",
1537not a name in
1538.IR /dev .
1539
210597d1
PC
1540.TP
1541.BR \-\-path=
87eb4fab
N
1542Only used with \-\-fail. The 'path' given will be recorded so that if
1543a new device appears at the same location it can be automatically
1544added to the same array. This allows the failed device to be
1545automatically replaced by a new device without metadata if it appears
1546at specified path. This option is normally only set by a
1547.I udev
1548script.
210597d1 1549
e0d19036
NB
1550.SH For Monitor mode:
1551.TP
7e23fc43 1552.BR \-m ", " \-\-mail
e0d19036
NB
1553Give a mail address to send alerts to.
1554
1555.TP
7e23fc43 1556.BR \-p ", " \-\-program ", " \-\-alert
e0d19036
NB
1557Give a program to be run whenever an event is detected.
1558
773135f5 1559.TP
7e23fc43 1560.BR \-y ", " \-\-syslog
773135f5
NB
1561Cause all events to be reported through 'syslog'. The messages have
1562facility of 'daemon' and varying priorities.
1563
e0d19036 1564.TP
7e23fc43 1565.BR \-d ", " \-\-delay
e0d19036 1566Give a delay in seconds.
51ac42e3 1567.I mdadm
e0d19036 1568polls the md arrays and then waits this many seconds before polling
e0fe762a
N
1569again. The default is 60 seconds. Since 2.6.16, there is no need to
1570reduce this as the kernel alerts
1571.I mdadm
1572immediately when there is any change.
e0d19036 1573
9a36a9b7
ZB
1574.TP
1575.BR \-r ", " \-\-increment
1576Give a percentage increment.
1577.I mdadm
1578will generate RebuildNN events with the given percentage increment.
1579
d013a55e 1580.TP
7e23fc43 1581.BR \-f ", " \-\-daemonise
d013a55e 1582Tell
51ac42e3 1583.I mdadm
d013a55e 1584to run as a background daemon if it decides to monitor anything. This
e0fe762a 1585causes it to fork and run in the child, and to disconnect from the
d013a55e
NB
1586terminal. The process id of the child is written to stdout.
1587This is useful with
7e23fc43 1588.B \-\-scan
d013a55e
NB
1589which will only continue monitoring if a mail address or alert program
1590is found in the config file.
1591
b5e64645 1592.TP
7e23fc43 1593.BR \-i ", " \-\-pid\-file
b5e64645 1594When
51ac42e3 1595.I mdadm
b5e64645
NB
1596is running in daemon mode, write the pid of the daemon process to
1597the specified file, instead of printing it on standard output.
1598
aa88f531 1599.TP
7e23fc43 1600.BR \-1 ", " \-\-oneshot
aa88f531
NB
1601Check arrays only once. This will generate
1602.B NewArray
1603events and more significantly
1604.B DegradedArray
a9d69660
NB
1605and
1606.B SparesMissing
aa88f531
NB
1607events. Running
1608.in +5
7e23fc43 1609.B " mdadm \-\-monitor \-\-scan \-1"
aa88f531
NB
1610.in -5
1611from a cron script will ensure regular notification of any degraded arrays.
1612
98c6faba 1613.TP
7e23fc43 1614.BR \-t ", " \-\-test
98c6faba
NB
1615Generate a
1616.B TestMessage
1617alert for every array found at startup. This alert gets mailed and
1618passed to the alert program. This can be used for testing that alert
a9d69660 1619message do get through successfully.
98c6faba 1620
210597d1
PC
1621.TP
1622.BR \-\-no\-sharing
87eb4fab 1623This inhibits the functionality for moving spares between arrays.
210597d1
PC
1624Only one monitoring process started with
1625.B \-\-scan
87eb4fab
N
1626but without this flag is allowed, otherwise the two could interfere
1627with each other.
210597d1 1628
e0d19036 1629.SH ASSEMBLE MODE
52826846 1630
cd29a5c8
NB
1631.HP 12
1632Usage:
7e23fc43 1633.B mdadm \-\-assemble
5787fa49
NB
1634.I md-device options-and-component-devices...
1635.HP 12
1636Usage:
7e23fc43 1637.B mdadm \-\-assemble \-\-scan
e0fe762a 1638.I md-devices-and-options...
cd29a5c8
NB
1639.HP 12
1640Usage:
7e23fc43 1641.B mdadm \-\-assemble \-\-scan
e0fe762a 1642.I options...
52826846 1643
cd29a5c8 1644.PP
e0fe762a 1645This usage assembles one or more RAID arrays from pre-existing components.
9a9dab36 1646For each array, mdadm needs to know the md device, the identity of the
e0fe762a 1647array, and a number of component-devices. These can be found in a number of ways.
52826846 1648
5787fa49 1649In the first usage example (without the
7e23fc43 1650.BR \-\-scan )
5787fa49
NB
1651the first device given is the md device.
1652In the second usage example, all devices listed are treated as md
1653devices and assembly is attempted.
1654In the third (where no devices are listed) all md devices that are
cb77f620 1655listed in the configuration file are assembled. If no arrays are
e0fe762a
N
1656described by the configuration file, then any arrays that
1657can be found on unused devices will be assembled.
52826846 1658
d013a55e 1659If precisely one device is listed, but
7e23fc43 1660.B \-\-scan
dd0781e5 1661is not given, then
d013a55e
NB
1662.I mdadm
1663acts as though
7e23fc43 1664.B \-\-scan
93e790af 1665was given and identity information is extracted from the configuration file.
d013a55e 1666
2ae555c3 1667The identity can be given with the
7e23fc43 1668.B \-\-uuid
e0fe762a
N
1669option, the
1670.B \-\-name
1671option, or the
7e23fc43 1672.B \-\-super\-minor
93e790af
SW
1673option, will be taken from the md-device record in the config file, or
1674will be taken from the super block of the first component-device
1675listed on the command line.
52826846 1676
2ae555c3 1677Devices can be given on the
7e23fc43 1678.B \-\-assemble
e0fe762a 1679command line or in the config file. Only devices which have an md
5787fa49
NB
1680superblock which contains the right identity will be considered for
1681any array.
52826846 1682
2ae555c3 1683The config file is only used if explicitly named with
7e23fc43 1684.B \-\-config
d013a55e 1685or requested with (a possibly implicit)
7e23fc43 1686.BR \-\-scan .
52826846 1687In the later case,
9a9dab36 1688.B /etc/mdadm.conf
8fd8d9c4
N
1689or
1690.B /etc/mdadm/mdadm.conf
52826846
NB
1691is used.
1692
2ae555c3 1693If
7e23fc43 1694.B \-\-scan
cd29a5c8
NB
1695is not given, then the config file will only be used to find the
1696identity of md arrays.
52826846 1697
2d465520 1698Normally the array will be started after it is assembled. However if
7e23fc43 1699.B \-\-scan
e0fe762a
N
1700is not given and not all expected drives were listed, then the array
1701is not started (to guard against usage errors). To insist that the
1702array be started in this case (as may work for RAID1, 4, 5, 6, or 10),
1703give the
7e23fc43 1704.B \-\-run
cd29a5c8 1705flag.
52826846 1706
e0fe762a
N
1707If
1708.I udev
1709is active,
1710.I mdadm
1711does not create any entries in
dd0781e5 1712.B /dev
e0fe762a
N
1713but leaves that to
1714.IR udev .
1715It does record information in
96fd06ed 1716.B {MAP_PATH}
e0fe762a
N
1717which will allow
1718.I udev
1719to choose the correct name.
dd0781e5 1720
e0fe762a
N
1721If
1722.I mdadm
1723detects that udev is not configured, it will create the devices in
1724.B /dev
1725itself.
dd0781e5 1726
e0fe762a
N
1727In Linux kernels prior to version 2.6.28 there were two distinctly
1728different types of md devices that could be created: one that could be
1729partitioned using standard partitioning tools and one that could not.
1730Since 2.6.28 that distinction is no longer relevant as both type of
1731devices can be partitioned.
1732.I mdadm
1733will normally create the type that originally could not be partitioned
1734as it has a well defined major number (9).
dd0781e5 1735
e0fe762a
N
1736Prior to 2.6.28, it is important that mdadm chooses the correct type
1737of array device to use. This can be controlled with the
1738.B \-\-auto
1739option. In particular, a value of "mdp" or "part" or "p" tells mdadm
1740to use a partitionable device rather than the default.
dd0781e5 1741
e0fe762a
N
1742In the no-udev case, the value given to
1743.B \-\-auto
1744can be suffixed by a number. This tells
1745.I mdadm
1746to create that number of partition devices rather than the default of 4.
dd0781e5 1747
e0fe762a 1748The value given to
7e23fc43 1749.B \-\-auto
e0fe762a
N
1750can also be given in the configuration file as a word starting
1751.B auto=
1752on the ARRAY line for the relevant array.
52826846 1753
41a3b72a
NB
1754.SS Auto Assembly
1755When
7e23fc43 1756.B \-\-assemble
41a3b72a 1757is used with
7e23fc43 1758.B \-\-scan
41a3b72a
NB
1759and no devices are listed,
1760.I mdadm
1761will first attempt to assemble all the arrays listed in the config
1762file.
1763
cb77f620 1764If no arrays are listed in the config (other than those marked
e0fe762a
N
1765.BR <ignore> )
1766it will look through the available devices for possible arrays and
1767will try to assemble anything that it finds. Arrays which are tagged
1768as belonging to the given homehost will be assembled and started
1769normally. Arrays which do not obviously belong to this host are given
1770names that are expected not to conflict with anything local, and are
1771started "read-auto" so that nothing is written to any device until the
1772array is written to. i.e. automatic resync etc is delayed.
41a3b72a
NB
1773
1774If
1775.I mdadm
1776finds a consistent set of devices that look like they should comprise
1777an array, and if the superblock is tagged as belonging to the given
1778home host, it will automatically choose a device name and try to
1779assemble the array. If the array uses version-0.90 metadata, then the
1780.B minor
1781number as recorded in the superblock is used to create a name in
1782.B /dev/md/
1783so for example
1784.BR /dev/md/3 .
1785If the array uses version-1 metadata, then the
1786.B name
1787from the superblock is used to similarly create a name in
e0fe762a 1788.B /dev/md/
93e790af 1789(the name will have any 'host' prefix stripped first).
41a3b72a 1790
c64ba03a
N
1791This behaviour can be modified by the
1792.I AUTO
1793line in the
1794.I mdadm.conf
1795configuration file. This line can indicate that specific metadata
1796type should, or should not, be automatically assembled. If an array
1797is found which is not listed in
1798.I mdadm.conf
1799and has a metadata format that is denied by the
1800.I AUTO
1801line, then it will not be assembled.
1802The
1803.I AUTO
1804line can also request that all arrays identified as being for this
1805homehost should be assembled regardless of their metadata type.
1806See
1807.IR mdadm.conf (5)
1808for further details.
1809
246cebdb
AK
1810Note: Auto assembly cannot be used for assembling and activating some
1811arrays which are undergoing reshape. In particular as the
1812.B backup\-file
1813cannot be given, any reshape which requires a backup-file to continue
1814cannot be started by auto assembly. An array which is growing to more
1815devices and has passed the critical section can be assembled using
1816auto-assembly.
41a3b72a 1817
cd29a5c8 1818.SH BUILD MODE
52826846 1819
cd29a5c8
NB
1820.HP 12
1821Usage:
7e23fc43 1822.B mdadm \-\-build
93e790af 1823.I md-device
7e23fc43
PS
1824.BI \-\-chunk= X
1825.BI \-\-level= Y
1826.BI \-\-raid\-devices= Z
cd29a5c8
NB
1827.I devices
1828
1829.PP
2ae555c3 1830This usage is similar to
7e23fc43 1831.BR \-\-create .
e0fe762a 1832The difference is that it creates an array without a superblock. With
cd29a5c8 1833these arrays there is no difference between initially creating the array and
52826846
NB
1834subsequently assembling the array, except that hopefully there is useful
1835data there in the second case.
1836
e0fe762a
N
1837The level may raid0, linear, raid1, raid10, multipath, or faulty, or
1838one of their synonyms. All devices must be listed and the array will
1839be started once complete. It will often be appropriate to use
1840.B \-\-assume\-clean
1841with levels raid1 or raid10.
cd29a5c8
NB
1842
1843.SH CREATE MODE
1844
1845.HP 12
1846Usage:
7e23fc43 1847.B mdadm \-\-create
93e790af 1848.I md-device
7e23fc43
PS
1849.BI \-\-chunk= X
1850.BI \-\-level= Y
cd29a5c8 1851.br
7e23fc43 1852.BI \-\-raid\-devices= Z
e0fe762a 1853.I devices
cd29a5c8
NB
1854
1855.PP
1856This usage will initialise a new md array, associate some devices with
1857it, and activate the array.
1858
e0fe762a
N
1859The named device will normally not exist when
1860.I "mdadm \-\-create"
1861is run, but will be created by
1862.I udev
1863once the array becomes active.
dd0781e5 1864
e0fe762a
N
1865As devices are added, they are checked to see if they contain RAID
1866superblocks or filesystems. They are also checked to see if the variance in
cd29a5c8
NB
1867device size exceeds 1%.
1868
1869If any discrepancy is found, the array will not automatically be run, though
2ae555c3 1870the presence of a
7e23fc43 1871.B \-\-run
cd29a5c8
NB
1872can override this caution.
1873
2d465520 1874To create a "degraded" array in which some devices are missing, simply
d013a55e 1875give the word "\fBmissing\fP"
2d465520 1876in place of a device name. This will cause
51ac42e3 1877.I mdadm
2d465520
NB
1878to leave the corresponding slot in the array empty.
1879For a RAID4 or RAID5 array at most one slot can be
98c6faba 1880"\fBmissing\fP"; for a RAID6 array at most two slots.
2d465520
NB
1881For a RAID1 array, only one real device needs to be given. All of the
1882others can be
d013a55e 1883"\fBmissing\fP".
2d465520 1884
feb716e9 1885When creating a RAID5 array,
51ac42e3 1886.I mdadm
feb716e9 1887will automatically create a degraded array with an extra spare drive.
e0fe762a
N
1888This is because building the spare into a degraded array is in general
1889faster than resyncing the parity on a non-degraded, but not clean,
1890array. This feature can be overridden with the
7e23fc43 1891.B \-\-force
feb716e9
NB
1892option.
1893
0ee4da98 1894When creating an array with version-1 metadata a name for the array is
41a3b72a
NB
1895required.
1896If this is not given with the
7e23fc43 1897.B \-\-name
41a3b72a
NB
1898option,
1899.I mdadm
0ee4da98 1900will choose a name based on the last component of the name of the
41a3b72a
NB
1901device being created. So if
1902.B /dev/md3
1903is being created, then the name
1904.B 3
1905will be chosen.
1906If
1907.B /dev/md/home
1908is being created, then the name
1909.B home
1910will be used.
1911
e0fe762a
N
1912When creating a partition based array, using
1913.I mdadm
1914with version-1.x metadata, the partition type should be set to
e0f31f50 1915.B 0xDA
e0fe762a 1916(non fs-data). This type selection allows for greater precision since
e0f31f50
PC
1917using any other [RAID auto-detect (0xFD) or a GNU/Linux partition (0x83)],
1918might create problems in the event of array recovery through a live cdrom.
1919
3d3dd91e
NB
1920A new array will normally get a randomly assigned 128bit UUID which is
1921very likely to be unique. If you have a specific need, you can choose
1922a UUID for the array by giving the
7e23fc43 1923.B \-\-uuid=
3d3dd91e
NB
1924option. Be warned that creating two arrays with the same UUID is a
1925recipe for disaster. Also, using
7e23fc43 1926.B \-\-uuid=
3d3dd91e 1927when creating a v0.90 array will silently override any
7e23fc43 1928.B \-\-homehost=
3d3dd91e 1929setting.
e43d0cda
NB
1930.\"If the
1931.\".B \-\-size
1932.\"option is given, it is not necessary to list any component-devices in this command.
1933.\"They can be added later, before a
1934.\".B \-\-run.
1935.\"If no
1936.\".B \-\-size
1937.\"is given, the apparent size of the smallest drive given is used.
cd29a5c8 1938
bf95d0f3
N
1939If the metadata type supports it (currently only 1.x metadata), space
1940will be allocated to store a bad block list. This allows a modest
1941number of bad blocks to be recorded, allowing the drive to remain in
1942service while only partially functional.
1943
8fd8d9c4
N
1944When creating an array within a
1945.B CONTAINER
1946.I mdadm
1947can be given either the list of devices to use, or simply the name of
1948the container. The former case gives control over which devices in
1949the container will be used for the array. The latter case allows
1950.I mdadm
1951to automatically choose which devices to use based on how much spare
1952space is available.
1953
53e8b987 1954The General Management options that are valid with
7e23fc43 1955.B \-\-create
53e8b987 1956are:
cd29a5c8 1957.TP
7e23fc43 1958.B \-\-run
dd0781e5 1959insist on running the array even if some devices look like they might
cd29a5c8
NB
1960be in use.
1961
1962.TP
7e23fc43 1963.B \-\-readonly
b3f1c093 1964start the array readonly \(em not supported yet.
52826846 1965
e0d19036 1966.SH MANAGE MODE
cd29a5c8
NB
1967.HP 12
1968Usage:
e0d19036
NB
1969.B mdadm
1970.I device
1971.I options... devices...
cd29a5c8
NB
1972.PP
1973
e0d19036
NB
1974This usage will allow individual devices in an array to be failed,
1975removed or added. It is possible to perform multiple operations with
e0fe762a 1976on command. For example:
e0d19036 1977.br
7e23fc43 1978.B " mdadm /dev/md0 \-f /dev/hda1 \-r /dev/hda1 \-a /dev/hda1"
e0d19036
NB
1979.br
1980will firstly mark
1981.B /dev/hda1
1982as faulty in
1983.B /dev/md0
1984and will then remove it from the array and finally add it back
2d465520 1985in as a spare. However only one md array can be affected by a single
2ae555c3 1986command.
e0d19036 1987
e0fe762a
N
1988When a device is added to an active array, mdadm checks to see if it
1989has metadata on it which suggests that it was recently a member of the
a4e13010 1990array. If it does, it tries to "re\-add" the device. If there have
e0fe762a
N
1991been no changes since the device was removed, or if the array has a
1992write-intent bitmap which has recorded whatever changes there were,
1993then the device will immediately become a full member of the array and
1994those differences recorded in the bitmap will be resolved.
1995
e0d19036
NB
1996.SH MISC MODE
1997.HP 12
1998Usage:
9a9dab36 1999.B mdadm
e0d19036 2000.I options ...
e0fe762a 2001.I devices ...
e0d19036 2002.PP
cd29a5c8 2003
b5e64645 2004MISC mode includes a number of distinct operations that
e0d19036
NB
2005operate on distinct devices. The operations are:
2006.TP
962a108f 2007.B \-\-query
e0d19036
NB
2008The device is examined to see if it is
2009(1) an active md array, or
2010(2) a component of an md array.
2011The information discovered is reported.
2012
2013.TP
962a108f 2014.B \-\-detail
2d465520 2015The device should be an active md device.
e0fe762a 2016.B mdadm
2d465520 2017will display a detailed description of the array.
7e23fc43 2018.B \-\-brief
2d465520 2019or
7e23fc43 2020.B \-\-scan
2d465520 2021will cause the output to be less detailed and the format to be
e0d19036 2022suitable for inclusion in
87eb4fab 2023.BR mdadm.conf .
feb716e9
NB
2024The exit status of
2025.I mdadm
2026will normally be 0 unless
2027.I mdadm
93e790af 2028failed to get useful information about the device(s); however, if the
7e23fc43 2029.B \-\-test
feb716e9
NB
2030option is given, then the exit status will be:
2031.RS
2032.TP
20330
2034The array is functioning normally.
2035.TP
20361
2037The array has at least one failed device.
2038.TP
20392
a77be586 2040The array has multiple failed devices such that it is unusable.
feb716e9
NB
2041.TP
20424
2043There was an error while trying to get information about the device.
2044.RE
cd29a5c8 2045
4cce4069
DW
2046.TP
2047.B \-\-detail\-platform
e0fe762a 2048Print detail of the platform's RAID capabilities (firmware / hardware
4cce4069
DW
2049topology). If the metadata is specified with
2050.B \-e
2051or
2052.B \-\-metadata=
2053then the return status will be:
2054.RS
2055.TP
20560
2057metadata successfully enumerated its platform components on this system
2058.TP
20591
2060metadata is platform independent
2061.TP
20622
2063metadata failed to find its platform components on this system
2064.RE
2065
aa534678
DW
2066.TP
2067.B \-\-update\-subarray=
2068If the device is a container and the argument to \-\-update\-subarray
2069specifies a subarray in the container, then attempt to update the given
2070superblock field in the subarray. Similar to updating an array in
2071"assemble" mode, the field to update is selected by
2072.B \-U
2073or
2074.B \-\-update=
2075option. Currently only
2076.B name
2077is supported.
2078
2079The
2080.B name
2081option updates the subarray name in the metadata, it may not affect the
2082device node name or the device node symlink until the subarray is
2083re\-assembled. If updating
2084.B name
2085would change the UUID of an active subarray this operation is blocked,
2086and the command will end in an error.
2087
e0d19036 2088.TP
962a108f 2089.B \-\-examine
2d465520 2090The device should be a component of an md array.
51ac42e3 2091.I mdadm
2d465520 2092will read the md superblock of the device and display the contents.
e0d19036 2093If
7e23fc43 2094.B \-\-brief
93e790af 2095or
7e23fc43 2096.B \-\-scan
93e790af 2097is given, then multiple devices that are components of the one array
e0d19036
NB
2098are grouped together and reported in a single entry suitable
2099for inclusion in
87eb4fab 2100.BR mdadm.conf .
e0d19036 2101
2d465520 2102Having
7e23fc43 2103.B \-\-scan
e0d19036
NB
2104without listing any devices will cause all devices listed in the
2105config file to be examined.
2106
2107.TP
962a108f 2108.B \-\-stop
98c6faba
NB
2109The devices should be active md arrays which will be deactivated, as
2110long as they are not currently in use.
e0d19036
NB
2111
2112.TP
962a108f 2113.B \-\-run
e0d19036
NB
2114This will fully activate a partially assembled md array.
2115
2116.TP
962a108f 2117.B \-\-readonly
e0d19036
NB
2118This will mark an active array as read-only, providing that it is
2119not currently being used.
2120
2121.TP
962a108f 2122.B \-\-readwrite
e0d19036
NB
2123This will change a
2124.B readonly
2125array back to being read/write.
2126
2d465520 2127.TP
962a108f 2128.B \-\-scan
2d465520 2129For all operations except
7e23fc43
PS
2130.BR \-\-examine ,
2131.B \-\-scan
2d465520
NB
2132will cause the operation to be applied to all arrays listed in
2133.BR /proc/mdstat .
2134For
7e23fc43
PS
2135.BR \-\-examine,
2136.B \-\-scan
2d465520
NB
2137causes all devices listed in the config file to be examined.
2138
a1331cc4
N
2139.TP
2140.BR \-b ", " \-\-brief
2141Be less verbose. This is used with
2142.B \-\-detail
2143and
2144.BR \-\-examine .
2145Using
2146.B \-\-brief
2147with
2148.B \-\-verbose
2149gives an intermediate level of verbosity.
2150
e0d19036
NB
2151.SH MONITOR MODE
2152
cd29a5c8
NB
2153.HP 12
2154Usage:
7e23fc43 2155.B mdadm \-\-monitor
e0d19036
NB
2156.I options... devices...
2157
cd29a5c8 2158.PP
e0d19036 2159This usage causes
51ac42e3 2160.I mdadm
e0d19036
NB
2161to periodically poll a number of md arrays and to report on any events
2162noticed.
51ac42e3 2163.I mdadm
e0d19036
NB
2164will never exit once it decides that there are arrays to be checked,
2165so it should normally be run in the background.
2166
2d465520 2167As well as reporting events,
51ac42e3 2168.I mdadm
2d465520
NB
2169may move a spare drive from one array to another if they are in the
2170same
2171.B spare-group
210597d1
PC
2172or
2173.B domain
a9d69660 2174and if the destination array has a failed drive but no spares.
2d465520 2175
e0d19036 2176If any devices are listed on the command line,
51ac42e3 2177.I mdadm
e0fe762a 2178will only monitor those devices. Otherwise all arrays listed in the
e0d19036 2179configuration file will be monitored. Further, if
7e23fc43 2180.B \-\-scan
e0d19036
NB
2181is given, then any other md devices that appear in
2182.B /proc/mdstat
2183will also be monitored.
2184
2185The result of monitoring the arrays is the generation of events.
bd526cee 2186These events are passed to a separate program (if specified) and may
2d465520 2187be mailed to a given E-mail address.
e0d19036 2188
93e790af
SW
2189When passing events to a program, the program is run once for each event,
2190and is given 2 or 3 command-line arguments: the first is the
2191name of the event (see below), the second is the name of the
bd526cee 2192md device which is affected, and the third is the name of a related
93e790af 2193device if relevant (such as a component device that has failed).
cd29a5c8
NB
2194
2195If
7e23fc43 2196.B \-\-scan
e0d19036
NB
2197is given, then a program or an E-mail address must be specified on the
2198command line or in the config file. If neither are available, then
51ac42e3 2199.I mdadm
e0d19036
NB
2200will not monitor anything.
2201Without
93e790af 2202.B \-\-scan,
51ac42e3 2203.I mdadm
2d465520 2204will continue monitoring as long as something was found to monitor. If
e0d19036
NB
2205no program or email is given, then each event is reported to
2206.BR stdout .
cd29a5c8 2207
e0d19036
NB
2208The different events are:
2209
2210.RS 4
2211.TP
2212.B DeviceDisappeared
2d465520 2213An md array which previously was configured appears to no longer be
773135f5 2214configured. (syslog priority: Critical)
e0d19036 2215
b8f72a62
NB
2216If
2217.I mdadm
2218was told to monitor an array which is RAID0 or Linear, then it will
2219report
2220.B DeviceDisappeared
2221with the extra information
2222.BR Wrong-Level .
2223This is because RAID0 and Linear do not support the device-failed,
2224hot-spare and resync operations which are monitored.
2225
e0d19036
NB
2226.TP
2227.B RebuildStarted
773135f5 2228An md array started reconstruction. (syslog priority: Warning)
e0d19036
NB
2229
2230.TP
2231.BI Rebuild NN
2232Where
2233.I NN
9a36a9b7
ZB
2234is a two-digit number (ie. 05, 48). This indicates that rebuild
2235has passed that many percent of the total. The events are generated
2236with fixed increment since 0. Increment size may be specified with
2237a commandline option (default is 20). (syslog priority: Warning)
e0d19036 2238
98c6faba
NB
2239.TP
2240.B RebuildFinished
2241An md array that was rebuilding, isn't any more, either because it
773135f5 2242finished normally or was aborted. (syslog priority: Warning)
98c6faba 2243
e0d19036
NB
2244.TP
2245.B Fail
773135f5
NB
2246An active component device of an array has been marked as
2247faulty. (syslog priority: Critical)
e0d19036
NB
2248
2249.TP
2250.B FailSpare
2251A spare component device which was being rebuilt to replace a faulty
93e790af 2252device has failed. (syslog priority: Critical)
e0d19036
NB
2253
2254.TP
2255.B SpareActive
2256A spare component device which was being rebuilt to replace a faulty
98b24a2a 2257device has been successfully rebuilt and has been made active.
773135f5 2258(syslog priority: Info)
e0d19036
NB
2259
2260.TP
2261.B NewArray
2262A new md array has been detected in the
2263.B /proc/mdstat
e0fe762a 2264file. (syslog priority: Info)
e0d19036 2265
aa88f531
NB
2266.TP
2267.B DegradedArray
2268A newly noticed array appears to be degraded. This message is not
2269generated when
2270.I mdadm
2271notices a drive failure which causes degradation, but only when
2272.I mdadm
2273notices that an array is degraded when it first sees the array.
93e790af 2274(syslog priority: Critical)
aa88f531 2275
e0d19036
NB
2276.TP
2277.B MoveSpare
2278A spare drive has been moved from one array in a
2279.B spare-group
210597d1
PC
2280or
2281.B domain
e0d19036 2282to another to allow a failed drive to be replaced.
773135f5 2283(syslog priority: Info)
e0d19036 2284
b8f72a62
NB
2285.TP
2286.B SparesMissing
2287If
2288.I mdadm
2289has been told, via the config file, that an array should have a certain
2290number of spare devices, and
2291.I mdadm
93e790af 2292detects that it has fewer than this number when it first sees the
b8f72a62
NB
2293array, it will report a
2294.B SparesMissing
2295message.
d1732eeb 2296(syslog priority: Warning)
b8f72a62 2297
98c6faba
NB
2298.TP
2299.B TestMessage
2300An array was found at startup, and the
7e23fc43 2301.B \-\-test
98c6faba 2302flag was given.
773135f5 2303(syslog priority: Info)
e0d19036
NB
2304.RE
2305
2306Only
93e790af
SW
2307.B Fail,
2308.B FailSpare,
2309.B DegradedArray,
2310.B SparesMissing
e0d19036 2311and
98c6faba 2312.B TestMessage
e0d19036 2313cause Email to be sent. All events cause the program to be run.
93e790af 2314The program is run with two or three arguments: the event
e0d19036
NB
2315name, the array device and possibly a second device.
2316
2317Each event has an associated array device (e.g.
2318.BR /dev/md1 )
2319and possibly a second device. For
2320.BR Fail ,
2321.BR FailSpare ,
2322and
2323.B SpareActive
2324the second device is the relevant component device.
2325For
2326.B MoveSpare
2327the second device is the array that the spare was moved from.
2328
2329For
51ac42e3 2330.I mdadm
e0d19036 2331to move spares from one array to another, the different arrays need to
93e790af 2332be labeled with the same
e0d19036 2333.B spare-group
210597d1 2334or the spares must be allowed to migrate through matching POLICY domains
e0d19036
NB
2335in the configuration file. The
2336.B spare-group
93e790af 2337name can be any string; it is only necessary that different spare
2d465520 2338groups use different names.
e0d19036
NB
2339
2340When
51ac42e3 2341.I mdadm
93e790af 2342detects that an array in a spare group has fewer active
e0d19036
NB
2343devices than necessary for the complete array, and has no spare
2344devices, it will look for another array in the same spare group that
2345has a full complement of working drive and a spare. It will then
2346attempt to remove the spare from the second drive and add it to the
2347first.
2348If the removal succeeds but the adding fails, then it is added back to
2349the original array.
2350
210597d1
PC
2351If the spare group for a degraded array is not defined,
2352.I mdadm
2353will look at the rules of spare migration specified by POLICY lines in
87eb4fab 2354.B mdadm.conf
210597d1
PC
2355and then follow similar steps as above if a matching spare is found.
2356
dd0781e5
NB
2357.SH GROW MODE
2358The GROW mode is used for changing the size or shape of an active
2359array.
2360For this to work, the kernel must support the necessary change.
c64881d7 2361Various types of growth are being added during 2.6 development.
dd0781e5 2362
c64881d7 2363Currently the supported changes include
dfd4d8ee 2364.IP \(bu 4
c64881d7 2365change the "size" attribute for RAID1, RAID4, RAID5 and RAID6.
dfd4d8ee 2366.IP \(bu 4
c64881d7
N
2367increase or decrease the "raid\-devices" attribute of RAID0, RAID1, RAID4,
2368RAID5, and RAID6.
cb77f620 2369.IP \(bu 4
c64881d7 2370change the chunk-size and layout of RAID0, RAID4, RAID5 and RAID6.
cb77f620 2371.IP \(bu 4
c64881d7 2372convert between RAID1 and RAID5, between RAID5 and RAID6, between
cb77f620 2373RAID0, RAID4, and RAID5, and between RAID0 and RAID10 (in the near-2 mode).
dfd4d8ee 2374.IP \(bu 4
93e790af 2375add a write-intent bitmap to any array which supports these bitmaps, or
2ae555c3 2376remove a write-intent bitmap from such an array.
dfd4d8ee 2377.PP
dd0781e5 2378
9ab6e80a 2379Using GROW on containers is currently supported only for Intel's IMSM
c64881d7
N
2380container format. The number of devices in a container can be
2381increased - which affects all arrays in the container - or an array
2382in a container can be converted between levels where those levels are
2383supported by the container, and the conversion is on of those listed
9ab6e80a
N
2384above. Resizing arrays in an IMSM container with
2385.B "--grow --size"
2386is not yet supported.
8fd8d9c4 2387
ca24ddb0
AK
2388Grow functionality (e.g. expand a number of raid devices) for Intel's
2389IMSM container format has an experimental status. It is guarded by the
2390.B MDADM_EXPERIMENTAL
2391environment variable which must be set to '1' for a GROW command to
2392succeed.
2393This is for the following reasons:
2394
2395.IP 1.
0de8d44d
AK
2396Intel's native IMSM check-pointing is not fully tested yet.
2397This can causes IMSM incompatibility during the grow process: an array
ca24ddb0
AK
2398which is growing cannot roam between Microsoft Windows(R) and Linux
2399systems.
2400
2401.IP 2.
2402Interrupting a grow operation is not recommended, because it
2403has not been fully tested for Intel's IMSM container format yet.
2404
0de8d44d
AK
2405.PP
2406Note: Intel's native checkpointing doesn't use
2407.B --backup-file
2408option and it is transparent for assembly feature.
2409
2ae555c3 2410.SS SIZE CHANGES
c64881d7 2411Normally when an array is built the "size" is taken from the smallest
dd0781e5
NB
2412of the drives. If all the small drives in an arrays are, one at a
2413time, removed and replaced with larger drives, then you could have an
2414array of large drives with only a small amount used. In this
2415situation, changing the "size" with "GROW" mode will allow the extra
2416space to start being used. If the size is increased in this way, a
2417"resync" process will start to make sure the new parts of the array
2418are synchronised.
2419
2420Note that when an array changes size, any filesystem that may be
cb77f620 2421stored in the array will not automatically grow or shrink to use or
88b496c2 2422vacate the space. The
666bba9b
N
2423filesystem will need to be explicitly told to use the extra space
2424after growing, or to reduce its size
2425.B prior
2426to shrinking the array.
dd0781e5 2427
e0fe762a
N
2428Also the size of an array cannot be changed while it has an active
2429bitmap. If an array has a bitmap, it must be removed before the size
cb77f620 2430can be changed. Once the change is complete a new bitmap can be created.
e0fe762a
N
2431
2432.SS RAID\-DEVICES CHANGES
2ae555c3 2433
dd0781e5
NB
2434A RAID1 array can work with any number of devices from 1 upwards
2435(though 1 is not very useful). There may be times which you want to
2436increase or decrease the number of active devices. Note that this is
2437different to hot-add or hot-remove which changes the number of
2438inactive devices.
2439
2440When reducing the number of devices in a RAID1 array, the slots which
2441are to be removed from the array must already be vacant. That is, the
93e790af 2442devices which were in those slots must be failed and removed.
dd0781e5
NB
2443
2444When the number of devices is increased, any hot spares that are
a9d69660 2445present will be activated immediately.
dd0781e5 2446
f24e2d6c 2447Changing the number of active devices in a RAID5 or RAID6 is much more
2ae555c3 2448effort. Every block in the array will need to be read and written
f24e2d6c 2449back to a new location. From 2.6.17, the Linux Kernel is able to
ca4f89a3
N
2450increase the number of devices in a RAID5 safely, including restarting
2451an interrupted "reshape". From 2.6.31, the Linux Kernel is able to
f24e2d6c
N
2452increase or decrease the number of devices in a RAID5 or RAID6.
2453
c64881d7
N
2454From 2.6.35, the Linux Kernel is able to convert a RAID0 in to a RAID4
2455or RAID5.
2456.I mdadm
2457uses this functionality and the ability to add
2458devices to a RAID4 to allow devices to be added to a RAID0. When
2459requested to do this,
2460.I mdadm
2461will convert the RAID0 to a RAID4, add the necessary disks and make
2462the reshape happen, and then convert the RAID4 back to RAID0.
2463
f24e2d6c
N
2464When decreasing the number of devices, the size of the array will also
2465decrease. If there was data in the array, it could get destroyed and
666bba9b
N
2466this is not reversible, so you should firstly shrink the filesystem on
2467the array to fit within the new size. To help prevent accidents,
f24e2d6c
N
2468.I mdadm
2469requires that the size of the array be decreased first with
2470.BR "mdadm --grow --array-size" .
2471This is a reversible change which simply makes the end of the array
2472inaccessible. The integrity of any data can then be checked before
2473the non-reversible reduction in the number of devices is request.
2ae555c3 2474
cd19c0cf
JR
2475When relocating the first few stripes on a RAID5 or RAID6, it is not
2476possible to keep the data on disk completely consistent and
2477crash-proof. To provide the required safety, mdadm disables writes to
2478the array while this "critical section" is reshaped, and takes a
2479backup of the data that is in that section. For grows, this backup may be
2480stored in any spare devices that the array has, however it can also be
2481stored in a separate file specified with the
7e23fc43 2482.B \-\-backup\-file
cd19c0cf
JR
2483option, and is required to be specified for shrinks, RAID level
2484changes and layout changes. If this option is used, and the system
2485does crash during the critical period, the same file must be passed to
7e23fc43 2486.B \-\-assemble
cd19c0cf
JR
2487to restore the backup and reassemble the array. When shrinking rather
2488than growing the array, the reshape is done from the end towards the
2489beginning, so the "critical section" is at the end of the reshape.
2ae555c3 2490
f24e2d6c
N
2491.SS LEVEL CHANGES
2492
2493Changing the RAID level of any array happens instantaneously. However
cd19c0cf 2494in the RAID5 to RAID6 case this requires a non-standard layout of the
f24e2d6c 2495RAID6 data, and in the RAID6 to RAID5 case that non-standard layout is
cd19c0cf 2496required before the change can be accomplished. So while the level
f24e2d6c 2497change is instant, the accompanying layout change can take quite a
cd19c0cf
JR
2498long time. A
2499.B \-\-backup\-file
2500is required. If the array is not simultaneously being grown or
2501shrunk, so that the array size will remain the same - for example,
2502reshaping a 3-drive RAID5 into a 4-drive RAID6 - the backup file will
2503be used not just for a "cricital section" but throughout the reshape
2504operation, as described below under LAYOUT CHANGES.
f24e2d6c
N
2505
2506.SS CHUNK-SIZE AND LAYOUT CHANGES
2507
2508Changing the chunk-size of layout without also changing the number of
2509devices as the same time will involve re-writing all blocks in-place.
2510To ensure against data loss in the case of a crash, a
2511.B --backup-file
2512must be provided for these changes. Small sections of the array will
cd19c0cf
JR
2513be copied to the backup file while they are being rearranged. This
2514means that all the data is copied twice, once to the backup and once
2515to the new layout on the array, so this type of reshape will go very
2516slowly.
f24e2d6c
N
2517
2518If the reshape is interrupted for any reason, this backup file must be
cd19c0cf 2519made available to
f24e2d6c
N
2520.B "mdadm --assemble"
2521so the array can be reassembled. Consequently the file cannot be
2522stored on the device being reshaped.
2523
2524
2ae555c3
NB
2525.SS BITMAP CHANGES
2526
2527A write-intent bitmap can be added to, or removed from, an active
93e790af 2528array. Either internal bitmaps, or bitmaps stored in a separate file,
fe80f49b 2529can be added. Note that if you add a bitmap stored in a file which is
e0fe762a 2530in a filesystem that is on the RAID array being affected, the system
fe80f49b
NB
2531will deadlock. The bitmap must be on a separate filesystem.
2532
8382f19b
NB
2533.SH INCREMENTAL MODE
2534
2535.HP 12
2536Usage:
7e23fc43
PS
2537.B mdadm \-\-incremental
2538.RB [ \-\-run ]
2539.RB [ \-\-quiet ]
8382f19b
NB
2540.I component-device
2541.HP 12
2542Usage:
29ba4804
N
2543.B mdadm \-\-incremental \-\-fail
2544.I component-device
2545.HP 12
2546Usage:
7e6140e6 2547.B mdadm \-\-incremental \-\-rebuild\-map
8382f19b
NB
2548.HP 12
2549Usage:
7e23fc43 2550.B mdadm \-\-incremental \-\-run \-\-scan
8382f19b 2551
8382f19b
NB
2552.PP
2553This mode is designed to be used in conjunction with a device
2554discovery system. As devices are found in a system, they can be
2555passed to
7e23fc43 2556.B "mdadm \-\-incremental"
8382f19b
NB
2557to be conditionally added to an appropriate array.
2558
29ba4804
N
2559Conversely, it can also be used with the
2560.B \-\-fail
2561flag to do just the opposite and find whatever array a particular device
2562is part of and remove the device from that array.
2563
8fd8d9c4
N
2564If the device passed is a
2565.B CONTAINER
2566device created by a previous call to
2567.IR mdadm ,
2568then rather than trying to add that device to an array, all the arrays
2569described by the metadata of the container will be started.
2570
8382f19b
NB
2571.I mdadm
2572performs a number of tests to determine if the device is part of an
93e790af 2573array, and which array it should be part of. If an appropriate array
8382f19b
NB
2574is found, or can be created,
2575.I mdadm
2576adds the device to the array and conditionally starts the array.
2577
2578Note that
2579.I mdadm
87eb4fab
N
2580will normally only add devices to an array which were previously working
2581(active or spare) parts of that array. The support for automatic
210597d1
PC
2582inclusion of a new drive as a spare in some array requires
2583a configuration through POLICY in config file.
8382f19b 2584
8382f19b
NB
2585The tests that
2586.I mdadm
2587makes are as follow:
2588.IP +
2589Is the device permitted by
2590.BR mdadm.conf ?
2591That is, is it listed in a
2592.B DEVICES
2593line in that file. If
2594.B DEVICES
2595is absent then the default it to allow any device. Similar if
2596.B DEVICES
2597contains the special word
2598.B partitions
2599then any device is allowed. Otherwise the device name given to
2600.I mdadm
2601must match one of the names or patterns in a
2602.B DEVICES
2603line.
2604
2605.IP +
cb77f620
NK
2606Does the device have a valid md superblock? If a specific metadata
2607version is requested with
7e23fc43 2608.B \-\-metadata
8382f19b 2609or
7e23fc43 2610.B \-e
8382f19b
NB
2611then only that style of metadata is accepted, otherwise
2612.I mdadm
2613finds any known version of metadata. If no
2614.I md
210597d1
PC
2615metadata is found, the device may be still added to an array
2616as a spare if POLICY allows.
8382f19b 2617
d1302dd8 2618.ig
8382f19b
NB
2619.IP +
2620Does the metadata match an expected array?
2621The metadata can match in two ways. Either there is an array listed
2622in
2623.B mdadm.conf
2624which identifies the array (either by UUID, by name, by device list,
93e790af 2625or by minor-number), or the array was created with a
8382f19b 2626.B homehost
93e790af 2627specified and that
8382f19b 2628.B homehost
93e790af 2629matches the one in
8382f19b
NB
2630.B mdadm.conf
2631or on the command line.
2632If
2633.I mdadm
2634is not able to positively identify the array as belonging to the
2635current host, the device will be rejected.
d1302dd8 2636..
8382f19b 2637
cb77f620 2638.PP
8382f19b 2639.I mdadm
93e790af 2640keeps a list of arrays that it has partially assembled in
96fd06ed 2641.BR {MAP_PATH} .
e0fe762a 2642If no array exists which matches
8382f19b
NB
2643the metadata on the new device,
2644.I mdadm
2645must choose a device name and unit number. It does this based on any
2646name given in
2647.B mdadm.conf
2648or any name information stored in the metadata. If this name
2649suggests a unit number, that number will be used, otherwise a free
2650unit number will be chosen. Normally
2651.I mdadm
2652will prefer to create a partitionable array, however if the
2653.B CREATE
2654line in
2655.B mdadm.conf
2656suggests that a non-partitionable array is preferred, that will be
2657honoured.
2658
e0fe762a
N
2659If the array is not found in the config file and its metadata does not
2660identify it as belonging to the "homehost", then
2661.I mdadm
2662will choose a name for the array which is certain not to conflict with
2663any array which does belong to this host. It does this be adding an
2664underscore and a small number to the name preferred by the metadata.
2665
8382f19b
NB
2666Once an appropriate array is found or created and the device is added,
2667.I mdadm
2668must decide if the array is ready to be started. It will
2669normally compare the number of available (non-spare) devices to the
2670number of devices that the metadata suggests need to be active. If
2671there are at least that many, the array will be started. This means
2672that if any devices are missing the array will not be restarted.
2673
2674As an alternative,
7e23fc43 2675.B \-\-run
8382f19b 2676may be passed to
51ac42e3 2677.I mdadm
8382f19b 2678in which case the array will be run as soon as there are enough
e0fe762a
N
2679devices present for the data to be accessible. For a RAID1, that
2680means one device will start the array. For a clean RAID5, the array
8382f19b
NB
2681will be started as soon as all but one drive is present.
2682
93e790af 2683Note that neither of these approaches is really ideal. If it can
8382f19b
NB
2684be known that all device discovery has completed, then
2685.br
7e23fc43 2686.B " mdadm \-IRs"
8382f19b
NB
2687.br
2688can be run which will try to start all arrays that are being
2689incrementally assembled. They are started in "read-auto" mode in
2690which they are read-only until the first write request. This means
2691that no metadata updates are made and no attempt at resync or recovery
2692happens. Further devices that are found before the first write can
2693still be added safely.
2694
5545fa6d
DW
2695.SH ENVIRONMENT
2696This section describes environment variables that affect how mdadm
2697operates.
2698
2699.TP
2700.B MDADM_NO_MDMON
2701Setting this value to 1 will prevent mdadm from automatically launching
2702mdmon. This variable is intended primarily for debugging mdadm/mdmon.
2703
8fd8d9c4
N
2704.TP
2705.B MDADM_NO_UDEV
2706Normally,
2707.I mdadm
2708does not create any device nodes in /dev, but leaves that task to
2709.IR udev .
2710If
2711.I udev
2712appears not to be configured, or if this environment variable is set
2713to '1', the
2714.I mdadm
2715will create and devices that are needed.
2716
2d465520
NB
2717.SH EXAMPLES
2718
7e23fc43 2719.B " mdadm \-\-query /dev/name-of-device"
2d465520 2720.br
e0fe762a 2721This will find out if a given device is a RAID array, or is part of
5787fa49 2722one, and will provide brief information about the device.
2d465520 2723
7e23fc43 2724.B " mdadm \-\-assemble \-\-scan"
2d465520 2725.br
93e790af 2726This will assemble and start all arrays listed in the standard config
5787fa49 2727file. This command will typically go in a system startup file.
2d465520 2728
7e23fc43 2729.B " mdadm \-\-stop \-\-scan"
5787fa49 2730.br
93e790af 2731This will shut down all arrays that can be shut down (i.e. are not
19f8b8fc 2732currently in use). This will typically go in a system shutdown script.
2d465520 2733
7e23fc43 2734.B " mdadm \-\-follow \-\-scan \-\-delay=120"
2d465520 2735.br
5787fa49
NB
2736If (and only if) there is an Email address or program given in the
2737standard config file, then
2738monitor the status of all arrays listed in that file by
2739polling them ever 2 minutes.
2d465520 2740
7e23fc43 2741.B " mdadm \-\-create /dev/md0 \-\-level=1 \-\-raid\-devices=2 /dev/hd[ac]1"
2d465520 2742.br
5787fa49 2743Create /dev/md0 as a RAID1 array consisting of /dev/hda1 and /dev/hdc1.
2d465520 2744
2d465520 2745.br
7e23fc43 2746.B " echo 'DEVICE /dev/hd*[0\-9] /dev/sd*[0\-9]' > mdadm.conf"
2d465520 2747.br
7e23fc43 2748.B " mdadm \-\-detail \-\-scan >> mdadm.conf"
2d465520 2749.br
5787fa49
NB
2750This will create a prototype config file that describes currently
2751active arrays that are known to be made from partitions of IDE or SCSI drives.
2d465520
NB
2752This file should be reviewed before being used as it may
2753contain unwanted detail.
2754
7e23fc43 2755.B " echo 'DEVICE /dev/hd[a\-z] /dev/sd*[a\-z]' > mdadm.conf"
2d465520 2756.br
7e23fc43 2757.B " mdadm \-\-examine \-\-scan \-\-config=mdadm.conf >> mdadm.conf"
93e790af
SW
2758.br
2759This will find arrays which could be assembled from existing IDE and
2760SCSI whole drives (not partitions), and store the information in the
5787fa49 2761format of a config file.
2d465520
NB
2762This file is very likely to contain unwanted detail, particularly
2763the
2764.B devices=
5787fa49
NB
2765entries. It should be reviewed and edited before being used as an
2766actual config file.
2d465520 2767
7e23fc43 2768.B " mdadm \-\-examine \-\-brief \-\-scan \-\-config=partitions"
2d465520 2769.br
7e23fc43 2770.B " mdadm \-Ebsc partitions"
5787fa49
NB
2771.br
2772Create a list of devices by reading
2773.BR /proc/partitions ,
2774scan these for RAID superblocks, and printout a brief listing of all
93e790af 2775that were found.
2d465520 2776
7e23fc43 2777.B " mdadm \-Ac partitions \-m 0 /dev/md0"
2d465520 2778.br
5787fa49
NB
2779Scan all partitions and devices listed in
2780.BR /proc/partitions
2781and assemble
2782.B /dev/md0
2783out of all such devices with a RAID superblock with a minor number of 0.
2d465520 2784
96fd06ed 2785.B " mdadm \-\-monitor \-\-scan \-\-daemonise > /run/mdadm/mon.pid"
d013a55e
NB
2786.br
2787If config file contains a mail address or alert program, run mdadm in
2788the background in monitor mode monitoring all md devices. Also write
2789pid of mdadm daemon to
96fd06ed 2790.BR /run/mdadm/mon.pid .
d013a55e 2791
7e23fc43 2792.B " mdadm \-Iq /dev/somedevice"
8382f19b
NB
2793.br
2794Try to incorporate newly discovered device into some array as
2795appropriate.
2796
7e6140e6 2797.B " mdadm \-\-incremental \-\-rebuild\-map \-\-run \-\-scan"
8382f19b
NB
2798.br
2799Rebuild the array map from any current arrays, and then start any that
2800can be started.
2801
b80da661
NB
2802.B " mdadm /dev/md4 --fail detached --remove detached"
2803.br
2804Any devices which are components of /dev/md4 will be marked as faulty
2805and then remove from the array.
2806
cb77f620 2807.B " mdadm --grow /dev/md4 --level=6 --backup-file=/root/backup-md4"
f24e2d6c
N
2808.br
2809The array
2810.B /dev/md4
2811which is currently a RAID5 array will be converted to RAID6. There
2812should normally already be a spare drive attached to the array as a
2813RAID6 needs one more drive than a matching RAID5.
2814
8fd8d9c4
N
2815.B " mdadm --create /dev/md/ddf --metadata=ddf --raid-disks 6 /dev/sd[a-f]"
2816.br
2817Create a DDF array over 6 devices.
2818
2819.B " mdadm --create /dev/md/home -n3 -l5 -z 30000000 /dev/md/ddf"
2820.br
e0fe762a 2821Create a RAID5 array over any 3 devices in the given DDF set. Use
8fd8d9c4
N
2822only 30 gigabytes of each device.
2823
2824.B " mdadm -A /dev/md/ddf1 /dev/sd[a-f]"
2825.br
2826Assemble a pre-exist ddf array.
2827
2828.B " mdadm -I /dev/md/ddf1"
2829.br
2830Assemble all arrays contained in the ddf array, assigning names as
2831appropriate.
2832
7e23fc43 2833.B " mdadm \-\-create \-\-help"
2d465520 2834.br
2ae555c3 2835Provide help about the Create mode.
2d465520 2836
7e23fc43 2837.B " mdadm \-\-config \-\-help"
5787fa49
NB
2838.br
2839Provide help about the format of the config file.
2d465520 2840
7e23fc43 2841.B " mdadm \-\-help"
5787fa49
NB
2842.br
2843Provide general help.
cd29a5c8 2844
cd29a5c8
NB
2845.SH FILES
2846
2847.SS /proc/mdstat
2848
2ae555c3
NB
2849If you're using the
2850.B /proc
cd29a5c8
NB
2851filesystem,
2852.B /proc/mdstat
2d465520 2853lists all active md devices with information about them.
51ac42e3 2854.I mdadm
2d465520 2855uses this to find arrays when
7e23fc43 2856.B \-\-scan
2d465520
NB
2857is given in Misc mode, and to monitor array reconstruction
2858on Monitor mode.
2859
9a9dab36 2860.SS /etc/mdadm.conf
cd29a5c8 2861
11a3e71d
NB
2862The config file lists which devices may be scanned to see if
2863they contain MD super block, and gives identifying information
2864(e.g. UUID) about known MD arrays. See
2865.BR mdadm.conf (5)
2866for more details.
cd29a5c8 2867
96fd06ed 2868.SS {MAP_PATH}
8382f19b 2869When
7e23fc43 2870.B \-\-incremental
93e790af 2871mode is used, this file gets a list of arrays currently being created.
8382f19b 2872
48f7b27a
NB
2873.SH DEVICE NAMES
2874
48f7b27a 2875.I mdadm
8fd8d9c4
N
2876understand two sorts of names for array devices.
2877
2878The first is the so-called 'standard' format name, which matches the
2879names used by the kernel and which appear in
2880.IR /proc/mdstat .
2881
2882The second sort can be freely chosen, but must reside in
2883.IR /dev/md/ .
2884When giving a device name to
2885.I mdadm
2886to create or assemble an array, either full path name such as
2887.I /dev/md0
2888or
2889.I /dev/md/home
2890can be given, or just the suffix of the second sort of name, such as
2891.I home
2892can be given.
2893
2894When
2895.I mdadm
e0fe762a
N
2896chooses device names during auto-assembly or incremental assembly, it
2897will sometimes add a small sequence number to the end of the name to
2898avoid conflicted between multiple arrays that have the same name. If
8fd8d9c4
N
2899.I mdadm
2900can reasonably determine that the array really is meant for this host,
2901either by a hostname in the metadata, or by the presence of the array
87eb4fab
N
2902in
2903.BR mdadm.conf ,
2904then it will leave off the suffix if possible.
e0fe762a
N
2905Also if the homehost is specified as
2906.B <ignore>
2907.I mdadm
2908will only use a suffix if a different array of the same name already
2909exists or is listed in the config file.
48f7b27a
NB
2910
2911The standard names for non-partitioned arrays (the only sort of md
8fd8d9c4 2912array available in 2.4 and earlier) are of the form
48f7b27a
NB
2913.IP
2914/dev/mdNN
48f7b27a
NB
2915.PP
2916where NN is a number.
2917The standard names for partitionable arrays (as available from 2.6
8fd8d9c4 2918onwards) are of the form
48f7b27a 2919.IP
48f7b27a
NB
2920/dev/md_dNN
2921.PP
2922Partition numbers should be indicated by added "pMM" to these, thus "/dev/md/d1p2".
8fd8d9c4
N
2923.PP
2924From kernel version, 2.6.28 the "non-partitioned array" can actually
2925be partitioned. So the "md_dNN" names are no longer needed, and
2926partitions such as "/dev/mdNNpXX" are possible.
52826846 2927
2d465520 2928.SH NOTE
51ac42e3 2929.I mdadm
2d465520 2930was previously known as
51ac42e3 2931.IR mdctl .
a9d69660 2932.P
51ac42e3 2933.I mdadm
a9d69660 2934is completely separate from the
51ac42e3 2935.I raidtools
a9d69660
NB
2936package, and does not use the
2937.I /etc/raidtab
2938configuration file at all.
2939
52826846 2940.SH SEE ALSO
75f74377 2941For further information on mdadm usage, MD and the various levels of
3cdfb6a7 2942RAID, see:
3cdfb6a7 2943.IP
cb77f620 2944.B http://raid.wiki.kernel.org/
75f74377
DG
2945.PP
2946(based upon Jakob \(/Ostergaard's Software\-RAID.HOWTO)
e43d0cda
NB
2947.\".PP
2948.\"for new releases of the RAID driver check out:
2949.\"
2950.\".IP
e0fe762a 2951.\".UR ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
e43d0cda
NB
2952.\"ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
2953.\".UE
2954.\".PP
2955.\"or
2956.\".IP
2957.\".UR http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2958.\"http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2959.\".UE
cd29a5c8 2960.PP
2ae555c3 2961The latest version of
a9d69660
NB
2962.I mdadm
2963should always be available from
cd29a5c8 2964.IP
11cd8b79
N
2965.B http://www.kernel.org/pub/linux/utils/raid/mdadm/
2966.PP
2967Related man pages:
cd29a5c8 2968.PP
e0fe762a 2969.IR mdmon (8),
a9d69660
NB
2970.IR mdadm.conf (5),
2971.IR md (4).
56eb10c0 2972.PP
52826846
NB
2973.IR raidtab (5),
2974.IR raid0run (8),
2975.IR raidstop (8),
a9d69660 2976.IR mkraid (8).