]> git.ipfire.org Git - thirdparty/mdadm.git/blame - mdadm.8.in
platform-intel - cache 'intel_devices' for a few seconds.
[thirdparty/mdadm.git] / mdadm.8.in
CommitLineData
52826846 1.\" -*- nroff -*-
e43d0cda
NB
2.\" Copyright Neil Brown and others.
3.\" This program is free software; you can redistribute it and/or modify
4.\" it under the terms of the GNU General Public License as published by
5.\" the Free Software Foundation; either version 2 of the License, or
6.\" (at your option) any later version.
7.\" See file COPYING in distribution for details.
3b2aad6e 8.TH MDADM 8 "" v3.2.5
52826846 9.SH NAME
9a9dab36 10mdadm \- manage MD devices
cd29a5c8 11.I aka
93e790af 12Linux Software RAID
cd29a5c8 13
52826846
NB
14.SH SYNOPSIS
15
e0d19036 16.BI mdadm " [mode] <raiddevice> [options] <component-devices>"
52826846 17
2ae555c3 18.SH DESCRIPTION
52826846 19RAID devices are virtual devices created from two or more
e0fe762a 20real block devices. This allows multiple devices (typically disk
35cc5be4 21drives or partitions thereof) to be combined into a single device to
cd29a5c8 22hold (for example) a single filesystem.
2d465520 23Some RAID levels include redundancy and so can survive some degree of
cd29a5c8
NB
24device failure.
25
2d465520
NB
26Linux Software RAID devices are implemented through the md (Multiple
27Devices) device driver.
cd29a5c8
NB
28
29Currently, Linux supports
30.B LINEAR
31md devices,
32.B RAID0
33(striping),
34.B RAID1
35(mirroring),
d013a55e
NB
36.BR RAID4 ,
37.BR RAID5 ,
98c6faba 38.BR RAID6 ,
1a7dfc35 39.BR RAID10 ,
b5e64645 40.BR MULTIPATH ,
90c8d668 41.BR FAULTY ,
cd29a5c8 42and
90c8d668 43.BR CONTAINER .
d013a55e 44
a9d69660
NB
45.B MULTIPATH
46is not a Software RAID mechanism, but does involve
93e790af 47multiple devices:
d013a55e 48each device is a path to one common physical storage device.
9652457e
N
49New installations should not use md/multipath as it is not well
50supported and has no ongoing development. Use the Device Mapper based
51multipath-tools instead.
d013a55e 52
a9d69660
NB
53.B FAULTY
54is also not true RAID, and it only involves one device. It
b5e64645 55provides a layer over a true device that can be used to inject faults.
52826846 56
4cce4069 57.B CONTAINER
8fd8d9c4
N
58is different again. A
59.B CONTAINER
60is a collection of devices that are
90c8d668
N
61managed as a set. This is similar to the set of devices connected to
62a hardware RAID controller. The set of devices may contain a number
9652457e 63of different RAID arrays each utilising some (or all) of the blocks from a
90c8d668 64number of the devices in the set. For example, two devices in a 5-device set
9652457e 65might form a RAID1 using the whole devices. The remaining three might
90c8d668
N
66have a RAID5 over the first half of each device, and a RAID0 over the
67second half.
68
8fd8d9c4
N
69With a
70.BR CONTAINER ,
71there is one set of metadata that describes all of
72the arrays in the container. So when
73.I mdadm
74creates a
75.B CONTAINER
9652457e
N
76device, the device just represents the metadata. Other normal arrays (RAID1
77etc) can be created inside the container.
52826846
NB
78
79.SH MODES
8382f19b 80mdadm has several major modes of operation:
cd29a5c8
NB
81.TP
82.B Assemble
93e790af 83Assemble the components of a previously created
e0fe762a 84array into an active array. Components can be explicitly given
2ae555c3 85or can be searched for.
51ac42e3 86.I mdadm
cd29a5c8
NB
87checks that the components
88do form a bona fide array, and can, on request, fiddle superblock
89information so as to assemble a faulty array.
90
91.TP
92.B Build
e0fe762a 93Build an array that doesn't have per-device metadata (superblocks). For these
a9d69660
NB
94sorts of arrays,
95.I mdadm
96cannot differentiate between initial creation and subsequent assembly
97of an array. It also cannot perform any checks that appropriate
93e790af 98components have been requested. Because of this, the
a9d69660
NB
99.B Build
100mode should only be used together with a complete understanding of
101what you are doing.
cd29a5c8
NB
102
103.TP
104.B Create
e0fe762a
N
105Create a new array with per-device metadata (superblocks).
106Appropriate metadata is written to each device, and then the array
107comprising those devices is activated. A 'resync' process is started
108to make sure that the array is consistent (e.g. both sides of a mirror
109contain the same data) but the content of the device is left otherwise
110untouched.
111The array can be used as soon as it has been created. There is no
112need to wait for the initial resync to finish.
cd29a5c8 113
cd29a5c8
NB
114.TP
115.B "Follow or Monitor"
5787fa49 116Monitor one or more md devices and act on any state changes. This is
e0fe762a
N
117only meaningful for RAID1, 4, 5, 6, 10 or multipath arrays, as
118only these have interesting state. RAID0 or Linear never have
98c6faba 119missing, spare, or failed drives, so there is nothing to monitor.
5787fa49 120
dd0781e5
NB
121.TP
122.B "Grow"
123Grow (or shrink) an array, or otherwise reshape it in some way.
124Currently supported growth options including changing the active size
c64881d7
N
125of component devices and changing the number of active devices in
126Linear and RAID levels 0/1/4/5/6,
127changing the RAID level between 0, 1, 5, and 6, and between 0 and 10,
128changing the chunk size and layout for RAID 0,4,5,6, as well as adding or
f24e2d6c 129removing a write-intent bitmap.
cd29a5c8 130
8382f19b
NB
131.TP
132.B "Incremental Assembly"
133Add a single device to an appropriate array. If the addition of the
134device makes the array runnable, the array will be started.
135This provides a convenient interface to a
136.I hot-plug
137system. As each device is detected,
138.I mdadm
139has a chance to include it in some array as appropriate.
29ba4804
N
140Optionally, when the
141.I \-\-fail
142flag is passed in we will remove the device from any active array
143instead of adding it.
9652457e 144
8fd8d9c4
N
145If a
146.B CONTAINER
147is passed to
148.I mdadm
149in this mode, then any arrays within that container will be assembled
150and started.
8382f19b 151
2ae555c3
NB
152.TP
153.B Manage
154This is for doing things to specific components of an array such as
155adding new spares and removing faulty devices.
156
157.TP
158.B Misc
159This is an 'everything else' mode that supports operations on active
160arrays, operations on component devices such as erasing old superblocks, and
161information gathering operations.
e43d0cda
NB
162.\"This mode allows operations on independent devices such as examine MD
163.\"superblocks, erasing old superblocks and stopping active arrays.
2ae555c3 164
1f48664b
NB
165.TP
166.B Auto-detect
167This mode does not act on a specific device or array, but rather it
168requests the Linux Kernel to activate any auto-detected arrays.
52826846
NB
169.SH OPTIONS
170
2ae555c3 171.SH Options for selecting a mode are:
52826846 172
cd29a5c8 173.TP
7e23fc43 174.BR \-A ", " \-\-assemble
2d465520 175Assemble a pre-existing array.
52826846 176
cd29a5c8 177.TP
7e23fc43 178.BR \-B ", " \-\-build
cd29a5c8 179Build a legacy array without superblocks.
52826846 180
cd29a5c8 181.TP
7e23fc43 182.BR \-C ", " \-\-create
cd29a5c8 183Create a new array.
52826846 184
cd29a5c8 185.TP
7e23fc43 186.BR \-F ", " \-\-follow ", " \-\-monitor
cd29a5c8
NB
187Select
188.B Monitor
189mode.
52826846 190
dd0781e5 191.TP
7e23fc43 192.BR \-G ", " \-\-grow
dd0781e5 193Change the size or shape of an active array.
8382f19b
NB
194
195.TP
1f48664b 196.BR \-I ", " \-\-incremental
29ba4804 197Add/remove a single device to/from an appropriate array, and possibly start the array.
8382f19b 198
1f48664b
NB
199.TP
200.B \-\-auto-detect
201Request that the kernel starts any auto-detected arrays. This can only
202work if
203.I md
204is compiled into the kernel \(em not if it is a module.
205Arrays can be auto-detected by the kernel if all the components are in
206primary MS-DOS partitions with partition type
e0fe762a
N
207.BR FD ,
208and all use v0.90 metadata.
1f48664b
NB
209In-kernel autodetect is not recommended for new installations. Using
210.I mdadm
211to detect and assemble arrays \(em possibly in an
212.I initrd
213\(em is substantially more flexible and should be preferred.
214
2ae555c3
NB
215.P
216If a device is given before any options, or if the first option is
7e23fc43
PS
217.BR \-\-add ,
218.BR \-\-fail ,
7e23fc43 219.BR \-\-remove ,
70c55e36
N
220or
221.BR \-\-replace ,
e0fe762a 222then the MANAGE mode is assumed.
2ae555c3
NB
223Anything other than these will cause the
224.B Misc
225mode to be assumed.
dd0781e5 226
2ae555c3 227.SH Options that are not mode-specific are:
e793c2e5 228
cd29a5c8 229.TP
7e23fc43 230.BR \-h ", " \-\-help
a9d69660 231Display general help message or, after one of the above options, a
93e790af 232mode-specific help message.
56eedc1a
NB
233
234.TP
7e23fc43 235.B \-\-help\-options
56eedc1a
NB
236Display more detailed help about command line parsing and some commonly
237used options.
52826846 238
cd29a5c8 239.TP
7e23fc43 240.BR \-V ", " \-\-version
9a9dab36 241Print version information for mdadm.
52826846 242
cd29a5c8 243.TP
7e23fc43 244.BR \-v ", " \-\-verbose
22892d56
NB
245Be more verbose about what is happening. This can be used twice to be
246extra-verbose.
a9d69660 247The extra verbosity currently only affects
7e23fc43 248.B \-\-detail \-\-scan
22892d56 249and
7e23fc43 250.BR "\-\-examine \-\-scan" .
52826846 251
dab6685f 252.TP
7e23fc43 253.BR \-q ", " \-\-quiet
dab6685f 254Avoid printing purely informative messages. With this,
51ac42e3 255.I mdadm
dab6685f
NB
256will be silent unless there is something really important to report.
257
08ca2adf
JS
258.TP
259.BR \-\-offroot
260Set first character of argv[0] to @ to indicate mdadm was launched
261from initrd/initramfs and should not be shutdown by systemd as part of
262the regular shutdown process. This option is normally only used by
263the system's initscripts. Please see here for more details on how
264systemd handled argv[0]:
265.IP
266.B http://www.freedesktop.org/wiki/Software/systemd/RootStorageDaemons
267.PP
268
269
e0d19036 270.TP
7e23fc43 271.BR \-f ", " \-\-force
93e790af 272Be more forceful about certain operations. See the various modes for
e0d19036
NB
273the exact meaning of this option in different contexts.
274
275.TP
7e23fc43 276.BR \-c ", " \-\-config=
2ae555c3
NB
277Specify the config file. Default is to use
278.BR /etc/mdadm.conf ,
93e790af 279or if that is missing then
2ae555c3 280.BR /etc/mdadm/mdadm.conf .
5787fa49 281If the config file given is
93e790af 282.B "partitions"
5787fa49
NB
283then nothing will be read, but
284.I mdadm
285will act as though the config file contained exactly
8fd8d9c4 286.B "DEVICE partitions containers"
5787fa49
NB
287and will read
288.B /proc/partitions
8fd8d9c4
N
289to find a list of devices to scan, and
290.B /proc/mdstat
291to find a list of containers to examine.
d013a55e 292If the word
93e790af 293.B "none"
d013a55e
NB
294is given for the config file, then
295.I mdadm
296will act as though the config file were empty.
e0d19036
NB
297
298.TP
7e23fc43 299.BR \-s ", " \-\-scan
93e790af 300Scan config file or
e0d19036
NB
301.B /proc/mdstat
302for missing information.
303In general, this option gives
51ac42e3 304.I mdadm
93e790af
SW
305permission to get any missing information (like component devices,
306array devices, array identities, and alert destination) from the
307configuration file (see previous option);
308one exception is MISC mode when using
7e23fc43 309.B \-\-detail
e0d19036 310or
93e790af 311.B \-\-stop,
e0d19036 312in which case
7e23fc43 313.B \-\-scan
e0d19036
NB
314says to get a list of array devices from
315.BR /proc/mdstat .
316
570c0542 317.TP
d16c7af6 318.BR \-e ", " \-\-metadata=
e0fe762a 319Declare the style of RAID metadata (superblock) to be used. The
26f467a9 320default is {DEFAULT_METADATA} for
7e23fc43 321.BR \-\-create ,
53e8b987 322and to guess for other operations.
2790ffe3
GB
323The default can be overridden by setting the
324.B metadata
325value for the
326.B CREATE
327keyword in
328.BR mdadm.conf .
570c0542
NB
329
330Options are:
331.RS
26f467a9 332.ie '{DEFAULT_METADATA}'0.90'
333.IP "0, 0.90, default"
334.el
7d5c3964 335.IP "0, 0.90"
570c0542 336Use the original 0.90 format superblock. This format limits arrays to
93e790af 33728 component devices and limits component devices of levels 1 and
cd19c0cf
JR
338greater to 2 terabytes. It is also possible for there to be confusion
339about whether the superblock applies to a whole device or just the
340last partition, if that partition starts on a 64K boundary.
26f467a9 341.ie '{DEFAULT_METADATA}'0.90'
342.IP "1, 1.0, 1.1, 1.2"
343.el
7d5c3964 344.IP "1, 1.0, 1.1, 1.2 default"
cd19c0cf
JR
345Use the new version-1 format superblock. This has fewer restrictions.
346It can easily be moved between hosts with different endian-ness, and a
347recovery operation can be checkpointed and restarted. The different
348sub-versions store the superblock at different locations on the
349device, either at the end (for 1.0), at the start (for 1.1) or 4K from
7050aa3f
N
350the start (for 1.2). "1" is equivalent to "1.2" (the commonly
351preferred 1.x format).
26f467a9 352'if '{DEFAULT_METADATA}'1.2' "default" is equivalent to "1.2".
8fd8d9c4 353.IP ddf
e0fe762a
N
354Use the "Industry Standard" DDF (Disk Data Format) format defined by
355SNIA.
356When creating a DDF array a
8fd8d9c4
N
357.B CONTAINER
358will be created, and normal arrays can be created in that container.
359.IP imsm
4cce4069 360Use the Intel(R) Matrix Storage Manager metadata format. This creates a
8fd8d9c4 361.B CONTAINER
4cce4069
DW
362which is managed in a similar manner to DDF, and is supported by an
363option-rom on some platforms:
364.IP
365.B http://www.intel.com/design/chipsets/matrixstorage_sb.htm
366.PP
570c0542
NB
367.RE
368
41a3b72a 369.TP
7e23fc43 370.B \-\-homehost=
35cc5be4 371This will override any
41a3b72a 372.B HOMEHOST
93e790af 373setting in the config file and provides the identity of the host which
41a3b72a
NB
374should be considered the home for any arrays.
375
376When creating an array, the
377.B homehost
e0fe762a 378will be recorded in the metadata. For version-1 superblocks, it will
93e790af 379be prefixed to the array name. For version-0.90 superblocks, part of
41a3b72a
NB
380the SHA1 hash of the hostname will be stored in the later half of the
381UUID.
382
383When reporting information about an array, any array which is tagged
384for the given homehost will be reported as such.
385
386When using Auto-Assemble, only arrays tagged for the given homehost
0ac91628 387will be allowed to use 'local' names (i.e. not ending in '_' followed
e0fe762a
N
388by a digit string). See below under
389.BR "Auto Assembly" .
41a3b72a 390
c2ecf5f6
N
391.TP
392.B \-\-prefer=
393When
394.I mdadm
395needs to print the name for a device it normally finds the name in
396.B /dev
397which refers to the device and is shortest. When a path component is
398given with
399.B \-\-prefer
400.I mdadm
401will prefer a longer name if it contains that component. For example
402.B \-\-prefer=by-uuid
403will prefer a name in a subdirectory of
404.B /dev
405called
406.BR by-uuid .
407
408This functionality is currently only provided by
409.B \-\-detail
410and
411.BR \-\-monitor .
412
2ae555c3
NB
413.SH For create, build, or grow:
414
415.TP
7e23fc43 416.BR \-n ", " \-\-raid\-devices=
2ae555c3
NB
417Specify the number of active devices in the array. This, plus the
418number of spare devices (see below) must equal the number of
419.I component-devices
420(including "\fBmissing\fP" devices)
421that are listed on the command line for
e0fe762a 422.BR \-\-create .
2ae555c3
NB
423Setting a value of 1 is probably
424a mistake and so requires that
7e23fc43 425.B \-\-force
2ae555c3 426be specified first. A value of 1 will then be allowed for linear,
e0fe762a 427multipath, RAID0 and RAID1. It is never allowed for RAID4, RAID5 or RAID6.
2ae555c3
NB
428.br
429This number can only be changed using
7e23fc43 430.B \-\-grow
e0fe762a
N
431for RAID1, RAID4, RAID5 and RAID6 arrays, and only on kernels which provide
432the necessary support.
2ae555c3
NB
433
434.TP
7e23fc43 435.BR \-x ", " \-\-spare\-devices=
2ae555c3
NB
436Specify the number of spare (eXtra) devices in the initial array.
437Spares can also be added
438and removed later. The number of component devices listed
e0fe762a 439on the command line must equal the number of RAID devices plus the
2ae555c3
NB
440number of spare devices.
441
2ae555c3 442.TP
7e23fc43 443.BR \-z ", " \-\-size=
e0fe762a 444Amount (in Kibibytes) of space to use from each drive in RAID levels 1/4/5/6.
2ae555c3
NB
445This must be a multiple of the chunk size, and must leave about 128Kb
446of space at the end of the drive for the RAID superblock.
447If this is not specified
448(as it normally is not) the smallest drive (or partition) sets the
449size, though if there is a variance among the drives of greater than 1%, a warning is
450issued.
451
36fad8ec
N
452A suffix of 'M' or 'G' can be given to indicate Megabytes or
453Gigabytes respectively.
454
9ab6e80a
N
455Sometimes a replacement drive can be a little smaller than the
456original drives though this should be minimised by IDEMA standards.
457Such a replacement drive will be rejected by
458.IR md .
459To guard against this it can be useful to set the initial size
460slightly smaller than the smaller device with the aim that it will
461still be larger than any replacement.
462
2ae555c3 463This value can be set with
7e23fc43 464.B \-\-grow
9ab6e80a
N
465for RAID level 1/4/5/6 though
466.B CONTAINER
467based arrays such as those with IMSM metadata may not be able to
468support this.
469If the array was created with a size smaller than the currently
470active drives, the extra space can be accessed using
7e23fc43 471.BR \-\-grow .
2ae555c3
NB
472The size can be given as
473.B max
474which means to choose the largest size that fits on all current drives.
52826846 475
c26d78fe
N
476Before reducing the size of the array (with
477.BR "\-\-grow \-\-size=" )
478you should make sure that space isn't needed. If the device holds a
479filesystem, you would need to resize the filesystem to use less space.
480
481After reducing the array size you should check that the data stored in
482the device is still available. If the device holds a filesystem, then
483an 'fsck' of the filesystem is a minimum requirement. If there are
484problems the array can be made bigger again with no loss with another
485.B "\-\-grow \-\-size="
486command.
487
9ab6e80a 488This value cannot be used when creating a
8fd8d9c4 489.B CONTAINER
9ab6e80a
N
490such as with DDF and IMSM metadata, though it perfectly valid when
491creating an array inside a container.
8fd8d9c4 492
f24e2d6c 493.TP
c26d78fe 494.BR \-Z ", " \-\-array\-size=
f24e2d6c
N
495This is only meaningful with
496.B \-\-grow
36fad8ec 497and its effect is not persistent: when the array is stopped and
f24e2d6c
N
498restarted the default array size will be restored.
499
500Setting the array-size causes the array to appear smaller to programs
501that access the data. This is particularly needed before reshaping an
502array so that it will be smaller. As the reshape is not reversible,
503but setting the size with
504.B \-\-array-size
505is, it is required that the array size is reduced as appropriate
506before the number of devices in the array is reduced.
507
c26d78fe
N
508Before reducing the size of the array you should make sure that space
509isn't needed. If the device holds a filesystem, you would need to
510resize the filesystem to use less space.
511
512After reducing the array size you should check that the data stored in
513the device is still available. If the device holds a filesystem, then
514an 'fsck' of the filesystem is a minimum requirement. If there are
515problems the array can be made bigger again with no loss with another
516.B "\-\-grow \-\-array\-size="
517command.
518
36fad8ec
N
519A suffix of 'M' or 'G' can be given to indicate Megabytes or
520Gigabytes respectively.
521A value of
522.B max
523restores the apparent size of the array to be whatever the real
524amount of available space is.
525
cd29a5c8 526.TP
7e23fc43 527.BR \-c ", " \-\-chunk=
5f175898
N
528Specify chunk size of kibibytes. The default when creating an
529array is 512KB. To ensure compatibility with earlier versions, the
530default when Building and array with no persistent metadata is 64KB.
e0fe762a 531This is only meaningful for RAID0, RAID4, RAID5, RAID6, and RAID10.
52826846 532
a252c078
N
533RAID4, RAID5, RAID6, and RAID10 require the chunk size to be a power
534of 2. In any case it must be a multiple of 4KB.
535
36fad8ec
N
536A suffix of 'M' or 'G' can be given to indicate Megabytes or
537Gigabytes respectively.
538
cd29a5c8 539.TP
7e23fc43 540.BR \-\-rounding=
e0fe762a
N
541Specify rounding factor for a Linear array. The size of each
542component will be rounded down to a multiple of this size.
543This is a synonym for
544.B \-\-chunk
545but highlights the different meaning for Linear as compared to other
5f175898
N
546RAID levels. The default is 64K if a kernel earlier than 2.6.16 is in
547use, and is 0K (i.e. no rounding) in later kernels.
52826846 548
cd29a5c8 549.TP
7e23fc43 550.BR \-l ", " \-\-level=
e0fe762a 551Set RAID level. When used with
7e23fc43 552.BR \-\-create ,
98c6faba 553options are: linear, raid0, 0, stripe, raid1, 1, mirror, raid4, 4,
8fd8d9c4
N
554raid5, 5, raid6, 6, raid10, 10, multipath, mp, faulty, container.
555Obviously some of these are synonymous.
556
557When a
558.B CONTAINER
559metadata type is requested, only the
560.B container
561level is permitted, and it does not need to be explicitly given.
aa88f531
NB
562
563When used with
7e23fc43 564.BR \-\-build ,
a9d69660 565only linear, stripe, raid0, 0, raid1, multipath, mp, and faulty are valid.
52826846 566
fd547b50
N
567Can be used with
568.B \-\-grow
569to change the RAID level in some cases. See LEVEL CHANGES below.
2ae555c3 570
cd29a5c8 571.TP
7e23fc43 572.BR \-p ", " \-\-layout=
f24e2d6c
N
573This option configures the fine details of data layout for RAID5, RAID6,
574and RAID10 arrays, and controls the failure modes for
1a7dfc35
NB
575.IR faulty .
576
e0fe762a 577The layout of the RAID5 parity block can be one of
7e23fc43
PS
578.BR left\-asymmetric ,
579.BR left\-symmetric ,
580.BR right\-asymmetric ,
581.BR right\-symmetric ,
53e8b987
PS
582.BR la ", " ra ", " ls ", " rs .
583The default is
7e23fc43 584.BR left\-symmetric .
52826846 585
cd19c0cf 586It is also possible to cause RAID5 to use a RAID4-like layout by
e0fe762a
N
587choosing
588.BR parity\-first ,
589or
590.BR parity\-last .
591
592Finally for RAID5 there are DDF\-compatible layouts,
593.BR ddf\-zero\-restart ,
594.BR ddf\-N\-restart ,
595and
596.BR ddf\-N\-continue .
597
598These same layouts are available for RAID6. There are also 4 layouts
599that will provide an intermediate stage for converting between RAID5
600and RAID6. These provide a layout which is identical to the
601corresponding RAID5 layout on the first N\-1 devices, and has the 'Q'
602syndrome (the second 'parity' block used by RAID6) on the last device.
603These layouts are:
604.BR left\-symmetric\-6 ,
605.BR right\-symmetric\-6 ,
606.BR left\-asymmetric\-6 ,
607.BR right\-asymmetric\-6 ,
608and
10adfe9a 609.BR parity\-first\-6 .
e0fe762a 610
93e790af
SW
611When setting the failure mode for level
612.I faulty,
1a7dfc35 613the options are:
7e23fc43
PS
614.BR write\-transient ", " wt ,
615.BR read\-transient ", " rt ,
616.BR write\-persistent ", " wp ,
617.BR read\-persistent ", " rp ,
618.BR write\-all ,
619.BR read\-fixable ", " rf ,
53e8b987 620.BR clear ", " flush ", " none .
b5e64645 621
93e790af 622Each failure mode can be followed by a number, which is used as a period
b5e64645
NB
623between fault generation. Without a number, the fault is generated
624once on the first relevant request. With a number, the fault will be
93e790af 625generated after that many requests, and will continue to be generated
b5e64645
NB
626every time the period elapses.
627
628Multiple failure modes can be current simultaneously by using the
7e23fc43 629.B \-\-grow
53e8b987 630option to set subsequent failure modes.
b5e64645
NB
631
632"clear" or "none" will remove any pending or periodic failure modes,
2ae555c3 633and "flush" will clear any persistent faults.
b5e64645 634
6f9a21a7 635Finally, the layout options for RAID10 are one of 'n', 'o' or 'f' followed
93e790af 636by a small number. The default is 'n2'. The supported options are:
1a7dfc35 637
93e790af 638.I 'n'
e0fe762a 639signals 'near' copies. Multiple copies of one data block are at
b578481c
NB
640similar offsets in different devices.
641
93e790af 642.I 'o'
b578481c
NB
643signals 'offset' copies. Rather than the chunks being duplicated
644within a stripe, whole stripes are duplicated but are rotated by one
645device so duplicate blocks are on different devices. Thus subsequent
646copies of a block are in the next drive, and are one chunk further
647down.
648
93e790af 649.I 'f'
1a7dfc35 650signals 'far' copies
93e790af 651(multiple copies have very different offsets).
e0fe762a 652See md(4) for more detail about 'near', 'offset', and 'far'.
1a7dfc35
NB
653
654The number is the number of copies of each datablock. 2 is normal, 3
655can be useful. This number can be at most equal to the number of
656devices in the array. It does not need to divide evenly into that
657number (e.g. it is perfectly legal to have an 'n2' layout for an array
658with an odd number of devices).
659
f24e2d6c
N
660When an array is converted between RAID5 and RAID6 an intermediate
661RAID6 layout is used in which the second parity block (Q) is always on
662the last device. To convert a RAID5 to RAID6 and leave it in this new
663layout (which does not require re-striping) use
664.BR \-\-layout=preserve .
665This will try to avoid any restriping.
666
667The converse of this is
668.B \-\-layout=normalise
669which will change a non-standard RAID6 layout into a more standard
670arrangement.
671
cd29a5c8 672.TP
7e23fc43 673.BR \-\-parity=
53e8b987 674same as
7e23fc43 675.B \-\-layout
53e8b987 676(thus explaining the p of
7e23fc43 677.BR \-p ).
52826846 678
e793c2e5 679.TP
7e23fc43 680.BR \-b ", " \-\-bitmap=
e793c2e5 681Specify a file to store a write-intent bitmap in. The file should not
53e8b987 682exist unless
7e23fc43 683.B \-\-force
53e8b987 684is also given. The same file should be provided
2ae555c3 685when assembling the array. If the word
93e790af 686.B "internal"
2ae555c3
NB
687is given, then the bitmap is stored with the metadata on the array,
688and so is replicated on all devices. If the word
93e790af 689.B "none"
2ae555c3 690is given with
7e23fc43 691.B \-\-grow
2ae555c3 692mode, then any bitmap that is present is removed.
e793c2e5 693
2ae555c3
NB
694To help catch typing errors, the filename must contain at least one
695slash ('/') if it is a real file (not 'internal' or 'none').
696
697Note: external bitmaps are only known to work on ext2 and ext3.
698Storing bitmap files on other filesystems may result in serious problems.
e793c2e5 699
cd29a5c8 700.TP
7e23fc43 701.BR \-\-bitmap\-chunk=
e0fe762a 702Set the chunksize of the bitmap. Each bit corresponds to that many
1bfdbe01
NB
703Kilobytes of storage.
704When using a file based bitmap, the default is to use the smallest
93e790af 705size that is at-least 4 and requires no more than 2^21 chunks.
2ae555c3
NB
706When using an
707.B internal
b8ab2a50
N
708bitmap, the chunksize defaults to 64Meg, or larger if necessary to
709fit the bitmap into the available space.
5787fa49 710
36fad8ec
N
711A suffix of 'M' or 'G' can be given to indicate Megabytes or
712Gigabytes respectively.
713
cd29a5c8 714.TP
7e23fc43 715.BR \-W ", " \-\-write\-mostly
e0fe762a 716subsequent devices listed in a
7e23fc43
PS
717.BR \-\-build ,
718.BR \-\-create ,
2ae555c3 719or
7e23fc43 720.B \-\-add
2ae555c3
NB
721command will be flagged as 'write-mostly'. This is valid for RAID1
722only and means that the 'md' driver will avoid reading from these
723devices if at all possible. This can be useful if mirroring over a
724slow link.
52826846 725
2ae555c3 726.TP
7e23fc43 727.BR \-\-write\-behind=
2ae555c3 728Specify that write-behind mode should be enabled (valid for RAID1
e0fe762a
N
729only). If an argument is specified, it will set the maximum number
730of outstanding writes allowed. The default value is 256.
2ae555c3
NB
731A write-intent bitmap is required in order to use write-behind
732mode, and write-behind is only attempted on drives marked as
733.IR write-mostly .
dd0781e5
NB
734
735.TP
7e23fc43 736.BR \-\-assume\-clean
dd0781e5
NB
737Tell
738.I mdadm
47d79ef8
NB
739that the array pre-existed and is known to be clean. It can be useful
740when trying to recover from a major failure as you can be sure that no
741data will be affected unless you actually write to the array. It can
742also be used when creating a RAID1 or RAID10 if you want to avoid the
b3f1c093 743initial resync, however this practice \(em while normally safe \(em is not
e0fe762a 744recommended. Use this only if you really know what you are doing.
6acad481
ME
745.IP
746When the devices that will be part of a new array were filled
747with zeros before creation the operator knows the array is
748actually clean. If that is the case, such as after running
749badblocks, this argument can be used to tell mdadm the
750facts the operator knows.
ce52f92f
N
751.IP
752When an array is resized to a larger size with
753.B "\-\-grow \-\-size="
754the new space is normally resynced in that same way that the whole
6cbf8fb8 755array is resynced at creation. From Linux version 3.0,
ce52f92f
N
756.B \-\-assume\-clean
757can be used with that command to avoid the automatic resync.
dd0781e5 758
2ae555c3 759.TP
7e23fc43 760.BR \-\-backup\-file=
53e8b987 761This is needed when
7e23fc43 762.B \-\-grow
cd19c0cf
JR
763is used to increase the number of raid-devices in a RAID5 or RAID6 if
764there are no spare devices available, or to shrink, change RAID level
765or layout. See the GROW MODE section below on RAID\-DEVICES CHANGES.
766The file must be stored on a separate device, not on the RAID array
767being reshaped.
2ae555c3 768
40c9a66a
N
769.TP
770.B \-\-data\-offset=
771Arrays with 1.x metadata can leave a gap between the start of the
772device and the start of array data. This gap can be used for various
773metadata. The start of data is known as the
774.IR data\-offset .
775Normally an appropriate data offset is computed automatically.
776However it can be useful to set it explicitly such as when re-creating
777an array which was originally created using a different version of
778.I mdadm
779which computed a different offset.
780
781Setting the offset explicitly over-rides the default. The value given
782is in Kilobytes unless an 'M' or 'G' suffix is given.
783
784Since Linux 3.4,
785.B \-\-data\-offset
786can also be used with
787.B --grow
788for some RAID levels (initially on RAID10). This allows the
72ca9bcf 789data\-offset to be changed as part of the reshape process. When the
40c9a66a
N
790data offset is changed, no backup file is required as the difference
791in offsets is used to provide the same functionality.
792
793When the new offset is earlier than the old offset, the number of
794devices in the array cannot shrink. When it is after the old offset,
795the number of devices in the array cannot increase.
796
72ca9bcf
N
797When creating an array,
798.B \-\-data\-offset
799can be specified as
800.BR variable .
801In the case each member device is expected to have a offset appended
802to the name, separated by a colon. This makes it possible to recreate
803exactly an array which has varying data offsets (as can happen when
804different versions of
805.I mdadm
806are used to add different devices).
807
f211a137
AK
808.TP
809.BR \-\-continue
810This option is complementary to the
811.B \-\-freeze-reshape
812option for assembly. It is needed when
813.B \-\-grow
814operation is interrupted and it is not restarted automatically due to
815.B \-\-freeze-reshape
816usage during array assembly. This option is used together with
817.BR \-G
818, (
819.BR \-\-grow
820) command and device for a pending reshape to be continued.
821All parameters required for reshape continuation will be read from array metadata.
822If initial
823.BR \-\-grow
824command had required
825.BR \-\-backup\-file=
826option to be set, continuation option will require to have exactly the same
827backup file given as well.
828.IP
829Any other parameter passed together with
830.BR \-\-continue
831option will be ignored.
832
947fd4dd 833.TP
7e23fc43 834.BR \-N ", " \-\-name=
947fd4dd
NB
835Set a
836.B name
837for the array. This is currently only effective when creating an
e0fe762a
N
838array with a version-1 superblock, or an array in a DDF container.
839The name is a simple textual string that can be used to identify array
840components when assembling. If name is needed but not specified, it
841is taken from the basename of the device that is being created.
842e.g. when creating
843.I /dev/md/home
844the
845.B name
846will default to
847.IR home .
947fd4dd 848
dd0781e5 849.TP
7e23fc43 850.BR \-R ", " \-\-run
dd0781e5
NB
851Insist that
852.I mdadm
853run the array, even if some of the components
854appear to be active in another array or filesystem. Normally
855.I mdadm
856will ask for confirmation before including such components in an
857array. This option causes that question to be suppressed.
858
859.TP
7e23fc43 860.BR \-f ", " \-\-force
dd0781e5
NB
861Insist that
862.I mdadm
863accept the geometry and layout specified without question. Normally
864.I mdadm
865will not allow creation of an array with only one device, and will try
e0fe762a 866to create a RAID5 array with one missing drive (as this makes the
dd0781e5 867initial resync work faster). With
7e23fc43 868.BR \-\-force ,
dd0781e5
NB
869.I mdadm
870will not try to be so clever.
871
0ea8f5b1
N
872.TP
873.BR \-o ", " \-\-readonly
874Start the array
875.B read only
876rather than read-write as normal. No writes will be allowed to the
877array, and no resync, recovery, or reshape will be started.
878
dd0781e5 879.TP
257c1dc2
N
880.BR \-a ", " "\-\-auto{=yes,md,mdp,part,p}{NN}"
881Instruct mdadm how to create the device file if needed, possibly allocating
48f7b27a 882an unused minor number. "md" causes a non-partitionable array
257c1dc2
N
883to be used (though since Linux 2.6.28, these array devices are in fact
884partitionable). "mdp", "part" or "p" causes a partitionable array (2.6 and
2ae555c3 885later) to be used. "yes" requires the named md device to have
f9c25f1d 886a 'standard' format, and the type and minor number will be determined
257c1dc2
N
887from this. With mdadm 3.0, device creation is normally left up to
888.I udev
889so this option is unlikely to be needed.
890See DEVICE NAMES below.
48f7b27a 891
a9d69660 892The argument can also come immediately after
7e23fc43 893"\-a". e.g. "\-ap".
dd0781e5 894
53e8b987 895If
7e23fc43 896.B \-\-auto
53e8b987 897is not given on the command line or in the config file, then
75723446 898the default will be
7e23fc43 899.BR \-\-auto=yes .
75723446 900
1337546d 901If
7e23fc43 902.B \-\-scan
1337546d
NB
903is also given, then any
904.I auto=
35cc5be4 905entries in the config file will override the
7e23fc43 906.B \-\-auto
1337546d
NB
907instruction given on the command line.
908
dd0781e5
NB
909For partitionable arrays,
910.I mdadm
911will create the device file for the whole array and for the first 4
912partitions. A different number of partitions can be specified at the
913end of this option (e.g.
7e23fc43 914.BR \-\-auto=p7 ).
2ae555c3 915If the device name ends with a digit, the partition names add a 'p',
e0fe762a
N
916and a number, e.g.
917.IR /dev/md/home1p3 .
918If there is no trailing digit, then the partition names just have a
919number added, e.g.
920.IR /dev/md/scratch3 .
dd0781e5 921
48f7b27a
NB
922If the md device name is in a 'standard' format as described in DEVICE
923NAMES, then it will be created, if necessary, with the appropriate
e0fe762a
N
924device number based on that name. If the device name is not in one of these
925formats, then a unused device number will be allocated. The device
48f7b27a
NB
926number will be considered unused if there is no active array for that
927number, and there is no entry in /dev for that number and with a
e0fe762a 928non-standard name. Names that are not in 'standard' format are only
8fd8d9c4
N
929allowed in "/dev/md/".
930
3c7efacb
NK
931This is meaningful with
932.B \-\-create
933or
934.BR \-\-build .
935
3c7efacb
NK
936.TP
937.BR \-a ", " "\-\-add"
938This option can be used in Grow mode in two cases.
939
940If the target array is a Linear array, then
941.B \-\-add
942can be used to add one or more devices to the array. They
943are simply catenated on to the end of the array. Once added, the
944devices cannot be removed.
945
946If the
947.B \-\-raid\-disks
948option is being used to increase the number of devices in an array,
949then
950.B \-\-add
951can be used to add some extra devices to be included in the array.
952In most cases this is not needed as the extra devices can be added as
953spares first, and then the number of raid-disks can be changed.
954However for RAID0, it is not possible to add spares. So to increase
955the number of devices in a RAID0, it is necessary to set the new
956number of devices, and to add the new devices, in the same command.
957
52826846
NB
958.SH For assemble:
959
cd29a5c8 960.TP
7e23fc43 961.BR \-u ", " \-\-uuid=
e0fe762a 962uuid of array to assemble. Devices which don't have this uuid are
cd29a5c8
NB
963excluded
964
965.TP
7e23fc43 966.BR \-m ", " \-\-super\-minor=
cd29a5c8
NB
967Minor number of device that array was created for. Devices which
968don't have this minor number are excluded. If you create an array as
2d465520 969/dev/md1, then all superblocks will contain the minor number 1, even if
cd29a5c8
NB
970the array is later assembled as /dev/md2.
971
d013a55e 972Giving the literal word "dev" for
7e23fc43 973.B \-\-super\-minor
d013a55e
NB
974will cause
975.I mdadm
976to use the minor number of the md device that is being assembled.
977e.g. when assembling
978.BR /dev/md0 ,
51ac42e3 979.B \-\-super\-minor=dev
d013a55e
NB
980will look for super blocks with a minor number of 0.
981
e0fe762a
N
982.B \-\-super\-minor
983is only relevant for v0.90 metadata, and should not normally be used.
984Using
985.B \-\-uuid
986is much safer.
987
947fd4dd 988.TP
7e23fc43 989.BR \-N ", " \-\-name=
947fd4dd 990Specify the name of the array to assemble. This must be the name
624920bb 991that was specified when creating the array. It must either match
93e790af 992the name stored in the superblock exactly, or it must match
41a3b72a 993with the current
624920bb 994.I homehost
93e790af 995prefixed to the start of the given name.
947fd4dd 996
cd29a5c8 997.TP
7e23fc43 998.BR \-f ", " \-\-force
e0fe762a
N
999Assemble the array even if the metadata on some devices appears to be
1000out-of-date. If
1001.I mdadm
1002cannot find enough working devices to start the array, but can find
1003some devices that are recorded as having failed, then it will mark
1004those devices as working so that the array can be started.
1005An array which requires
1006.B \-\-force
1007to be started may contain data corruption. Use it carefully.
52826846 1008
cd29a5c8 1009.TP
7e23fc43 1010.BR \-R ", " \-\-run
b8a8ccf9
NB
1011Attempt to start the array even if fewer drives were given than were
1012present last time the array was active. Normally if not all the
1013expected drives are found and
7e23fc43 1014.B \-\-scan
cd29a5c8
NB
1015is not used, then the array will be assembled but not started.
1016With
7e23fc43 1017.B \-\-run
cd29a5c8 1018an attempt will be made to start it anyway.
52826846 1019
b8a8ccf9 1020.TP
7e23fc43 1021.B \-\-no\-degraded
b8a8ccf9 1022This is the reverse of
7e23fc43 1023.B \-\-run
93e790af 1024in that it inhibits the startup of array unless all expected drives
b8a8ccf9 1025are present. This is only needed with
93e790af
SW
1026.B \-\-scan,
1027and can be used if the physical connections to devices are
b8a8ccf9
NB
1028not as reliable as you would like.
1029
dd0781e5 1030.TP
7e23fc43 1031.BR \-a ", " "\-\-auto{=no,yes,md,mdp,part}"
dd0781e5
NB
1032See this option under Create and Build options.
1033
e793c2e5 1034.TP
7e23fc43 1035.BR \-b ", " \-\-bitmap=
2ae555c3
NB
1036Specify the bitmap file that was given when the array was created. If
1037an array has an
1038.B internal
1039bitmap, there is no need to specify this when assembling the array.
1040
1041.TP
7e23fc43 1042.BR \-\-backup\-file=
2ae555c3 1043If
7e23fc43 1044.B \-\-backup\-file
87f26d14
N
1045was used while reshaping an array (e.g. changing number of devices or
1046chunk size) and the system crashed during the critical section, then the same
7e23fc43 1047.B \-\-backup\-file
53e8b987 1048must be presented to
7e23fc43 1049.B \-\-assemble
cd19c0cf
JR
1050to allow possibly corrupted data to be restored, and the reshape
1051to be completed.
e793c2e5 1052
87f26d14
N
1053.TP
1054.BR \-\-invalid\-backup
1055If the file needed for the above option is not available for any
1056reason an empty file can be given together with this option to
1057indicate that the backup file is invalid. In this case the data that
1058was being rearranged at the time of the crash could be irrecoverably
1059lost, but the rest of the array may still be recoverable. This option
1060should only be used as a last resort if there is no way to recover the
1061backup file.
1062
1063
5787fa49 1064.TP
7e23fc43 1065.BR \-U ", " \-\-update=
5787fa49 1066Update the superblock on each device while assembling the array. The
feb716e9
NB
1067argument given to this flag can be one of
1068.BR sparc2.2 ,
1069.BR summaries ,
7d99579f 1070.BR uuid ,
c4f12c13 1071.BR name ,
0237e0ca 1072.BR homehost ,
e5329c37 1073.BR resync ,
586ed405 1074.BR byteorder ,
bee8ec56 1075.BR devicesize ,
5a31170d 1076.BR no\-bitmap ,
688e99a7
N
1077.BR bbl ,
1078.BR no-\bbl ,
5787fa49 1079or
7e23fc43 1080.BR super\-minor .
5787fa49
NB
1081
1082The
1083.B sparc2.2
7d99579f 1084option will adjust the superblock of an array what was created on a Sparc
5787fa49
NB
1085machine running a patched 2.2 Linux kernel. This kernel got the
1086alignment of part of the superblock wrong. You can use the
7e23fc43 1087.B "\-\-examine \-\-sparc2.2"
5787fa49
NB
1088option to
1089.I mdadm
1090to see what effect this would have.
1091
1092The
7e23fc43 1093.B super\-minor
5787fa49 1094option will update the
2ae555c3 1095.B "preferred minor"
5787fa49 1096field on each superblock to match the minor number of the array being
45c073c9
NB
1097assembled.
1098This can be useful if
7e23fc43 1099.B \-\-examine
45c073c9 1100reports a different "Preferred Minor" to
7e23fc43 1101.BR \-\-detail .
45c073c9 1102In some cases this update will be performed automatically
e0fe762a 1103by the kernel driver. In particular the update happens automatically
45c073c9
NB
1104at the first write to an array with redundancy (RAID level 1 or
1105greater) on a 2.6 (or later) kernel.
5787fa49 1106
7d99579f
NB
1107The
1108.B uuid
1109option will change the uuid of the array. If a UUID is given with the
7e23fc43 1110.B \-\-uuid
53e8b987 1111option that UUID will be used as a new UUID and will
7d99579f
NB
1112.B NOT
1113be used to help identify the devices in the array.
53e8b987 1114If no
7e23fc43 1115.B \-\-uuid
53e8b987 1116is given, a random UUID is chosen.
7d99579f 1117
c4f12c13
NB
1118The
1119.B name
1120option will change the
1121.I name
1122of the array as stored in the superblock. This is only supported for
1123version-1 superblocks.
1124
0237e0ca
NB
1125The
1126.B homehost
1127option will change the
1128.I homehost
1129as recorded in the superblock. For version-0 superblocks, this is the
1130same as updating the UUID.
1131For version-1 superblocks, this involves updating the name.
1132
e5329c37
NB
1133The
1134.B resync
1135option will cause the array to be marked
1136.I dirty
e0fe762a
N
1137meaning that any redundancy in the array (e.g. parity for RAID5,
1138copies for RAID1) may be incorrect. This will cause the RAID system
e5329c37
NB
1139to perform a "resync" pass to make sure that all redundant information
1140is correct.
1141
586ed405
NB
1142The
1143.B byteorder
1144option allows arrays to be moved between machines with different
1145byte-order.
2ae555c3 1146When assembling such an array for the first time after a move, giving
7e23fc43 1147.B "\-\-update=byteorder"
586ed405
NB
1148will cause
1149.I mdadm
1150to expect superblocks to have their byteorder reversed, and will
1151correct that order before assembling the array. This is only valid
2ae555c3 1152with original (Version 0.90) superblocks.
586ed405 1153
feb716e9
NB
1154The
1155.B summaries
e0fe762a 1156option will correct the summaries in the superblock. That is the
feb716e9 1157counts of total, working, active, failed, and spare devices.
5787fa49 1158
bee8ec56
NB
1159The
1160.B devicesize
5a31170d 1161option will rarely be of use. It applies to version 1.1 and 1.2 metadata
bee8ec56
NB
1162only (where the metadata is at the start of the device) and is only
1163useful when the component device has changed size (typically become
1164larger). The version 1 metadata records the amount of the device that
1165can be used to store data, so if a device in a version 1.1 or 1.2
1166array becomes larger, the metadata will still be visible, but the
1167extra space will not. In this case it might be useful to assemble the
1168array with
7e23fc43 1169.BR \-\-update=devicesize .
bee8ec56
NB
1170This will cause
1171.I mdadm
1172to determine the maximum usable amount of space on each device and
1173update the relevant field in the metadata.
1174
5a31170d
N
1175The
1176.B no\-bitmap
1177option can be used when an array has an internal bitmap which is
1178corrupt in some way so that assembling the array normally fails. It
1179will cause any internal bitmap to be ignored.
1180
688e99a7
N
1181The
1182.B bbl
1183option will reserve space in each device for a bad block list. This
1184will be 4K in size and positioned near the end of any free space
1185between the superblock and the data.
1186
1187The
1188.B no\-bbl
1189option will cause any reservation of space for a bad block list to be
1190removed. If the bad block list contains entries, this will fail, as
1191removing the list could cause data corruption.
1192
afd0a969
AK
1193.TP
1194.BR \-\-freeze\-reshape
1195Option is intended to be used in start-up scripts during initrd boot phase.
1196When array under reshape is assembled during initrd phase, this option
1197stops reshape after reshape critical section is being restored. This happens
1198before file system pivot operation and avoids loss of file system context.
1199Losing file system context would cause reshape to be broken.
1200
a6482415
N
1201Reshape can be continued later using the
1202.B \-\-continue
1203option for the grow command.
afd0a969 1204
e0d19036 1205.SH For Manage mode:
52826846 1206
3d5279b0
N
1207.TP
1208.BR \-t ", " \-\-test
1209Unless a more serious error occurred,
1210.I mdadm
1211will exit with a status of 2 if no changes were made to the array and
12120 if at least one change was made.
1213This can be useful when an indirect specifier such as
1214.BR missing ,
1215.B detached
1216or
1217.B faulty
1218is used in requesting an operation on the array.
1219.B \-\-test
1220will report failure if these specifiers didn't find any match.
1221
cd29a5c8 1222.TP
7e23fc43 1223.BR \-a ", " \-\-add
3d5279b0
N
1224hot-add listed devices.
1225If a device appears to have recently been part of the array
342460cb 1226(possibly it failed or was removed) the device is re\-added as described
3d5279b0
N
1227in the next point.
1228If that fails or the device was never part of the array, the device is
1229added as a hot-spare.
1230If the array is degraded, it will immediately start to rebuild data
1231onto that spare.
1232
1233Note that this and the following options are only meaningful on array
1234with redundancy. They don't apply to RAID0 or Linear.
52826846 1235
fe80f49b 1236.TP
7e23fc43 1237.BR \-\-re\-add
3d5279b0
N
1238re\-add a device that was previous removed from an array.
1239If the metadata on the device reports that it is a member of the
1240array, and the slot that it used is still vacant, then the device will
1241be added back to the array in the same position. This will normally
1242cause the data for that device to be recovered. However based on the
1243event count on the device, the recovery may only require sections that
1244are flagged a write-intent bitmap to be recovered or may not require
1245any recovery at all.
1246
1247When used on an array that has no metadata (i.e. it was built with
1248.BR \-\-build)
1249it will be assumed that bitmap-based recovery is enough to make the
1250device fully consistent with the array.
fe80f49b 1251
688e99a7 1252When used with v1.x metadata,
833bb0f8
N
1253.B \-\-re\-add
1254can be accompanied by
688e99a7
N
1255.BR \-\-update=devicesize ,
1256.BR \-\-update=bbl ", or"
1257.BR \-\-update=no\-bbl .
1258See the description of these option when used in Assemble mode for an
1259explanation of their use.
833bb0f8 1260
a4e13010
N
1261If the device name given is
1262.B missing
262e3b7f
N
1263then
1264.I mdadm
1265will try to find any device that looks like it should be
a4e13010
N
1266part of the array but isn't and will try to re\-add all such devices.
1267
262e3b7f
N
1268If the device name given is
1269.B faulty
1270then
1271.I mdadm
1272will find all devices in the array that are marked
1273.BR faulty ,
1274remove them and attempt to immediately re\-add them. This can be
1275useful if you are certain that the reason for failure has been
1276resolved.
1277
cd29a5c8 1278.TP
7e23fc43 1279.BR \-r ", " \-\-remove
2d465520 1280remove listed devices. They must not be active. i.e. they should
b80da661
NB
1281be failed or spare devices. As well as the name of a device file
1282(e.g.
1283.BR /dev/sda1 )
1284the words
1285.B failed
1286and
1287.B detached
1288can be given to
1289.BR \-\-remove .
1290The first causes all failed device to be removed. The second causes
93e790af 1291any device which is no longer connected to the system (i.e an 'open'
b80da661
NB
1292returns
1293.BR ENXIO )
1294to be removed. This will only succeed for devices that are spares or
1295have already been marked as failed.
52826846 1296
cd29a5c8 1297.TP
7e23fc43 1298.BR \-f ", " \-\-fail
70c55e36 1299Mark listed devices as faulty.
b80da661
NB
1300As well as the name of a device file, the word
1301.B detached
1302can be given. This will cause any device that has been detached from
1303the system to be marked as failed. It can then be removed.
52826846 1304
cd29a5c8 1305.TP
7e23fc43 1306.BR \-\-set\-faulty
53e8b987 1307same as
7e23fc43 1308.BR \-\-fail .
52826846 1309
70c55e36
N
1310.TP
1311.B \-\-replace
1312Mark listed devices as requiring replacement. As soon as a spare is
1313available, it will be rebuilt and will replace the marked device.
1314This is similar to marking a device as faulty, but the device remains
1315in service during the recovery process to increase resilience against
1316multiple failures. When the replacement process finishes, the
1317replaced device will be marked as faulty.
1318
1319.TP
1320.B \-\-with
1321This can follow a list of
1322.B \-\-replace
1323devices. The devices listed after
1324.B \-\-with
1325will be preferentially used to replace the devices listed after
1326.BR \-\-replace .
1327These device must already be spare devices in the array.
1328
b3d31955
N
1329.TP
1330.BR \-\-write\-mostly
a4e13010 1331Subsequent devices that are added or re\-added will have the 'write-mostly'
e0fe762a 1332flag set. This is only valid for RAID1 and means that the 'md' driver
b3d31955
N
1333will avoid reading from these devices if possible.
1334.TP
1335.BR \-\-readwrite
a4e13010 1336Subsequent devices that are added or re\-added will have the 'write-mostly'
b3d31955
N
1337flag cleared.
1338
2ae555c3 1339.P
e0fe762a 1340Each of these options requires that the first device listed is the array
93e790af 1341to be acted upon, and the remainder are component devices to be added,
e0fe762a 1342removed, marked as faulty, etc. Several different operations can be
2ae555c3
NB
1343specified for different devices, e.g.
1344.in +5
7e23fc43 1345mdadm /dev/md0 \-\-add /dev/sda1 \-\-fail /dev/sdb1 \-\-remove /dev/sdb1
2ae555c3
NB
1346.in -5
1347Each operation applies to all devices listed until the next
93e790af 1348operation.
2ae555c3
NB
1349
1350If an array is using a write-intent bitmap, then devices which have
a4e13010 1351been removed can be re\-added in a way that avoids a full
93e790af 1352reconstruction but instead just updates the blocks that have changed
2ae555c3
NB
1353since the device was removed. For arrays with persistent metadata
1354(superblocks) this is done automatically. For arrays created with
7e23fc43 1355.B \-\-build
2ae555c3 1356mdadm needs to be told that this device we removed recently with
7e23fc43 1357.BR \-\-re\-add .
2ae555c3
NB
1358
1359Devices can only be removed from an array if they are not in active
93e790af
SW
1360use, i.e. that must be spares or failed devices. To remove an active
1361device, it must first be marked as
1362.B faulty.
2ae555c3
NB
1363
1364.SH For Misc mode:
1365
1366.TP
7e23fc43 1367.BR \-Q ", " \-\-query
2ae555c3
NB
1368Examine a device to see
1369(1) if it is an md device and (2) if it is a component of an md
1370array.
1371Information about what is discovered is presented.
1372
1373.TP
7e23fc43 1374.BR \-D ", " \-\-detail
e0fe762a 1375Print details of one or more md devices.
5787fa49 1376
4cce4069
DW
1377.TP
1378.BR \-\-detail\-platform
e0fe762a 1379Print details of the platform's RAID capabilities (firmware / hardware
9eafa1de
MN
1380topology) for a given metadata format. If used without argument, mdadm
1381will scan all controllers looking for their capabilities. Otherwise, mdadm
1382will only look at the controller specified by the argument in form of an
1383absolute filepath or a link, e.g.
1384.IR /sys/devices/pci0000:00/0000:00:1f.2 .
4cce4069 1385
54bad364
KS
1386.TP
1387.BR \-Y ", " \-\-export
1388When used with
e50cf220 1389.B \-\-detail , \-\-detail-platform
0d726f17
KS
1390or
1391.BR \-\-examine ,
54bad364
KS
1392output will be formatted as
1393.B key=value
1394pairs for easy import into the environment.
1395
2ae555c3 1396.TP
7e23fc43 1397.BR \-E ", " \-\-examine
e0fe762a
N
1398Print contents of the metadata stored on the named device(s).
1399Note the contrast between
1400.B \-\-examine
1401and
1402.BR \-\-detail .
1403.B \-\-examine
1404applies to devices which are components of an array, while
1405.B \-\-detail
1406applies to a whole array which is currently active.
5787fa49 1407.TP
7e23fc43 1408.B \-\-sparc2.2
e0fe762a
N
1409If an array was created on a SPARC machine with a 2.2 Linux kernel
1410patched with RAID support, the superblock will have been created
1411incorrectly, or at least incompatibly with 2.4 and later kernels.
1412Using the
7e23fc43 1413.B \-\-sparc2.2
5787fa49 1414flag with
7e23fc43 1415.B \-\-examine
5787fa49
NB
1416will fix the superblock before displaying it. If this appears to do
1417the right thing, then the array can be successfully assembled using
7e23fc43 1418.BR "\-\-assemble \-\-update=sparc2.2" .
5787fa49 1419
2ae555c3 1420.TP
7e23fc43 1421.BR \-X ", " \-\-examine\-bitmap
2ae555c3 1422Report information about a bitmap file.
01d9299c 1423The argument is either an external bitmap file or an array component
e0fe762a
N
1424in case of an internal bitmap. Note that running this on an array
1425device (e.g.
1426.BR /dev/md0 )
1427does not report the bitmap for that array.
e0d19036 1428
6d388a88
N
1429.TP
1430.B \-\-examine\-badblocks
1431List the bad-blocks recorded for the device, if a bad-blocks list has
1432been configured. Currently only
1433.B 1.x
1434metadata supports bad-blocks lists.
1435
cd29a5c8 1436.TP
7e23fc43 1437.BR \-R ", " \-\-run
e0fe762a
N
1438start a partially assembled array. If
1439.B \-\-assemble
1440did not find enough devices to fully start the array, it might leaving
1441it partially assembled. If you wish, you can then use
1442.B \-\-run
1443to start the array in degraded mode.
52826846 1444
cd29a5c8 1445.TP
7e23fc43 1446.BR \-S ", " \-\-stop
cd29a5c8 1447deactivate array, releasing all resources.
52826846 1448
cd29a5c8 1449.TP
7e23fc43 1450.BR \-o ", " \-\-readonly
cd29a5c8 1451mark array as readonly.
52826846 1452
cd29a5c8 1453.TP
7e23fc43 1454.BR \-w ", " \-\-readwrite
cd29a5c8 1455mark array as readwrite.
52826846 1456
e0d19036 1457.TP
7e23fc43 1458.B \-\-zero\-superblock
e0d19036 1459If the device contains a valid md superblock, the block is
35cc5be4 1460overwritten with zeros. With
7e23fc43 1461.B \-\-force
35cc5be4 1462the block where the superblock would be is overwritten even if it
e0d19036 1463doesn't appear to be valid.
52826846 1464
33414a01
DW
1465.TP
1466.B \-\-kill\-subarray=
1467If the device is a container and the argument to \-\-kill\-subarray
1468specifies an inactive subarray in the container, then the subarray is
1469deleted. Deleting all subarrays will leave an 'empty-container' or
1470spare superblock on the drives. See \-\-zero\-superblock for completely
1471removing a superblock. Note that some formats depend on the subarray
1472index for generating a UUID, this command will fail if it would change
1473the UUID of an active subarray.
1474
aa534678
DW
1475.TP
1476.B \-\-update\-subarray=
1477If the device is a container and the argument to \-\-update\-subarray
1478specifies a subarray in the container, then attempt to update the given
1479superblock field in the subarray. See below in
1480.B MISC MODE
1481for details.
1482
feb716e9 1483.TP
7e23fc43 1484.BR \-t ", " \-\-test
feb716e9 1485When used with
7e23fc43 1486.BR \-\-detail ,
feb716e9
NB
1487the exit status of
1488.I mdadm
e0fe762a
N
1489is set to reflect the status of the device. See below in
1490.B MISC MODE
1491for details.
feb716e9 1492
b90c0e9a 1493.TP
7e23fc43 1494.BR \-W ", " \-\-wait
b90c0e9a
NB
1495For each md device given, wait for any resync, recovery, or reshape
1496activity to finish before returning.
1497.I mdadm
1498will return with success if it actually waited for every device
1499listed, otherwise it will return failure.
1500
1770662b
DW
1501.TP
1502.BR \-\-wait\-clean
fabbfd48
DW
1503For each md device given, or each device in /proc/mdstat if
1504.B \-\-scan
1505is given, arrange for the array to be marked clean as soon as possible.
7146ec6a
DW
1506.I mdadm
1507will return with success if the array uses external metadata and we
1508successfully waited. For native arrays this returns immediately as the
6a0ee6a0
DW
1509kernel handles dirty-clean transitions at shutdown. No action is taken
1510if safe-mode handling is disabled.
1770662b 1511
8382f19b
NB
1512.SH For Incremental Assembly mode:
1513.TP
7e23fc43 1514.BR \-\-rebuild\-map ", " \-r
8382f19b 1515Rebuild the map file
96fd06ed 1516.RB ( {MAP_PATH} )
8382f19b
NB
1517that
1518.I mdadm
1519uses to help track which arrays are currently being assembled.
1520
1521.TP
7e23fc43 1522.BR \-\-run ", " \-R
8382f19b
NB
1523Run any array assembled as soon as a minimal number of devices are
1524available, rather than waiting until all expected devices are present.
1525
1526.TP
7e23fc43 1527.BR \-\-scan ", " \-s
8382f19b 1528Only meaningful with
7e23fc43 1529.B \-R
8382f19b
NB
1530this will scan the
1531.B map
1532file for arrays that are being incrementally assembled and will try to
1533start any that are not already started. If any such array is listed
1534in
1535.B mdadm.conf
1536as requiring an external bitmap, that bitmap will be attached first.
1537
29ba4804
N
1538.TP
1539.BR \-\-fail ", " \-f
1540This allows the hot-plug system to remove devices that have fully disappeared
1541from the kernel. It will first fail and then remove the device from any
1542array it belongs to.
1543The device name given should be a kernel device name such as "sda",
1544not a name in
1545.IR /dev .
1546
210597d1
PC
1547.TP
1548.BR \-\-path=
87eb4fab
N
1549Only used with \-\-fail. The 'path' given will be recorded so that if
1550a new device appears at the same location it can be automatically
1551added to the same array. This allows the failed device to be
1552automatically replaced by a new device without metadata if it appears
1553at specified path. This option is normally only set by a
1554.I udev
1555script.
210597d1 1556
e0d19036
NB
1557.SH For Monitor mode:
1558.TP
7e23fc43 1559.BR \-m ", " \-\-mail
e0d19036
NB
1560Give a mail address to send alerts to.
1561
1562.TP
7e23fc43 1563.BR \-p ", " \-\-program ", " \-\-alert
e0d19036
NB
1564Give a program to be run whenever an event is detected.
1565
773135f5 1566.TP
7e23fc43 1567.BR \-y ", " \-\-syslog
773135f5
NB
1568Cause all events to be reported through 'syslog'. The messages have
1569facility of 'daemon' and varying priorities.
1570
e0d19036 1571.TP
7e23fc43 1572.BR \-d ", " \-\-delay
e0d19036 1573Give a delay in seconds.
51ac42e3 1574.I mdadm
e0d19036 1575polls the md arrays and then waits this many seconds before polling
e0fe762a
N
1576again. The default is 60 seconds. Since 2.6.16, there is no need to
1577reduce this as the kernel alerts
1578.I mdadm
1579immediately when there is any change.
e0d19036 1580
9a36a9b7
ZB
1581.TP
1582.BR \-r ", " \-\-increment
1583Give a percentage increment.
1584.I mdadm
1585will generate RebuildNN events with the given percentage increment.
1586
d013a55e 1587.TP
7e23fc43 1588.BR \-f ", " \-\-daemonise
d013a55e 1589Tell
51ac42e3 1590.I mdadm
d013a55e 1591to run as a background daemon if it decides to monitor anything. This
e0fe762a 1592causes it to fork and run in the child, and to disconnect from the
d013a55e
NB
1593terminal. The process id of the child is written to stdout.
1594This is useful with
7e23fc43 1595.B \-\-scan
d013a55e
NB
1596which will only continue monitoring if a mail address or alert program
1597is found in the config file.
1598
b5e64645 1599.TP
7e23fc43 1600.BR \-i ", " \-\-pid\-file
b5e64645 1601When
51ac42e3 1602.I mdadm
b5e64645
NB
1603is running in daemon mode, write the pid of the daemon process to
1604the specified file, instead of printing it on standard output.
1605
aa88f531 1606.TP
7e23fc43 1607.BR \-1 ", " \-\-oneshot
aa88f531
NB
1608Check arrays only once. This will generate
1609.B NewArray
1610events and more significantly
1611.B DegradedArray
a9d69660
NB
1612and
1613.B SparesMissing
aa88f531
NB
1614events. Running
1615.in +5
7e23fc43 1616.B " mdadm \-\-monitor \-\-scan \-1"
aa88f531
NB
1617.in -5
1618from a cron script will ensure regular notification of any degraded arrays.
1619
98c6faba 1620.TP
7e23fc43 1621.BR \-t ", " \-\-test
98c6faba
NB
1622Generate a
1623.B TestMessage
1624alert for every array found at startup. This alert gets mailed and
1625passed to the alert program. This can be used for testing that alert
a9d69660 1626message do get through successfully.
98c6faba 1627
210597d1
PC
1628.TP
1629.BR \-\-no\-sharing
87eb4fab 1630This inhibits the functionality for moving spares between arrays.
210597d1
PC
1631Only one monitoring process started with
1632.B \-\-scan
87eb4fab
N
1633but without this flag is allowed, otherwise the two could interfere
1634with each other.
210597d1 1635
e0d19036 1636.SH ASSEMBLE MODE
52826846 1637
cd29a5c8
NB
1638.HP 12
1639Usage:
7e23fc43 1640.B mdadm \-\-assemble
5787fa49
NB
1641.I md-device options-and-component-devices...
1642.HP 12
1643Usage:
7e23fc43 1644.B mdadm \-\-assemble \-\-scan
e0fe762a 1645.I md-devices-and-options...
cd29a5c8
NB
1646.HP 12
1647Usage:
7e23fc43 1648.B mdadm \-\-assemble \-\-scan
e0fe762a 1649.I options...
52826846 1650
cd29a5c8 1651.PP
e0fe762a 1652This usage assembles one or more RAID arrays from pre-existing components.
9a9dab36 1653For each array, mdadm needs to know the md device, the identity of the
e0fe762a 1654array, and a number of component-devices. These can be found in a number of ways.
52826846 1655
5787fa49 1656In the first usage example (without the
7e23fc43 1657.BR \-\-scan )
5787fa49
NB
1658the first device given is the md device.
1659In the second usage example, all devices listed are treated as md
1660devices and assembly is attempted.
1661In the third (where no devices are listed) all md devices that are
cb77f620 1662listed in the configuration file are assembled. If no arrays are
e0fe762a
N
1663described by the configuration file, then any arrays that
1664can be found on unused devices will be assembled.
52826846 1665
d013a55e 1666If precisely one device is listed, but
7e23fc43 1667.B \-\-scan
dd0781e5 1668is not given, then
d013a55e
NB
1669.I mdadm
1670acts as though
7e23fc43 1671.B \-\-scan
93e790af 1672was given and identity information is extracted from the configuration file.
d013a55e 1673
2ae555c3 1674The identity can be given with the
7e23fc43 1675.B \-\-uuid
e0fe762a
N
1676option, the
1677.B \-\-name
1678option, or the
7e23fc43 1679.B \-\-super\-minor
93e790af
SW
1680option, will be taken from the md-device record in the config file, or
1681will be taken from the super block of the first component-device
1682listed on the command line.
52826846 1683
2ae555c3 1684Devices can be given on the
7e23fc43 1685.B \-\-assemble
e0fe762a 1686command line or in the config file. Only devices which have an md
5787fa49
NB
1687superblock which contains the right identity will be considered for
1688any array.
52826846 1689
2ae555c3 1690The config file is only used if explicitly named with
7e23fc43 1691.B \-\-config
d013a55e 1692or requested with (a possibly implicit)
7e23fc43 1693.BR \-\-scan .
52826846 1694In the later case,
9a9dab36 1695.B /etc/mdadm.conf
8fd8d9c4
N
1696or
1697.B /etc/mdadm/mdadm.conf
52826846
NB
1698is used.
1699
2ae555c3 1700If
7e23fc43 1701.B \-\-scan
cd29a5c8
NB
1702is not given, then the config file will only be used to find the
1703identity of md arrays.
52826846 1704
2d465520 1705Normally the array will be started after it is assembled. However if
7e23fc43 1706.B \-\-scan
e0fe762a
N
1707is not given and not all expected drives were listed, then the array
1708is not started (to guard against usage errors). To insist that the
1709array be started in this case (as may work for RAID1, 4, 5, 6, or 10),
1710give the
7e23fc43 1711.B \-\-run
cd29a5c8 1712flag.
52826846 1713
e0fe762a
N
1714If
1715.I udev
1716is active,
1717.I mdadm
1718does not create any entries in
dd0781e5 1719.B /dev
e0fe762a
N
1720but leaves that to
1721.IR udev .
1722It does record information in
96fd06ed 1723.B {MAP_PATH}
e0fe762a
N
1724which will allow
1725.I udev
1726to choose the correct name.
dd0781e5 1727
e0fe762a
N
1728If
1729.I mdadm
1730detects that udev is not configured, it will create the devices in
1731.B /dev
1732itself.
dd0781e5 1733
e0fe762a
N
1734In Linux kernels prior to version 2.6.28 there were two distinctly
1735different types of md devices that could be created: one that could be
1736partitioned using standard partitioning tools and one that could not.
1737Since 2.6.28 that distinction is no longer relevant as both type of
1738devices can be partitioned.
1739.I mdadm
1740will normally create the type that originally could not be partitioned
1741as it has a well defined major number (9).
dd0781e5 1742
e0fe762a
N
1743Prior to 2.6.28, it is important that mdadm chooses the correct type
1744of array device to use. This can be controlled with the
1745.B \-\-auto
1746option. In particular, a value of "mdp" or "part" or "p" tells mdadm
1747to use a partitionable device rather than the default.
dd0781e5 1748
e0fe762a
N
1749In the no-udev case, the value given to
1750.B \-\-auto
1751can be suffixed by a number. This tells
1752.I mdadm
1753to create that number of partition devices rather than the default of 4.
dd0781e5 1754
e0fe762a 1755The value given to
7e23fc43 1756.B \-\-auto
e0fe762a
N
1757can also be given in the configuration file as a word starting
1758.B auto=
1759on the ARRAY line for the relevant array.
52826846 1760
41a3b72a
NB
1761.SS Auto Assembly
1762When
7e23fc43 1763.B \-\-assemble
41a3b72a 1764is used with
7e23fc43 1765.B \-\-scan
41a3b72a
NB
1766and no devices are listed,
1767.I mdadm
1768will first attempt to assemble all the arrays listed in the config
1769file.
1770
cb77f620 1771If no arrays are listed in the config (other than those marked
e0fe762a
N
1772.BR <ignore> )
1773it will look through the available devices for possible arrays and
1774will try to assemble anything that it finds. Arrays which are tagged
1775as belonging to the given homehost will be assembled and started
1776normally. Arrays which do not obviously belong to this host are given
1777names that are expected not to conflict with anything local, and are
1778started "read-auto" so that nothing is written to any device until the
1779array is written to. i.e. automatic resync etc is delayed.
41a3b72a
NB
1780
1781If
1782.I mdadm
1783finds a consistent set of devices that look like they should comprise
1784an array, and if the superblock is tagged as belonging to the given
1785home host, it will automatically choose a device name and try to
1786assemble the array. If the array uses version-0.90 metadata, then the
1787.B minor
1788number as recorded in the superblock is used to create a name in
1789.B /dev/md/
1790so for example
1791.BR /dev/md/3 .
1792If the array uses version-1 metadata, then the
1793.B name
1794from the superblock is used to similarly create a name in
e0fe762a 1795.B /dev/md/
93e790af 1796(the name will have any 'host' prefix stripped first).
41a3b72a 1797
c64ba03a
N
1798This behaviour can be modified by the
1799.I AUTO
1800line in the
1801.I mdadm.conf
1802configuration file. This line can indicate that specific metadata
1803type should, or should not, be automatically assembled. If an array
1804is found which is not listed in
1805.I mdadm.conf
1806and has a metadata format that is denied by the
1807.I AUTO
1808line, then it will not be assembled.
1809The
1810.I AUTO
1811line can also request that all arrays identified as being for this
1812homehost should be assembled regardless of their metadata type.
1813See
1814.IR mdadm.conf (5)
1815for further details.
1816
246cebdb
AK
1817Note: Auto assembly cannot be used for assembling and activating some
1818arrays which are undergoing reshape. In particular as the
1819.B backup\-file
1820cannot be given, any reshape which requires a backup-file to continue
1821cannot be started by auto assembly. An array which is growing to more
1822devices and has passed the critical section can be assembled using
1823auto-assembly.
41a3b72a 1824
cd29a5c8 1825.SH BUILD MODE
52826846 1826
cd29a5c8
NB
1827.HP 12
1828Usage:
7e23fc43 1829.B mdadm \-\-build
93e790af 1830.I md-device
7e23fc43
PS
1831.BI \-\-chunk= X
1832.BI \-\-level= Y
1833.BI \-\-raid\-devices= Z
cd29a5c8
NB
1834.I devices
1835
1836.PP
2ae555c3 1837This usage is similar to
7e23fc43 1838.BR \-\-create .
e0fe762a 1839The difference is that it creates an array without a superblock. With
cd29a5c8 1840these arrays there is no difference between initially creating the array and
52826846
NB
1841subsequently assembling the array, except that hopefully there is useful
1842data there in the second case.
1843
e0fe762a
N
1844The level may raid0, linear, raid1, raid10, multipath, or faulty, or
1845one of their synonyms. All devices must be listed and the array will
1846be started once complete. It will often be appropriate to use
1847.B \-\-assume\-clean
1848with levels raid1 or raid10.
cd29a5c8
NB
1849
1850.SH CREATE MODE
1851
1852.HP 12
1853Usage:
7e23fc43 1854.B mdadm \-\-create
93e790af 1855.I md-device
7e23fc43
PS
1856.BI \-\-chunk= X
1857.BI \-\-level= Y
cd29a5c8 1858.br
7e23fc43 1859.BI \-\-raid\-devices= Z
e0fe762a 1860.I devices
cd29a5c8
NB
1861
1862.PP
1863This usage will initialise a new md array, associate some devices with
1864it, and activate the array.
1865
e0fe762a
N
1866The named device will normally not exist when
1867.I "mdadm \-\-create"
1868is run, but will be created by
1869.I udev
1870once the array becomes active.
dd0781e5 1871
e0fe762a
N
1872As devices are added, they are checked to see if they contain RAID
1873superblocks or filesystems. They are also checked to see if the variance in
cd29a5c8
NB
1874device size exceeds 1%.
1875
1876If any discrepancy is found, the array will not automatically be run, though
2ae555c3 1877the presence of a
7e23fc43 1878.B \-\-run
cd29a5c8
NB
1879can override this caution.
1880
2d465520 1881To create a "degraded" array in which some devices are missing, simply
d013a55e 1882give the word "\fBmissing\fP"
2d465520 1883in place of a device name. This will cause
51ac42e3 1884.I mdadm
2d465520
NB
1885to leave the corresponding slot in the array empty.
1886For a RAID4 or RAID5 array at most one slot can be
98c6faba 1887"\fBmissing\fP"; for a RAID6 array at most two slots.
2d465520
NB
1888For a RAID1 array, only one real device needs to be given. All of the
1889others can be
d013a55e 1890"\fBmissing\fP".
2d465520 1891
feb716e9 1892When creating a RAID5 array,
51ac42e3 1893.I mdadm
feb716e9 1894will automatically create a degraded array with an extra spare drive.
e0fe762a
N
1895This is because building the spare into a degraded array is in general
1896faster than resyncing the parity on a non-degraded, but not clean,
1897array. This feature can be overridden with the
7e23fc43 1898.B \-\-force
feb716e9
NB
1899option.
1900
0ee4da98 1901When creating an array with version-1 metadata a name for the array is
41a3b72a
NB
1902required.
1903If this is not given with the
7e23fc43 1904.B \-\-name
41a3b72a
NB
1905option,
1906.I mdadm
0ee4da98 1907will choose a name based on the last component of the name of the
41a3b72a
NB
1908device being created. So if
1909.B /dev/md3
1910is being created, then the name
1911.B 3
1912will be chosen.
1913If
1914.B /dev/md/home
1915is being created, then the name
1916.B home
1917will be used.
1918
e0fe762a
N
1919When creating a partition based array, using
1920.I mdadm
1921with version-1.x metadata, the partition type should be set to
e0f31f50 1922.B 0xDA
e0fe762a 1923(non fs-data). This type selection allows for greater precision since
e0f31f50
PC
1924using any other [RAID auto-detect (0xFD) or a GNU/Linux partition (0x83)],
1925might create problems in the event of array recovery through a live cdrom.
1926
3d3dd91e
NB
1927A new array will normally get a randomly assigned 128bit UUID which is
1928very likely to be unique. If you have a specific need, you can choose
1929a UUID for the array by giving the
7e23fc43 1930.B \-\-uuid=
3d3dd91e
NB
1931option. Be warned that creating two arrays with the same UUID is a
1932recipe for disaster. Also, using
7e23fc43 1933.B \-\-uuid=
3d3dd91e 1934when creating a v0.90 array will silently override any
7e23fc43 1935.B \-\-homehost=
3d3dd91e 1936setting.
e43d0cda
NB
1937.\"If the
1938.\".B \-\-size
1939.\"option is given, it is not necessary to list any component-devices in this command.
1940.\"They can be added later, before a
1941.\".B \-\-run.
1942.\"If no
1943.\".B \-\-size
1944.\"is given, the apparent size of the smallest drive given is used.
cd29a5c8 1945
bf95d0f3
N
1946If the metadata type supports it (currently only 1.x metadata), space
1947will be allocated to store a bad block list. This allows a modest
1948number of bad blocks to be recorded, allowing the drive to remain in
1949service while only partially functional.
1950
8fd8d9c4
N
1951When creating an array within a
1952.B CONTAINER
1953.I mdadm
1954can be given either the list of devices to use, or simply the name of
1955the container. The former case gives control over which devices in
1956the container will be used for the array. The latter case allows
1957.I mdadm
1958to automatically choose which devices to use based on how much spare
1959space is available.
1960
53e8b987 1961The General Management options that are valid with
7e23fc43 1962.B \-\-create
53e8b987 1963are:
cd29a5c8 1964.TP
7e23fc43 1965.B \-\-run
dd0781e5 1966insist on running the array even if some devices look like they might
cd29a5c8
NB
1967be in use.
1968
1969.TP
7e23fc43 1970.B \-\-readonly
b3f1c093 1971start the array readonly \(em not supported yet.
52826846 1972
e0d19036 1973.SH MANAGE MODE
cd29a5c8
NB
1974.HP 12
1975Usage:
e0d19036
NB
1976.B mdadm
1977.I device
1978.I options... devices...
cd29a5c8
NB
1979.PP
1980
e0d19036
NB
1981This usage will allow individual devices in an array to be failed,
1982removed or added. It is possible to perform multiple operations with
e0fe762a 1983on command. For example:
e0d19036 1984.br
7e23fc43 1985.B " mdadm /dev/md0 \-f /dev/hda1 \-r /dev/hda1 \-a /dev/hda1"
e0d19036
NB
1986.br
1987will firstly mark
1988.B /dev/hda1
1989as faulty in
1990.B /dev/md0
1991and will then remove it from the array and finally add it back
2d465520 1992in as a spare. However only one md array can be affected by a single
2ae555c3 1993command.
e0d19036 1994
e0fe762a
N
1995When a device is added to an active array, mdadm checks to see if it
1996has metadata on it which suggests that it was recently a member of the
a4e13010 1997array. If it does, it tries to "re\-add" the device. If there have
e0fe762a
N
1998been no changes since the device was removed, or if the array has a
1999write-intent bitmap which has recorded whatever changes there were,
2000then the device will immediately become a full member of the array and
2001those differences recorded in the bitmap will be resolved.
2002
e0d19036
NB
2003.SH MISC MODE
2004.HP 12
2005Usage:
9a9dab36 2006.B mdadm
e0d19036 2007.I options ...
e0fe762a 2008.I devices ...
e0d19036 2009.PP
cd29a5c8 2010
b5e64645 2011MISC mode includes a number of distinct operations that
e0d19036
NB
2012operate on distinct devices. The operations are:
2013.TP
962a108f 2014.B \-\-query
e0d19036
NB
2015The device is examined to see if it is
2016(1) an active md array, or
2017(2) a component of an md array.
2018The information discovered is reported.
2019
2020.TP
962a108f 2021.B \-\-detail
2d465520 2022The device should be an active md device.
e0fe762a 2023.B mdadm
2d465520 2024will display a detailed description of the array.
7e23fc43 2025.B \-\-brief
2d465520 2026or
7e23fc43 2027.B \-\-scan
2d465520 2028will cause the output to be less detailed and the format to be
e0d19036 2029suitable for inclusion in
87eb4fab 2030.BR mdadm.conf .
feb716e9
NB
2031The exit status of
2032.I mdadm
2033will normally be 0 unless
2034.I mdadm
93e790af 2035failed to get useful information about the device(s); however, if the
7e23fc43 2036.B \-\-test
feb716e9
NB
2037option is given, then the exit status will be:
2038.RS
2039.TP
20400
2041The array is functioning normally.
2042.TP
20431
2044The array has at least one failed device.
2045.TP
20462
a77be586 2047The array has multiple failed devices such that it is unusable.
feb716e9
NB
2048.TP
20494
2050There was an error while trying to get information about the device.
2051.RE
cd29a5c8 2052
4cce4069
DW
2053.TP
2054.B \-\-detail\-platform
e0fe762a 2055Print detail of the platform's RAID capabilities (firmware / hardware
4cce4069
DW
2056topology). If the metadata is specified with
2057.B \-e
2058or
2059.B \-\-metadata=
2060then the return status will be:
2061.RS
2062.TP
20630
2064metadata successfully enumerated its platform components on this system
2065.TP
20661
2067metadata is platform independent
2068.TP
20692
2070metadata failed to find its platform components on this system
2071.RE
2072
aa534678
DW
2073.TP
2074.B \-\-update\-subarray=
2075If the device is a container and the argument to \-\-update\-subarray
2076specifies a subarray in the container, then attempt to update the given
2077superblock field in the subarray. Similar to updating an array in
2078"assemble" mode, the field to update is selected by
2079.B \-U
2080or
2081.B \-\-update=
2082option. Currently only
2083.B name
2084is supported.
2085
2086The
2087.B name
2088option updates the subarray name in the metadata, it may not affect the
2089device node name or the device node symlink until the subarray is
2090re\-assembled. If updating
2091.B name
2092would change the UUID of an active subarray this operation is blocked,
2093and the command will end in an error.
2094
e0d19036 2095.TP
962a108f 2096.B \-\-examine
2d465520 2097The device should be a component of an md array.
51ac42e3 2098.I mdadm
2d465520 2099will read the md superblock of the device and display the contents.
e0d19036 2100If
7e23fc43 2101.B \-\-brief
93e790af 2102or
7e23fc43 2103.B \-\-scan
93e790af 2104is given, then multiple devices that are components of the one array
e0d19036
NB
2105are grouped together and reported in a single entry suitable
2106for inclusion in
87eb4fab 2107.BR mdadm.conf .
e0d19036 2108
2d465520 2109Having
7e23fc43 2110.B \-\-scan
e0d19036
NB
2111without listing any devices will cause all devices listed in the
2112config file to be examined.
2113
2114.TP
962a108f 2115.B \-\-stop
98c6faba
NB
2116The devices should be active md arrays which will be deactivated, as
2117long as they are not currently in use.
e0d19036
NB
2118
2119.TP
962a108f 2120.B \-\-run
e0d19036
NB
2121This will fully activate a partially assembled md array.
2122
2123.TP
962a108f 2124.B \-\-readonly
e0d19036
NB
2125This will mark an active array as read-only, providing that it is
2126not currently being used.
2127
2128.TP
962a108f 2129.B \-\-readwrite
e0d19036
NB
2130This will change a
2131.B readonly
2132array back to being read/write.
2133
2d465520 2134.TP
962a108f 2135.B \-\-scan
2d465520 2136For all operations except
7e23fc43
PS
2137.BR \-\-examine ,
2138.B \-\-scan
2d465520
NB
2139will cause the operation to be applied to all arrays listed in
2140.BR /proc/mdstat .
2141For
7e23fc43
PS
2142.BR \-\-examine,
2143.B \-\-scan
2d465520
NB
2144causes all devices listed in the config file to be examined.
2145
a1331cc4
N
2146.TP
2147.BR \-b ", " \-\-brief
2148Be less verbose. This is used with
2149.B \-\-detail
2150and
2151.BR \-\-examine .
2152Using
2153.B \-\-brief
2154with
2155.B \-\-verbose
2156gives an intermediate level of verbosity.
2157
e0d19036
NB
2158.SH MONITOR MODE
2159
cd29a5c8
NB
2160.HP 12
2161Usage:
7e23fc43 2162.B mdadm \-\-monitor
e0d19036
NB
2163.I options... devices...
2164
cd29a5c8 2165.PP
e0d19036 2166This usage causes
51ac42e3 2167.I mdadm
e0d19036
NB
2168to periodically poll a number of md arrays and to report on any events
2169noticed.
51ac42e3 2170.I mdadm
e0d19036
NB
2171will never exit once it decides that there are arrays to be checked,
2172so it should normally be run in the background.
2173
2d465520 2174As well as reporting events,
51ac42e3 2175.I mdadm
2d465520
NB
2176may move a spare drive from one array to another if they are in the
2177same
2178.B spare-group
210597d1
PC
2179or
2180.B domain
a9d69660 2181and if the destination array has a failed drive but no spares.
2d465520 2182
e0d19036 2183If any devices are listed on the command line,
51ac42e3 2184.I mdadm
e0fe762a 2185will only monitor those devices. Otherwise all arrays listed in the
e0d19036 2186configuration file will be monitored. Further, if
7e23fc43 2187.B \-\-scan
e0d19036
NB
2188is given, then any other md devices that appear in
2189.B /proc/mdstat
2190will also be monitored.
2191
2192The result of monitoring the arrays is the generation of events.
bd526cee 2193These events are passed to a separate program (if specified) and may
2d465520 2194be mailed to a given E-mail address.
e0d19036 2195
93e790af
SW
2196When passing events to a program, the program is run once for each event,
2197and is given 2 or 3 command-line arguments: the first is the
2198name of the event (see below), the second is the name of the
bd526cee 2199md device which is affected, and the third is the name of a related
93e790af 2200device if relevant (such as a component device that has failed).
cd29a5c8
NB
2201
2202If
7e23fc43 2203.B \-\-scan
e0d19036
NB
2204is given, then a program or an E-mail address must be specified on the
2205command line or in the config file. If neither are available, then
51ac42e3 2206.I mdadm
e0d19036
NB
2207will not monitor anything.
2208Without
93e790af 2209.B \-\-scan,
51ac42e3 2210.I mdadm
2d465520 2211will continue monitoring as long as something was found to monitor. If
e0d19036
NB
2212no program or email is given, then each event is reported to
2213.BR stdout .
cd29a5c8 2214
e0d19036
NB
2215The different events are:
2216
2217.RS 4
2218.TP
2219.B DeviceDisappeared
2d465520 2220An md array which previously was configured appears to no longer be
773135f5 2221configured. (syslog priority: Critical)
e0d19036 2222
b8f72a62
NB
2223If
2224.I mdadm
2225was told to monitor an array which is RAID0 or Linear, then it will
2226report
2227.B DeviceDisappeared
2228with the extra information
2229.BR Wrong-Level .
2230This is because RAID0 and Linear do not support the device-failed,
2231hot-spare and resync operations which are monitored.
2232
e0d19036
NB
2233.TP
2234.B RebuildStarted
773135f5 2235An md array started reconstruction. (syslog priority: Warning)
e0d19036
NB
2236
2237.TP
2238.BI Rebuild NN
2239Where
2240.I NN
9a36a9b7
ZB
2241is a two-digit number (ie. 05, 48). This indicates that rebuild
2242has passed that many percent of the total. The events are generated
2243with fixed increment since 0. Increment size may be specified with
2244a commandline option (default is 20). (syslog priority: Warning)
e0d19036 2245
98c6faba
NB
2246.TP
2247.B RebuildFinished
2248An md array that was rebuilding, isn't any more, either because it
773135f5 2249finished normally or was aborted. (syslog priority: Warning)
98c6faba 2250
e0d19036
NB
2251.TP
2252.B Fail
773135f5
NB
2253An active component device of an array has been marked as
2254faulty. (syslog priority: Critical)
e0d19036
NB
2255
2256.TP
2257.B FailSpare
2258A spare component device which was being rebuilt to replace a faulty
93e790af 2259device has failed. (syslog priority: Critical)
e0d19036
NB
2260
2261.TP
2262.B SpareActive
2263A spare component device which was being rebuilt to replace a faulty
98b24a2a 2264device has been successfully rebuilt and has been made active.
773135f5 2265(syslog priority: Info)
e0d19036
NB
2266
2267.TP
2268.B NewArray
2269A new md array has been detected in the
2270.B /proc/mdstat
e0fe762a 2271file. (syslog priority: Info)
e0d19036 2272
aa88f531
NB
2273.TP
2274.B DegradedArray
2275A newly noticed array appears to be degraded. This message is not
2276generated when
2277.I mdadm
2278notices a drive failure which causes degradation, but only when
2279.I mdadm
2280notices that an array is degraded when it first sees the array.
93e790af 2281(syslog priority: Critical)
aa88f531 2282
e0d19036
NB
2283.TP
2284.B MoveSpare
2285A spare drive has been moved from one array in a
2286.B spare-group
210597d1
PC
2287or
2288.B domain
e0d19036 2289to another to allow a failed drive to be replaced.
773135f5 2290(syslog priority: Info)
e0d19036 2291
b8f72a62
NB
2292.TP
2293.B SparesMissing
2294If
2295.I mdadm
2296has been told, via the config file, that an array should have a certain
2297number of spare devices, and
2298.I mdadm
93e790af 2299detects that it has fewer than this number when it first sees the
b8f72a62
NB
2300array, it will report a
2301.B SparesMissing
2302message.
d1732eeb 2303(syslog priority: Warning)
b8f72a62 2304
98c6faba
NB
2305.TP
2306.B TestMessage
2307An array was found at startup, and the
7e23fc43 2308.B \-\-test
98c6faba 2309flag was given.
773135f5 2310(syslog priority: Info)
e0d19036
NB
2311.RE
2312
2313Only
93e790af
SW
2314.B Fail,
2315.B FailSpare,
2316.B DegradedArray,
2317.B SparesMissing
e0d19036 2318and
98c6faba 2319.B TestMessage
e0d19036 2320cause Email to be sent. All events cause the program to be run.
93e790af 2321The program is run with two or three arguments: the event
e0d19036
NB
2322name, the array device and possibly a second device.
2323
2324Each event has an associated array device (e.g.
2325.BR /dev/md1 )
2326and possibly a second device. For
2327.BR Fail ,
2328.BR FailSpare ,
2329and
2330.B SpareActive
2331the second device is the relevant component device.
2332For
2333.B MoveSpare
2334the second device is the array that the spare was moved from.
2335
2336For
51ac42e3 2337.I mdadm
e0d19036 2338to move spares from one array to another, the different arrays need to
93e790af 2339be labeled with the same
e0d19036 2340.B spare-group
210597d1 2341or the spares must be allowed to migrate through matching POLICY domains
e0d19036
NB
2342in the configuration file. The
2343.B spare-group
93e790af 2344name can be any string; it is only necessary that different spare
2d465520 2345groups use different names.
e0d19036
NB
2346
2347When
51ac42e3 2348.I mdadm
93e790af 2349detects that an array in a spare group has fewer active
e0d19036
NB
2350devices than necessary for the complete array, and has no spare
2351devices, it will look for another array in the same spare group that
2352has a full complement of working drive and a spare. It will then
2353attempt to remove the spare from the second drive and add it to the
2354first.
2355If the removal succeeds but the adding fails, then it is added back to
2356the original array.
2357
210597d1
PC
2358If the spare group for a degraded array is not defined,
2359.I mdadm
2360will look at the rules of spare migration specified by POLICY lines in
87eb4fab 2361.B mdadm.conf
210597d1
PC
2362and then follow similar steps as above if a matching spare is found.
2363
dd0781e5
NB
2364.SH GROW MODE
2365The GROW mode is used for changing the size or shape of an active
2366array.
2367For this to work, the kernel must support the necessary change.
c64881d7 2368Various types of growth are being added during 2.6 development.
dd0781e5 2369
c64881d7 2370Currently the supported changes include
dfd4d8ee 2371.IP \(bu 4
c64881d7 2372change the "size" attribute for RAID1, RAID4, RAID5 and RAID6.
dfd4d8ee 2373.IP \(bu 4
c64881d7
N
2374increase or decrease the "raid\-devices" attribute of RAID0, RAID1, RAID4,
2375RAID5, and RAID6.
cb77f620 2376.IP \(bu 4
c64881d7 2377change the chunk-size and layout of RAID0, RAID4, RAID5 and RAID6.
cb77f620 2378.IP \(bu 4
c64881d7 2379convert between RAID1 and RAID5, between RAID5 and RAID6, between
cb77f620 2380RAID0, RAID4, and RAID5, and between RAID0 and RAID10 (in the near-2 mode).
dfd4d8ee 2381.IP \(bu 4
93e790af 2382add a write-intent bitmap to any array which supports these bitmaps, or
2ae555c3 2383remove a write-intent bitmap from such an array.
dfd4d8ee 2384.PP
dd0781e5 2385
9ab6e80a 2386Using GROW on containers is currently supported only for Intel's IMSM
c64881d7
N
2387container format. The number of devices in a container can be
2388increased - which affects all arrays in the container - or an array
2389in a container can be converted between levels where those levels are
2390supported by the container, and the conversion is on of those listed
9ab6e80a
N
2391above. Resizing arrays in an IMSM container with
2392.B "--grow --size"
2393is not yet supported.
8fd8d9c4 2394
ca24ddb0
AK
2395Grow functionality (e.g. expand a number of raid devices) for Intel's
2396IMSM container format has an experimental status. It is guarded by the
2397.B MDADM_EXPERIMENTAL
2398environment variable which must be set to '1' for a GROW command to
2399succeed.
2400This is for the following reasons:
2401
2402.IP 1.
0de8d44d
AK
2403Intel's native IMSM check-pointing is not fully tested yet.
2404This can causes IMSM incompatibility during the grow process: an array
ca24ddb0
AK
2405which is growing cannot roam between Microsoft Windows(R) and Linux
2406systems.
2407
2408.IP 2.
2409Interrupting a grow operation is not recommended, because it
2410has not been fully tested for Intel's IMSM container format yet.
2411
0de8d44d
AK
2412.PP
2413Note: Intel's native checkpointing doesn't use
2414.B --backup-file
2415option and it is transparent for assembly feature.
2416
2ae555c3 2417.SS SIZE CHANGES
c64881d7 2418Normally when an array is built the "size" is taken from the smallest
dd0781e5
NB
2419of the drives. If all the small drives in an arrays are, one at a
2420time, removed and replaced with larger drives, then you could have an
2421array of large drives with only a small amount used. In this
2422situation, changing the "size" with "GROW" mode will allow the extra
2423space to start being used. If the size is increased in this way, a
2424"resync" process will start to make sure the new parts of the array
2425are synchronised.
2426
2427Note that when an array changes size, any filesystem that may be
cb77f620 2428stored in the array will not automatically grow or shrink to use or
88b496c2 2429vacate the space. The
666bba9b
N
2430filesystem will need to be explicitly told to use the extra space
2431after growing, or to reduce its size
2432.B prior
2433to shrinking the array.
dd0781e5 2434
e0fe762a
N
2435Also the size of an array cannot be changed while it has an active
2436bitmap. If an array has a bitmap, it must be removed before the size
cb77f620 2437can be changed. Once the change is complete a new bitmap can be created.
e0fe762a
N
2438
2439.SS RAID\-DEVICES CHANGES
2ae555c3 2440
dd0781e5
NB
2441A RAID1 array can work with any number of devices from 1 upwards
2442(though 1 is not very useful). There may be times which you want to
2443increase or decrease the number of active devices. Note that this is
2444different to hot-add or hot-remove which changes the number of
2445inactive devices.
2446
2447When reducing the number of devices in a RAID1 array, the slots which
2448are to be removed from the array must already be vacant. That is, the
93e790af 2449devices which were in those slots must be failed and removed.
dd0781e5
NB
2450
2451When the number of devices is increased, any hot spares that are
a9d69660 2452present will be activated immediately.
dd0781e5 2453
f24e2d6c 2454Changing the number of active devices in a RAID5 or RAID6 is much more
2ae555c3 2455effort. Every block in the array will need to be read and written
f24e2d6c 2456back to a new location. From 2.6.17, the Linux Kernel is able to
ca4f89a3
N
2457increase the number of devices in a RAID5 safely, including restarting
2458an interrupted "reshape". From 2.6.31, the Linux Kernel is able to
f24e2d6c
N
2459increase or decrease the number of devices in a RAID5 or RAID6.
2460
c64881d7
N
2461From 2.6.35, the Linux Kernel is able to convert a RAID0 in to a RAID4
2462or RAID5.
2463.I mdadm
2464uses this functionality and the ability to add
2465devices to a RAID4 to allow devices to be added to a RAID0. When
2466requested to do this,
2467.I mdadm
2468will convert the RAID0 to a RAID4, add the necessary disks and make
2469the reshape happen, and then convert the RAID4 back to RAID0.
2470
f24e2d6c
N
2471When decreasing the number of devices, the size of the array will also
2472decrease. If there was data in the array, it could get destroyed and
666bba9b
N
2473this is not reversible, so you should firstly shrink the filesystem on
2474the array to fit within the new size. To help prevent accidents,
f24e2d6c
N
2475.I mdadm
2476requires that the size of the array be decreased first with
2477.BR "mdadm --grow --array-size" .
2478This is a reversible change which simply makes the end of the array
2479inaccessible. The integrity of any data can then be checked before
2480the non-reversible reduction in the number of devices is request.
2ae555c3 2481
cd19c0cf
JR
2482When relocating the first few stripes on a RAID5 or RAID6, it is not
2483possible to keep the data on disk completely consistent and
2484crash-proof. To provide the required safety, mdadm disables writes to
2485the array while this "critical section" is reshaped, and takes a
2486backup of the data that is in that section. For grows, this backup may be
2487stored in any spare devices that the array has, however it can also be
2488stored in a separate file specified with the
7e23fc43 2489.B \-\-backup\-file
cd19c0cf
JR
2490option, and is required to be specified for shrinks, RAID level
2491changes and layout changes. If this option is used, and the system
2492does crash during the critical period, the same file must be passed to
7e23fc43 2493.B \-\-assemble
cd19c0cf
JR
2494to restore the backup and reassemble the array. When shrinking rather
2495than growing the array, the reshape is done from the end towards the
2496beginning, so the "critical section" is at the end of the reshape.
2ae555c3 2497
f24e2d6c
N
2498.SS LEVEL CHANGES
2499
2500Changing the RAID level of any array happens instantaneously. However
cd19c0cf 2501in the RAID5 to RAID6 case this requires a non-standard layout of the
f24e2d6c 2502RAID6 data, and in the RAID6 to RAID5 case that non-standard layout is
cd19c0cf 2503required before the change can be accomplished. So while the level
f24e2d6c 2504change is instant, the accompanying layout change can take quite a
cd19c0cf
JR
2505long time. A
2506.B \-\-backup\-file
2507is required. If the array is not simultaneously being grown or
2508shrunk, so that the array size will remain the same - for example,
2509reshaping a 3-drive RAID5 into a 4-drive RAID6 - the backup file will
2510be used not just for a "cricital section" but throughout the reshape
2511operation, as described below under LAYOUT CHANGES.
f24e2d6c
N
2512
2513.SS CHUNK-SIZE AND LAYOUT CHANGES
2514
2515Changing the chunk-size of layout without also changing the number of
2516devices as the same time will involve re-writing all blocks in-place.
2517To ensure against data loss in the case of a crash, a
2518.B --backup-file
2519must be provided for these changes. Small sections of the array will
cd19c0cf
JR
2520be copied to the backup file while they are being rearranged. This
2521means that all the data is copied twice, once to the backup and once
2522to the new layout on the array, so this type of reshape will go very
2523slowly.
f24e2d6c
N
2524
2525If the reshape is interrupted for any reason, this backup file must be
cd19c0cf 2526made available to
f24e2d6c
N
2527.B "mdadm --assemble"
2528so the array can be reassembled. Consequently the file cannot be
2529stored on the device being reshaped.
2530
2531
2ae555c3
NB
2532.SS BITMAP CHANGES
2533
2534A write-intent bitmap can be added to, or removed from, an active
93e790af 2535array. Either internal bitmaps, or bitmaps stored in a separate file,
fe80f49b 2536can be added. Note that if you add a bitmap stored in a file which is
e0fe762a 2537in a filesystem that is on the RAID array being affected, the system
fe80f49b
NB
2538will deadlock. The bitmap must be on a separate filesystem.
2539
8382f19b
NB
2540.SH INCREMENTAL MODE
2541
2542.HP 12
2543Usage:
7e23fc43
PS
2544.B mdadm \-\-incremental
2545.RB [ \-\-run ]
2546.RB [ \-\-quiet ]
8382f19b
NB
2547.I component-device
2548.HP 12
2549Usage:
29ba4804
N
2550.B mdadm \-\-incremental \-\-fail
2551.I component-device
2552.HP 12
2553Usage:
7e6140e6 2554.B mdadm \-\-incremental \-\-rebuild\-map
8382f19b
NB
2555.HP 12
2556Usage:
7e23fc43 2557.B mdadm \-\-incremental \-\-run \-\-scan
8382f19b 2558
8382f19b
NB
2559.PP
2560This mode is designed to be used in conjunction with a device
2561discovery system. As devices are found in a system, they can be
2562passed to
7e23fc43 2563.B "mdadm \-\-incremental"
8382f19b
NB
2564to be conditionally added to an appropriate array.
2565
29ba4804
N
2566Conversely, it can also be used with the
2567.B \-\-fail
2568flag to do just the opposite and find whatever array a particular device
2569is part of and remove the device from that array.
2570
8fd8d9c4
N
2571If the device passed is a
2572.B CONTAINER
2573device created by a previous call to
2574.IR mdadm ,
2575then rather than trying to add that device to an array, all the arrays
2576described by the metadata of the container will be started.
2577
8382f19b
NB
2578.I mdadm
2579performs a number of tests to determine if the device is part of an
93e790af 2580array, and which array it should be part of. If an appropriate array
8382f19b
NB
2581is found, or can be created,
2582.I mdadm
2583adds the device to the array and conditionally starts the array.
2584
2585Note that
2586.I mdadm
87eb4fab
N
2587will normally only add devices to an array which were previously working
2588(active or spare) parts of that array. The support for automatic
210597d1
PC
2589inclusion of a new drive as a spare in some array requires
2590a configuration through POLICY in config file.
8382f19b 2591
8382f19b
NB
2592The tests that
2593.I mdadm
2594makes are as follow:
2595.IP +
2596Is the device permitted by
2597.BR mdadm.conf ?
2598That is, is it listed in a
2599.B DEVICES
2600line in that file. If
2601.B DEVICES
2602is absent then the default it to allow any device. Similar if
2603.B DEVICES
2604contains the special word
2605.B partitions
2606then any device is allowed. Otherwise the device name given to
2607.I mdadm
2608must match one of the names or patterns in a
2609.B DEVICES
2610line.
2611
2612.IP +
cb77f620
NK
2613Does the device have a valid md superblock? If a specific metadata
2614version is requested with
7e23fc43 2615.B \-\-metadata
8382f19b 2616or
7e23fc43 2617.B \-e
8382f19b
NB
2618then only that style of metadata is accepted, otherwise
2619.I mdadm
2620finds any known version of metadata. If no
2621.I md
210597d1
PC
2622metadata is found, the device may be still added to an array
2623as a spare if POLICY allows.
8382f19b 2624
d1302dd8 2625.ig
8382f19b
NB
2626.IP +
2627Does the metadata match an expected array?
2628The metadata can match in two ways. Either there is an array listed
2629in
2630.B mdadm.conf
2631which identifies the array (either by UUID, by name, by device list,
93e790af 2632or by minor-number), or the array was created with a
8382f19b 2633.B homehost
93e790af 2634specified and that
8382f19b 2635.B homehost
93e790af 2636matches the one in
8382f19b
NB
2637.B mdadm.conf
2638or on the command line.
2639If
2640.I mdadm
2641is not able to positively identify the array as belonging to the
2642current host, the device will be rejected.
d1302dd8 2643..
8382f19b 2644
cb77f620 2645.PP
8382f19b 2646.I mdadm
93e790af 2647keeps a list of arrays that it has partially assembled in
96fd06ed 2648.BR {MAP_PATH} .
e0fe762a 2649If no array exists which matches
8382f19b
NB
2650the metadata on the new device,
2651.I mdadm
2652must choose a device name and unit number. It does this based on any
2653name given in
2654.B mdadm.conf
2655or any name information stored in the metadata. If this name
2656suggests a unit number, that number will be used, otherwise a free
2657unit number will be chosen. Normally
2658.I mdadm
2659will prefer to create a partitionable array, however if the
2660.B CREATE
2661line in
2662.B mdadm.conf
2663suggests that a non-partitionable array is preferred, that will be
2664honoured.
2665
e0fe762a
N
2666If the array is not found in the config file and its metadata does not
2667identify it as belonging to the "homehost", then
2668.I mdadm
2669will choose a name for the array which is certain not to conflict with
2670any array which does belong to this host. It does this be adding an
2671underscore and a small number to the name preferred by the metadata.
2672
8382f19b
NB
2673Once an appropriate array is found or created and the device is added,
2674.I mdadm
2675must decide if the array is ready to be started. It will
2676normally compare the number of available (non-spare) devices to the
2677number of devices that the metadata suggests need to be active. If
2678there are at least that many, the array will be started. This means
2679that if any devices are missing the array will not be restarted.
2680
2681As an alternative,
7e23fc43 2682.B \-\-run
8382f19b 2683may be passed to
51ac42e3 2684.I mdadm
8382f19b 2685in which case the array will be run as soon as there are enough
e0fe762a
N
2686devices present for the data to be accessible. For a RAID1, that
2687means one device will start the array. For a clean RAID5, the array
8382f19b
NB
2688will be started as soon as all but one drive is present.
2689
93e790af 2690Note that neither of these approaches is really ideal. If it can
8382f19b
NB
2691be known that all device discovery has completed, then
2692.br
7e23fc43 2693.B " mdadm \-IRs"
8382f19b
NB
2694.br
2695can be run which will try to start all arrays that are being
2696incrementally assembled. They are started in "read-auto" mode in
2697which they are read-only until the first write request. This means
2698that no metadata updates are made and no attempt at resync or recovery
2699happens. Further devices that are found before the first write can
2700still be added safely.
2701
5545fa6d
DW
2702.SH ENVIRONMENT
2703This section describes environment variables that affect how mdadm
2704operates.
2705
2706.TP
2707.B MDADM_NO_MDMON
2708Setting this value to 1 will prevent mdadm from automatically launching
2709mdmon. This variable is intended primarily for debugging mdadm/mdmon.
2710
8fd8d9c4
N
2711.TP
2712.B MDADM_NO_UDEV
2713Normally,
2714.I mdadm
2715does not create any device nodes in /dev, but leaves that task to
2716.IR udev .
2717If
2718.I udev
2719appears not to be configured, or if this environment variable is set
2720to '1', the
2721.I mdadm
2722will create and devices that are needed.
2723
2d465520
NB
2724.SH EXAMPLES
2725
7e23fc43 2726.B " mdadm \-\-query /dev/name-of-device"
2d465520 2727.br
e0fe762a 2728This will find out if a given device is a RAID array, or is part of
5787fa49 2729one, and will provide brief information about the device.
2d465520 2730
7e23fc43 2731.B " mdadm \-\-assemble \-\-scan"
2d465520 2732.br
93e790af 2733This will assemble and start all arrays listed in the standard config
5787fa49 2734file. This command will typically go in a system startup file.
2d465520 2735
7e23fc43 2736.B " mdadm \-\-stop \-\-scan"
5787fa49 2737.br
93e790af 2738This will shut down all arrays that can be shut down (i.e. are not
19f8b8fc 2739currently in use). This will typically go in a system shutdown script.
2d465520 2740
7e23fc43 2741.B " mdadm \-\-follow \-\-scan \-\-delay=120"
2d465520 2742.br
5787fa49
NB
2743If (and only if) there is an Email address or program given in the
2744standard config file, then
2745monitor the status of all arrays listed in that file by
2746polling them ever 2 minutes.
2d465520 2747
7e23fc43 2748.B " mdadm \-\-create /dev/md0 \-\-level=1 \-\-raid\-devices=2 /dev/hd[ac]1"
2d465520 2749.br
5787fa49 2750Create /dev/md0 as a RAID1 array consisting of /dev/hda1 and /dev/hdc1.
2d465520 2751
2d465520 2752.br
7e23fc43 2753.B " echo 'DEVICE /dev/hd*[0\-9] /dev/sd*[0\-9]' > mdadm.conf"
2d465520 2754.br
7e23fc43 2755.B " mdadm \-\-detail \-\-scan >> mdadm.conf"
2d465520 2756.br
5787fa49
NB
2757This will create a prototype config file that describes currently
2758active arrays that are known to be made from partitions of IDE or SCSI drives.
2d465520
NB
2759This file should be reviewed before being used as it may
2760contain unwanted detail.
2761
7e23fc43 2762.B " echo 'DEVICE /dev/hd[a\-z] /dev/sd*[a\-z]' > mdadm.conf"
2d465520 2763.br
7e23fc43 2764.B " mdadm \-\-examine \-\-scan \-\-config=mdadm.conf >> mdadm.conf"
93e790af
SW
2765.br
2766This will find arrays which could be assembled from existing IDE and
2767SCSI whole drives (not partitions), and store the information in the
5787fa49 2768format of a config file.
2d465520
NB
2769This file is very likely to contain unwanted detail, particularly
2770the
2771.B devices=
5787fa49
NB
2772entries. It should be reviewed and edited before being used as an
2773actual config file.
2d465520 2774
7e23fc43 2775.B " mdadm \-\-examine \-\-brief \-\-scan \-\-config=partitions"
2d465520 2776.br
7e23fc43 2777.B " mdadm \-Ebsc partitions"
5787fa49
NB
2778.br
2779Create a list of devices by reading
2780.BR /proc/partitions ,
2781scan these for RAID superblocks, and printout a brief listing of all
93e790af 2782that were found.
2d465520 2783
7e23fc43 2784.B " mdadm \-Ac partitions \-m 0 /dev/md0"
2d465520 2785.br
5787fa49
NB
2786Scan all partitions and devices listed in
2787.BR /proc/partitions
2788and assemble
2789.B /dev/md0
2790out of all such devices with a RAID superblock with a minor number of 0.
2d465520 2791
96fd06ed 2792.B " mdadm \-\-monitor \-\-scan \-\-daemonise > /run/mdadm/mon.pid"
d013a55e
NB
2793.br
2794If config file contains a mail address or alert program, run mdadm in
2795the background in monitor mode monitoring all md devices. Also write
2796pid of mdadm daemon to
96fd06ed 2797.BR /run/mdadm/mon.pid .
d013a55e 2798
7e23fc43 2799.B " mdadm \-Iq /dev/somedevice"
8382f19b
NB
2800.br
2801Try to incorporate newly discovered device into some array as
2802appropriate.
2803
7e6140e6 2804.B " mdadm \-\-incremental \-\-rebuild\-map \-\-run \-\-scan"
8382f19b
NB
2805.br
2806Rebuild the array map from any current arrays, and then start any that
2807can be started.
2808
b80da661
NB
2809.B " mdadm /dev/md4 --fail detached --remove detached"
2810.br
2811Any devices which are components of /dev/md4 will be marked as faulty
2812and then remove from the array.
2813
cb77f620 2814.B " mdadm --grow /dev/md4 --level=6 --backup-file=/root/backup-md4"
f24e2d6c
N
2815.br
2816The array
2817.B /dev/md4
2818which is currently a RAID5 array will be converted to RAID6. There
2819should normally already be a spare drive attached to the array as a
2820RAID6 needs one more drive than a matching RAID5.
2821
8fd8d9c4
N
2822.B " mdadm --create /dev/md/ddf --metadata=ddf --raid-disks 6 /dev/sd[a-f]"
2823.br
2824Create a DDF array over 6 devices.
2825
2826.B " mdadm --create /dev/md/home -n3 -l5 -z 30000000 /dev/md/ddf"
2827.br
e0fe762a 2828Create a RAID5 array over any 3 devices in the given DDF set. Use
8fd8d9c4
N
2829only 30 gigabytes of each device.
2830
2831.B " mdadm -A /dev/md/ddf1 /dev/sd[a-f]"
2832.br
2833Assemble a pre-exist ddf array.
2834
2835.B " mdadm -I /dev/md/ddf1"
2836.br
2837Assemble all arrays contained in the ddf array, assigning names as
2838appropriate.
2839
7e23fc43 2840.B " mdadm \-\-create \-\-help"
2d465520 2841.br
2ae555c3 2842Provide help about the Create mode.
2d465520 2843
7e23fc43 2844.B " mdadm \-\-config \-\-help"
5787fa49
NB
2845.br
2846Provide help about the format of the config file.
2d465520 2847
7e23fc43 2848.B " mdadm \-\-help"
5787fa49
NB
2849.br
2850Provide general help.
cd29a5c8 2851
cd29a5c8
NB
2852.SH FILES
2853
2854.SS /proc/mdstat
2855
2ae555c3
NB
2856If you're using the
2857.B /proc
cd29a5c8
NB
2858filesystem,
2859.B /proc/mdstat
2d465520 2860lists all active md devices with information about them.
51ac42e3 2861.I mdadm
2d465520 2862uses this to find arrays when
7e23fc43 2863.B \-\-scan
2d465520
NB
2864is given in Misc mode, and to monitor array reconstruction
2865on Monitor mode.
2866
9a9dab36 2867.SS /etc/mdadm.conf
cd29a5c8 2868
11a3e71d
NB
2869The config file lists which devices may be scanned to see if
2870they contain MD super block, and gives identifying information
2871(e.g. UUID) about known MD arrays. See
2872.BR mdadm.conf (5)
2873for more details.
cd29a5c8 2874
96fd06ed 2875.SS {MAP_PATH}
8382f19b 2876When
7e23fc43 2877.B \-\-incremental
93e790af 2878mode is used, this file gets a list of arrays currently being created.
8382f19b 2879
48f7b27a
NB
2880.SH DEVICE NAMES
2881
48f7b27a 2882.I mdadm
8fd8d9c4
N
2883understand two sorts of names for array devices.
2884
2885The first is the so-called 'standard' format name, which matches the
2886names used by the kernel and which appear in
2887.IR /proc/mdstat .
2888
2889The second sort can be freely chosen, but must reside in
2890.IR /dev/md/ .
2891When giving a device name to
2892.I mdadm
2893to create or assemble an array, either full path name such as
2894.I /dev/md0
2895or
2896.I /dev/md/home
2897can be given, or just the suffix of the second sort of name, such as
2898.I home
2899can be given.
2900
2901When
2902.I mdadm
e0fe762a
N
2903chooses device names during auto-assembly or incremental assembly, it
2904will sometimes add a small sequence number to the end of the name to
2905avoid conflicted between multiple arrays that have the same name. If
8fd8d9c4
N
2906.I mdadm
2907can reasonably determine that the array really is meant for this host,
2908either by a hostname in the metadata, or by the presence of the array
87eb4fab
N
2909in
2910.BR mdadm.conf ,
2911then it will leave off the suffix if possible.
e0fe762a
N
2912Also if the homehost is specified as
2913.B <ignore>
2914.I mdadm
2915will only use a suffix if a different array of the same name already
2916exists or is listed in the config file.
48f7b27a
NB
2917
2918The standard names for non-partitioned arrays (the only sort of md
8fd8d9c4 2919array available in 2.4 and earlier) are of the form
48f7b27a
NB
2920.IP
2921/dev/mdNN
48f7b27a
NB
2922.PP
2923where NN is a number.
2924The standard names for partitionable arrays (as available from 2.6
8fd8d9c4 2925onwards) are of the form
48f7b27a 2926.IP
48f7b27a
NB
2927/dev/md_dNN
2928.PP
2929Partition numbers should be indicated by added "pMM" to these, thus "/dev/md/d1p2".
8fd8d9c4
N
2930.PP
2931From kernel version, 2.6.28 the "non-partitioned array" can actually
2932be partitioned. So the "md_dNN" names are no longer needed, and
2933partitions such as "/dev/mdNNpXX" are possible.
52826846 2934
2d465520 2935.SH NOTE
51ac42e3 2936.I mdadm
2d465520 2937was previously known as
51ac42e3 2938.IR mdctl .
a9d69660 2939.P
51ac42e3 2940.I mdadm
a9d69660 2941is completely separate from the
51ac42e3 2942.I raidtools
a9d69660
NB
2943package, and does not use the
2944.I /etc/raidtab
2945configuration file at all.
2946
52826846 2947.SH SEE ALSO
75f74377 2948For further information on mdadm usage, MD and the various levels of
3cdfb6a7 2949RAID, see:
3cdfb6a7 2950.IP
cb77f620 2951.B http://raid.wiki.kernel.org/
75f74377
DG
2952.PP
2953(based upon Jakob \(/Ostergaard's Software\-RAID.HOWTO)
e43d0cda
NB
2954.\".PP
2955.\"for new releases of the RAID driver check out:
2956.\"
2957.\".IP
e0fe762a 2958.\".UR ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
e43d0cda
NB
2959.\"ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
2960.\".UE
2961.\".PP
2962.\"or
2963.\".IP
2964.\".UR http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2965.\"http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2966.\".UE
cd29a5c8 2967.PP
2ae555c3 2968The latest version of
a9d69660
NB
2969.I mdadm
2970should always be available from
cd29a5c8 2971.IP
11cd8b79
N
2972.B http://www.kernel.org/pub/linux/utils/raid/mdadm/
2973.PP
2974Related man pages:
cd29a5c8 2975.PP
e0fe762a 2976.IR mdmon (8),
a9d69660
NB
2977.IR mdadm.conf (5),
2978.IR md (4).
56eb10c0 2979.PP
52826846
NB
2980.IR raidtab (5),
2981.IR raid0run (8),
2982.IR raidstop (8),
a9d69660 2983.IR mkraid (8).