]> git.ipfire.org Git - thirdparty/mdadm.git/blame - mdadm.8.in
Allow data-offset to be specified per-device for create
[thirdparty/mdadm.git] / mdadm.8.in
CommitLineData
52826846 1.\" -*- nroff -*-
e43d0cda
NB
2.\" Copyright Neil Brown and others.
3.\" This program is free software; you can redistribute it and/or modify
4.\" it under the terms of the GNU General Public License as published by
5.\" the Free Software Foundation; either version 2 of the License, or
6.\" (at your option) any later version.
7.\" See file COPYING in distribution for details.
3b2aad6e 8.TH MDADM 8 "" v3.2.5
52826846 9.SH NAME
9a9dab36 10mdadm \- manage MD devices
cd29a5c8 11.I aka
93e790af 12Linux Software RAID
cd29a5c8 13
52826846
NB
14.SH SYNOPSIS
15
e0d19036 16.BI mdadm " [mode] <raiddevice> [options] <component-devices>"
52826846 17
2ae555c3 18.SH DESCRIPTION
52826846 19RAID devices are virtual devices created from two or more
e0fe762a 20real block devices. This allows multiple devices (typically disk
35cc5be4 21drives or partitions thereof) to be combined into a single device to
cd29a5c8 22hold (for example) a single filesystem.
2d465520 23Some RAID levels include redundancy and so can survive some degree of
cd29a5c8
NB
24device failure.
25
2d465520
NB
26Linux Software RAID devices are implemented through the md (Multiple
27Devices) device driver.
cd29a5c8
NB
28
29Currently, Linux supports
30.B LINEAR
31md devices,
32.B RAID0
33(striping),
34.B RAID1
35(mirroring),
d013a55e
NB
36.BR RAID4 ,
37.BR RAID5 ,
98c6faba 38.BR RAID6 ,
1a7dfc35 39.BR RAID10 ,
b5e64645 40.BR MULTIPATH ,
90c8d668 41.BR FAULTY ,
cd29a5c8 42and
90c8d668 43.BR CONTAINER .
d013a55e 44
a9d69660
NB
45.B MULTIPATH
46is not a Software RAID mechanism, but does involve
93e790af 47multiple devices:
d013a55e 48each device is a path to one common physical storage device.
9652457e
N
49New installations should not use md/multipath as it is not well
50supported and has no ongoing development. Use the Device Mapper based
51multipath-tools instead.
d013a55e 52
a9d69660
NB
53.B FAULTY
54is also not true RAID, and it only involves one device. It
b5e64645 55provides a layer over a true device that can be used to inject faults.
52826846 56
4cce4069 57.B CONTAINER
8fd8d9c4
N
58is different again. A
59.B CONTAINER
60is a collection of devices that are
90c8d668
N
61managed as a set. This is similar to the set of devices connected to
62a hardware RAID controller. The set of devices may contain a number
9652457e 63of different RAID arrays each utilising some (or all) of the blocks from a
90c8d668 64number of the devices in the set. For example, two devices in a 5-device set
9652457e 65might form a RAID1 using the whole devices. The remaining three might
90c8d668
N
66have a RAID5 over the first half of each device, and a RAID0 over the
67second half.
68
8fd8d9c4
N
69With a
70.BR CONTAINER ,
71there is one set of metadata that describes all of
72the arrays in the container. So when
73.I mdadm
74creates a
75.B CONTAINER
9652457e
N
76device, the device just represents the metadata. Other normal arrays (RAID1
77etc) can be created inside the container.
52826846
NB
78
79.SH MODES
8382f19b 80mdadm has several major modes of operation:
cd29a5c8
NB
81.TP
82.B Assemble
93e790af 83Assemble the components of a previously created
e0fe762a 84array into an active array. Components can be explicitly given
2ae555c3 85or can be searched for.
51ac42e3 86.I mdadm
cd29a5c8
NB
87checks that the components
88do form a bona fide array, and can, on request, fiddle superblock
89information so as to assemble a faulty array.
90
91.TP
92.B Build
e0fe762a 93Build an array that doesn't have per-device metadata (superblocks). For these
a9d69660
NB
94sorts of arrays,
95.I mdadm
96cannot differentiate between initial creation and subsequent assembly
97of an array. It also cannot perform any checks that appropriate
93e790af 98components have been requested. Because of this, the
a9d69660
NB
99.B Build
100mode should only be used together with a complete understanding of
101what you are doing.
cd29a5c8
NB
102
103.TP
104.B Create
e0fe762a
N
105Create a new array with per-device metadata (superblocks).
106Appropriate metadata is written to each device, and then the array
107comprising those devices is activated. A 'resync' process is started
108to make sure that the array is consistent (e.g. both sides of a mirror
109contain the same data) but the content of the device is left otherwise
110untouched.
111The array can be used as soon as it has been created. There is no
112need to wait for the initial resync to finish.
cd29a5c8 113
cd29a5c8
NB
114.TP
115.B "Follow or Monitor"
5787fa49 116Monitor one or more md devices and act on any state changes. This is
e0fe762a
N
117only meaningful for RAID1, 4, 5, 6, 10 or multipath arrays, as
118only these have interesting state. RAID0 or Linear never have
98c6faba 119missing, spare, or failed drives, so there is nothing to monitor.
5787fa49 120
dd0781e5
NB
121.TP
122.B "Grow"
123Grow (or shrink) an array, or otherwise reshape it in some way.
124Currently supported growth options including changing the active size
c64881d7
N
125of component devices and changing the number of active devices in
126Linear and RAID levels 0/1/4/5/6,
127changing the RAID level between 0, 1, 5, and 6, and between 0 and 10,
128changing the chunk size and layout for RAID 0,4,5,6, as well as adding or
f24e2d6c 129removing a write-intent bitmap.
cd29a5c8 130
8382f19b
NB
131.TP
132.B "Incremental Assembly"
133Add a single device to an appropriate array. If the addition of the
134device makes the array runnable, the array will be started.
135This provides a convenient interface to a
136.I hot-plug
137system. As each device is detected,
138.I mdadm
139has a chance to include it in some array as appropriate.
29ba4804
N
140Optionally, when the
141.I \-\-fail
142flag is passed in we will remove the device from any active array
143instead of adding it.
9652457e 144
8fd8d9c4
N
145If a
146.B CONTAINER
147is passed to
148.I mdadm
149in this mode, then any arrays within that container will be assembled
150and started.
8382f19b 151
2ae555c3
NB
152.TP
153.B Manage
154This is for doing things to specific components of an array such as
155adding new spares and removing faulty devices.
156
157.TP
158.B Misc
159This is an 'everything else' mode that supports operations on active
160arrays, operations on component devices such as erasing old superblocks, and
161information gathering operations.
e43d0cda
NB
162.\"This mode allows operations on independent devices such as examine MD
163.\"superblocks, erasing old superblocks and stopping active arrays.
2ae555c3 164
1f48664b
NB
165.TP
166.B Auto-detect
167This mode does not act on a specific device or array, but rather it
168requests the Linux Kernel to activate any auto-detected arrays.
52826846
NB
169.SH OPTIONS
170
2ae555c3 171.SH Options for selecting a mode are:
52826846 172
cd29a5c8 173.TP
7e23fc43 174.BR \-A ", " \-\-assemble
2d465520 175Assemble a pre-existing array.
52826846 176
cd29a5c8 177.TP
7e23fc43 178.BR \-B ", " \-\-build
cd29a5c8 179Build a legacy array without superblocks.
52826846 180
cd29a5c8 181.TP
7e23fc43 182.BR \-C ", " \-\-create
cd29a5c8 183Create a new array.
52826846 184
cd29a5c8 185.TP
7e23fc43 186.BR \-F ", " \-\-follow ", " \-\-monitor
cd29a5c8
NB
187Select
188.B Monitor
189mode.
52826846 190
dd0781e5 191.TP
7e23fc43 192.BR \-G ", " \-\-grow
dd0781e5 193Change the size or shape of an active array.
8382f19b
NB
194
195.TP
1f48664b 196.BR \-I ", " \-\-incremental
29ba4804 197Add/remove a single device to/from an appropriate array, and possibly start the array.
8382f19b 198
1f48664b
NB
199.TP
200.B \-\-auto-detect
201Request that the kernel starts any auto-detected arrays. This can only
202work if
203.I md
204is compiled into the kernel \(em not if it is a module.
205Arrays can be auto-detected by the kernel if all the components are in
206primary MS-DOS partitions with partition type
e0fe762a
N
207.BR FD ,
208and all use v0.90 metadata.
1f48664b
NB
209In-kernel autodetect is not recommended for new installations. Using
210.I mdadm
211to detect and assemble arrays \(em possibly in an
212.I initrd
213\(em is substantially more flexible and should be preferred.
214
2ae555c3
NB
215.P
216If a device is given before any options, or if the first option is
7e23fc43
PS
217.BR \-\-add ,
218.BR \-\-fail ,
2ae555c3 219or
7e23fc43 220.BR \-\-remove ,
e0fe762a 221then the MANAGE mode is assumed.
2ae555c3
NB
222Anything other than these will cause the
223.B Misc
224mode to be assumed.
dd0781e5 225
2ae555c3 226.SH Options that are not mode-specific are:
e793c2e5 227
cd29a5c8 228.TP
7e23fc43 229.BR \-h ", " \-\-help
a9d69660 230Display general help message or, after one of the above options, a
93e790af 231mode-specific help message.
56eedc1a
NB
232
233.TP
7e23fc43 234.B \-\-help\-options
56eedc1a
NB
235Display more detailed help about command line parsing and some commonly
236used options.
52826846 237
cd29a5c8 238.TP
7e23fc43 239.BR \-V ", " \-\-version
9a9dab36 240Print version information for mdadm.
52826846 241
cd29a5c8 242.TP
7e23fc43 243.BR \-v ", " \-\-verbose
22892d56
NB
244Be more verbose about what is happening. This can be used twice to be
245extra-verbose.
a9d69660 246The extra verbosity currently only affects
7e23fc43 247.B \-\-detail \-\-scan
22892d56 248and
7e23fc43 249.BR "\-\-examine \-\-scan" .
52826846 250
dab6685f 251.TP
7e23fc43 252.BR \-q ", " \-\-quiet
dab6685f 253Avoid printing purely informative messages. With this,
51ac42e3 254.I mdadm
dab6685f
NB
255will be silent unless there is something really important to report.
256
08ca2adf
JS
257.TP
258.BR \-\-offroot
259Set first character of argv[0] to @ to indicate mdadm was launched
260from initrd/initramfs and should not be shutdown by systemd as part of
261the regular shutdown process. This option is normally only used by
262the system's initscripts. Please see here for more details on how
263systemd handled argv[0]:
264.IP
265.B http://www.freedesktop.org/wiki/Software/systemd/RootStorageDaemons
266.PP
267
268
e0d19036 269.TP
7e23fc43 270.BR \-f ", " \-\-force
93e790af 271Be more forceful about certain operations. See the various modes for
e0d19036
NB
272the exact meaning of this option in different contexts.
273
274.TP
7e23fc43 275.BR \-c ", " \-\-config=
2ae555c3
NB
276Specify the config file. Default is to use
277.BR /etc/mdadm.conf ,
93e790af 278or if that is missing then
2ae555c3 279.BR /etc/mdadm/mdadm.conf .
5787fa49 280If the config file given is
93e790af 281.B "partitions"
5787fa49
NB
282then nothing will be read, but
283.I mdadm
284will act as though the config file contained exactly
8fd8d9c4 285.B "DEVICE partitions containers"
5787fa49
NB
286and will read
287.B /proc/partitions
8fd8d9c4
N
288to find a list of devices to scan, and
289.B /proc/mdstat
290to find a list of containers to examine.
d013a55e 291If the word
93e790af 292.B "none"
d013a55e
NB
293is given for the config file, then
294.I mdadm
295will act as though the config file were empty.
e0d19036
NB
296
297.TP
7e23fc43 298.BR \-s ", " \-\-scan
93e790af 299Scan config file or
e0d19036
NB
300.B /proc/mdstat
301for missing information.
302In general, this option gives
51ac42e3 303.I mdadm
93e790af
SW
304permission to get any missing information (like component devices,
305array devices, array identities, and alert destination) from the
306configuration file (see previous option);
307one exception is MISC mode when using
7e23fc43 308.B \-\-detail
e0d19036 309or
93e790af 310.B \-\-stop,
e0d19036 311in which case
7e23fc43 312.B \-\-scan
e0d19036
NB
313says to get a list of array devices from
314.BR /proc/mdstat .
315
570c0542 316.TP
d16c7af6 317.BR \-e ", " \-\-metadata=
e0fe762a 318Declare the style of RAID metadata (superblock) to be used. The
26f467a9 319default is {DEFAULT_METADATA} for
7e23fc43 320.BR \-\-create ,
53e8b987 321and to guess for other operations.
2790ffe3
GB
322The default can be overridden by setting the
323.B metadata
324value for the
325.B CREATE
326keyword in
327.BR mdadm.conf .
570c0542
NB
328
329Options are:
330.RS
26f467a9 331.ie '{DEFAULT_METADATA}'0.90'
332.IP "0, 0.90, default"
333.el
7d5c3964 334.IP "0, 0.90"
26f467a9 335..
570c0542 336Use the original 0.90 format superblock. This format limits arrays to
93e790af 33728 component devices and limits component devices of levels 1 and
cd19c0cf
JR
338greater to 2 terabytes. It is also possible for there to be confusion
339about whether the superblock applies to a whole device or just the
340last partition, if that partition starts on a 64K boundary.
26f467a9 341.ie '{DEFAULT_METADATA}'0.90'
342.IP "1, 1.0, 1.1, 1.2"
343.el
7d5c3964 344.IP "1, 1.0, 1.1, 1.2 default"
26f467a9 345..
cd19c0cf
JR
346Use the new version-1 format superblock. This has fewer restrictions.
347It can easily be moved between hosts with different endian-ness, and a
348recovery operation can be checkpointed and restarted. The different
349sub-versions store the superblock at different locations on the
350device, either at the end (for 1.0), at the start (for 1.1) or 4K from
7050aa3f
N
351the start (for 1.2). "1" is equivalent to "1.2" (the commonly
352preferred 1.x format).
26f467a9 353'if '{DEFAULT_METADATA}'1.2' "default" is equivalent to "1.2".
8fd8d9c4 354.IP ddf
e0fe762a
N
355Use the "Industry Standard" DDF (Disk Data Format) format defined by
356SNIA.
357When creating a DDF array a
8fd8d9c4
N
358.B CONTAINER
359will be created, and normal arrays can be created in that container.
360.IP imsm
4cce4069 361Use the Intel(R) Matrix Storage Manager metadata format. This creates a
8fd8d9c4 362.B CONTAINER
4cce4069
DW
363which is managed in a similar manner to DDF, and is supported by an
364option-rom on some platforms:
365.IP
366.B http://www.intel.com/design/chipsets/matrixstorage_sb.htm
367.PP
570c0542
NB
368.RE
369
41a3b72a 370.TP
7e23fc43 371.B \-\-homehost=
35cc5be4 372This will override any
41a3b72a 373.B HOMEHOST
93e790af 374setting in the config file and provides the identity of the host which
41a3b72a
NB
375should be considered the home for any arrays.
376
377When creating an array, the
378.B homehost
e0fe762a 379will be recorded in the metadata. For version-1 superblocks, it will
93e790af 380be prefixed to the array name. For version-0.90 superblocks, part of
41a3b72a
NB
381the SHA1 hash of the hostname will be stored in the later half of the
382UUID.
383
384When reporting information about an array, any array which is tagged
385for the given homehost will be reported as such.
386
387When using Auto-Assemble, only arrays tagged for the given homehost
0ac91628 388will be allowed to use 'local' names (i.e. not ending in '_' followed
e0fe762a
N
389by a digit string). See below under
390.BR "Auto Assembly" .
41a3b72a 391
c2ecf5f6
N
392.TP
393.B \-\-prefer=
394When
395.I mdadm
396needs to print the name for a device it normally finds the name in
397.B /dev
398which refers to the device and is shortest. When a path component is
399given with
400.B \-\-prefer
401.I mdadm
402will prefer a longer name if it contains that component. For example
403.B \-\-prefer=by-uuid
404will prefer a name in a subdirectory of
405.B /dev
406called
407.BR by-uuid .
408
409This functionality is currently only provided by
410.B \-\-detail
411and
412.BR \-\-monitor .
413
2ae555c3
NB
414.SH For create, build, or grow:
415
416.TP
7e23fc43 417.BR \-n ", " \-\-raid\-devices=
2ae555c3
NB
418Specify the number of active devices in the array. This, plus the
419number of spare devices (see below) must equal the number of
420.I component-devices
421(including "\fBmissing\fP" devices)
422that are listed on the command line for
e0fe762a 423.BR \-\-create .
2ae555c3
NB
424Setting a value of 1 is probably
425a mistake and so requires that
7e23fc43 426.B \-\-force
2ae555c3 427be specified first. A value of 1 will then be allowed for linear,
e0fe762a 428multipath, RAID0 and RAID1. It is never allowed for RAID4, RAID5 or RAID6.
2ae555c3
NB
429.br
430This number can only be changed using
7e23fc43 431.B \-\-grow
e0fe762a
N
432for RAID1, RAID4, RAID5 and RAID6 arrays, and only on kernels which provide
433the necessary support.
2ae555c3
NB
434
435.TP
7e23fc43 436.BR \-x ", " \-\-spare\-devices=
2ae555c3
NB
437Specify the number of spare (eXtra) devices in the initial array.
438Spares can also be added
439and removed later. The number of component devices listed
e0fe762a 440on the command line must equal the number of RAID devices plus the
2ae555c3
NB
441number of spare devices.
442
2ae555c3 443.TP
7e23fc43 444.BR \-z ", " \-\-size=
e0fe762a 445Amount (in Kibibytes) of space to use from each drive in RAID levels 1/4/5/6.
2ae555c3
NB
446This must be a multiple of the chunk size, and must leave about 128Kb
447of space at the end of the drive for the RAID superblock.
448If this is not specified
449(as it normally is not) the smallest drive (or partition) sets the
450size, though if there is a variance among the drives of greater than 1%, a warning is
451issued.
452
36fad8ec
N
453A suffix of 'M' or 'G' can be given to indicate Megabytes or
454Gigabytes respectively.
455
9ab6e80a
N
456Sometimes a replacement drive can be a little smaller than the
457original drives though this should be minimised by IDEMA standards.
458Such a replacement drive will be rejected by
459.IR md .
460To guard against this it can be useful to set the initial size
461slightly smaller than the smaller device with the aim that it will
462still be larger than any replacement.
463
2ae555c3 464This value can be set with
7e23fc43 465.B \-\-grow
9ab6e80a
N
466for RAID level 1/4/5/6 though
467.B CONTAINER
468based arrays such as those with IMSM metadata may not be able to
469support this.
470If the array was created with a size smaller than the currently
471active drives, the extra space can be accessed using
7e23fc43 472.BR \-\-grow .
2ae555c3
NB
473The size can be given as
474.B max
475which means to choose the largest size that fits on all current drives.
52826846 476
c26d78fe
N
477Before reducing the size of the array (with
478.BR "\-\-grow \-\-size=" )
479you should make sure that space isn't needed. If the device holds a
480filesystem, you would need to resize the filesystem to use less space.
481
482After reducing the array size you should check that the data stored in
483the device is still available. If the device holds a filesystem, then
484an 'fsck' of the filesystem is a minimum requirement. If there are
485problems the array can be made bigger again with no loss with another
486.B "\-\-grow \-\-size="
487command.
488
9ab6e80a 489This value cannot be used when creating a
8fd8d9c4 490.B CONTAINER
9ab6e80a
N
491such as with DDF and IMSM metadata, though it perfectly valid when
492creating an array inside a container.
8fd8d9c4 493
f24e2d6c 494.TP
c26d78fe 495.BR \-Z ", " \-\-array\-size=
f24e2d6c
N
496This is only meaningful with
497.B \-\-grow
36fad8ec 498and its effect is not persistent: when the array is stopped and
f24e2d6c
N
499restarted the default array size will be restored.
500
501Setting the array-size causes the array to appear smaller to programs
502that access the data. This is particularly needed before reshaping an
503array so that it will be smaller. As the reshape is not reversible,
504but setting the size with
505.B \-\-array-size
506is, it is required that the array size is reduced as appropriate
507before the number of devices in the array is reduced.
508
c26d78fe
N
509Before reducing the size of the array you should make sure that space
510isn't needed. If the device holds a filesystem, you would need to
511resize the filesystem to use less space.
512
513After reducing the array size you should check that the data stored in
514the device is still available. If the device holds a filesystem, then
515an 'fsck' of the filesystem is a minimum requirement. If there are
516problems the array can be made bigger again with no loss with another
517.B "\-\-grow \-\-array\-size="
518command.
519
36fad8ec
N
520A suffix of 'M' or 'G' can be given to indicate Megabytes or
521Gigabytes respectively.
522A value of
523.B max
524restores the apparent size of the array to be whatever the real
525amount of available space is.
526
cd29a5c8 527.TP
7e23fc43 528.BR \-c ", " \-\-chunk=
5f175898
N
529Specify chunk size of kibibytes. The default when creating an
530array is 512KB. To ensure compatibility with earlier versions, the
531default when Building and array with no persistent metadata is 64KB.
e0fe762a 532This is only meaningful for RAID0, RAID4, RAID5, RAID6, and RAID10.
52826846 533
a252c078
N
534RAID4, RAID5, RAID6, and RAID10 require the chunk size to be a power
535of 2. In any case it must be a multiple of 4KB.
536
36fad8ec
N
537A suffix of 'M' or 'G' can be given to indicate Megabytes or
538Gigabytes respectively.
539
cd29a5c8 540.TP
7e23fc43 541.BR \-\-rounding=
e0fe762a
N
542Specify rounding factor for a Linear array. The size of each
543component will be rounded down to a multiple of this size.
544This is a synonym for
545.B \-\-chunk
546but highlights the different meaning for Linear as compared to other
5f175898
N
547RAID levels. The default is 64K if a kernel earlier than 2.6.16 is in
548use, and is 0K (i.e. no rounding) in later kernels.
52826846 549
cd29a5c8 550.TP
7e23fc43 551.BR \-l ", " \-\-level=
e0fe762a 552Set RAID level. When used with
7e23fc43 553.BR \-\-create ,
98c6faba 554options are: linear, raid0, 0, stripe, raid1, 1, mirror, raid4, 4,
8fd8d9c4
N
555raid5, 5, raid6, 6, raid10, 10, multipath, mp, faulty, container.
556Obviously some of these are synonymous.
557
558When a
559.B CONTAINER
560metadata type is requested, only the
561.B container
562level is permitted, and it does not need to be explicitly given.
aa88f531
NB
563
564When used with
7e23fc43 565.BR \-\-build ,
a9d69660 566only linear, stripe, raid0, 0, raid1, multipath, mp, and faulty are valid.
52826846 567
fd547b50
N
568Can be used with
569.B \-\-grow
570to change the RAID level in some cases. See LEVEL CHANGES below.
2ae555c3 571
cd29a5c8 572.TP
7e23fc43 573.BR \-p ", " \-\-layout=
f24e2d6c
N
574This option configures the fine details of data layout for RAID5, RAID6,
575and RAID10 arrays, and controls the failure modes for
1a7dfc35
NB
576.IR faulty .
577
e0fe762a 578The layout of the RAID5 parity block can be one of
7e23fc43
PS
579.BR left\-asymmetric ,
580.BR left\-symmetric ,
581.BR right\-asymmetric ,
582.BR right\-symmetric ,
53e8b987
PS
583.BR la ", " ra ", " ls ", " rs .
584The default is
7e23fc43 585.BR left\-symmetric .
52826846 586
cd19c0cf 587It is also possible to cause RAID5 to use a RAID4-like layout by
e0fe762a
N
588choosing
589.BR parity\-first ,
590or
591.BR parity\-last .
592
593Finally for RAID5 there are DDF\-compatible layouts,
594.BR ddf\-zero\-restart ,
595.BR ddf\-N\-restart ,
596and
597.BR ddf\-N\-continue .
598
599These same layouts are available for RAID6. There are also 4 layouts
600that will provide an intermediate stage for converting between RAID5
601and RAID6. These provide a layout which is identical to the
602corresponding RAID5 layout on the first N\-1 devices, and has the 'Q'
603syndrome (the second 'parity' block used by RAID6) on the last device.
604These layouts are:
605.BR left\-symmetric\-6 ,
606.BR right\-symmetric\-6 ,
607.BR left\-asymmetric\-6 ,
608.BR right\-asymmetric\-6 ,
609and
10adfe9a 610.BR parity\-first\-6 .
e0fe762a 611
93e790af
SW
612When setting the failure mode for level
613.I faulty,
1a7dfc35 614the options are:
7e23fc43
PS
615.BR write\-transient ", " wt ,
616.BR read\-transient ", " rt ,
617.BR write\-persistent ", " wp ,
618.BR read\-persistent ", " rp ,
619.BR write\-all ,
620.BR read\-fixable ", " rf ,
53e8b987 621.BR clear ", " flush ", " none .
b5e64645 622
93e790af 623Each failure mode can be followed by a number, which is used as a period
b5e64645
NB
624between fault generation. Without a number, the fault is generated
625once on the first relevant request. With a number, the fault will be
93e790af 626generated after that many requests, and will continue to be generated
b5e64645
NB
627every time the period elapses.
628
629Multiple failure modes can be current simultaneously by using the
7e23fc43 630.B \-\-grow
53e8b987 631option to set subsequent failure modes.
b5e64645
NB
632
633"clear" or "none" will remove any pending or periodic failure modes,
2ae555c3 634and "flush" will clear any persistent faults.
b5e64645 635
6f9a21a7 636Finally, the layout options for RAID10 are one of 'n', 'o' or 'f' followed
93e790af 637by a small number. The default is 'n2'. The supported options are:
1a7dfc35 638
93e790af 639.I 'n'
e0fe762a 640signals 'near' copies. Multiple copies of one data block are at
b578481c
NB
641similar offsets in different devices.
642
93e790af 643.I 'o'
b578481c
NB
644signals 'offset' copies. Rather than the chunks being duplicated
645within a stripe, whole stripes are duplicated but are rotated by one
646device so duplicate blocks are on different devices. Thus subsequent
647copies of a block are in the next drive, and are one chunk further
648down.
649
93e790af 650.I 'f'
1a7dfc35 651signals 'far' copies
93e790af 652(multiple copies have very different offsets).
e0fe762a 653See md(4) for more detail about 'near', 'offset', and 'far'.
1a7dfc35
NB
654
655The number is the number of copies of each datablock. 2 is normal, 3
656can be useful. This number can be at most equal to the number of
657devices in the array. It does not need to divide evenly into that
658number (e.g. it is perfectly legal to have an 'n2' layout for an array
659with an odd number of devices).
660
f24e2d6c
N
661When an array is converted between RAID5 and RAID6 an intermediate
662RAID6 layout is used in which the second parity block (Q) is always on
663the last device. To convert a RAID5 to RAID6 and leave it in this new
664layout (which does not require re-striping) use
665.BR \-\-layout=preserve .
666This will try to avoid any restriping.
667
668The converse of this is
669.B \-\-layout=normalise
670which will change a non-standard RAID6 layout into a more standard
671arrangement.
672
cd29a5c8 673.TP
7e23fc43 674.BR \-\-parity=
53e8b987 675same as
7e23fc43 676.B \-\-layout
53e8b987 677(thus explaining the p of
7e23fc43 678.BR \-p ).
52826846 679
e793c2e5 680.TP
7e23fc43 681.BR \-b ", " \-\-bitmap=
e793c2e5 682Specify a file to store a write-intent bitmap in. The file should not
53e8b987 683exist unless
7e23fc43 684.B \-\-force
53e8b987 685is also given. The same file should be provided
2ae555c3 686when assembling the array. If the word
93e790af 687.B "internal"
2ae555c3
NB
688is given, then the bitmap is stored with the metadata on the array,
689and so is replicated on all devices. If the word
93e790af 690.B "none"
2ae555c3 691is given with
7e23fc43 692.B \-\-grow
2ae555c3 693mode, then any bitmap that is present is removed.
e793c2e5 694
2ae555c3
NB
695To help catch typing errors, the filename must contain at least one
696slash ('/') if it is a real file (not 'internal' or 'none').
697
698Note: external bitmaps are only known to work on ext2 and ext3.
699Storing bitmap files on other filesystems may result in serious problems.
e793c2e5 700
cd29a5c8 701.TP
7e23fc43 702.BR \-\-bitmap\-chunk=
e0fe762a 703Set the chunksize of the bitmap. Each bit corresponds to that many
1bfdbe01
NB
704Kilobytes of storage.
705When using a file based bitmap, the default is to use the smallest
93e790af 706size that is at-least 4 and requires no more than 2^21 chunks.
2ae555c3
NB
707When using an
708.B internal
b8ab2a50
N
709bitmap, the chunksize defaults to 64Meg, or larger if necessary to
710fit the bitmap into the available space.
5787fa49 711
36fad8ec
N
712A suffix of 'M' or 'G' can be given to indicate Megabytes or
713Gigabytes respectively.
714
cd29a5c8 715.TP
7e23fc43 716.BR \-W ", " \-\-write\-mostly
e0fe762a 717subsequent devices listed in a
7e23fc43
PS
718.BR \-\-build ,
719.BR \-\-create ,
2ae555c3 720or
7e23fc43 721.B \-\-add
2ae555c3
NB
722command will be flagged as 'write-mostly'. This is valid for RAID1
723only and means that the 'md' driver will avoid reading from these
724devices if at all possible. This can be useful if mirroring over a
725slow link.
52826846 726
2ae555c3 727.TP
7e23fc43 728.BR \-\-write\-behind=
2ae555c3 729Specify that write-behind mode should be enabled (valid for RAID1
e0fe762a
N
730only). If an argument is specified, it will set the maximum number
731of outstanding writes allowed. The default value is 256.
2ae555c3
NB
732A write-intent bitmap is required in order to use write-behind
733mode, and write-behind is only attempted on drives marked as
734.IR write-mostly .
dd0781e5
NB
735
736.TP
7e23fc43 737.BR \-\-assume\-clean
dd0781e5
NB
738Tell
739.I mdadm
47d79ef8
NB
740that the array pre-existed and is known to be clean. It can be useful
741when trying to recover from a major failure as you can be sure that no
742data will be affected unless you actually write to the array. It can
743also be used when creating a RAID1 or RAID10 if you want to avoid the
b3f1c093 744initial resync, however this practice \(em while normally safe \(em is not
e0fe762a 745recommended. Use this only if you really know what you are doing.
6acad481
ME
746.IP
747When the devices that will be part of a new array were filled
748with zeros before creation the operator knows the array is
749actually clean. If that is the case, such as after running
750badblocks, this argument can be used to tell mdadm the
751facts the operator knows.
ce52f92f
N
752.IP
753When an array is resized to a larger size with
754.B "\-\-grow \-\-size="
755the new space is normally resynced in that same way that the whole
6cbf8fb8 756array is resynced at creation. From Linux version 3.0,
ce52f92f
N
757.B \-\-assume\-clean
758can be used with that command to avoid the automatic resync.
dd0781e5 759
2ae555c3 760.TP
7e23fc43 761.BR \-\-backup\-file=
53e8b987 762This is needed when
7e23fc43 763.B \-\-grow
cd19c0cf
JR
764is used to increase the number of raid-devices in a RAID5 or RAID6 if
765there are no spare devices available, or to shrink, change RAID level
766or layout. See the GROW MODE section below on RAID\-DEVICES CHANGES.
767The file must be stored on a separate device, not on the RAID array
768being reshaped.
2ae555c3 769
40c9a66a
N
770.TP
771.B \-\-data\-offset=
772Arrays with 1.x metadata can leave a gap between the start of the
773device and the start of array data. This gap can be used for various
774metadata. The start of data is known as the
775.IR data\-offset .
776Normally an appropriate data offset is computed automatically.
777However it can be useful to set it explicitly such as when re-creating
778an array which was originally created using a different version of
779.I mdadm
780which computed a different offset.
781
782Setting the offset explicitly over-rides the default. The value given
783is in Kilobytes unless an 'M' or 'G' suffix is given.
784
785Since Linux 3.4,
786.B \-\-data\-offset
787can also be used with
788.B --grow
789for some RAID levels (initially on RAID10). This allows the
72ca9bcf 790data\-offset to be changed as part of the reshape process. When the
40c9a66a
N
791data offset is changed, no backup file is required as the difference
792in offsets is used to provide the same functionality.
793
794When the new offset is earlier than the old offset, the number of
795devices in the array cannot shrink. When it is after the old offset,
796the number of devices in the array cannot increase.
797
72ca9bcf
N
798When creating an array,
799.B \-\-data\-offset
800can be specified as
801.BR variable .
802In the case each member device is expected to have a offset appended
803to the name, separated by a colon. This makes it possible to recreate
804exactly an array which has varying data offsets (as can happen when
805different versions of
806.I mdadm
807are used to add different devices).
808
f211a137
AK
809.TP
810.BR \-\-continue
811This option is complementary to the
812.B \-\-freeze-reshape
813option for assembly. It is needed when
814.B \-\-grow
815operation is interrupted and it is not restarted automatically due to
816.B \-\-freeze-reshape
817usage during array assembly. This option is used together with
818.BR \-G
819, (
820.BR \-\-grow
821) command and device for a pending reshape to be continued.
822All parameters required for reshape continuation will be read from array metadata.
823If initial
824.BR \-\-grow
825command had required
826.BR \-\-backup\-file=
827option to be set, continuation option will require to have exactly the same
828backup file given as well.
829.IP
830Any other parameter passed together with
831.BR \-\-continue
832option will be ignored.
833
947fd4dd 834.TP
7e23fc43 835.BR \-N ", " \-\-name=
947fd4dd
NB
836Set a
837.B name
838for the array. This is currently only effective when creating an
e0fe762a
N
839array with a version-1 superblock, or an array in a DDF container.
840The name is a simple textual string that can be used to identify array
841components when assembling. If name is needed but not specified, it
842is taken from the basename of the device that is being created.
843e.g. when creating
844.I /dev/md/home
845the
846.B name
847will default to
848.IR home .
947fd4dd 849
dd0781e5 850.TP
7e23fc43 851.BR \-R ", " \-\-run
dd0781e5
NB
852Insist that
853.I mdadm
854run the array, even if some of the components
855appear to be active in another array or filesystem. Normally
856.I mdadm
857will ask for confirmation before including such components in an
858array. This option causes that question to be suppressed.
859
860.TP
7e23fc43 861.BR \-f ", " \-\-force
dd0781e5
NB
862Insist that
863.I mdadm
864accept the geometry and layout specified without question. Normally
865.I mdadm
866will not allow creation of an array with only one device, and will try
e0fe762a 867to create a RAID5 array with one missing drive (as this makes the
dd0781e5 868initial resync work faster). With
7e23fc43 869.BR \-\-force ,
dd0781e5
NB
870.I mdadm
871will not try to be so clever.
872
0ea8f5b1
N
873.TP
874.BR \-o ", " \-\-readonly
875Start the array
876.B read only
877rather than read-write as normal. No writes will be allowed to the
878array, and no resync, recovery, or reshape will be started.
879
dd0781e5 880.TP
257c1dc2
N
881.BR \-a ", " "\-\-auto{=yes,md,mdp,part,p}{NN}"
882Instruct mdadm how to create the device file if needed, possibly allocating
48f7b27a 883an unused minor number. "md" causes a non-partitionable array
257c1dc2
N
884to be used (though since Linux 2.6.28, these array devices are in fact
885partitionable). "mdp", "part" or "p" causes a partitionable array (2.6 and
2ae555c3 886later) to be used. "yes" requires the named md device to have
f9c25f1d 887a 'standard' format, and the type and minor number will be determined
257c1dc2
N
888from this. With mdadm 3.0, device creation is normally left up to
889.I udev
890so this option is unlikely to be needed.
891See DEVICE NAMES below.
48f7b27a 892
a9d69660 893The argument can also come immediately after
7e23fc43 894"\-a". e.g. "\-ap".
dd0781e5 895
53e8b987 896If
7e23fc43 897.B \-\-auto
53e8b987 898is not given on the command line or in the config file, then
75723446 899the default will be
7e23fc43 900.BR \-\-auto=yes .
75723446 901
1337546d 902If
7e23fc43 903.B \-\-scan
1337546d
NB
904is also given, then any
905.I auto=
35cc5be4 906entries in the config file will override the
7e23fc43 907.B \-\-auto
1337546d
NB
908instruction given on the command line.
909
dd0781e5
NB
910For partitionable arrays,
911.I mdadm
912will create the device file for the whole array and for the first 4
913partitions. A different number of partitions can be specified at the
914end of this option (e.g.
7e23fc43 915.BR \-\-auto=p7 ).
2ae555c3 916If the device name ends with a digit, the partition names add a 'p',
e0fe762a
N
917and a number, e.g.
918.IR /dev/md/home1p3 .
919If there is no trailing digit, then the partition names just have a
920number added, e.g.
921.IR /dev/md/scratch3 .
dd0781e5 922
48f7b27a
NB
923If the md device name is in a 'standard' format as described in DEVICE
924NAMES, then it will be created, if necessary, with the appropriate
e0fe762a
N
925device number based on that name. If the device name is not in one of these
926formats, then a unused device number will be allocated. The device
48f7b27a
NB
927number will be considered unused if there is no active array for that
928number, and there is no entry in /dev for that number and with a
e0fe762a 929non-standard name. Names that are not in 'standard' format are only
8fd8d9c4
N
930allowed in "/dev/md/".
931
3c7efacb
NK
932This is meaningful with
933.B \-\-create
934or
935.BR \-\-build .
936
f24e2d6c 937.ig XX
e0fe762a
N
938.\".TP
939.\".BR \-\-symlink = no
940.\"Normally when
941.\".B \-\-auto
942.\"causes
943.\".I mdadm
944.\"to create devices in
945.\".B /dev/md/
946.\"it will also create symlinks from
947.\".B /dev/
948.\"with names starting with
949.\".B md
950.\"or
951.\".BR md_ .
952.\"Use
953.\".B \-\-symlink=no
954.\"to suppress this, or
955.\".B \-\-symlink=yes
956.\"to enforce this even if it is suppressing
957.\".IR mdadm.conf .
958.\"
f24e2d6c 959.XX
38098016 960
3c7efacb
NK
961.TP
962.BR \-a ", " "\-\-add"
963This option can be used in Grow mode in two cases.
964
965If the target array is a Linear array, then
966.B \-\-add
967can be used to add one or more devices to the array. They
968are simply catenated on to the end of the array. Once added, the
969devices cannot be removed.
970
971If the
972.B \-\-raid\-disks
973option is being used to increase the number of devices in an array,
974then
975.B \-\-add
976can be used to add some extra devices to be included in the array.
977In most cases this is not needed as the extra devices can be added as
978spares first, and then the number of raid-disks can be changed.
979However for RAID0, it is not possible to add spares. So to increase
980the number of devices in a RAID0, it is necessary to set the new
981number of devices, and to add the new devices, in the same command.
982
52826846
NB
983.SH For assemble:
984
cd29a5c8 985.TP
7e23fc43 986.BR \-u ", " \-\-uuid=
e0fe762a 987uuid of array to assemble. Devices which don't have this uuid are
cd29a5c8
NB
988excluded
989
990.TP
7e23fc43 991.BR \-m ", " \-\-super\-minor=
cd29a5c8
NB
992Minor number of device that array was created for. Devices which
993don't have this minor number are excluded. If you create an array as
2d465520 994/dev/md1, then all superblocks will contain the minor number 1, even if
cd29a5c8
NB
995the array is later assembled as /dev/md2.
996
d013a55e 997Giving the literal word "dev" for
7e23fc43 998.B \-\-super\-minor
d013a55e
NB
999will cause
1000.I mdadm
1001to use the minor number of the md device that is being assembled.
1002e.g. when assembling
1003.BR /dev/md0 ,
51ac42e3 1004.B \-\-super\-minor=dev
d013a55e
NB
1005will look for super blocks with a minor number of 0.
1006
e0fe762a
N
1007.B \-\-super\-minor
1008is only relevant for v0.90 metadata, and should not normally be used.
1009Using
1010.B \-\-uuid
1011is much safer.
1012
947fd4dd 1013.TP
7e23fc43 1014.BR \-N ", " \-\-name=
947fd4dd 1015Specify the name of the array to assemble. This must be the name
624920bb 1016that was specified when creating the array. It must either match
93e790af 1017the name stored in the superblock exactly, or it must match
41a3b72a 1018with the current
624920bb 1019.I homehost
93e790af 1020prefixed to the start of the given name.
947fd4dd 1021
cd29a5c8 1022.TP
7e23fc43 1023.BR \-f ", " \-\-force
e0fe762a
N
1024Assemble the array even if the metadata on some devices appears to be
1025out-of-date. If
1026.I mdadm
1027cannot find enough working devices to start the array, but can find
1028some devices that are recorded as having failed, then it will mark
1029those devices as working so that the array can be started.
1030An array which requires
1031.B \-\-force
1032to be started may contain data corruption. Use it carefully.
52826846 1033
cd29a5c8 1034.TP
7e23fc43 1035.BR \-R ", " \-\-run
b8a8ccf9
NB
1036Attempt to start the array even if fewer drives were given than were
1037present last time the array was active. Normally if not all the
1038expected drives are found and
7e23fc43 1039.B \-\-scan
cd29a5c8
NB
1040is not used, then the array will be assembled but not started.
1041With
7e23fc43 1042.B \-\-run
cd29a5c8 1043an attempt will be made to start it anyway.
52826846 1044
b8a8ccf9 1045.TP
7e23fc43 1046.B \-\-no\-degraded
b8a8ccf9 1047This is the reverse of
7e23fc43 1048.B \-\-run
93e790af 1049in that it inhibits the startup of array unless all expected drives
b8a8ccf9 1050are present. This is only needed with
93e790af
SW
1051.B \-\-scan,
1052and can be used if the physical connections to devices are
b8a8ccf9
NB
1053not as reliable as you would like.
1054
dd0781e5 1055.TP
7e23fc43 1056.BR \-a ", " "\-\-auto{=no,yes,md,mdp,part}"
dd0781e5
NB
1057See this option under Create and Build options.
1058
e793c2e5 1059.TP
7e23fc43 1060.BR \-b ", " \-\-bitmap=
2ae555c3
NB
1061Specify the bitmap file that was given when the array was created. If
1062an array has an
1063.B internal
1064bitmap, there is no need to specify this when assembling the array.
1065
1066.TP
7e23fc43 1067.BR \-\-backup\-file=
2ae555c3 1068If
7e23fc43 1069.B \-\-backup\-file
87f26d14
N
1070was used while reshaping an array (e.g. changing number of devices or
1071chunk size) and the system crashed during the critical section, then the same
7e23fc43 1072.B \-\-backup\-file
53e8b987 1073must be presented to
7e23fc43 1074.B \-\-assemble
cd19c0cf
JR
1075to allow possibly corrupted data to be restored, and the reshape
1076to be completed.
e793c2e5 1077
87f26d14
N
1078.TP
1079.BR \-\-invalid\-backup
1080If the file needed for the above option is not available for any
1081reason an empty file can be given together with this option to
1082indicate that the backup file is invalid. In this case the data that
1083was being rearranged at the time of the crash could be irrecoverably
1084lost, but the rest of the array may still be recoverable. This option
1085should only be used as a last resort if there is no way to recover the
1086backup file.
1087
1088
5787fa49 1089.TP
7e23fc43 1090.BR \-U ", " \-\-update=
5787fa49 1091Update the superblock on each device while assembling the array. The
feb716e9
NB
1092argument given to this flag can be one of
1093.BR sparc2.2 ,
1094.BR summaries ,
7d99579f 1095.BR uuid ,
c4f12c13 1096.BR name ,
0237e0ca 1097.BR homehost ,
e5329c37 1098.BR resync ,
586ed405 1099.BR byteorder ,
bee8ec56 1100.BR devicesize ,
5a31170d 1101.BR no\-bitmap ,
688e99a7
N
1102.BR bbl ,
1103.BR no-\bbl ,
5787fa49 1104or
7e23fc43 1105.BR super\-minor .
5787fa49
NB
1106
1107The
1108.B sparc2.2
7d99579f 1109option will adjust the superblock of an array what was created on a Sparc
5787fa49
NB
1110machine running a patched 2.2 Linux kernel. This kernel got the
1111alignment of part of the superblock wrong. You can use the
7e23fc43 1112.B "\-\-examine \-\-sparc2.2"
5787fa49
NB
1113option to
1114.I mdadm
1115to see what effect this would have.
1116
1117The
7e23fc43 1118.B super\-minor
5787fa49 1119option will update the
2ae555c3 1120.B "preferred minor"
5787fa49 1121field on each superblock to match the minor number of the array being
45c073c9
NB
1122assembled.
1123This can be useful if
7e23fc43 1124.B \-\-examine
45c073c9 1125reports a different "Preferred Minor" to
7e23fc43 1126.BR \-\-detail .
45c073c9 1127In some cases this update will be performed automatically
e0fe762a 1128by the kernel driver. In particular the update happens automatically
45c073c9
NB
1129at the first write to an array with redundancy (RAID level 1 or
1130greater) on a 2.6 (or later) kernel.
5787fa49 1131
7d99579f
NB
1132The
1133.B uuid
1134option will change the uuid of the array. If a UUID is given with the
7e23fc43 1135.B \-\-uuid
53e8b987 1136option that UUID will be used as a new UUID and will
7d99579f
NB
1137.B NOT
1138be used to help identify the devices in the array.
53e8b987 1139If no
7e23fc43 1140.B \-\-uuid
53e8b987 1141is given, a random UUID is chosen.
7d99579f 1142
c4f12c13
NB
1143The
1144.B name
1145option will change the
1146.I name
1147of the array as stored in the superblock. This is only supported for
1148version-1 superblocks.
1149
0237e0ca
NB
1150The
1151.B homehost
1152option will change the
1153.I homehost
1154as recorded in the superblock. For version-0 superblocks, this is the
1155same as updating the UUID.
1156For version-1 superblocks, this involves updating the name.
1157
e5329c37
NB
1158The
1159.B resync
1160option will cause the array to be marked
1161.I dirty
e0fe762a
N
1162meaning that any redundancy in the array (e.g. parity for RAID5,
1163copies for RAID1) may be incorrect. This will cause the RAID system
e5329c37
NB
1164to perform a "resync" pass to make sure that all redundant information
1165is correct.
1166
586ed405
NB
1167The
1168.B byteorder
1169option allows arrays to be moved between machines with different
1170byte-order.
2ae555c3 1171When assembling such an array for the first time after a move, giving
7e23fc43 1172.B "\-\-update=byteorder"
586ed405
NB
1173will cause
1174.I mdadm
1175to expect superblocks to have their byteorder reversed, and will
1176correct that order before assembling the array. This is only valid
2ae555c3 1177with original (Version 0.90) superblocks.
586ed405 1178
feb716e9
NB
1179The
1180.B summaries
e0fe762a 1181option will correct the summaries in the superblock. That is the
feb716e9 1182counts of total, working, active, failed, and spare devices.
5787fa49 1183
bee8ec56
NB
1184The
1185.B devicesize
5a31170d 1186option will rarely be of use. It applies to version 1.1 and 1.2 metadata
bee8ec56
NB
1187only (where the metadata is at the start of the device) and is only
1188useful when the component device has changed size (typically become
1189larger). The version 1 metadata records the amount of the device that
1190can be used to store data, so if a device in a version 1.1 or 1.2
1191array becomes larger, the metadata will still be visible, but the
1192extra space will not. In this case it might be useful to assemble the
1193array with
7e23fc43 1194.BR \-\-update=devicesize .
bee8ec56
NB
1195This will cause
1196.I mdadm
1197to determine the maximum usable amount of space on each device and
1198update the relevant field in the metadata.
1199
5a31170d
N
1200The
1201.B no\-bitmap
1202option can be used when an array has an internal bitmap which is
1203corrupt in some way so that assembling the array normally fails. It
1204will cause any internal bitmap to be ignored.
1205
688e99a7
N
1206The
1207.B bbl
1208option will reserve space in each device for a bad block list. This
1209will be 4K in size and positioned near the end of any free space
1210between the superblock and the data.
1211
1212The
1213.B no\-bbl
1214option will cause any reservation of space for a bad block list to be
1215removed. If the bad block list contains entries, this will fail, as
1216removing the list could cause data corruption.
1217
afd0a969
AK
1218.TP
1219.BR \-\-freeze\-reshape
1220Option is intended to be used in start-up scripts during initrd boot phase.
1221When array under reshape is assembled during initrd phase, this option
1222stops reshape after reshape critical section is being restored. This happens
1223before file system pivot operation and avoids loss of file system context.
1224Losing file system context would cause reshape to be broken.
1225
a6482415
N
1226Reshape can be continued later using the
1227.B \-\-continue
1228option for the grow command.
afd0a969 1229
e0d19036 1230.SH For Manage mode:
52826846 1231
3d5279b0
N
1232.TP
1233.BR \-t ", " \-\-test
1234Unless a more serious error occurred,
1235.I mdadm
1236will exit with a status of 2 if no changes were made to the array and
12370 if at least one change was made.
1238This can be useful when an indirect specifier such as
1239.BR missing ,
1240.B detached
1241or
1242.B faulty
1243is used in requesting an operation on the array.
1244.B \-\-test
1245will report failure if these specifiers didn't find any match.
1246
cd29a5c8 1247.TP
7e23fc43 1248.BR \-a ", " \-\-add
3d5279b0
N
1249hot-add listed devices.
1250If a device appears to have recently been part of the array
342460cb 1251(possibly it failed or was removed) the device is re\-added as described
3d5279b0
N
1252in the next point.
1253If that fails or the device was never part of the array, the device is
1254added as a hot-spare.
1255If the array is degraded, it will immediately start to rebuild data
1256onto that spare.
1257
1258Note that this and the following options are only meaningful on array
1259with redundancy. They don't apply to RAID0 or Linear.
52826846 1260
fe80f49b 1261.TP
7e23fc43 1262.BR \-\-re\-add
3d5279b0
N
1263re\-add a device that was previous removed from an array.
1264If the metadata on the device reports that it is a member of the
1265array, and the slot that it used is still vacant, then the device will
1266be added back to the array in the same position. This will normally
1267cause the data for that device to be recovered. However based on the
1268event count on the device, the recovery may only require sections that
1269are flagged a write-intent bitmap to be recovered or may not require
1270any recovery at all.
1271
1272When used on an array that has no metadata (i.e. it was built with
1273.BR \-\-build)
1274it will be assumed that bitmap-based recovery is enough to make the
1275device fully consistent with the array.
fe80f49b 1276
688e99a7 1277When used with v1.x metadata,
833bb0f8
N
1278.B \-\-re\-add
1279can be accompanied by
688e99a7
N
1280.BR \-\-update=devicesize ,
1281.BR \-\-update=bbl ", or"
1282.BR \-\-update=no\-bbl .
1283See the description of these option when used in Assemble mode for an
1284explanation of their use.
833bb0f8 1285
a4e13010
N
1286If the device name given is
1287.B missing
1288then mdadm will try to find any device that looks like it should be
1289part of the array but isn't and will try to re\-add all such devices.
1290
cd29a5c8 1291.TP
7e23fc43 1292.BR \-r ", " \-\-remove
2d465520 1293remove listed devices. They must not be active. i.e. they should
b80da661
NB
1294be failed or spare devices. As well as the name of a device file
1295(e.g.
1296.BR /dev/sda1 )
1297the words
1298.B failed
1299and
1300.B detached
1301can be given to
1302.BR \-\-remove .
1303The first causes all failed device to be removed. The second causes
93e790af 1304any device which is no longer connected to the system (i.e an 'open'
b80da661
NB
1305returns
1306.BR ENXIO )
1307to be removed. This will only succeed for devices that are spares or
1308have already been marked as failed.
52826846 1309
cd29a5c8 1310.TP
7e23fc43 1311.BR \-f ", " \-\-fail
cd29a5c8 1312mark listed devices as faulty.
b80da661
NB
1313As well as the name of a device file, the word
1314.B detached
1315can be given. This will cause any device that has been detached from
1316the system to be marked as failed. It can then be removed.
52826846 1317
cd29a5c8 1318.TP
7e23fc43 1319.BR \-\-set\-faulty
53e8b987 1320same as
7e23fc43 1321.BR \-\-fail .
52826846 1322
b3d31955
N
1323.TP
1324.BR \-\-write\-mostly
a4e13010 1325Subsequent devices that are added or re\-added will have the 'write-mostly'
e0fe762a 1326flag set. This is only valid for RAID1 and means that the 'md' driver
b3d31955
N
1327will avoid reading from these devices if possible.
1328.TP
1329.BR \-\-readwrite
a4e13010 1330Subsequent devices that are added or re\-added will have the 'write-mostly'
b3d31955
N
1331flag cleared.
1332
2ae555c3 1333.P
e0fe762a 1334Each of these options requires that the first device listed is the array
93e790af 1335to be acted upon, and the remainder are component devices to be added,
e0fe762a 1336removed, marked as faulty, etc. Several different operations can be
2ae555c3
NB
1337specified for different devices, e.g.
1338.in +5
7e23fc43 1339mdadm /dev/md0 \-\-add /dev/sda1 \-\-fail /dev/sdb1 \-\-remove /dev/sdb1
2ae555c3
NB
1340.in -5
1341Each operation applies to all devices listed until the next
93e790af 1342operation.
2ae555c3
NB
1343
1344If an array is using a write-intent bitmap, then devices which have
a4e13010 1345been removed can be re\-added in a way that avoids a full
93e790af 1346reconstruction but instead just updates the blocks that have changed
2ae555c3
NB
1347since the device was removed. For arrays with persistent metadata
1348(superblocks) this is done automatically. For arrays created with
7e23fc43 1349.B \-\-build
2ae555c3 1350mdadm needs to be told that this device we removed recently with
7e23fc43 1351.BR \-\-re\-add .
2ae555c3
NB
1352
1353Devices can only be removed from an array if they are not in active
93e790af
SW
1354use, i.e. that must be spares or failed devices. To remove an active
1355device, it must first be marked as
1356.B faulty.
2ae555c3
NB
1357
1358.SH For Misc mode:
1359
1360.TP
7e23fc43 1361.BR \-Q ", " \-\-query
2ae555c3
NB
1362Examine a device to see
1363(1) if it is an md device and (2) if it is a component of an md
1364array.
1365Information about what is discovered is presented.
1366
1367.TP
7e23fc43 1368.BR \-D ", " \-\-detail
e0fe762a 1369Print details of one or more md devices.
5787fa49 1370
4cce4069
DW
1371.TP
1372.BR \-\-detail\-platform
e0fe762a 1373Print details of the platform's RAID capabilities (firmware / hardware
9eafa1de
MN
1374topology) for a given metadata format. If used without argument, mdadm
1375will scan all controllers looking for their capabilities. Otherwise, mdadm
1376will only look at the controller specified by the argument in form of an
1377absolute filepath or a link, e.g.
1378.IR /sys/devices/pci0000:00/0000:00:1f.2 .
4cce4069 1379
54bad364
KS
1380.TP
1381.BR \-Y ", " \-\-export
1382When used with
e50cf220 1383.B \-\-detail , \-\-detail-platform
0d726f17
KS
1384or
1385.BR \-\-examine ,
54bad364
KS
1386output will be formatted as
1387.B key=value
1388pairs for easy import into the environment.
1389
2ae555c3 1390.TP
7e23fc43 1391.BR \-E ", " \-\-examine
e0fe762a
N
1392Print contents of the metadata stored on the named device(s).
1393Note the contrast between
1394.B \-\-examine
1395and
1396.BR \-\-detail .
1397.B \-\-examine
1398applies to devices which are components of an array, while
1399.B \-\-detail
1400applies to a whole array which is currently active.
5787fa49 1401.TP
7e23fc43 1402.B \-\-sparc2.2
e0fe762a
N
1403If an array was created on a SPARC machine with a 2.2 Linux kernel
1404patched with RAID support, the superblock will have been created
1405incorrectly, or at least incompatibly with 2.4 and later kernels.
1406Using the
7e23fc43 1407.B \-\-sparc2.2
5787fa49 1408flag with
7e23fc43 1409.B \-\-examine
5787fa49
NB
1410will fix the superblock before displaying it. If this appears to do
1411the right thing, then the array can be successfully assembled using
7e23fc43 1412.BR "\-\-assemble \-\-update=sparc2.2" .
5787fa49 1413
2ae555c3 1414.TP
7e23fc43 1415.BR \-X ", " \-\-examine\-bitmap
2ae555c3 1416Report information about a bitmap file.
01d9299c 1417The argument is either an external bitmap file or an array component
e0fe762a
N
1418in case of an internal bitmap. Note that running this on an array
1419device (e.g.
1420.BR /dev/md0 )
1421does not report the bitmap for that array.
e0d19036 1422
cd29a5c8 1423.TP
7e23fc43 1424.BR \-R ", " \-\-run
e0fe762a
N
1425start a partially assembled array. If
1426.B \-\-assemble
1427did not find enough devices to fully start the array, it might leaving
1428it partially assembled. If you wish, you can then use
1429.B \-\-run
1430to start the array in degraded mode.
52826846 1431
cd29a5c8 1432.TP
7e23fc43 1433.BR \-S ", " \-\-stop
cd29a5c8 1434deactivate array, releasing all resources.
52826846 1435
cd29a5c8 1436.TP
7e23fc43 1437.BR \-o ", " \-\-readonly
cd29a5c8 1438mark array as readonly.
52826846 1439
cd29a5c8 1440.TP
7e23fc43 1441.BR \-w ", " \-\-readwrite
cd29a5c8 1442mark array as readwrite.
52826846 1443
e0d19036 1444.TP
7e23fc43 1445.B \-\-zero\-superblock
e0d19036 1446If the device contains a valid md superblock, the block is
35cc5be4 1447overwritten with zeros. With
7e23fc43 1448.B \-\-force
35cc5be4 1449the block where the superblock would be is overwritten even if it
e0d19036 1450doesn't appear to be valid.
52826846 1451
33414a01
DW
1452.TP
1453.B \-\-kill\-subarray=
1454If the device is a container and the argument to \-\-kill\-subarray
1455specifies an inactive subarray in the container, then the subarray is
1456deleted. Deleting all subarrays will leave an 'empty-container' or
1457spare superblock on the drives. See \-\-zero\-superblock for completely
1458removing a superblock. Note that some formats depend on the subarray
1459index for generating a UUID, this command will fail if it would change
1460the UUID of an active subarray.
1461
aa534678
DW
1462.TP
1463.B \-\-update\-subarray=
1464If the device is a container and the argument to \-\-update\-subarray
1465specifies a subarray in the container, then attempt to update the given
1466superblock field in the subarray. See below in
1467.B MISC MODE
1468for details.
1469
feb716e9 1470.TP
7e23fc43 1471.BR \-t ", " \-\-test
feb716e9 1472When used with
7e23fc43 1473.BR \-\-detail ,
feb716e9
NB
1474the exit status of
1475.I mdadm
e0fe762a
N
1476is set to reflect the status of the device. See below in
1477.B MISC MODE
1478for details.
feb716e9 1479
b90c0e9a 1480.TP
7e23fc43 1481.BR \-W ", " \-\-wait
b90c0e9a
NB
1482For each md device given, wait for any resync, recovery, or reshape
1483activity to finish before returning.
1484.I mdadm
1485will return with success if it actually waited for every device
1486listed, otherwise it will return failure.
1487
1770662b
DW
1488.TP
1489.BR \-\-wait\-clean
fabbfd48
DW
1490For each md device given, or each device in /proc/mdstat if
1491.B \-\-scan
1492is given, arrange for the array to be marked clean as soon as possible.
7146ec6a
DW
1493.I mdadm
1494will return with success if the array uses external metadata and we
1495successfully waited. For native arrays this returns immediately as the
6a0ee6a0
DW
1496kernel handles dirty-clean transitions at shutdown. No action is taken
1497if safe-mode handling is disabled.
1770662b 1498
8382f19b
NB
1499.SH For Incremental Assembly mode:
1500.TP
7e23fc43 1501.BR \-\-rebuild\-map ", " \-r
8382f19b 1502Rebuild the map file
96fd06ed 1503.RB ( {MAP_PATH} )
8382f19b
NB
1504that
1505.I mdadm
1506uses to help track which arrays are currently being assembled.
1507
1508.TP
7e23fc43 1509.BR \-\-run ", " \-R
8382f19b
NB
1510Run any array assembled as soon as a minimal number of devices are
1511available, rather than waiting until all expected devices are present.
1512
1513.TP
7e23fc43 1514.BR \-\-scan ", " \-s
8382f19b 1515Only meaningful with
7e23fc43 1516.B \-R
8382f19b
NB
1517this will scan the
1518.B map
1519file for arrays that are being incrementally assembled and will try to
1520start any that are not already started. If any such array is listed
1521in
1522.B mdadm.conf
1523as requiring an external bitmap, that bitmap will be attached first.
1524
29ba4804
N
1525.TP
1526.BR \-\-fail ", " \-f
1527This allows the hot-plug system to remove devices that have fully disappeared
1528from the kernel. It will first fail and then remove the device from any
1529array it belongs to.
1530The device name given should be a kernel device name such as "sda",
1531not a name in
1532.IR /dev .
1533
210597d1
PC
1534.TP
1535.BR \-\-path=
87eb4fab
N
1536Only used with \-\-fail. The 'path' given will be recorded so that if
1537a new device appears at the same location it can be automatically
1538added to the same array. This allows the failed device to be
1539automatically replaced by a new device without metadata if it appears
1540at specified path. This option is normally only set by a
1541.I udev
1542script.
210597d1 1543
e0d19036
NB
1544.SH For Monitor mode:
1545.TP
7e23fc43 1546.BR \-m ", " \-\-mail
e0d19036
NB
1547Give a mail address to send alerts to.
1548
1549.TP
7e23fc43 1550.BR \-p ", " \-\-program ", " \-\-alert
e0d19036
NB
1551Give a program to be run whenever an event is detected.
1552
773135f5 1553.TP
7e23fc43 1554.BR \-y ", " \-\-syslog
773135f5
NB
1555Cause all events to be reported through 'syslog'. The messages have
1556facility of 'daemon' and varying priorities.
1557
e0d19036 1558.TP
7e23fc43 1559.BR \-d ", " \-\-delay
e0d19036 1560Give a delay in seconds.
51ac42e3 1561.I mdadm
e0d19036 1562polls the md arrays and then waits this many seconds before polling
e0fe762a
N
1563again. The default is 60 seconds. Since 2.6.16, there is no need to
1564reduce this as the kernel alerts
1565.I mdadm
1566immediately when there is any change.
e0d19036 1567
9a36a9b7
ZB
1568.TP
1569.BR \-r ", " \-\-increment
1570Give a percentage increment.
1571.I mdadm
1572will generate RebuildNN events with the given percentage increment.
1573
d013a55e 1574.TP
7e23fc43 1575.BR \-f ", " \-\-daemonise
d013a55e 1576Tell
51ac42e3 1577.I mdadm
d013a55e 1578to run as a background daemon if it decides to monitor anything. This
e0fe762a 1579causes it to fork and run in the child, and to disconnect from the
d013a55e
NB
1580terminal. The process id of the child is written to stdout.
1581This is useful with
7e23fc43 1582.B \-\-scan
d013a55e
NB
1583which will only continue monitoring if a mail address or alert program
1584is found in the config file.
1585
b5e64645 1586.TP
7e23fc43 1587.BR \-i ", " \-\-pid\-file
b5e64645 1588When
51ac42e3 1589.I mdadm
b5e64645
NB
1590is running in daemon mode, write the pid of the daemon process to
1591the specified file, instead of printing it on standard output.
1592
aa88f531 1593.TP
7e23fc43 1594.BR \-1 ", " \-\-oneshot
aa88f531
NB
1595Check arrays only once. This will generate
1596.B NewArray
1597events and more significantly
1598.B DegradedArray
a9d69660
NB
1599and
1600.B SparesMissing
aa88f531
NB
1601events. Running
1602.in +5
7e23fc43 1603.B " mdadm \-\-monitor \-\-scan \-1"
aa88f531
NB
1604.in -5
1605from a cron script will ensure regular notification of any degraded arrays.
1606
98c6faba 1607.TP
7e23fc43 1608.BR \-t ", " \-\-test
98c6faba
NB
1609Generate a
1610.B TestMessage
1611alert for every array found at startup. This alert gets mailed and
1612passed to the alert program. This can be used for testing that alert
a9d69660 1613message do get through successfully.
98c6faba 1614
210597d1
PC
1615.TP
1616.BR \-\-no\-sharing
87eb4fab 1617This inhibits the functionality for moving spares between arrays.
210597d1
PC
1618Only one monitoring process started with
1619.B \-\-scan
87eb4fab
N
1620but without this flag is allowed, otherwise the two could interfere
1621with each other.
210597d1 1622
e0d19036 1623.SH ASSEMBLE MODE
52826846 1624
cd29a5c8
NB
1625.HP 12
1626Usage:
7e23fc43 1627.B mdadm \-\-assemble
5787fa49
NB
1628.I md-device options-and-component-devices...
1629.HP 12
1630Usage:
7e23fc43 1631.B mdadm \-\-assemble \-\-scan
e0fe762a 1632.I md-devices-and-options...
cd29a5c8
NB
1633.HP 12
1634Usage:
7e23fc43 1635.B mdadm \-\-assemble \-\-scan
e0fe762a 1636.I options...
52826846 1637
cd29a5c8 1638.PP
e0fe762a 1639This usage assembles one or more RAID arrays from pre-existing components.
9a9dab36 1640For each array, mdadm needs to know the md device, the identity of the
e0fe762a 1641array, and a number of component-devices. These can be found in a number of ways.
52826846 1642
5787fa49 1643In the first usage example (without the
7e23fc43 1644.BR \-\-scan )
5787fa49
NB
1645the first device given is the md device.
1646In the second usage example, all devices listed are treated as md
1647devices and assembly is attempted.
1648In the third (where no devices are listed) all md devices that are
cb77f620 1649listed in the configuration file are assembled. If no arrays are
e0fe762a
N
1650described by the configuration file, then any arrays that
1651can be found on unused devices will be assembled.
52826846 1652
d013a55e 1653If precisely one device is listed, but
7e23fc43 1654.B \-\-scan
dd0781e5 1655is not given, then
d013a55e
NB
1656.I mdadm
1657acts as though
7e23fc43 1658.B \-\-scan
93e790af 1659was given and identity information is extracted from the configuration file.
d013a55e 1660
2ae555c3 1661The identity can be given with the
7e23fc43 1662.B \-\-uuid
e0fe762a
N
1663option, the
1664.B \-\-name
1665option, or the
7e23fc43 1666.B \-\-super\-minor
93e790af
SW
1667option, will be taken from the md-device record in the config file, or
1668will be taken from the super block of the first component-device
1669listed on the command line.
52826846 1670
2ae555c3 1671Devices can be given on the
7e23fc43 1672.B \-\-assemble
e0fe762a 1673command line or in the config file. Only devices which have an md
5787fa49
NB
1674superblock which contains the right identity will be considered for
1675any array.
52826846 1676
2ae555c3 1677The config file is only used if explicitly named with
7e23fc43 1678.B \-\-config
d013a55e 1679or requested with (a possibly implicit)
7e23fc43 1680.BR \-\-scan .
52826846 1681In the later case,
9a9dab36 1682.B /etc/mdadm.conf
8fd8d9c4
N
1683or
1684.B /etc/mdadm/mdadm.conf
52826846
NB
1685is used.
1686
2ae555c3 1687If
7e23fc43 1688.B \-\-scan
cd29a5c8
NB
1689is not given, then the config file will only be used to find the
1690identity of md arrays.
52826846 1691
2d465520 1692Normally the array will be started after it is assembled. However if
7e23fc43 1693.B \-\-scan
e0fe762a
N
1694is not given and not all expected drives were listed, then the array
1695is not started (to guard against usage errors). To insist that the
1696array be started in this case (as may work for RAID1, 4, 5, 6, or 10),
1697give the
7e23fc43 1698.B \-\-run
cd29a5c8 1699flag.
52826846 1700
e0fe762a
N
1701If
1702.I udev
1703is active,
1704.I mdadm
1705does not create any entries in
dd0781e5 1706.B /dev
e0fe762a
N
1707but leaves that to
1708.IR udev .
1709It does record information in
96fd06ed 1710.B {MAP_PATH}
e0fe762a
N
1711which will allow
1712.I udev
1713to choose the correct name.
dd0781e5 1714
e0fe762a
N
1715If
1716.I mdadm
1717detects that udev is not configured, it will create the devices in
1718.B /dev
1719itself.
dd0781e5 1720
e0fe762a
N
1721In Linux kernels prior to version 2.6.28 there were two distinctly
1722different types of md devices that could be created: one that could be
1723partitioned using standard partitioning tools and one that could not.
1724Since 2.6.28 that distinction is no longer relevant as both type of
1725devices can be partitioned.
1726.I mdadm
1727will normally create the type that originally could not be partitioned
1728as it has a well defined major number (9).
dd0781e5 1729
e0fe762a
N
1730Prior to 2.6.28, it is important that mdadm chooses the correct type
1731of array device to use. This can be controlled with the
1732.B \-\-auto
1733option. In particular, a value of "mdp" or "part" or "p" tells mdadm
1734to use a partitionable device rather than the default.
dd0781e5 1735
e0fe762a
N
1736In the no-udev case, the value given to
1737.B \-\-auto
1738can be suffixed by a number. This tells
1739.I mdadm
1740to create that number of partition devices rather than the default of 4.
dd0781e5 1741
e0fe762a 1742The value given to
7e23fc43 1743.B \-\-auto
e0fe762a
N
1744can also be given in the configuration file as a word starting
1745.B auto=
1746on the ARRAY line for the relevant array.
52826846 1747
41a3b72a
NB
1748.SS Auto Assembly
1749When
7e23fc43 1750.B \-\-assemble
41a3b72a 1751is used with
7e23fc43 1752.B \-\-scan
41a3b72a
NB
1753and no devices are listed,
1754.I mdadm
1755will first attempt to assemble all the arrays listed in the config
1756file.
1757
cb77f620 1758If no arrays are listed in the config (other than those marked
e0fe762a
N
1759.BR <ignore> )
1760it will look through the available devices for possible arrays and
1761will try to assemble anything that it finds. Arrays which are tagged
1762as belonging to the given homehost will be assembled and started
1763normally. Arrays which do not obviously belong to this host are given
1764names that are expected not to conflict with anything local, and are
1765started "read-auto" so that nothing is written to any device until the
1766array is written to. i.e. automatic resync etc is delayed.
41a3b72a
NB
1767
1768If
1769.I mdadm
1770finds a consistent set of devices that look like they should comprise
1771an array, and if the superblock is tagged as belonging to the given
1772home host, it will automatically choose a device name and try to
1773assemble the array. If the array uses version-0.90 metadata, then the
1774.B minor
1775number as recorded in the superblock is used to create a name in
1776.B /dev/md/
1777so for example
1778.BR /dev/md/3 .
1779If the array uses version-1 metadata, then the
1780.B name
1781from the superblock is used to similarly create a name in
e0fe762a 1782.B /dev/md/
93e790af 1783(the name will have any 'host' prefix stripped first).
41a3b72a 1784
c64ba03a
N
1785This behaviour can be modified by the
1786.I AUTO
1787line in the
1788.I mdadm.conf
1789configuration file. This line can indicate that specific metadata
1790type should, or should not, be automatically assembled. If an array
1791is found which is not listed in
1792.I mdadm.conf
1793and has a metadata format that is denied by the
1794.I AUTO
1795line, then it will not be assembled.
1796The
1797.I AUTO
1798line can also request that all arrays identified as being for this
1799homehost should be assembled regardless of their metadata type.
1800See
1801.IR mdadm.conf (5)
1802for further details.
1803
246cebdb
AK
1804Note: Auto assembly cannot be used for assembling and activating some
1805arrays which are undergoing reshape. In particular as the
1806.B backup\-file
1807cannot be given, any reshape which requires a backup-file to continue
1808cannot be started by auto assembly. An array which is growing to more
1809devices and has passed the critical section can be assembled using
1810auto-assembly.
41a3b72a 1811
cd29a5c8 1812.SH BUILD MODE
52826846 1813
cd29a5c8
NB
1814.HP 12
1815Usage:
7e23fc43 1816.B mdadm \-\-build
93e790af 1817.I md-device
7e23fc43
PS
1818.BI \-\-chunk= X
1819.BI \-\-level= Y
1820.BI \-\-raid\-devices= Z
cd29a5c8
NB
1821.I devices
1822
1823.PP
2ae555c3 1824This usage is similar to
7e23fc43 1825.BR \-\-create .
e0fe762a 1826The difference is that it creates an array without a superblock. With
cd29a5c8 1827these arrays there is no difference between initially creating the array and
52826846
NB
1828subsequently assembling the array, except that hopefully there is useful
1829data there in the second case.
1830
e0fe762a
N
1831The level may raid0, linear, raid1, raid10, multipath, or faulty, or
1832one of their synonyms. All devices must be listed and the array will
1833be started once complete. It will often be appropriate to use
1834.B \-\-assume\-clean
1835with levels raid1 or raid10.
cd29a5c8
NB
1836
1837.SH CREATE MODE
1838
1839.HP 12
1840Usage:
7e23fc43 1841.B mdadm \-\-create
93e790af 1842.I md-device
7e23fc43
PS
1843.BI \-\-chunk= X
1844.BI \-\-level= Y
cd29a5c8 1845.br
7e23fc43 1846.BI \-\-raid\-devices= Z
e0fe762a 1847.I devices
cd29a5c8
NB
1848
1849.PP
1850This usage will initialise a new md array, associate some devices with
1851it, and activate the array.
1852
e0fe762a
N
1853The named device will normally not exist when
1854.I "mdadm \-\-create"
1855is run, but will be created by
1856.I udev
1857once the array becomes active.
dd0781e5 1858
e0fe762a
N
1859As devices are added, they are checked to see if they contain RAID
1860superblocks or filesystems. They are also checked to see if the variance in
cd29a5c8
NB
1861device size exceeds 1%.
1862
1863If any discrepancy is found, the array will not automatically be run, though
2ae555c3 1864the presence of a
7e23fc43 1865.B \-\-run
cd29a5c8
NB
1866can override this caution.
1867
2d465520 1868To create a "degraded" array in which some devices are missing, simply
d013a55e 1869give the word "\fBmissing\fP"
2d465520 1870in place of a device name. This will cause
51ac42e3 1871.I mdadm
2d465520
NB
1872to leave the corresponding slot in the array empty.
1873For a RAID4 or RAID5 array at most one slot can be
98c6faba 1874"\fBmissing\fP"; for a RAID6 array at most two slots.
2d465520
NB
1875For a RAID1 array, only one real device needs to be given. All of the
1876others can be
d013a55e 1877"\fBmissing\fP".
2d465520 1878
feb716e9 1879When creating a RAID5 array,
51ac42e3 1880.I mdadm
feb716e9 1881will automatically create a degraded array with an extra spare drive.
e0fe762a
N
1882This is because building the spare into a degraded array is in general
1883faster than resyncing the parity on a non-degraded, but not clean,
1884array. This feature can be overridden with the
7e23fc43 1885.B \-\-force
feb716e9
NB
1886option.
1887
0ee4da98 1888When creating an array with version-1 metadata a name for the array is
41a3b72a
NB
1889required.
1890If this is not given with the
7e23fc43 1891.B \-\-name
41a3b72a
NB
1892option,
1893.I mdadm
0ee4da98 1894will choose a name based on the last component of the name of the
41a3b72a
NB
1895device being created. So if
1896.B /dev/md3
1897is being created, then the name
1898.B 3
1899will be chosen.
1900If
1901.B /dev/md/home
1902is being created, then the name
1903.B home
1904will be used.
1905
e0fe762a
N
1906When creating a partition based array, using
1907.I mdadm
1908with version-1.x metadata, the partition type should be set to
e0f31f50 1909.B 0xDA
e0fe762a 1910(non fs-data). This type selection allows for greater precision since
e0f31f50
PC
1911using any other [RAID auto-detect (0xFD) or a GNU/Linux partition (0x83)],
1912might create problems in the event of array recovery through a live cdrom.
1913
3d3dd91e
NB
1914A new array will normally get a randomly assigned 128bit UUID which is
1915very likely to be unique. If you have a specific need, you can choose
1916a UUID for the array by giving the
7e23fc43 1917.B \-\-uuid=
3d3dd91e
NB
1918option. Be warned that creating two arrays with the same UUID is a
1919recipe for disaster. Also, using
7e23fc43 1920.B \-\-uuid=
3d3dd91e 1921when creating a v0.90 array will silently override any
7e23fc43 1922.B \-\-homehost=
3d3dd91e 1923setting.
e43d0cda
NB
1924.\"If the
1925.\".B \-\-size
1926.\"option is given, it is not necessary to list any component-devices in this command.
1927.\"They can be added later, before a
1928.\".B \-\-run.
1929.\"If no
1930.\".B \-\-size
1931.\"is given, the apparent size of the smallest drive given is used.
cd29a5c8 1932
bf95d0f3
N
1933If the metadata type supports it (currently only 1.x metadata), space
1934will be allocated to store a bad block list. This allows a modest
1935number of bad blocks to be recorded, allowing the drive to remain in
1936service while only partially functional.
1937
8fd8d9c4
N
1938When creating an array within a
1939.B CONTAINER
1940.I mdadm
1941can be given either the list of devices to use, or simply the name of
1942the container. The former case gives control over which devices in
1943the container will be used for the array. The latter case allows
1944.I mdadm
1945to automatically choose which devices to use based on how much spare
1946space is available.
1947
53e8b987 1948The General Management options that are valid with
7e23fc43 1949.B \-\-create
53e8b987 1950are:
cd29a5c8 1951.TP
7e23fc43 1952.B \-\-run
dd0781e5 1953insist on running the array even if some devices look like they might
cd29a5c8
NB
1954be in use.
1955
1956.TP
7e23fc43 1957.B \-\-readonly
b3f1c093 1958start the array readonly \(em not supported yet.
52826846 1959
e0d19036 1960.SH MANAGE MODE
cd29a5c8
NB
1961.HP 12
1962Usage:
e0d19036
NB
1963.B mdadm
1964.I device
1965.I options... devices...
cd29a5c8
NB
1966.PP
1967
e0d19036
NB
1968This usage will allow individual devices in an array to be failed,
1969removed or added. It is possible to perform multiple operations with
e0fe762a 1970on command. For example:
e0d19036 1971.br
7e23fc43 1972.B " mdadm /dev/md0 \-f /dev/hda1 \-r /dev/hda1 \-a /dev/hda1"
e0d19036
NB
1973.br
1974will firstly mark
1975.B /dev/hda1
1976as faulty in
1977.B /dev/md0
1978and will then remove it from the array and finally add it back
2d465520 1979in as a spare. However only one md array can be affected by a single
2ae555c3 1980command.
e0d19036 1981
e0fe762a
N
1982When a device is added to an active array, mdadm checks to see if it
1983has metadata on it which suggests that it was recently a member of the
a4e13010 1984array. If it does, it tries to "re\-add" the device. If there have
e0fe762a
N
1985been no changes since the device was removed, or if the array has a
1986write-intent bitmap which has recorded whatever changes there were,
1987then the device will immediately become a full member of the array and
1988those differences recorded in the bitmap will be resolved.
1989
e0d19036
NB
1990.SH MISC MODE
1991.HP 12
1992Usage:
9a9dab36 1993.B mdadm
e0d19036 1994.I options ...
e0fe762a 1995.I devices ...
e0d19036 1996.PP
cd29a5c8 1997
b5e64645 1998MISC mode includes a number of distinct operations that
e0d19036
NB
1999operate on distinct devices. The operations are:
2000.TP
962a108f 2001.B \-\-query
e0d19036
NB
2002The device is examined to see if it is
2003(1) an active md array, or
2004(2) a component of an md array.
2005The information discovered is reported.
2006
2007.TP
962a108f 2008.B \-\-detail
2d465520 2009The device should be an active md device.
e0fe762a 2010.B mdadm
2d465520 2011will display a detailed description of the array.
7e23fc43 2012.B \-\-brief
2d465520 2013or
7e23fc43 2014.B \-\-scan
2d465520 2015will cause the output to be less detailed and the format to be
e0d19036 2016suitable for inclusion in
87eb4fab 2017.BR mdadm.conf .
feb716e9
NB
2018The exit status of
2019.I mdadm
2020will normally be 0 unless
2021.I mdadm
93e790af 2022failed to get useful information about the device(s); however, if the
7e23fc43 2023.B \-\-test
feb716e9
NB
2024option is given, then the exit status will be:
2025.RS
2026.TP
20270
2028The array is functioning normally.
2029.TP
20301
2031The array has at least one failed device.
2032.TP
20332
a77be586 2034The array has multiple failed devices such that it is unusable.
feb716e9
NB
2035.TP
20364
2037There was an error while trying to get information about the device.
2038.RE
cd29a5c8 2039
4cce4069
DW
2040.TP
2041.B \-\-detail\-platform
e0fe762a 2042Print detail of the platform's RAID capabilities (firmware / hardware
4cce4069
DW
2043topology). If the metadata is specified with
2044.B \-e
2045or
2046.B \-\-metadata=
2047then the return status will be:
2048.RS
2049.TP
20500
2051metadata successfully enumerated its platform components on this system
2052.TP
20531
2054metadata is platform independent
2055.TP
20562
2057metadata failed to find its platform components on this system
2058.RE
2059
aa534678
DW
2060.TP
2061.B \-\-update\-subarray=
2062If the device is a container and the argument to \-\-update\-subarray
2063specifies a subarray in the container, then attempt to update the given
2064superblock field in the subarray. Similar to updating an array in
2065"assemble" mode, the field to update is selected by
2066.B \-U
2067or
2068.B \-\-update=
2069option. Currently only
2070.B name
2071is supported.
2072
2073The
2074.B name
2075option updates the subarray name in the metadata, it may not affect the
2076device node name or the device node symlink until the subarray is
2077re\-assembled. If updating
2078.B name
2079would change the UUID of an active subarray this operation is blocked,
2080and the command will end in an error.
2081
e0d19036 2082.TP
962a108f 2083.B \-\-examine
2d465520 2084The device should be a component of an md array.
51ac42e3 2085.I mdadm
2d465520 2086will read the md superblock of the device and display the contents.
e0d19036 2087If
7e23fc43 2088.B \-\-brief
93e790af 2089or
7e23fc43 2090.B \-\-scan
93e790af 2091is given, then multiple devices that are components of the one array
e0d19036
NB
2092are grouped together and reported in a single entry suitable
2093for inclusion in
87eb4fab 2094.BR mdadm.conf .
e0d19036 2095
2d465520 2096Having
7e23fc43 2097.B \-\-scan
e0d19036
NB
2098without listing any devices will cause all devices listed in the
2099config file to be examined.
2100
2101.TP
962a108f 2102.B \-\-stop
98c6faba
NB
2103The devices should be active md arrays which will be deactivated, as
2104long as they are not currently in use.
e0d19036
NB
2105
2106.TP
962a108f 2107.B \-\-run
e0d19036
NB
2108This will fully activate a partially assembled md array.
2109
2110.TP
962a108f 2111.B \-\-readonly
e0d19036
NB
2112This will mark an active array as read-only, providing that it is
2113not currently being used.
2114
2115.TP
962a108f 2116.B \-\-readwrite
e0d19036
NB
2117This will change a
2118.B readonly
2119array back to being read/write.
2120
2d465520 2121.TP
962a108f 2122.B \-\-scan
2d465520 2123For all operations except
7e23fc43
PS
2124.BR \-\-examine ,
2125.B \-\-scan
2d465520
NB
2126will cause the operation to be applied to all arrays listed in
2127.BR /proc/mdstat .
2128For
7e23fc43
PS
2129.BR \-\-examine,
2130.B \-\-scan
2d465520
NB
2131causes all devices listed in the config file to be examined.
2132
a1331cc4
N
2133.TP
2134.BR \-b ", " \-\-brief
2135Be less verbose. This is used with
2136.B \-\-detail
2137and
2138.BR \-\-examine .
2139Using
2140.B \-\-brief
2141with
2142.B \-\-verbose
2143gives an intermediate level of verbosity.
2144
e0d19036
NB
2145.SH MONITOR MODE
2146
cd29a5c8
NB
2147.HP 12
2148Usage:
7e23fc43 2149.B mdadm \-\-monitor
e0d19036
NB
2150.I options... devices...
2151
cd29a5c8 2152.PP
e0d19036 2153This usage causes
51ac42e3 2154.I mdadm
e0d19036
NB
2155to periodically poll a number of md arrays and to report on any events
2156noticed.
51ac42e3 2157.I mdadm
e0d19036
NB
2158will never exit once it decides that there are arrays to be checked,
2159so it should normally be run in the background.
2160
2d465520 2161As well as reporting events,
51ac42e3 2162.I mdadm
2d465520
NB
2163may move a spare drive from one array to another if they are in the
2164same
2165.B spare-group
210597d1
PC
2166or
2167.B domain
a9d69660 2168and if the destination array has a failed drive but no spares.
2d465520 2169
e0d19036 2170If any devices are listed on the command line,
51ac42e3 2171.I mdadm
e0fe762a 2172will only monitor those devices. Otherwise all arrays listed in the
e0d19036 2173configuration file will be monitored. Further, if
7e23fc43 2174.B \-\-scan
e0d19036
NB
2175is given, then any other md devices that appear in
2176.B /proc/mdstat
2177will also be monitored.
2178
2179The result of monitoring the arrays is the generation of events.
bd526cee 2180These events are passed to a separate program (if specified) and may
2d465520 2181be mailed to a given E-mail address.
e0d19036 2182
93e790af
SW
2183When passing events to a program, the program is run once for each event,
2184and is given 2 or 3 command-line arguments: the first is the
2185name of the event (see below), the second is the name of the
bd526cee 2186md device which is affected, and the third is the name of a related
93e790af 2187device if relevant (such as a component device that has failed).
cd29a5c8
NB
2188
2189If
7e23fc43 2190.B \-\-scan
e0d19036
NB
2191is given, then a program or an E-mail address must be specified on the
2192command line or in the config file. If neither are available, then
51ac42e3 2193.I mdadm
e0d19036
NB
2194will not monitor anything.
2195Without
93e790af 2196.B \-\-scan,
51ac42e3 2197.I mdadm
2d465520 2198will continue monitoring as long as something was found to monitor. If
e0d19036
NB
2199no program or email is given, then each event is reported to
2200.BR stdout .
cd29a5c8 2201
e0d19036
NB
2202The different events are:
2203
2204.RS 4
2205.TP
2206.B DeviceDisappeared
2d465520 2207An md array which previously was configured appears to no longer be
773135f5 2208configured. (syslog priority: Critical)
e0d19036 2209
b8f72a62
NB
2210If
2211.I mdadm
2212was told to monitor an array which is RAID0 or Linear, then it will
2213report
2214.B DeviceDisappeared
2215with the extra information
2216.BR Wrong-Level .
2217This is because RAID0 and Linear do not support the device-failed,
2218hot-spare and resync operations which are monitored.
2219
e0d19036
NB
2220.TP
2221.B RebuildStarted
773135f5 2222An md array started reconstruction. (syslog priority: Warning)
e0d19036
NB
2223
2224.TP
2225.BI Rebuild NN
2226Where
2227.I NN
9a36a9b7
ZB
2228is a two-digit number (ie. 05, 48). This indicates that rebuild
2229has passed that many percent of the total. The events are generated
2230with fixed increment since 0. Increment size may be specified with
2231a commandline option (default is 20). (syslog priority: Warning)
e0d19036 2232
98c6faba
NB
2233.TP
2234.B RebuildFinished
2235An md array that was rebuilding, isn't any more, either because it
773135f5 2236finished normally or was aborted. (syslog priority: Warning)
98c6faba 2237
e0d19036
NB
2238.TP
2239.B Fail
773135f5
NB
2240An active component device of an array has been marked as
2241faulty. (syslog priority: Critical)
e0d19036
NB
2242
2243.TP
2244.B FailSpare
2245A spare component device which was being rebuilt to replace a faulty
93e790af 2246device has failed. (syslog priority: Critical)
e0d19036
NB
2247
2248.TP
2249.B SpareActive
2250A spare component device which was being rebuilt to replace a faulty
98b24a2a 2251device has been successfully rebuilt and has been made active.
773135f5 2252(syslog priority: Info)
e0d19036
NB
2253
2254.TP
2255.B NewArray
2256A new md array has been detected in the
2257.B /proc/mdstat
e0fe762a 2258file. (syslog priority: Info)
e0d19036 2259
aa88f531
NB
2260.TP
2261.B DegradedArray
2262A newly noticed array appears to be degraded. This message is not
2263generated when
2264.I mdadm
2265notices a drive failure which causes degradation, but only when
2266.I mdadm
2267notices that an array is degraded when it first sees the array.
93e790af 2268(syslog priority: Critical)
aa88f531 2269
e0d19036
NB
2270.TP
2271.B MoveSpare
2272A spare drive has been moved from one array in a
2273.B spare-group
210597d1
PC
2274or
2275.B domain
e0d19036 2276to another to allow a failed drive to be replaced.
773135f5 2277(syslog priority: Info)
e0d19036 2278
b8f72a62
NB
2279.TP
2280.B SparesMissing
2281If
2282.I mdadm
2283has been told, via the config file, that an array should have a certain
2284number of spare devices, and
2285.I mdadm
93e790af 2286detects that it has fewer than this number when it first sees the
b8f72a62
NB
2287array, it will report a
2288.B SparesMissing
2289message.
d1732eeb 2290(syslog priority: Warning)
b8f72a62 2291
98c6faba
NB
2292.TP
2293.B TestMessage
2294An array was found at startup, and the
7e23fc43 2295.B \-\-test
98c6faba 2296flag was given.
773135f5 2297(syslog priority: Info)
e0d19036
NB
2298.RE
2299
2300Only
93e790af
SW
2301.B Fail,
2302.B FailSpare,
2303.B DegradedArray,
2304.B SparesMissing
e0d19036 2305and
98c6faba 2306.B TestMessage
e0d19036 2307cause Email to be sent. All events cause the program to be run.
93e790af 2308The program is run with two or three arguments: the event
e0d19036
NB
2309name, the array device and possibly a second device.
2310
2311Each event has an associated array device (e.g.
2312.BR /dev/md1 )
2313and possibly a second device. For
2314.BR Fail ,
2315.BR FailSpare ,
2316and
2317.B SpareActive
2318the second device is the relevant component device.
2319For
2320.B MoveSpare
2321the second device is the array that the spare was moved from.
2322
2323For
51ac42e3 2324.I mdadm
e0d19036 2325to move spares from one array to another, the different arrays need to
93e790af 2326be labeled with the same
e0d19036 2327.B spare-group
210597d1 2328or the spares must be allowed to migrate through matching POLICY domains
e0d19036
NB
2329in the configuration file. The
2330.B spare-group
93e790af 2331name can be any string; it is only necessary that different spare
2d465520 2332groups use different names.
e0d19036
NB
2333
2334When
51ac42e3 2335.I mdadm
93e790af 2336detects that an array in a spare group has fewer active
e0d19036
NB
2337devices than necessary for the complete array, and has no spare
2338devices, it will look for another array in the same spare group that
2339has a full complement of working drive and a spare. It will then
2340attempt to remove the spare from the second drive and add it to the
2341first.
2342If the removal succeeds but the adding fails, then it is added back to
2343the original array.
2344
210597d1
PC
2345If the spare group for a degraded array is not defined,
2346.I mdadm
2347will look at the rules of spare migration specified by POLICY lines in
87eb4fab 2348.B mdadm.conf
210597d1
PC
2349and then follow similar steps as above if a matching spare is found.
2350
dd0781e5
NB
2351.SH GROW MODE
2352The GROW mode is used for changing the size or shape of an active
2353array.
2354For this to work, the kernel must support the necessary change.
c64881d7 2355Various types of growth are being added during 2.6 development.
dd0781e5 2356
c64881d7 2357Currently the supported changes include
dfd4d8ee 2358.IP \(bu 4
c64881d7 2359change the "size" attribute for RAID1, RAID4, RAID5 and RAID6.
dfd4d8ee 2360.IP \(bu 4
c64881d7
N
2361increase or decrease the "raid\-devices" attribute of RAID0, RAID1, RAID4,
2362RAID5, and RAID6.
cb77f620 2363.IP \(bu 4
c64881d7 2364change the chunk-size and layout of RAID0, RAID4, RAID5 and RAID6.
cb77f620 2365.IP \(bu 4
c64881d7 2366convert between RAID1 and RAID5, between RAID5 and RAID6, between
cb77f620 2367RAID0, RAID4, and RAID5, and between RAID0 and RAID10 (in the near-2 mode).
dfd4d8ee 2368.IP \(bu 4
93e790af 2369add a write-intent bitmap to any array which supports these bitmaps, or
2ae555c3 2370remove a write-intent bitmap from such an array.
dfd4d8ee 2371.PP
dd0781e5 2372
9ab6e80a 2373Using GROW on containers is currently supported only for Intel's IMSM
c64881d7
N
2374container format. The number of devices in a container can be
2375increased - which affects all arrays in the container - or an array
2376in a container can be converted between levels where those levels are
2377supported by the container, and the conversion is on of those listed
9ab6e80a
N
2378above. Resizing arrays in an IMSM container with
2379.B "--grow --size"
2380is not yet supported.
8fd8d9c4 2381
ca24ddb0
AK
2382Grow functionality (e.g. expand a number of raid devices) for Intel's
2383IMSM container format has an experimental status. It is guarded by the
2384.B MDADM_EXPERIMENTAL
2385environment variable which must be set to '1' for a GROW command to
2386succeed.
2387This is for the following reasons:
2388
2389.IP 1.
0de8d44d
AK
2390Intel's native IMSM check-pointing is not fully tested yet.
2391This can causes IMSM incompatibility during the grow process: an array
ca24ddb0
AK
2392which is growing cannot roam between Microsoft Windows(R) and Linux
2393systems.
2394
2395.IP 2.
2396Interrupting a grow operation is not recommended, because it
2397has not been fully tested for Intel's IMSM container format yet.
2398
0de8d44d
AK
2399.PP
2400Note: Intel's native checkpointing doesn't use
2401.B --backup-file
2402option and it is transparent for assembly feature.
2403
2ae555c3 2404.SS SIZE CHANGES
c64881d7 2405Normally when an array is built the "size" is taken from the smallest
dd0781e5
NB
2406of the drives. If all the small drives in an arrays are, one at a
2407time, removed and replaced with larger drives, then you could have an
2408array of large drives with only a small amount used. In this
2409situation, changing the "size" with "GROW" mode will allow the extra
2410space to start being used. If the size is increased in this way, a
2411"resync" process will start to make sure the new parts of the array
2412are synchronised.
2413
2414Note that when an array changes size, any filesystem that may be
cb77f620 2415stored in the array will not automatically grow or shrink to use or
88b496c2 2416vacate the space. The
666bba9b
N
2417filesystem will need to be explicitly told to use the extra space
2418after growing, or to reduce its size
2419.B prior
2420to shrinking the array.
dd0781e5 2421
e0fe762a
N
2422Also the size of an array cannot be changed while it has an active
2423bitmap. If an array has a bitmap, it must be removed before the size
cb77f620 2424can be changed. Once the change is complete a new bitmap can be created.
e0fe762a
N
2425
2426.SS RAID\-DEVICES CHANGES
2ae555c3 2427
dd0781e5
NB
2428A RAID1 array can work with any number of devices from 1 upwards
2429(though 1 is not very useful). There may be times which you want to
2430increase or decrease the number of active devices. Note that this is
2431different to hot-add or hot-remove which changes the number of
2432inactive devices.
2433
2434When reducing the number of devices in a RAID1 array, the slots which
2435are to be removed from the array must already be vacant. That is, the
93e790af 2436devices which were in those slots must be failed and removed.
dd0781e5
NB
2437
2438When the number of devices is increased, any hot spares that are
a9d69660 2439present will be activated immediately.
dd0781e5 2440
f24e2d6c 2441Changing the number of active devices in a RAID5 or RAID6 is much more
2ae555c3 2442effort. Every block in the array will need to be read and written
f24e2d6c 2443back to a new location. From 2.6.17, the Linux Kernel is able to
ca4f89a3
N
2444increase the number of devices in a RAID5 safely, including restarting
2445an interrupted "reshape". From 2.6.31, the Linux Kernel is able to
f24e2d6c
N
2446increase or decrease the number of devices in a RAID5 or RAID6.
2447
c64881d7
N
2448From 2.6.35, the Linux Kernel is able to convert a RAID0 in to a RAID4
2449or RAID5.
2450.I mdadm
2451uses this functionality and the ability to add
2452devices to a RAID4 to allow devices to be added to a RAID0. When
2453requested to do this,
2454.I mdadm
2455will convert the RAID0 to a RAID4, add the necessary disks and make
2456the reshape happen, and then convert the RAID4 back to RAID0.
2457
f24e2d6c
N
2458When decreasing the number of devices, the size of the array will also
2459decrease. If there was data in the array, it could get destroyed and
666bba9b
N
2460this is not reversible, so you should firstly shrink the filesystem on
2461the array to fit within the new size. To help prevent accidents,
f24e2d6c
N
2462.I mdadm
2463requires that the size of the array be decreased first with
2464.BR "mdadm --grow --array-size" .
2465This is a reversible change which simply makes the end of the array
2466inaccessible. The integrity of any data can then be checked before
2467the non-reversible reduction in the number of devices is request.
2ae555c3 2468
cd19c0cf
JR
2469When relocating the first few stripes on a RAID5 or RAID6, it is not
2470possible to keep the data on disk completely consistent and
2471crash-proof. To provide the required safety, mdadm disables writes to
2472the array while this "critical section" is reshaped, and takes a
2473backup of the data that is in that section. For grows, this backup may be
2474stored in any spare devices that the array has, however it can also be
2475stored in a separate file specified with the
7e23fc43 2476.B \-\-backup\-file
cd19c0cf
JR
2477option, and is required to be specified for shrinks, RAID level
2478changes and layout changes. If this option is used, and the system
2479does crash during the critical period, the same file must be passed to
7e23fc43 2480.B \-\-assemble
cd19c0cf
JR
2481to restore the backup and reassemble the array. When shrinking rather
2482than growing the array, the reshape is done from the end towards the
2483beginning, so the "critical section" is at the end of the reshape.
2ae555c3 2484
f24e2d6c
N
2485.SS LEVEL CHANGES
2486
2487Changing the RAID level of any array happens instantaneously. However
cd19c0cf 2488in the RAID5 to RAID6 case this requires a non-standard layout of the
f24e2d6c 2489RAID6 data, and in the RAID6 to RAID5 case that non-standard layout is
cd19c0cf 2490required before the change can be accomplished. So while the level
f24e2d6c 2491change is instant, the accompanying layout change can take quite a
cd19c0cf
JR
2492long time. A
2493.B \-\-backup\-file
2494is required. If the array is not simultaneously being grown or
2495shrunk, so that the array size will remain the same - for example,
2496reshaping a 3-drive RAID5 into a 4-drive RAID6 - the backup file will
2497be used not just for a "cricital section" but throughout the reshape
2498operation, as described below under LAYOUT CHANGES.
f24e2d6c
N
2499
2500.SS CHUNK-SIZE AND LAYOUT CHANGES
2501
2502Changing the chunk-size of layout without also changing the number of
2503devices as the same time will involve re-writing all blocks in-place.
2504To ensure against data loss in the case of a crash, a
2505.B --backup-file
2506must be provided for these changes. Small sections of the array will
cd19c0cf
JR
2507be copied to the backup file while they are being rearranged. This
2508means that all the data is copied twice, once to the backup and once
2509to the new layout on the array, so this type of reshape will go very
2510slowly.
f24e2d6c
N
2511
2512If the reshape is interrupted for any reason, this backup file must be
cd19c0cf 2513made available to
f24e2d6c
N
2514.B "mdadm --assemble"
2515so the array can be reassembled. Consequently the file cannot be
2516stored on the device being reshaped.
2517
2518
2ae555c3
NB
2519.SS BITMAP CHANGES
2520
2521A write-intent bitmap can be added to, or removed from, an active
93e790af 2522array. Either internal bitmaps, or bitmaps stored in a separate file,
fe80f49b 2523can be added. Note that if you add a bitmap stored in a file which is
e0fe762a 2524in a filesystem that is on the RAID array being affected, the system
fe80f49b
NB
2525will deadlock. The bitmap must be on a separate filesystem.
2526
8382f19b
NB
2527.SH INCREMENTAL MODE
2528
2529.HP 12
2530Usage:
7e23fc43
PS
2531.B mdadm \-\-incremental
2532.RB [ \-\-run ]
2533.RB [ \-\-quiet ]
8382f19b
NB
2534.I component-device
2535.HP 12
2536Usage:
29ba4804
N
2537.B mdadm \-\-incremental \-\-fail
2538.I component-device
2539.HP 12
2540Usage:
7e6140e6 2541.B mdadm \-\-incremental \-\-rebuild\-map
8382f19b
NB
2542.HP 12
2543Usage:
7e23fc43 2544.B mdadm \-\-incremental \-\-run \-\-scan
8382f19b 2545
8382f19b
NB
2546.PP
2547This mode is designed to be used in conjunction with a device
2548discovery system. As devices are found in a system, they can be
2549passed to
7e23fc43 2550.B "mdadm \-\-incremental"
8382f19b
NB
2551to be conditionally added to an appropriate array.
2552
29ba4804
N
2553Conversely, it can also be used with the
2554.B \-\-fail
2555flag to do just the opposite and find whatever array a particular device
2556is part of and remove the device from that array.
2557
8fd8d9c4
N
2558If the device passed is a
2559.B CONTAINER
2560device created by a previous call to
2561.IR mdadm ,
2562then rather than trying to add that device to an array, all the arrays
2563described by the metadata of the container will be started.
2564
8382f19b
NB
2565.I mdadm
2566performs a number of tests to determine if the device is part of an
93e790af 2567array, and which array it should be part of. If an appropriate array
8382f19b
NB
2568is found, or can be created,
2569.I mdadm
2570adds the device to the array and conditionally starts the array.
2571
2572Note that
2573.I mdadm
87eb4fab
N
2574will normally only add devices to an array which were previously working
2575(active or spare) parts of that array. The support for automatic
210597d1
PC
2576inclusion of a new drive as a spare in some array requires
2577a configuration through POLICY in config file.
8382f19b 2578
8382f19b
NB
2579The tests that
2580.I mdadm
2581makes are as follow:
2582.IP +
2583Is the device permitted by
2584.BR mdadm.conf ?
2585That is, is it listed in a
2586.B DEVICES
2587line in that file. If
2588.B DEVICES
2589is absent then the default it to allow any device. Similar if
2590.B DEVICES
2591contains the special word
2592.B partitions
2593then any device is allowed. Otherwise the device name given to
2594.I mdadm
2595must match one of the names or patterns in a
2596.B DEVICES
2597line.
2598
2599.IP +
cb77f620
NK
2600Does the device have a valid md superblock? If a specific metadata
2601version is requested with
7e23fc43 2602.B \-\-metadata
8382f19b 2603or
7e23fc43 2604.B \-e
8382f19b
NB
2605then only that style of metadata is accepted, otherwise
2606.I mdadm
2607finds any known version of metadata. If no
2608.I md
210597d1
PC
2609metadata is found, the device may be still added to an array
2610as a spare if POLICY allows.
8382f19b 2611
d1302dd8 2612.ig
8382f19b
NB
2613.IP +
2614Does the metadata match an expected array?
2615The metadata can match in two ways. Either there is an array listed
2616in
2617.B mdadm.conf
2618which identifies the array (either by UUID, by name, by device list,
93e790af 2619or by minor-number), or the array was created with a
8382f19b 2620.B homehost
93e790af 2621specified and that
8382f19b 2622.B homehost
93e790af 2623matches the one in
8382f19b
NB
2624.B mdadm.conf
2625or on the command line.
2626If
2627.I mdadm
2628is not able to positively identify the array as belonging to the
2629current host, the device will be rejected.
d1302dd8 2630..
8382f19b 2631
cb77f620 2632.PP
8382f19b 2633.I mdadm
93e790af 2634keeps a list of arrays that it has partially assembled in
96fd06ed 2635.BR {MAP_PATH} .
e0fe762a 2636If no array exists which matches
8382f19b
NB
2637the metadata on the new device,
2638.I mdadm
2639must choose a device name and unit number. It does this based on any
2640name given in
2641.B mdadm.conf
2642or any name information stored in the metadata. If this name
2643suggests a unit number, that number will be used, otherwise a free
2644unit number will be chosen. Normally
2645.I mdadm
2646will prefer to create a partitionable array, however if the
2647.B CREATE
2648line in
2649.B mdadm.conf
2650suggests that a non-partitionable array is preferred, that will be
2651honoured.
2652
e0fe762a
N
2653If the array is not found in the config file and its metadata does not
2654identify it as belonging to the "homehost", then
2655.I mdadm
2656will choose a name for the array which is certain not to conflict with
2657any array which does belong to this host. It does this be adding an
2658underscore and a small number to the name preferred by the metadata.
2659
8382f19b
NB
2660Once an appropriate array is found or created and the device is added,
2661.I mdadm
2662must decide if the array is ready to be started. It will
2663normally compare the number of available (non-spare) devices to the
2664number of devices that the metadata suggests need to be active. If
2665there are at least that many, the array will be started. This means
2666that if any devices are missing the array will not be restarted.
2667
2668As an alternative,
7e23fc43 2669.B \-\-run
8382f19b 2670may be passed to
51ac42e3 2671.I mdadm
8382f19b 2672in which case the array will be run as soon as there are enough
e0fe762a
N
2673devices present for the data to be accessible. For a RAID1, that
2674means one device will start the array. For a clean RAID5, the array
8382f19b
NB
2675will be started as soon as all but one drive is present.
2676
93e790af 2677Note that neither of these approaches is really ideal. If it can
8382f19b
NB
2678be known that all device discovery has completed, then
2679.br
7e23fc43 2680.B " mdadm \-IRs"
8382f19b
NB
2681.br
2682can be run which will try to start all arrays that are being
2683incrementally assembled. They are started in "read-auto" mode in
2684which they are read-only until the first write request. This means
2685that no metadata updates are made and no attempt at resync or recovery
2686happens. Further devices that are found before the first write can
2687still be added safely.
2688
5545fa6d
DW
2689.SH ENVIRONMENT
2690This section describes environment variables that affect how mdadm
2691operates.
2692
2693.TP
2694.B MDADM_NO_MDMON
2695Setting this value to 1 will prevent mdadm from automatically launching
2696mdmon. This variable is intended primarily for debugging mdadm/mdmon.
2697
8fd8d9c4
N
2698.TP
2699.B MDADM_NO_UDEV
2700Normally,
2701.I mdadm
2702does not create any device nodes in /dev, but leaves that task to
2703.IR udev .
2704If
2705.I udev
2706appears not to be configured, or if this environment variable is set
2707to '1', the
2708.I mdadm
2709will create and devices that are needed.
2710
2d465520
NB
2711.SH EXAMPLES
2712
7e23fc43 2713.B " mdadm \-\-query /dev/name-of-device"
2d465520 2714.br
e0fe762a 2715This will find out if a given device is a RAID array, or is part of
5787fa49 2716one, and will provide brief information about the device.
2d465520 2717
7e23fc43 2718.B " mdadm \-\-assemble \-\-scan"
2d465520 2719.br
93e790af 2720This will assemble and start all arrays listed in the standard config
5787fa49 2721file. This command will typically go in a system startup file.
2d465520 2722
7e23fc43 2723.B " mdadm \-\-stop \-\-scan"
5787fa49 2724.br
93e790af 2725This will shut down all arrays that can be shut down (i.e. are not
19f8b8fc 2726currently in use). This will typically go in a system shutdown script.
2d465520 2727
7e23fc43 2728.B " mdadm \-\-follow \-\-scan \-\-delay=120"
2d465520 2729.br
5787fa49
NB
2730If (and only if) there is an Email address or program given in the
2731standard config file, then
2732monitor the status of all arrays listed in that file by
2733polling them ever 2 minutes.
2d465520 2734
7e23fc43 2735.B " mdadm \-\-create /dev/md0 \-\-level=1 \-\-raid\-devices=2 /dev/hd[ac]1"
2d465520 2736.br
5787fa49 2737Create /dev/md0 as a RAID1 array consisting of /dev/hda1 and /dev/hdc1.
2d465520 2738
2d465520 2739.br
7e23fc43 2740.B " echo 'DEVICE /dev/hd*[0\-9] /dev/sd*[0\-9]' > mdadm.conf"
2d465520 2741.br
7e23fc43 2742.B " mdadm \-\-detail \-\-scan >> mdadm.conf"
2d465520 2743.br
5787fa49
NB
2744This will create a prototype config file that describes currently
2745active arrays that are known to be made from partitions of IDE or SCSI drives.
2d465520
NB
2746This file should be reviewed before being used as it may
2747contain unwanted detail.
2748
7e23fc43 2749.B " echo 'DEVICE /dev/hd[a\-z] /dev/sd*[a\-z]' > mdadm.conf"
2d465520 2750.br
7e23fc43 2751.B " mdadm \-\-examine \-\-scan \-\-config=mdadm.conf >> mdadm.conf"
93e790af
SW
2752.br
2753This will find arrays which could be assembled from existing IDE and
2754SCSI whole drives (not partitions), and store the information in the
5787fa49 2755format of a config file.
2d465520
NB
2756This file is very likely to contain unwanted detail, particularly
2757the
2758.B devices=
5787fa49
NB
2759entries. It should be reviewed and edited before being used as an
2760actual config file.
2d465520 2761
7e23fc43 2762.B " mdadm \-\-examine \-\-brief \-\-scan \-\-config=partitions"
2d465520 2763.br
7e23fc43 2764.B " mdadm \-Ebsc partitions"
5787fa49
NB
2765.br
2766Create a list of devices by reading
2767.BR /proc/partitions ,
2768scan these for RAID superblocks, and printout a brief listing of all
93e790af 2769that were found.
2d465520 2770
7e23fc43 2771.B " mdadm \-Ac partitions \-m 0 /dev/md0"
2d465520 2772.br
5787fa49
NB
2773Scan all partitions and devices listed in
2774.BR /proc/partitions
2775and assemble
2776.B /dev/md0
2777out of all such devices with a RAID superblock with a minor number of 0.
2d465520 2778
96fd06ed 2779.B " mdadm \-\-monitor \-\-scan \-\-daemonise > /run/mdadm/mon.pid"
d013a55e
NB
2780.br
2781If config file contains a mail address or alert program, run mdadm in
2782the background in monitor mode monitoring all md devices. Also write
2783pid of mdadm daemon to
96fd06ed 2784.BR /run/mdadm/mon.pid .
d013a55e 2785
7e23fc43 2786.B " mdadm \-Iq /dev/somedevice"
8382f19b
NB
2787.br
2788Try to incorporate newly discovered device into some array as
2789appropriate.
2790
7e6140e6 2791.B " mdadm \-\-incremental \-\-rebuild\-map \-\-run \-\-scan"
8382f19b
NB
2792.br
2793Rebuild the array map from any current arrays, and then start any that
2794can be started.
2795
b80da661
NB
2796.B " mdadm /dev/md4 --fail detached --remove detached"
2797.br
2798Any devices which are components of /dev/md4 will be marked as faulty
2799and then remove from the array.
2800
cb77f620 2801.B " mdadm --grow /dev/md4 --level=6 --backup-file=/root/backup-md4"
f24e2d6c
N
2802.br
2803The array
2804.B /dev/md4
2805which is currently a RAID5 array will be converted to RAID6. There
2806should normally already be a spare drive attached to the array as a
2807RAID6 needs one more drive than a matching RAID5.
2808
8fd8d9c4
N
2809.B " mdadm --create /dev/md/ddf --metadata=ddf --raid-disks 6 /dev/sd[a-f]"
2810.br
2811Create a DDF array over 6 devices.
2812
2813.B " mdadm --create /dev/md/home -n3 -l5 -z 30000000 /dev/md/ddf"
2814.br
e0fe762a 2815Create a RAID5 array over any 3 devices in the given DDF set. Use
8fd8d9c4
N
2816only 30 gigabytes of each device.
2817
2818.B " mdadm -A /dev/md/ddf1 /dev/sd[a-f]"
2819.br
2820Assemble a pre-exist ddf array.
2821
2822.B " mdadm -I /dev/md/ddf1"
2823.br
2824Assemble all arrays contained in the ddf array, assigning names as
2825appropriate.
2826
7e23fc43 2827.B " mdadm \-\-create \-\-help"
2d465520 2828.br
2ae555c3 2829Provide help about the Create mode.
2d465520 2830
7e23fc43 2831.B " mdadm \-\-config \-\-help"
5787fa49
NB
2832.br
2833Provide help about the format of the config file.
2d465520 2834
7e23fc43 2835.B " mdadm \-\-help"
5787fa49
NB
2836.br
2837Provide general help.
cd29a5c8 2838
cd29a5c8
NB
2839.SH FILES
2840
2841.SS /proc/mdstat
2842
2ae555c3
NB
2843If you're using the
2844.B /proc
cd29a5c8
NB
2845filesystem,
2846.B /proc/mdstat
2d465520 2847lists all active md devices with information about them.
51ac42e3 2848.I mdadm
2d465520 2849uses this to find arrays when
7e23fc43 2850.B \-\-scan
2d465520
NB
2851is given in Misc mode, and to monitor array reconstruction
2852on Monitor mode.
2853
9a9dab36 2854.SS /etc/mdadm.conf
cd29a5c8 2855
11a3e71d
NB
2856The config file lists which devices may be scanned to see if
2857they contain MD super block, and gives identifying information
2858(e.g. UUID) about known MD arrays. See
2859.BR mdadm.conf (5)
2860for more details.
cd29a5c8 2861
96fd06ed 2862.SS {MAP_PATH}
8382f19b 2863When
7e23fc43 2864.B \-\-incremental
93e790af 2865mode is used, this file gets a list of arrays currently being created.
8382f19b 2866
48f7b27a
NB
2867.SH DEVICE NAMES
2868
48f7b27a 2869.I mdadm
8fd8d9c4
N
2870understand two sorts of names for array devices.
2871
2872The first is the so-called 'standard' format name, which matches the
2873names used by the kernel and which appear in
2874.IR /proc/mdstat .
2875
2876The second sort can be freely chosen, but must reside in
2877.IR /dev/md/ .
2878When giving a device name to
2879.I mdadm
2880to create or assemble an array, either full path name such as
2881.I /dev/md0
2882or
2883.I /dev/md/home
2884can be given, or just the suffix of the second sort of name, such as
2885.I home
2886can be given.
2887
2888When
2889.I mdadm
e0fe762a
N
2890chooses device names during auto-assembly or incremental assembly, it
2891will sometimes add a small sequence number to the end of the name to
2892avoid conflicted between multiple arrays that have the same name. If
8fd8d9c4
N
2893.I mdadm
2894can reasonably determine that the array really is meant for this host,
2895either by a hostname in the metadata, or by the presence of the array
87eb4fab
N
2896in
2897.BR mdadm.conf ,
2898then it will leave off the suffix if possible.
e0fe762a
N
2899Also if the homehost is specified as
2900.B <ignore>
2901.I mdadm
2902will only use a suffix if a different array of the same name already
2903exists or is listed in the config file.
48f7b27a
NB
2904
2905The standard names for non-partitioned arrays (the only sort of md
8fd8d9c4 2906array available in 2.4 and earlier) are of the form
48f7b27a
NB
2907.IP
2908/dev/mdNN
48f7b27a
NB
2909.PP
2910where NN is a number.
2911The standard names for partitionable arrays (as available from 2.6
8fd8d9c4 2912onwards) are of the form
48f7b27a 2913.IP
48f7b27a
NB
2914/dev/md_dNN
2915.PP
2916Partition numbers should be indicated by added "pMM" to these, thus "/dev/md/d1p2".
8fd8d9c4
N
2917.PP
2918From kernel version, 2.6.28 the "non-partitioned array" can actually
2919be partitioned. So the "md_dNN" names are no longer needed, and
2920partitions such as "/dev/mdNNpXX" are possible.
52826846 2921
2d465520 2922.SH NOTE
51ac42e3 2923.I mdadm
2d465520 2924was previously known as
51ac42e3 2925.IR mdctl .
a9d69660 2926.P
51ac42e3 2927.I mdadm
a9d69660 2928is completely separate from the
51ac42e3 2929.I raidtools
a9d69660
NB
2930package, and does not use the
2931.I /etc/raidtab
2932configuration file at all.
2933
52826846 2934.SH SEE ALSO
75f74377 2935For further information on mdadm usage, MD and the various levels of
3cdfb6a7 2936RAID, see:
3cdfb6a7 2937.IP
cb77f620 2938.B http://raid.wiki.kernel.org/
75f74377
DG
2939.PP
2940(based upon Jakob \(/Ostergaard's Software\-RAID.HOWTO)
e43d0cda
NB
2941.\".PP
2942.\"for new releases of the RAID driver check out:
2943.\"
2944.\".IP
e0fe762a 2945.\".UR ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
e43d0cda
NB
2946.\"ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
2947.\".UE
2948.\".PP
2949.\"or
2950.\".IP
2951.\".UR http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2952.\"http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2953.\".UE
cd29a5c8 2954.PP
2ae555c3 2955The latest version of
a9d69660
NB
2956.I mdadm
2957should always be available from
cd29a5c8 2958.IP
11cd8b79
N
2959.B http://www.kernel.org/pub/linux/utils/raid/mdadm/
2960.PP
2961Related man pages:
cd29a5c8 2962.PP
e0fe762a 2963.IR mdmon (8),
a9d69660
NB
2964.IR mdadm.conf (5),
2965.IR md (4).
56eb10c0 2966.PP
52826846
NB
2967.IR raidtab (5),
2968.IR raid0run (8),
2969.IR raidstop (8),
a9d69660 2970.IR mkraid (8).