]> git.ipfire.org Git - thirdparty/mdadm.git/blame_incremental - mdadm.8.in
test/10-ddf-create: fix comments
[thirdparty/mdadm.git] / mdadm.8.in
... / ...
CommitLineData
1.\" -*- nroff -*-
2.\" Copyright Neil Brown and others.
3.\" This program is free software; you can redistribute it and/or modify
4.\" it under the terms of the GNU General Public License as published by
5.\" the Free Software Foundation; either version 2 of the License, or
6.\" (at your option) any later version.
7.\" See file COPYING in distribution for details.
8.TH MDADM 8 "" v3.2.5
9.SH NAME
10mdadm \- manage MD devices
11.I aka
12Linux Software RAID
13
14.SH SYNOPSIS
15
16.BI mdadm " [mode] <raiddevice> [options] <component-devices>"
17
18.SH DESCRIPTION
19RAID devices are virtual devices created from two or more
20real block devices. This allows multiple devices (typically disk
21drives or partitions thereof) to be combined into a single device to
22hold (for example) a single filesystem.
23Some RAID levels include redundancy and so can survive some degree of
24device failure.
25
26Linux Software RAID devices are implemented through the md (Multiple
27Devices) device driver.
28
29Currently, Linux supports
30.B LINEAR
31md devices,
32.B RAID0
33(striping),
34.B RAID1
35(mirroring),
36.BR RAID4 ,
37.BR RAID5 ,
38.BR RAID6 ,
39.BR RAID10 ,
40.BR MULTIPATH ,
41.BR FAULTY ,
42and
43.BR CONTAINER .
44
45.B MULTIPATH
46is not a Software RAID mechanism, but does involve
47multiple devices:
48each device is a path to one common physical storage device.
49New installations should not use md/multipath as it is not well
50supported and has no ongoing development. Use the Device Mapper based
51multipath-tools instead.
52
53.B FAULTY
54is also not true RAID, and it only involves one device. It
55provides a layer over a true device that can be used to inject faults.
56
57.B CONTAINER
58is different again. A
59.B CONTAINER
60is a collection of devices that are
61managed as a set. This is similar to the set of devices connected to
62a hardware RAID controller. The set of devices may contain a number
63of different RAID arrays each utilising some (or all) of the blocks from a
64number of the devices in the set. For example, two devices in a 5-device set
65might form a RAID1 using the whole devices. The remaining three might
66have a RAID5 over the first half of each device, and a RAID0 over the
67second half.
68
69With a
70.BR CONTAINER ,
71there is one set of metadata that describes all of
72the arrays in the container. So when
73.I mdadm
74creates a
75.B CONTAINER
76device, the device just represents the metadata. Other normal arrays (RAID1
77etc) can be created inside the container.
78
79.SH MODES
80mdadm has several major modes of operation:
81.TP
82.B Assemble
83Assemble the components of a previously created
84array into an active array. Components can be explicitly given
85or can be searched for.
86.I mdadm
87checks that the components
88do form a bona fide array, and can, on request, fiddle superblock
89information so as to assemble a faulty array.
90
91.TP
92.B Build
93Build an array that doesn't have per-device metadata (superblocks). For these
94sorts of arrays,
95.I mdadm
96cannot differentiate between initial creation and subsequent assembly
97of an array. It also cannot perform any checks that appropriate
98components have been requested. Because of this, the
99.B Build
100mode should only be used together with a complete understanding of
101what you are doing.
102
103.TP
104.B Create
105Create a new array with per-device metadata (superblocks).
106Appropriate metadata is written to each device, and then the array
107comprising those devices is activated. A 'resync' process is started
108to make sure that the array is consistent (e.g. both sides of a mirror
109contain the same data) but the content of the device is left otherwise
110untouched.
111The array can be used as soon as it has been created. There is no
112need to wait for the initial resync to finish.
113
114.TP
115.B "Follow or Monitor"
116Monitor one or more md devices and act on any state changes. This is
117only meaningful for RAID1, 4, 5, 6, 10 or multipath arrays, as
118only these have interesting state. RAID0 or Linear never have
119missing, spare, or failed drives, so there is nothing to monitor.
120
121.TP
122.B "Grow"
123Grow (or shrink) an array, or otherwise reshape it in some way.
124Currently supported growth options including changing the active size
125of component devices and changing the number of active devices in
126Linear and RAID levels 0/1/4/5/6,
127changing the RAID level between 0, 1, 5, and 6, and between 0 and 10,
128changing the chunk size and layout for RAID 0,4,5,6,10 as well as adding or
129removing a write-intent bitmap.
130
131.TP
132.B "Incremental Assembly"
133Add a single device to an appropriate array. If the addition of the
134device makes the array runnable, the array will be started.
135This provides a convenient interface to a
136.I hot-plug
137system. As each device is detected,
138.I mdadm
139has a chance to include it in some array as appropriate.
140Optionally, when the
141.I \-\-fail
142flag is passed in we will remove the device from any active array
143instead of adding it.
144
145If a
146.B CONTAINER
147is passed to
148.I mdadm
149in this mode, then any arrays within that container will be assembled
150and started.
151
152.TP
153.B Manage
154This is for doing things to specific components of an array such as
155adding new spares and removing faulty devices.
156
157.TP
158.B Misc
159This is an 'everything else' mode that supports operations on active
160arrays, operations on component devices such as erasing old superblocks, and
161information gathering operations.
162.\"This mode allows operations on independent devices such as examine MD
163.\"superblocks, erasing old superblocks and stopping active arrays.
164
165.TP
166.B Auto-detect
167This mode does not act on a specific device or array, but rather it
168requests the Linux Kernel to activate any auto-detected arrays.
169.SH OPTIONS
170
171.SH Options for selecting a mode are:
172
173.TP
174.BR \-A ", " \-\-assemble
175Assemble a pre-existing array.
176
177.TP
178.BR \-B ", " \-\-build
179Build a legacy array without superblocks.
180
181.TP
182.BR \-C ", " \-\-create
183Create a new array.
184
185.TP
186.BR \-F ", " \-\-follow ", " \-\-monitor
187Select
188.B Monitor
189mode.
190
191.TP
192.BR \-G ", " \-\-grow
193Change the size or shape of an active array.
194
195.TP
196.BR \-I ", " \-\-incremental
197Add/remove a single device to/from an appropriate array, and possibly start the array.
198
199.TP
200.B \-\-auto-detect
201Request that the kernel starts any auto-detected arrays. This can only
202work if
203.I md
204is compiled into the kernel \(em not if it is a module.
205Arrays can be auto-detected by the kernel if all the components are in
206primary MS-DOS partitions with partition type
207.BR FD ,
208and all use v0.90 metadata.
209In-kernel autodetect is not recommended for new installations. Using
210.I mdadm
211to detect and assemble arrays \(em possibly in an
212.I initrd
213\(em is substantially more flexible and should be preferred.
214
215.P
216If a device is given before any options, or if the first option is
217.BR \-\-add ,
218.BR \-\-fail ,
219.BR \-\-remove ,
220or
221.BR \-\-replace ,
222then the MANAGE mode is assumed.
223Anything other than these will cause the
224.B Misc
225mode to be assumed.
226
227.SH Options that are not mode-specific are:
228
229.TP
230.BR \-h ", " \-\-help
231Display general help message or, after one of the above options, a
232mode-specific help message.
233
234.TP
235.B \-\-help\-options
236Display more detailed help about command line parsing and some commonly
237used options.
238
239.TP
240.BR \-V ", " \-\-version
241Print version information for mdadm.
242
243.TP
244.BR \-v ", " \-\-verbose
245Be more verbose about what is happening. This can be used twice to be
246extra-verbose.
247The extra verbosity currently only affects
248.B \-\-detail \-\-scan
249and
250.BR "\-\-examine \-\-scan" .
251
252.TP
253.BR \-q ", " \-\-quiet
254Avoid printing purely informative messages. With this,
255.I mdadm
256will be silent unless there is something really important to report.
257
258
259.TP
260.BR \-f ", " \-\-force
261Be more forceful about certain operations. See the various modes for
262the exact meaning of this option in different contexts.
263
264.TP
265.BR \-c ", " \-\-config=
266Specify the config file. Default is to use
267.BR /etc/mdadm.conf ,
268or if that is missing then
269.BR /etc/mdadm/mdadm.conf .
270If the config file given is
271.B "partitions"
272then nothing will be read, but
273.I mdadm
274will act as though the config file contained exactly
275.B "DEVICE partitions containers"
276and will read
277.B /proc/partitions
278to find a list of devices to scan, and
279.B /proc/mdstat
280to find a list of containers to examine.
281If the word
282.B "none"
283is given for the config file, then
284.I mdadm
285will act as though the config file were empty.
286
287.TP
288.BR \-s ", " \-\-scan
289Scan config file or
290.B /proc/mdstat
291for missing information.
292In general, this option gives
293.I mdadm
294permission to get any missing information (like component devices,
295array devices, array identities, and alert destination) from the
296configuration file (see previous option);
297one exception is MISC mode when using
298.B \-\-detail
299or
300.B \-\-stop,
301in which case
302.B \-\-scan
303says to get a list of array devices from
304.BR /proc/mdstat .
305
306.TP
307.BR \-e ", " \-\-metadata=
308Declare the style of RAID metadata (superblock) to be used. The
309default is {DEFAULT_METADATA} for
310.BR \-\-create ,
311and to guess for other operations.
312The default can be overridden by setting the
313.B metadata
314value for the
315.B CREATE
316keyword in
317.BR mdadm.conf .
318
319Options are:
320.RS
321.ie '{DEFAULT_METADATA}'0.90'
322.IP "0, 0.90, default"
323.el
324.IP "0, 0.90"
325Use the original 0.90 format superblock. This format limits arrays to
32628 component devices and limits component devices of levels 1 and
327greater to 2 terabytes. It is also possible for there to be confusion
328about whether the superblock applies to a whole device or just the
329last partition, if that partition starts on a 64K boundary.
330.ie '{DEFAULT_METADATA}'0.90'
331.IP "1, 1.0, 1.1, 1.2"
332.el
333.IP "1, 1.0, 1.1, 1.2 default"
334Use the new version-1 format superblock. This has fewer restrictions.
335It can easily be moved between hosts with different endian-ness, and a
336recovery operation can be checkpointed and restarted. The different
337sub-versions store the superblock at different locations on the
338device, either at the end (for 1.0), at the start (for 1.1) or 4K from
339the start (for 1.2). "1" is equivalent to "1.2" (the commonly
340preferred 1.x format).
341'if '{DEFAULT_METADATA}'1.2' "default" is equivalent to "1.2".
342.IP ddf
343Use the "Industry Standard" DDF (Disk Data Format) format defined by
344SNIA.
345When creating a DDF array a
346.B CONTAINER
347will be created, and normal arrays can be created in that container.
348.IP imsm
349Use the Intel(R) Matrix Storage Manager metadata format. This creates a
350.B CONTAINER
351which is managed in a similar manner to DDF, and is supported by an
352option-rom on some platforms:
353.IP
354.B http://www.intel.com/design/chipsets/matrixstorage_sb.htm
355.PP
356.RE
357
358.TP
359.B \-\-homehost=
360This will override any
361.B HOMEHOST
362setting in the config file and provides the identity of the host which
363should be considered the home for any arrays.
364
365When creating an array, the
366.B homehost
367will be recorded in the metadata. For version-1 superblocks, it will
368be prefixed to the array name. For version-0.90 superblocks, part of
369the SHA1 hash of the hostname will be stored in the later half of the
370UUID.
371
372When reporting information about an array, any array which is tagged
373for the given homehost will be reported as such.
374
375When using Auto-Assemble, only arrays tagged for the given homehost
376will be allowed to use 'local' names (i.e. not ending in '_' followed
377by a digit string). See below under
378.BR "Auto Assembly" .
379
380.TP
381.B \-\-prefer=
382When
383.I mdadm
384needs to print the name for a device it normally finds the name in
385.B /dev
386which refers to the device and is shortest. When a path component is
387given with
388.B \-\-prefer
389.I mdadm
390will prefer a longer name if it contains that component. For example
391.B \-\-prefer=by-uuid
392will prefer a name in a subdirectory of
393.B /dev
394called
395.BR by-uuid .
396
397This functionality is currently only provided by
398.B \-\-detail
399and
400.BR \-\-monitor .
401
402.SH For create, build, or grow:
403
404.TP
405.BR \-n ", " \-\-raid\-devices=
406Specify the number of active devices in the array. This, plus the
407number of spare devices (see below) must equal the number of
408.I component-devices
409(including "\fBmissing\fP" devices)
410that are listed on the command line for
411.BR \-\-create .
412Setting a value of 1 is probably
413a mistake and so requires that
414.B \-\-force
415be specified first. A value of 1 will then be allowed for linear,
416multipath, RAID0 and RAID1. It is never allowed for RAID4, RAID5 or RAID6.
417.br
418This number can only be changed using
419.B \-\-grow
420for RAID1, RAID4, RAID5 and RAID6 arrays, and only on kernels which provide
421the necessary support.
422
423.TP
424.BR \-x ", " \-\-spare\-devices=
425Specify the number of spare (eXtra) devices in the initial array.
426Spares can also be added
427and removed later. The number of component devices listed
428on the command line must equal the number of RAID devices plus the
429number of spare devices.
430
431.TP
432.BR \-z ", " \-\-size=
433Amount (in Kibibytes) of space to use from each drive in RAID levels 1/4/5/6.
434This must be a multiple of the chunk size, and must leave about 128Kb
435of space at the end of the drive for the RAID superblock.
436If this is not specified
437(as it normally is not) the smallest drive (or partition) sets the
438size, though if there is a variance among the drives of greater than 1%, a warning is
439issued.
440
441A suffix of 'M' or 'G' can be given to indicate Megabytes or
442Gigabytes respectively.
443
444Sometimes a replacement drive can be a little smaller than the
445original drives though this should be minimised by IDEMA standards.
446Such a replacement drive will be rejected by
447.IR md .
448To guard against this it can be useful to set the initial size
449slightly smaller than the smaller device with the aim that it will
450still be larger than any replacement.
451
452This value can be set with
453.B \-\-grow
454for RAID level 1/4/5/6 though
455.B CONTAINER
456based arrays such as those with IMSM metadata may not be able to
457support this.
458If the array was created with a size smaller than the currently
459active drives, the extra space can be accessed using
460.BR \-\-grow .
461The size can be given as
462.B max
463which means to choose the largest size that fits on all current drives.
464
465Before reducing the size of the array (with
466.BR "\-\-grow \-\-size=" )
467you should make sure that space isn't needed. If the device holds a
468filesystem, you would need to resize the filesystem to use less space.
469
470After reducing the array size you should check that the data stored in
471the device is still available. If the device holds a filesystem, then
472an 'fsck' of the filesystem is a minimum requirement. If there are
473problems the array can be made bigger again with no loss with another
474.B "\-\-grow \-\-size="
475command.
476
477This value cannot be used when creating a
478.B CONTAINER
479such as with DDF and IMSM metadata, though it perfectly valid when
480creating an array inside a container.
481
482.TP
483.BR \-Z ", " \-\-array\-size=
484This is only meaningful with
485.B \-\-grow
486and its effect is not persistent: when the array is stopped and
487restarted the default array size will be restored.
488
489Setting the array-size causes the array to appear smaller to programs
490that access the data. This is particularly needed before reshaping an
491array so that it will be smaller. As the reshape is not reversible,
492but setting the size with
493.B \-\-array-size
494is, it is required that the array size is reduced as appropriate
495before the number of devices in the array is reduced.
496
497Before reducing the size of the array you should make sure that space
498isn't needed. If the device holds a filesystem, you would need to
499resize the filesystem to use less space.
500
501After reducing the array size you should check that the data stored in
502the device is still available. If the device holds a filesystem, then
503an 'fsck' of the filesystem is a minimum requirement. If there are
504problems the array can be made bigger again with no loss with another
505.B "\-\-grow \-\-array\-size="
506command.
507
508A suffix of 'M' or 'G' can be given to indicate Megabytes or
509Gigabytes respectively.
510A value of
511.B max
512restores the apparent size of the array to be whatever the real
513amount of available space is.
514
515.TP
516.BR \-c ", " \-\-chunk=
517Specify chunk size of kibibytes. The default when creating an
518array is 512KB. To ensure compatibility with earlier versions, the
519default when Building and array with no persistent metadata is 64KB.
520This is only meaningful for RAID0, RAID4, RAID5, RAID6, and RAID10.
521
522RAID4, RAID5, RAID6, and RAID10 require the chunk size to be a power
523of 2. In any case it must be a multiple of 4KB.
524
525A suffix of 'M' or 'G' can be given to indicate Megabytes or
526Gigabytes respectively.
527
528.TP
529.BR \-\-rounding=
530Specify rounding factor for a Linear array. The size of each
531component will be rounded down to a multiple of this size.
532This is a synonym for
533.B \-\-chunk
534but highlights the different meaning for Linear as compared to other
535RAID levels. The default is 64K if a kernel earlier than 2.6.16 is in
536use, and is 0K (i.e. no rounding) in later kernels.
537
538.TP
539.BR \-l ", " \-\-level=
540Set RAID level. When used with
541.BR \-\-create ,
542options are: linear, raid0, 0, stripe, raid1, 1, mirror, raid4, 4,
543raid5, 5, raid6, 6, raid10, 10, multipath, mp, faulty, container.
544Obviously some of these are synonymous.
545
546When a
547.B CONTAINER
548metadata type is requested, only the
549.B container
550level is permitted, and it does not need to be explicitly given.
551
552When used with
553.BR \-\-build ,
554only linear, stripe, raid0, 0, raid1, multipath, mp, and faulty are valid.
555
556Can be used with
557.B \-\-grow
558to change the RAID level in some cases. See LEVEL CHANGES below.
559
560.TP
561.BR \-p ", " \-\-layout=
562This option configures the fine details of data layout for RAID5, RAID6,
563and RAID10 arrays, and controls the failure modes for
564.IR faulty .
565
566The layout of the RAID5 parity block can be one of
567.BR left\-asymmetric ,
568.BR left\-symmetric ,
569.BR right\-asymmetric ,
570.BR right\-symmetric ,
571.BR la ", " ra ", " ls ", " rs .
572The default is
573.BR left\-symmetric .
574
575It is also possible to cause RAID5 to use a RAID4-like layout by
576choosing
577.BR parity\-first ,
578or
579.BR parity\-last .
580
581Finally for RAID5 there are DDF\-compatible layouts,
582.BR ddf\-zero\-restart ,
583.BR ddf\-N\-restart ,
584and
585.BR ddf\-N\-continue .
586
587These same layouts are available for RAID6. There are also 4 layouts
588that will provide an intermediate stage for converting between RAID5
589and RAID6. These provide a layout which is identical to the
590corresponding RAID5 layout on the first N\-1 devices, and has the 'Q'
591syndrome (the second 'parity' block used by RAID6) on the last device.
592These layouts are:
593.BR left\-symmetric\-6 ,
594.BR right\-symmetric\-6 ,
595.BR left\-asymmetric\-6 ,
596.BR right\-asymmetric\-6 ,
597and
598.BR parity\-first\-6 .
599
600When setting the failure mode for level
601.I faulty,
602the options are:
603.BR write\-transient ", " wt ,
604.BR read\-transient ", " rt ,
605.BR write\-persistent ", " wp ,
606.BR read\-persistent ", " rp ,
607.BR write\-all ,
608.BR read\-fixable ", " rf ,
609.BR clear ", " flush ", " none .
610
611Each failure mode can be followed by a number, which is used as a period
612between fault generation. Without a number, the fault is generated
613once on the first relevant request. With a number, the fault will be
614generated after that many requests, and will continue to be generated
615every time the period elapses.
616
617Multiple failure modes can be current simultaneously by using the
618.B \-\-grow
619option to set subsequent failure modes.
620
621"clear" or "none" will remove any pending or periodic failure modes,
622and "flush" will clear any persistent faults.
623
624Finally, the layout options for RAID10 are one of 'n', 'o' or 'f' followed
625by a small number. The default is 'n2'. The supported options are:
626
627.I 'n'
628signals 'near' copies. Multiple copies of one data block are at
629similar offsets in different devices.
630
631.I 'o'
632signals 'offset' copies. Rather than the chunks being duplicated
633within a stripe, whole stripes are duplicated but are rotated by one
634device so duplicate blocks are on different devices. Thus subsequent
635copies of a block are in the next drive, and are one chunk further
636down.
637
638.I 'f'
639signals 'far' copies
640(multiple copies have very different offsets).
641See md(4) for more detail about 'near', 'offset', and 'far'.
642
643The number is the number of copies of each datablock. 2 is normal, 3
644can be useful. This number can be at most equal to the number of
645devices in the array. It does not need to divide evenly into that
646number (e.g. it is perfectly legal to have an 'n2' layout for an array
647with an odd number of devices).
648
649When an array is converted between RAID5 and RAID6 an intermediate
650RAID6 layout is used in which the second parity block (Q) is always on
651the last device. To convert a RAID5 to RAID6 and leave it in this new
652layout (which does not require re-striping) use
653.BR \-\-layout=preserve .
654This will try to avoid any restriping.
655
656The converse of this is
657.B \-\-layout=normalise
658which will change a non-standard RAID6 layout into a more standard
659arrangement.
660
661.TP
662.BR \-\-parity=
663same as
664.B \-\-layout
665(thus explaining the p of
666.BR \-p ).
667
668.TP
669.BR \-b ", " \-\-bitmap=
670Specify a file to store a write-intent bitmap in. The file should not
671exist unless
672.B \-\-force
673is also given. The same file should be provided
674when assembling the array. If the word
675.B "internal"
676is given, then the bitmap is stored with the metadata on the array,
677and so is replicated on all devices. If the word
678.B "none"
679is given with
680.B \-\-grow
681mode, then any bitmap that is present is removed.
682
683To help catch typing errors, the filename must contain at least one
684slash ('/') if it is a real file (not 'internal' or 'none').
685
686Note: external bitmaps are only known to work on ext2 and ext3.
687Storing bitmap files on other filesystems may result in serious problems.
688
689When creating an array on devices which are 100G or larger,
690.I mdadm
691automatically adds an internal bitmap as it will usually be
692beneficial. This can be suppressed with
693.B "\-\-bitmap=none".
694
695.TP
696.BR \-\-bitmap\-chunk=
697Set the chunksize of the bitmap. Each bit corresponds to that many
698Kilobytes of storage.
699When using a file based bitmap, the default is to use the smallest
700size that is at-least 4 and requires no more than 2^21 chunks.
701When using an
702.B internal
703bitmap, the chunksize defaults to 64Meg, or larger if necessary to
704fit the bitmap into the available space.
705
706A suffix of 'M' or 'G' can be given to indicate Megabytes or
707Gigabytes respectively.
708
709.TP
710.BR \-W ", " \-\-write\-mostly
711subsequent devices listed in a
712.BR \-\-build ,
713.BR \-\-create ,
714or
715.B \-\-add
716command will be flagged as 'write-mostly'. This is valid for RAID1
717only and means that the 'md' driver will avoid reading from these
718devices if at all possible. This can be useful if mirroring over a
719slow link.
720
721.TP
722.BR \-\-write\-behind=
723Specify that write-behind mode should be enabled (valid for RAID1
724only). If an argument is specified, it will set the maximum number
725of outstanding writes allowed. The default value is 256.
726A write-intent bitmap is required in order to use write-behind
727mode, and write-behind is only attempted on drives marked as
728.IR write-mostly .
729
730.TP
731.BR \-\-assume\-clean
732Tell
733.I mdadm
734that the array pre-existed and is known to be clean. It can be useful
735when trying to recover from a major failure as you can be sure that no
736data will be affected unless you actually write to the array. It can
737also be used when creating a RAID1 or RAID10 if you want to avoid the
738initial resync, however this practice \(em while normally safe \(em is not
739recommended. Use this only if you really know what you are doing.
740.IP
741When the devices that will be part of a new array were filled
742with zeros before creation the operator knows the array is
743actually clean. If that is the case, such as after running
744badblocks, this argument can be used to tell mdadm the
745facts the operator knows.
746.IP
747When an array is resized to a larger size with
748.B "\-\-grow \-\-size="
749the new space is normally resynced in that same way that the whole
750array is resynced at creation. From Linux version 3.0,
751.B \-\-assume\-clean
752can be used with that command to avoid the automatic resync.
753
754.TP
755.BR \-\-backup\-file=
756This is needed when
757.B \-\-grow
758is used to increase the number of raid-devices in a RAID5 or RAID6 if
759there are no spare devices available, or to shrink, change RAID level
760or layout. See the GROW MODE section below on RAID\-DEVICES CHANGES.
761The file must be stored on a separate device, not on the RAID array
762being reshaped.
763
764.TP
765.B \-\-data\-offset=
766Arrays with 1.x metadata can leave a gap between the start of the
767device and the start of array data. This gap can be used for various
768metadata. The start of data is known as the
769.IR data\-offset .
770Normally an appropriate data offset is computed automatically.
771However it can be useful to set it explicitly such as when re-creating
772an array which was originally created using a different version of
773.I mdadm
774which computed a different offset.
775
776Setting the offset explicitly over-rides the default. The value given
777is in Kilobytes unless an 'M' or 'G' suffix is given.
778
779Since Linux 3.4,
780.B \-\-data\-offset
781can also be used with
782.B --grow
783for some RAID levels (initially on RAID10). This allows the
784data\-offset to be changed as part of the reshape process. When the
785data offset is changed, no backup file is required as the difference
786in offsets is used to provide the same functionality.
787
788When the new offset is earlier than the old offset, the number of
789devices in the array cannot shrink. When it is after the old offset,
790the number of devices in the array cannot increase.
791
792When creating an array,
793.B \-\-data\-offset
794can be specified as
795.BR variable .
796In the case each member device is expected to have a offset appended
797to the name, separated by a colon. This makes it possible to recreate
798exactly an array which has varying data offsets (as can happen when
799different versions of
800.I mdadm
801are used to add different devices).
802
803.TP
804.BR \-\-continue
805This option is complementary to the
806.B \-\-freeze-reshape
807option for assembly. It is needed when
808.B \-\-grow
809operation is interrupted and it is not restarted automatically due to
810.B \-\-freeze-reshape
811usage during array assembly. This option is used together with
812.BR \-G
813, (
814.BR \-\-grow
815) command and device for a pending reshape to be continued.
816All parameters required for reshape continuation will be read from array metadata.
817If initial
818.BR \-\-grow
819command had required
820.BR \-\-backup\-file=
821option to be set, continuation option will require to have exactly the same
822backup file given as well.
823.IP
824Any other parameter passed together with
825.BR \-\-continue
826option will be ignored.
827
828.TP
829.BR \-N ", " \-\-name=
830Set a
831.B name
832for the array. This is currently only effective when creating an
833array with a version-1 superblock, or an array in a DDF container.
834The name is a simple textual string that can be used to identify array
835components when assembling. If name is needed but not specified, it
836is taken from the basename of the device that is being created.
837e.g. when creating
838.I /dev/md/home
839the
840.B name
841will default to
842.IR home .
843
844.TP
845.BR \-R ", " \-\-run
846Insist that
847.I mdadm
848run the array, even if some of the components
849appear to be active in another array or filesystem. Normally
850.I mdadm
851will ask for confirmation before including such components in an
852array. This option causes that question to be suppressed.
853
854.TP
855.BR \-f ", " \-\-force
856Insist that
857.I mdadm
858accept the geometry and layout specified without question. Normally
859.I mdadm
860will not allow creation of an array with only one device, and will try
861to create a RAID5 array with one missing drive (as this makes the
862initial resync work faster). With
863.BR \-\-force ,
864.I mdadm
865will not try to be so clever.
866
867.TP
868.BR \-o ", " \-\-readonly
869Start the array
870.B read only
871rather than read-write as normal. No writes will be allowed to the
872array, and no resync, recovery, or reshape will be started.
873
874.TP
875.BR \-a ", " "\-\-auto{=yes,md,mdp,part,p}{NN}"
876Instruct mdadm how to create the device file if needed, possibly allocating
877an unused minor number. "md" causes a non-partitionable array
878to be used (though since Linux 2.6.28, these array devices are in fact
879partitionable). "mdp", "part" or "p" causes a partitionable array (2.6 and
880later) to be used. "yes" requires the named md device to have
881a 'standard' format, and the type and minor number will be determined
882from this. With mdadm 3.0, device creation is normally left up to
883.I udev
884so this option is unlikely to be needed.
885See DEVICE NAMES below.
886
887The argument can also come immediately after
888"\-a". e.g. "\-ap".
889
890If
891.B \-\-auto
892is not given on the command line or in the config file, then
893the default will be
894.BR \-\-auto=yes .
895
896If
897.B \-\-scan
898is also given, then any
899.I auto=
900entries in the config file will override the
901.B \-\-auto
902instruction given on the command line.
903
904For partitionable arrays,
905.I mdadm
906will create the device file for the whole array and for the first 4
907partitions. A different number of partitions can be specified at the
908end of this option (e.g.
909.BR \-\-auto=p7 ).
910If the device name ends with a digit, the partition names add a 'p',
911and a number, e.g.
912.IR /dev/md/home1p3 .
913If there is no trailing digit, then the partition names just have a
914number added, e.g.
915.IR /dev/md/scratch3 .
916
917If the md device name is in a 'standard' format as described in DEVICE
918NAMES, then it will be created, if necessary, with the appropriate
919device number based on that name. If the device name is not in one of these
920formats, then a unused device number will be allocated. The device
921number will be considered unused if there is no active array for that
922number, and there is no entry in /dev for that number and with a
923non-standard name. Names that are not in 'standard' format are only
924allowed in "/dev/md/".
925
926This is meaningful with
927.B \-\-create
928or
929.BR \-\-build .
930
931.TP
932.BR \-a ", " "\-\-add"
933This option can be used in Grow mode in two cases.
934
935If the target array is a Linear array, then
936.B \-\-add
937can be used to add one or more devices to the array. They
938are simply catenated on to the end of the array. Once added, the
939devices cannot be removed.
940
941If the
942.B \-\-raid\-disks
943option is being used to increase the number of devices in an array,
944then
945.B \-\-add
946can be used to add some extra devices to be included in the array.
947In most cases this is not needed as the extra devices can be added as
948spares first, and then the number of raid-disks can be changed.
949However for RAID0, it is not possible to add spares. So to increase
950the number of devices in a RAID0, it is necessary to set the new
951number of devices, and to add the new devices, in the same command.
952
953.SH For assemble:
954
955.TP
956.BR \-u ", " \-\-uuid=
957uuid of array to assemble. Devices which don't have this uuid are
958excluded
959
960.TP
961.BR \-m ", " \-\-super\-minor=
962Minor number of device that array was created for. Devices which
963don't have this minor number are excluded. If you create an array as
964/dev/md1, then all superblocks will contain the minor number 1, even if
965the array is later assembled as /dev/md2.
966
967Giving the literal word "dev" for
968.B \-\-super\-minor
969will cause
970.I mdadm
971to use the minor number of the md device that is being assembled.
972e.g. when assembling
973.BR /dev/md0 ,
974.B \-\-super\-minor=dev
975will look for super blocks with a minor number of 0.
976
977.B \-\-super\-minor
978is only relevant for v0.90 metadata, and should not normally be used.
979Using
980.B \-\-uuid
981is much safer.
982
983.TP
984.BR \-N ", " \-\-name=
985Specify the name of the array to assemble. This must be the name
986that was specified when creating the array. It must either match
987the name stored in the superblock exactly, or it must match
988with the current
989.I homehost
990prefixed to the start of the given name.
991
992.TP
993.BR \-f ", " \-\-force
994Assemble the array even if the metadata on some devices appears to be
995out-of-date. If
996.I mdadm
997cannot find enough working devices to start the array, but can find
998some devices that are recorded as having failed, then it will mark
999those devices as working so that the array can be started.
1000An array which requires
1001.B \-\-force
1002to be started may contain data corruption. Use it carefully.
1003
1004.TP
1005.BR \-R ", " \-\-run
1006Attempt to start the array even if fewer drives were given than were
1007present last time the array was active. Normally if not all the
1008expected drives are found and
1009.B \-\-scan
1010is not used, then the array will be assembled but not started.
1011With
1012.B \-\-run
1013an attempt will be made to start it anyway.
1014
1015.TP
1016.B \-\-no\-degraded
1017This is the reverse of
1018.B \-\-run
1019in that it inhibits the startup of array unless all expected drives
1020are present. This is only needed with
1021.B \-\-scan,
1022and can be used if the physical connections to devices are
1023not as reliable as you would like.
1024
1025.TP
1026.BR \-a ", " "\-\-auto{=no,yes,md,mdp,part}"
1027See this option under Create and Build options.
1028
1029.TP
1030.BR \-b ", " \-\-bitmap=
1031Specify the bitmap file that was given when the array was created. If
1032an array has an
1033.B internal
1034bitmap, there is no need to specify this when assembling the array.
1035
1036.TP
1037.BR \-\-backup\-file=
1038If
1039.B \-\-backup\-file
1040was used while reshaping an array (e.g. changing number of devices or
1041chunk size) and the system crashed during the critical section, then the same
1042.B \-\-backup\-file
1043must be presented to
1044.B \-\-assemble
1045to allow possibly corrupted data to be restored, and the reshape
1046to be completed.
1047
1048.TP
1049.BR \-\-invalid\-backup
1050If the file needed for the above option is not available for any
1051reason an empty file can be given together with this option to
1052indicate that the backup file is invalid. In this case the data that
1053was being rearranged at the time of the crash could be irrecoverably
1054lost, but the rest of the array may still be recoverable. This option
1055should only be used as a last resort if there is no way to recover the
1056backup file.
1057
1058
1059.TP
1060.BR \-U ", " \-\-update=
1061Update the superblock on each device while assembling the array. The
1062argument given to this flag can be one of
1063.BR sparc2.2 ,
1064.BR summaries ,
1065.BR uuid ,
1066.BR name ,
1067.BR homehost ,
1068.BR resync ,
1069.BR byteorder ,
1070.BR devicesize ,
1071.BR no\-bitmap ,
1072.BR bbl ,
1073.BR no-\bbl ,
1074.BR metadata ,
1075or
1076.BR super\-minor .
1077
1078The
1079.B sparc2.2
1080option will adjust the superblock of an array what was created on a Sparc
1081machine running a patched 2.2 Linux kernel. This kernel got the
1082alignment of part of the superblock wrong. You can use the
1083.B "\-\-examine \-\-sparc2.2"
1084option to
1085.I mdadm
1086to see what effect this would have.
1087
1088The
1089.B super\-minor
1090option will update the
1091.B "preferred minor"
1092field on each superblock to match the minor number of the array being
1093assembled.
1094This can be useful if
1095.B \-\-examine
1096reports a different "Preferred Minor" to
1097.BR \-\-detail .
1098In some cases this update will be performed automatically
1099by the kernel driver. In particular the update happens automatically
1100at the first write to an array with redundancy (RAID level 1 or
1101greater) on a 2.6 (or later) kernel.
1102
1103The
1104.B uuid
1105option will change the uuid of the array. If a UUID is given with the
1106.B \-\-uuid
1107option that UUID will be used as a new UUID and will
1108.B NOT
1109be used to help identify the devices in the array.
1110If no
1111.B \-\-uuid
1112is given, a random UUID is chosen.
1113
1114The
1115.B name
1116option will change the
1117.I name
1118of the array as stored in the superblock. This is only supported for
1119version-1 superblocks.
1120
1121The
1122.B homehost
1123option will change the
1124.I homehost
1125as recorded in the superblock. For version-0 superblocks, this is the
1126same as updating the UUID.
1127For version-1 superblocks, this involves updating the name.
1128
1129The
1130.B resync
1131option will cause the array to be marked
1132.I dirty
1133meaning that any redundancy in the array (e.g. parity for RAID5,
1134copies for RAID1) may be incorrect. This will cause the RAID system
1135to perform a "resync" pass to make sure that all redundant information
1136is correct.
1137
1138The
1139.B byteorder
1140option allows arrays to be moved between machines with different
1141byte-order.
1142When assembling such an array for the first time after a move, giving
1143.B "\-\-update=byteorder"
1144will cause
1145.I mdadm
1146to expect superblocks to have their byteorder reversed, and will
1147correct that order before assembling the array. This is only valid
1148with original (Version 0.90) superblocks.
1149
1150The
1151.B summaries
1152option will correct the summaries in the superblock. That is the
1153counts of total, working, active, failed, and spare devices.
1154
1155The
1156.B devicesize
1157option will rarely be of use. It applies to version 1.1 and 1.2 metadata
1158only (where the metadata is at the start of the device) and is only
1159useful when the component device has changed size (typically become
1160larger). The version 1 metadata records the amount of the device that
1161can be used to store data, so if a device in a version 1.1 or 1.2
1162array becomes larger, the metadata will still be visible, but the
1163extra space will not. In this case it might be useful to assemble the
1164array with
1165.BR \-\-update=devicesize .
1166This will cause
1167.I mdadm
1168to determine the maximum usable amount of space on each device and
1169update the relevant field in the metadata.
1170
1171The
1172.B metadata
1173option only works on v0.90 metadata arrays and will convert them to
1174v1.0 metadata. The array must not be dirty (i.e. it must not need a
1175sync) and it must not have a write-intent bitmap.
1176
1177The old metadata will remain on the devices, but will appear older
1178than the new metadata and so will usually be ignored. The old metadata
1179(or indeed the new metadata) can be removed by giving the appropriate
1180.B \-\-metadata=
1181option to
1182.BR \-\-zero\-superblock .
1183
1184The
1185.B no\-bitmap
1186option can be used when an array has an internal bitmap which is
1187corrupt in some way so that assembling the array normally fails. It
1188will cause any internal bitmap to be ignored.
1189
1190The
1191.B bbl
1192option will reserve space in each device for a bad block list. This
1193will be 4K in size and positioned near the end of any free space
1194between the superblock and the data.
1195
1196The
1197.B no\-bbl
1198option will cause any reservation of space for a bad block list to be
1199removed. If the bad block list contains entries, this will fail, as
1200removing the list could cause data corruption.
1201
1202.TP
1203.BR \-\-freeze\-reshape
1204Option is intended to be used in start-up scripts during initrd boot phase.
1205When array under reshape is assembled during initrd phase, this option
1206stops reshape after reshape critical section is being restored. This happens
1207before file system pivot operation and avoids loss of file system context.
1208Losing file system context would cause reshape to be broken.
1209
1210Reshape can be continued later using the
1211.B \-\-continue
1212option for the grow command.
1213
1214.SH For Manage mode:
1215
1216.TP
1217.BR \-t ", " \-\-test
1218Unless a more serious error occurred,
1219.I mdadm
1220will exit with a status of 2 if no changes were made to the array and
12210 if at least one change was made.
1222This can be useful when an indirect specifier such as
1223.BR missing ,
1224.B detached
1225or
1226.B faulty
1227is used in requesting an operation on the array.
1228.B \-\-test
1229will report failure if these specifiers didn't find any match.
1230
1231.TP
1232.BR \-a ", " \-\-add
1233hot-add listed devices.
1234If a device appears to have recently been part of the array
1235(possibly it failed or was removed) the device is re\-added as described
1236in the next point.
1237If that fails or the device was never part of the array, the device is
1238added as a hot-spare.
1239If the array is degraded, it will immediately start to rebuild data
1240onto that spare.
1241
1242Note that this and the following options are only meaningful on array
1243with redundancy. They don't apply to RAID0 or Linear.
1244
1245.TP
1246.BR \-\-re\-add
1247re\-add a device that was previously removed from an array.
1248If the metadata on the device reports that it is a member of the
1249array, and the slot that it used is still vacant, then the device will
1250be added back to the array in the same position. This will normally
1251cause the data for that device to be recovered. However based on the
1252event count on the device, the recovery may only require sections that
1253are flagged a write-intent bitmap to be recovered or may not require
1254any recovery at all.
1255
1256When used on an array that has no metadata (i.e. it was built with
1257.BR \-\-build)
1258it will be assumed that bitmap-based recovery is enough to make the
1259device fully consistent with the array.
1260
1261When used with v1.x metadata,
1262.B \-\-re\-add
1263can be accompanied by
1264.BR \-\-update=devicesize ,
1265.BR \-\-update=bbl ", or"
1266.BR \-\-update=no\-bbl .
1267See the description of these option when used in Assemble mode for an
1268explanation of their use.
1269
1270If the device name given is
1271.B missing
1272then
1273.I mdadm
1274will try to find any device that looks like it should be
1275part of the array but isn't and will try to re\-add all such devices.
1276
1277If the device name given is
1278.B faulty
1279then
1280.I mdadm
1281will find all devices in the array that are marked
1282.BR faulty ,
1283remove them and attempt to immediately re\-add them. This can be
1284useful if you are certain that the reason for failure has been
1285resolved.
1286
1287.TP
1288.BR \-r ", " \-\-remove
1289remove listed devices. They must not be active. i.e. they should
1290be failed or spare devices.
1291
1292As well as the name of a device file
1293(e.g.
1294.BR /dev/sda1 )
1295the words
1296.BR failed ,
1297.B detached
1298and names like
1299.B set-A
1300can be given to
1301.BR \-\-remove .
1302The first causes all failed device to be removed. The second causes
1303any device which is no longer connected to the system (i.e an 'open'
1304returns
1305.BR ENXIO )
1306to be removed.
1307The third will remove a set as describe below under
1308.BR \-\-fail .
1309
1310.TP
1311.BR \-f ", " \-\-fail
1312Mark listed devices as faulty.
1313As well as the name of a device file, the word
1314.B detached
1315or a set name like
1316.B set\-A
1317can be given. The former will cause any device that has been detached from
1318the system to be marked as failed. It can then be removed.
1319
1320For RAID10 arrays where the number of copies evenly divides the number
1321of devices, the devices can be conceptually divided into sets where
1322each set contains a single complete copy of the data on the array.
1323Sometimes a RAID10 array will be configured so that these sets are on
1324separate controllers. In this case all the devices in one set can be
1325failed by giving a name like
1326.B set\-A
1327or
1328.B set\-B
1329to
1330.BR \-\-fail .
1331The appropriate set names are reported by
1332.BR \-\-detail .
1333
1334.TP
1335.BR \-\-set\-faulty
1336same as
1337.BR \-\-fail .
1338
1339.TP
1340.B \-\-replace
1341Mark listed devices as requiring replacement. As soon as a spare is
1342available, it will be rebuilt and will replace the marked device.
1343This is similar to marking a device as faulty, but the device remains
1344in service during the recovery process to increase resilience against
1345multiple failures. When the replacement process finishes, the
1346replaced device will be marked as faulty.
1347
1348.TP
1349.B \-\-with
1350This can follow a list of
1351.B \-\-replace
1352devices. The devices listed after
1353.B \-\-with
1354will be preferentially used to replace the devices listed after
1355.BR \-\-replace .
1356These device must already be spare devices in the array.
1357
1358.TP
1359.BR \-\-write\-mostly
1360Subsequent devices that are added or re\-added will have the 'write-mostly'
1361flag set. This is only valid for RAID1 and means that the 'md' driver
1362will avoid reading from these devices if possible.
1363.TP
1364.BR \-\-readwrite
1365Subsequent devices that are added or re\-added will have the 'write-mostly'
1366flag cleared.
1367
1368.P
1369Each of these options requires that the first device listed is the array
1370to be acted upon, and the remainder are component devices to be added,
1371removed, marked as faulty, etc. Several different operations can be
1372specified for different devices, e.g.
1373.in +5
1374mdadm /dev/md0 \-\-add /dev/sda1 \-\-fail /dev/sdb1 \-\-remove /dev/sdb1
1375.in -5
1376Each operation applies to all devices listed until the next
1377operation.
1378
1379If an array is using a write-intent bitmap, then devices which have
1380been removed can be re\-added in a way that avoids a full
1381reconstruction but instead just updates the blocks that have changed
1382since the device was removed. For arrays with persistent metadata
1383(superblocks) this is done automatically. For arrays created with
1384.B \-\-build
1385mdadm needs to be told that this device we removed recently with
1386.BR \-\-re\-add .
1387
1388Devices can only be removed from an array if they are not in active
1389use, i.e. that must be spares or failed devices. To remove an active
1390device, it must first be marked as
1391.B faulty.
1392
1393.SH For Misc mode:
1394
1395.TP
1396.BR \-Q ", " \-\-query
1397Examine a device to see
1398(1) if it is an md device and (2) if it is a component of an md
1399array.
1400Information about what is discovered is presented.
1401
1402.TP
1403.BR \-D ", " \-\-detail
1404Print details of one or more md devices.
1405
1406.TP
1407.BR \-\-detail\-platform
1408Print details of the platform's RAID capabilities (firmware / hardware
1409topology) for a given metadata format. If used without argument, mdadm
1410will scan all controllers looking for their capabilities. Otherwise, mdadm
1411will only look at the controller specified by the argument in form of an
1412absolute filepath or a link, e.g.
1413.IR /sys/devices/pci0000:00/0000:00:1f.2 .
1414
1415.TP
1416.BR \-Y ", " \-\-export
1417When used with
1418.B \-\-detail , \-\-detail-platform
1419or
1420.BR \-\-examine ,
1421output will be formatted as
1422.B key=value
1423pairs for easy import into the environment.
1424
1425.TP
1426.BR \-E ", " \-\-examine
1427Print contents of the metadata stored on the named device(s).
1428Note the contrast between
1429.B \-\-examine
1430and
1431.BR \-\-detail .
1432.B \-\-examine
1433applies to devices which are components of an array, while
1434.B \-\-detail
1435applies to a whole array which is currently active.
1436.TP
1437.B \-\-sparc2.2
1438If an array was created on a SPARC machine with a 2.2 Linux kernel
1439patched with RAID support, the superblock will have been created
1440incorrectly, or at least incompatibly with 2.4 and later kernels.
1441Using the
1442.B \-\-sparc2.2
1443flag with
1444.B \-\-examine
1445will fix the superblock before displaying it. If this appears to do
1446the right thing, then the array can be successfully assembled using
1447.BR "\-\-assemble \-\-update=sparc2.2" .
1448
1449.TP
1450.BR \-X ", " \-\-examine\-bitmap
1451Report information about a bitmap file.
1452The argument is either an external bitmap file or an array component
1453in case of an internal bitmap. Note that running this on an array
1454device (e.g.
1455.BR /dev/md0 )
1456does not report the bitmap for that array.
1457
1458.TP
1459.B \-\-examine\-badblocks
1460List the bad-blocks recorded for the device, if a bad-blocks list has
1461been configured. Currently only
1462.B 1.x
1463metadata supports bad-blocks lists.
1464
1465.TP
1466.BI \-\-dump= directory
1467.TP
1468.BI \-\-restore= directory
1469Save metadata from lists devices, or restore metadata to listed devices.
1470
1471.TP
1472.BR \-R ", " \-\-run
1473start a partially assembled array. If
1474.B \-\-assemble
1475did not find enough devices to fully start the array, it might leaving
1476it partially assembled. If you wish, you can then use
1477.B \-\-run
1478to start the array in degraded mode.
1479
1480.TP
1481.BR \-S ", " \-\-stop
1482deactivate array, releasing all resources.
1483
1484.TP
1485.BR \-o ", " \-\-readonly
1486mark array as readonly.
1487
1488.TP
1489.BR \-w ", " \-\-readwrite
1490mark array as readwrite.
1491
1492.TP
1493.B \-\-zero\-superblock
1494If the device contains a valid md superblock, the block is
1495overwritten with zeros. With
1496.B \-\-force
1497the block where the superblock would be is overwritten even if it
1498doesn't appear to be valid.
1499
1500.TP
1501.B \-\-kill\-subarray=
1502If the device is a container and the argument to \-\-kill\-subarray
1503specifies an inactive subarray in the container, then the subarray is
1504deleted. Deleting all subarrays will leave an 'empty-container' or
1505spare superblock on the drives. See
1506.B \-\-zero\-superblock
1507for completely
1508removing a superblock. Note that some formats depend on the subarray
1509index for generating a UUID, this command will fail if it would change
1510the UUID of an active subarray.
1511
1512.TP
1513.B \-\-update\-subarray=
1514If the device is a container and the argument to \-\-update\-subarray
1515specifies a subarray in the container, then attempt to update the given
1516superblock field in the subarray. See below in
1517.B MISC MODE
1518for details.
1519
1520.TP
1521.BR \-t ", " \-\-test
1522When used with
1523.BR \-\-detail ,
1524the exit status of
1525.I mdadm
1526is set to reflect the status of the device. See below in
1527.B MISC MODE
1528for details.
1529
1530.TP
1531.BR \-W ", " \-\-wait
1532For each md device given, wait for any resync, recovery, or reshape
1533activity to finish before returning.
1534.I mdadm
1535will return with success if it actually waited for every device
1536listed, otherwise it will return failure.
1537
1538.TP
1539.BR \-\-wait\-clean
1540For each md device given, or each device in /proc/mdstat if
1541.B \-\-scan
1542is given, arrange for the array to be marked clean as soon as possible.
1543.I mdadm
1544will return with success if the array uses external metadata and we
1545successfully waited. For native arrays this returns immediately as the
1546kernel handles dirty-clean transitions at shutdown. No action is taken
1547if safe-mode handling is disabled.
1548
1549.SH For Incremental Assembly mode:
1550.TP
1551.BR \-\-rebuild\-map ", " \-r
1552Rebuild the map file
1553.RB ( {MAP_PATH} )
1554that
1555.I mdadm
1556uses to help track which arrays are currently being assembled.
1557
1558.TP
1559.BR \-\-run ", " \-R
1560Run any array assembled as soon as a minimal number of devices are
1561available, rather than waiting until all expected devices are present.
1562
1563.TP
1564.BR \-\-scan ", " \-s
1565Only meaningful with
1566.B \-R
1567this will scan the
1568.B map
1569file for arrays that are being incrementally assembled and will try to
1570start any that are not already started. If any such array is listed
1571in
1572.B mdadm.conf
1573as requiring an external bitmap, that bitmap will be attached first.
1574
1575.TP
1576.BR \-\-fail ", " \-f
1577This allows the hot-plug system to remove devices that have fully disappeared
1578from the kernel. It will first fail and then remove the device from any
1579array it belongs to.
1580The device name given should be a kernel device name such as "sda",
1581not a name in
1582.IR /dev .
1583
1584.TP
1585.BR \-\-path=
1586Only used with \-\-fail. The 'path' given will be recorded so that if
1587a new device appears at the same location it can be automatically
1588added to the same array. This allows the failed device to be
1589automatically replaced by a new device without metadata if it appears
1590at specified path. This option is normally only set by a
1591.I udev
1592script.
1593
1594.SH For Monitor mode:
1595.TP
1596.BR \-m ", " \-\-mail
1597Give a mail address to send alerts to.
1598
1599.TP
1600.BR \-p ", " \-\-program ", " \-\-alert
1601Give a program to be run whenever an event is detected.
1602
1603.TP
1604.BR \-y ", " \-\-syslog
1605Cause all events to be reported through 'syslog'. The messages have
1606facility of 'daemon' and varying priorities.
1607
1608.TP
1609.BR \-d ", " \-\-delay
1610Give a delay in seconds.
1611.I mdadm
1612polls the md arrays and then waits this many seconds before polling
1613again. The default is 60 seconds. Since 2.6.16, there is no need to
1614reduce this as the kernel alerts
1615.I mdadm
1616immediately when there is any change.
1617
1618.TP
1619.BR \-r ", " \-\-increment
1620Give a percentage increment.
1621.I mdadm
1622will generate RebuildNN events with the given percentage increment.
1623
1624.TP
1625.BR \-f ", " \-\-daemonise
1626Tell
1627.I mdadm
1628to run as a background daemon if it decides to monitor anything. This
1629causes it to fork and run in the child, and to disconnect from the
1630terminal. The process id of the child is written to stdout.
1631This is useful with
1632.B \-\-scan
1633which will only continue monitoring if a mail address or alert program
1634is found in the config file.
1635
1636.TP
1637.BR \-i ", " \-\-pid\-file
1638When
1639.I mdadm
1640is running in daemon mode, write the pid of the daemon process to
1641the specified file, instead of printing it on standard output.
1642
1643.TP
1644.BR \-1 ", " \-\-oneshot
1645Check arrays only once. This will generate
1646.B NewArray
1647events and more significantly
1648.B DegradedArray
1649and
1650.B SparesMissing
1651events. Running
1652.in +5
1653.B " mdadm \-\-monitor \-\-scan \-1"
1654.in -5
1655from a cron script will ensure regular notification of any degraded arrays.
1656
1657.TP
1658.BR \-t ", " \-\-test
1659Generate a
1660.B TestMessage
1661alert for every array found at startup. This alert gets mailed and
1662passed to the alert program. This can be used for testing that alert
1663message do get through successfully.
1664
1665.TP
1666.BR \-\-no\-sharing
1667This inhibits the functionality for moving spares between arrays.
1668Only one monitoring process started with
1669.B \-\-scan
1670but without this flag is allowed, otherwise the two could interfere
1671with each other.
1672
1673.SH ASSEMBLE MODE
1674
1675.HP 12
1676Usage:
1677.B mdadm \-\-assemble
1678.I md-device options-and-component-devices...
1679.HP 12
1680Usage:
1681.B mdadm \-\-assemble \-\-scan
1682.I md-devices-and-options...
1683.HP 12
1684Usage:
1685.B mdadm \-\-assemble \-\-scan
1686.I options...
1687
1688.PP
1689This usage assembles one or more RAID arrays from pre-existing components.
1690For each array, mdadm needs to know the md device, the identity of the
1691array, and a number of component-devices. These can be found in a number of ways.
1692
1693In the first usage example (without the
1694.BR \-\-scan )
1695the first device given is the md device.
1696In the second usage example, all devices listed are treated as md
1697devices and assembly is attempted.
1698In the third (where no devices are listed) all md devices that are
1699listed in the configuration file are assembled. If no arrays are
1700described by the configuration file, then any arrays that
1701can be found on unused devices will be assembled.
1702
1703If precisely one device is listed, but
1704.B \-\-scan
1705is not given, then
1706.I mdadm
1707acts as though
1708.B \-\-scan
1709was given and identity information is extracted from the configuration file.
1710
1711The identity can be given with the
1712.B \-\-uuid
1713option, the
1714.B \-\-name
1715option, or the
1716.B \-\-super\-minor
1717option, will be taken from the md-device record in the config file, or
1718will be taken from the super block of the first component-device
1719listed on the command line.
1720
1721Devices can be given on the
1722.B \-\-assemble
1723command line or in the config file. Only devices which have an md
1724superblock which contains the right identity will be considered for
1725any array.
1726
1727The config file is only used if explicitly named with
1728.B \-\-config
1729or requested with (a possibly implicit)
1730.BR \-\-scan .
1731In the later case,
1732.B /etc/mdadm.conf
1733or
1734.B /etc/mdadm/mdadm.conf
1735is used.
1736
1737If
1738.B \-\-scan
1739is not given, then the config file will only be used to find the
1740identity of md arrays.
1741
1742Normally the array will be started after it is assembled. However if
1743.B \-\-scan
1744is not given and not all expected drives were listed, then the array
1745is not started (to guard against usage errors). To insist that the
1746array be started in this case (as may work for RAID1, 4, 5, 6, or 10),
1747give the
1748.B \-\-run
1749flag.
1750
1751If
1752.I udev
1753is active,
1754.I mdadm
1755does not create any entries in
1756.B /dev
1757but leaves that to
1758.IR udev .
1759It does record information in
1760.B {MAP_PATH}
1761which will allow
1762.I udev
1763to choose the correct name.
1764
1765If
1766.I mdadm
1767detects that udev is not configured, it will create the devices in
1768.B /dev
1769itself.
1770
1771In Linux kernels prior to version 2.6.28 there were two distinctly
1772different types of md devices that could be created: one that could be
1773partitioned using standard partitioning tools and one that could not.
1774Since 2.6.28 that distinction is no longer relevant as both type of
1775devices can be partitioned.
1776.I mdadm
1777will normally create the type that originally could not be partitioned
1778as it has a well defined major number (9).
1779
1780Prior to 2.6.28, it is important that mdadm chooses the correct type
1781of array device to use. This can be controlled with the
1782.B \-\-auto
1783option. In particular, a value of "mdp" or "part" or "p" tells mdadm
1784to use a partitionable device rather than the default.
1785
1786In the no-udev case, the value given to
1787.B \-\-auto
1788can be suffixed by a number. This tells
1789.I mdadm
1790to create that number of partition devices rather than the default of 4.
1791
1792The value given to
1793.B \-\-auto
1794can also be given in the configuration file as a word starting
1795.B auto=
1796on the ARRAY line for the relevant array.
1797
1798.SS Auto Assembly
1799When
1800.B \-\-assemble
1801is used with
1802.B \-\-scan
1803and no devices are listed,
1804.I mdadm
1805will first attempt to assemble all the arrays listed in the config
1806file.
1807
1808If no arrays are listed in the config (other than those marked
1809.BR <ignore> )
1810it will look through the available devices for possible arrays and
1811will try to assemble anything that it finds. Arrays which are tagged
1812as belonging to the given homehost will be assembled and started
1813normally. Arrays which do not obviously belong to this host are given
1814names that are expected not to conflict with anything local, and are
1815started "read-auto" so that nothing is written to any device until the
1816array is written to. i.e. automatic resync etc is delayed.
1817
1818If
1819.I mdadm
1820finds a consistent set of devices that look like they should comprise
1821an array, and if the superblock is tagged as belonging to the given
1822home host, it will automatically choose a device name and try to
1823assemble the array. If the array uses version-0.90 metadata, then the
1824.B minor
1825number as recorded in the superblock is used to create a name in
1826.B /dev/md/
1827so for example
1828.BR /dev/md/3 .
1829If the array uses version-1 metadata, then the
1830.B name
1831from the superblock is used to similarly create a name in
1832.B /dev/md/
1833(the name will have any 'host' prefix stripped first).
1834
1835This behaviour can be modified by the
1836.I AUTO
1837line in the
1838.I mdadm.conf
1839configuration file. This line can indicate that specific metadata
1840type should, or should not, be automatically assembled. If an array
1841is found which is not listed in
1842.I mdadm.conf
1843and has a metadata format that is denied by the
1844.I AUTO
1845line, then it will not be assembled.
1846The
1847.I AUTO
1848line can also request that all arrays identified as being for this
1849homehost should be assembled regardless of their metadata type.
1850See
1851.IR mdadm.conf (5)
1852for further details.
1853
1854Note: Auto assembly cannot be used for assembling and activating some
1855arrays which are undergoing reshape. In particular as the
1856.B backup\-file
1857cannot be given, any reshape which requires a backup-file to continue
1858cannot be started by auto assembly. An array which is growing to more
1859devices and has passed the critical section can be assembled using
1860auto-assembly.
1861
1862.SH BUILD MODE
1863
1864.HP 12
1865Usage:
1866.B mdadm \-\-build
1867.I md-device
1868.BI \-\-chunk= X
1869.BI \-\-level= Y
1870.BI \-\-raid\-devices= Z
1871.I devices
1872
1873.PP
1874This usage is similar to
1875.BR \-\-create .
1876The difference is that it creates an array without a superblock. With
1877these arrays there is no difference between initially creating the array and
1878subsequently assembling the array, except that hopefully there is useful
1879data there in the second case.
1880
1881The level may raid0, linear, raid1, raid10, multipath, or faulty, or
1882one of their synonyms. All devices must be listed and the array will
1883be started once complete. It will often be appropriate to use
1884.B \-\-assume\-clean
1885with levels raid1 or raid10.
1886
1887.SH CREATE MODE
1888
1889.HP 12
1890Usage:
1891.B mdadm \-\-create
1892.I md-device
1893.BI \-\-chunk= X
1894.BI \-\-level= Y
1895.br
1896.BI \-\-raid\-devices= Z
1897.I devices
1898
1899.PP
1900This usage will initialise a new md array, associate some devices with
1901it, and activate the array.
1902
1903The named device will normally not exist when
1904.I "mdadm \-\-create"
1905is run, but will be created by
1906.I udev
1907once the array becomes active.
1908
1909As devices are added, they are checked to see if they contain RAID
1910superblocks or filesystems. They are also checked to see if the variance in
1911device size exceeds 1%.
1912
1913If any discrepancy is found, the array will not automatically be run, though
1914the presence of a
1915.B \-\-run
1916can override this caution.
1917
1918To create a "degraded" array in which some devices are missing, simply
1919give the word "\fBmissing\fP"
1920in place of a device name. This will cause
1921.I mdadm
1922to leave the corresponding slot in the array empty.
1923For a RAID4 or RAID5 array at most one slot can be
1924"\fBmissing\fP"; for a RAID6 array at most two slots.
1925For a RAID1 array, only one real device needs to be given. All of the
1926others can be
1927"\fBmissing\fP".
1928
1929When creating a RAID5 array,
1930.I mdadm
1931will automatically create a degraded array with an extra spare drive.
1932This is because building the spare into a degraded array is in general
1933faster than resyncing the parity on a non-degraded, but not clean,
1934array. This feature can be overridden with the
1935.B \-\-force
1936option.
1937
1938When creating an array with version-1 metadata a name for the array is
1939required.
1940If this is not given with the
1941.B \-\-name
1942option,
1943.I mdadm
1944will choose a name based on the last component of the name of the
1945device being created. So if
1946.B /dev/md3
1947is being created, then the name
1948.B 3
1949will be chosen.
1950If
1951.B /dev/md/home
1952is being created, then the name
1953.B home
1954will be used.
1955
1956When creating a partition based array, using
1957.I mdadm
1958with version-1.x metadata, the partition type should be set to
1959.B 0xDA
1960(non fs-data). This type selection allows for greater precision since
1961using any other [RAID auto-detect (0xFD) or a GNU/Linux partition (0x83)],
1962might create problems in the event of array recovery through a live cdrom.
1963
1964A new array will normally get a randomly assigned 128bit UUID which is
1965very likely to be unique. If you have a specific need, you can choose
1966a UUID for the array by giving the
1967.B \-\-uuid=
1968option. Be warned that creating two arrays with the same UUID is a
1969recipe for disaster. Also, using
1970.B \-\-uuid=
1971when creating a v0.90 array will silently override any
1972.B \-\-homehost=
1973setting.
1974.\"If the
1975.\".B \-\-size
1976.\"option is given, it is not necessary to list any component-devices in this command.
1977.\"They can be added later, before a
1978.\".B \-\-run.
1979.\"If no
1980.\".B \-\-size
1981.\"is given, the apparent size of the smallest drive given is used.
1982
1983If the array type supports a write-intent bitmap, and if the devices
1984in the array exceed 100G is size, an internal write-intent bitmap
1985will automatically be added unless some other option is explicitly
1986requested with the
1987.B \-\-bitmap
1988option. In any case space for a bitmap will be reserved so that one
1989can be added layer with
1990.BR "\-\-grow \-\-bitmap=internal" .
1991
1992If the metadata type supports it (currently only 1.x metadata), space
1993will be allocated to store a bad block list. This allows a modest
1994number of bad blocks to be recorded, allowing the drive to remain in
1995service while only partially functional.
1996
1997When creating an array within a
1998.B CONTAINER
1999.I mdadm
2000can be given either the list of devices to use, or simply the name of
2001the container. The former case gives control over which devices in
2002the container will be used for the array. The latter case allows
2003.I mdadm
2004to automatically choose which devices to use based on how much spare
2005space is available.
2006
2007The General Management options that are valid with
2008.B \-\-create
2009are:
2010.TP
2011.B \-\-run
2012insist on running the array even if some devices look like they might
2013be in use.
2014
2015.TP
2016.B \-\-readonly
2017start the array readonly \(em not supported yet.
2018
2019.SH MANAGE MODE
2020.HP 12
2021Usage:
2022.B mdadm
2023.I device
2024.I options... devices...
2025.PP
2026
2027This usage will allow individual devices in an array to be failed,
2028removed or added. It is possible to perform multiple operations with
2029on command. For example:
2030.br
2031.B " mdadm /dev/md0 \-f /dev/hda1 \-r /dev/hda1 \-a /dev/hda1"
2032.br
2033will firstly mark
2034.B /dev/hda1
2035as faulty in
2036.B /dev/md0
2037and will then remove it from the array and finally add it back
2038in as a spare. However only one md array can be affected by a single
2039command.
2040
2041When a device is added to an active array, mdadm checks to see if it
2042has metadata on it which suggests that it was recently a member of the
2043array. If it does, it tries to "re\-add" the device. If there have
2044been no changes since the device was removed, or if the array has a
2045write-intent bitmap which has recorded whatever changes there were,
2046then the device will immediately become a full member of the array and
2047those differences recorded in the bitmap will be resolved.
2048
2049.SH MISC MODE
2050.HP 12
2051Usage:
2052.B mdadm
2053.I options ...
2054.I devices ...
2055.PP
2056
2057MISC mode includes a number of distinct operations that
2058operate on distinct devices. The operations are:
2059.TP
2060.B \-\-query
2061The device is examined to see if it is
2062(1) an active md array, or
2063(2) a component of an md array.
2064The information discovered is reported.
2065
2066.TP
2067.B \-\-detail
2068The device should be an active md device.
2069.B mdadm
2070will display a detailed description of the array.
2071.B \-\-brief
2072or
2073.B \-\-scan
2074will cause the output to be less detailed and the format to be
2075suitable for inclusion in
2076.BR mdadm.conf .
2077The exit status of
2078.I mdadm
2079will normally be 0 unless
2080.I mdadm
2081failed to get useful information about the device(s); however, if the
2082.B \-\-test
2083option is given, then the exit status will be:
2084.RS
2085.TP
20860
2087The array is functioning normally.
2088.TP
20891
2090The array has at least one failed device.
2091.TP
20922
2093The array has multiple failed devices such that it is unusable.
2094.TP
20954
2096There was an error while trying to get information about the device.
2097.RE
2098
2099.TP
2100.B \-\-detail\-platform
2101Print detail of the platform's RAID capabilities (firmware / hardware
2102topology). If the metadata is specified with
2103.B \-e
2104or
2105.B \-\-metadata=
2106then the return status will be:
2107.RS
2108.TP
21090
2110metadata successfully enumerated its platform components on this system
2111.TP
21121
2113metadata is platform independent
2114.TP
21152
2116metadata failed to find its platform components on this system
2117.RE
2118
2119.TP
2120.B \-\-update\-subarray=
2121If the device is a container and the argument to \-\-update\-subarray
2122specifies a subarray in the container, then attempt to update the given
2123superblock field in the subarray. Similar to updating an array in
2124"assemble" mode, the field to update is selected by
2125.B \-U
2126or
2127.B \-\-update=
2128option. Currently only
2129.B name
2130is supported.
2131
2132The
2133.B name
2134option updates the subarray name in the metadata, it may not affect the
2135device node name or the device node symlink until the subarray is
2136re\-assembled. If updating
2137.B name
2138would change the UUID of an active subarray this operation is blocked,
2139and the command will end in an error.
2140
2141.TP
2142.B \-\-examine
2143The device should be a component of an md array.
2144.I mdadm
2145will read the md superblock of the device and display the contents.
2146If
2147.B \-\-brief
2148or
2149.B \-\-scan
2150is given, then multiple devices that are components of the one array
2151are grouped together and reported in a single entry suitable
2152for inclusion in
2153.BR mdadm.conf .
2154
2155Having
2156.B \-\-scan
2157without listing any devices will cause all devices listed in the
2158config file to be examined.
2159
2160.TP
2161.BI \-\-dump= directory
2162If the device contains RAID metadata, a file will be created in the
2163.I directory
2164and the metadata will be written to it. The file will be the same
2165size as the device and have the metadata written in the file at the
2166same locate that it exists in the device. However the file will be "sparse" so
2167that only those blocks containing metadata will be allocated. The
2168total space used will be small.
2169
2170The file name used in the
2171.I directory
2172will be the base name of the device. Further if any links appear in
2173.I /dev/disk/by-id
2174which point to the device, then hard links to the file will be created
2175in
2176.I directory
2177based on these
2178.I by-id
2179names.
2180
2181Multiple devices can be listed and their metadata will all be stored
2182in the one directory.
2183
2184.TP
2185.BI \-\-restore= directory
2186This is the reverse of
2187.BR \-\-dump .
2188.I mdadm
2189will locate a file in the directory that has a name appropriate for
2190the given device and will restore metadata from it. Names that match
2191.I /dev/disk/by-id
2192names are preferred, however if two of those refer to different files,
2193.I mdadm
2194will not choose between them but will abort the operation.
2195
2196If a file name is given instead of a
2197.I directory
2198then
2199.I mdadm
2200will restore from that file to a single device, always provided the
2201size of the file matches that of the device, and the file contains
2202valid metadata.
2203.TP
2204.B \-\-stop
2205The devices should be active md arrays which will be deactivated, as
2206long as they are not currently in use.
2207
2208.TP
2209.B \-\-run
2210This will fully activate a partially assembled md array.
2211
2212.TP
2213.B \-\-readonly
2214This will mark an active array as read-only, providing that it is
2215not currently being used.
2216
2217.TP
2218.B \-\-readwrite
2219This will change a
2220.B readonly
2221array back to being read/write.
2222
2223.TP
2224.B \-\-scan
2225For all operations except
2226.BR \-\-examine ,
2227.B \-\-scan
2228will cause the operation to be applied to all arrays listed in
2229.BR /proc/mdstat .
2230For
2231.BR \-\-examine,
2232.B \-\-scan
2233causes all devices listed in the config file to be examined.
2234
2235.TP
2236.BR \-b ", " \-\-brief
2237Be less verbose. This is used with
2238.B \-\-detail
2239and
2240.BR \-\-examine .
2241Using
2242.B \-\-brief
2243with
2244.B \-\-verbose
2245gives an intermediate level of verbosity.
2246
2247.SH MONITOR MODE
2248
2249.HP 12
2250Usage:
2251.B mdadm \-\-monitor
2252.I options... devices...
2253
2254.PP
2255This usage causes
2256.I mdadm
2257to periodically poll a number of md arrays and to report on any events
2258noticed.
2259.I mdadm
2260will never exit once it decides that there are arrays to be checked,
2261so it should normally be run in the background.
2262
2263As well as reporting events,
2264.I mdadm
2265may move a spare drive from one array to another if they are in the
2266same
2267.B spare-group
2268or
2269.B domain
2270and if the destination array has a failed drive but no spares.
2271
2272If any devices are listed on the command line,
2273.I mdadm
2274will only monitor those devices. Otherwise all arrays listed in the
2275configuration file will be monitored. Further, if
2276.B \-\-scan
2277is given, then any other md devices that appear in
2278.B /proc/mdstat
2279will also be monitored.
2280
2281The result of monitoring the arrays is the generation of events.
2282These events are passed to a separate program (if specified) and may
2283be mailed to a given E-mail address.
2284
2285When passing events to a program, the program is run once for each event,
2286and is given 2 or 3 command-line arguments: the first is the
2287name of the event (see below), the second is the name of the
2288md device which is affected, and the third is the name of a related
2289device if relevant (such as a component device that has failed).
2290
2291If
2292.B \-\-scan
2293is given, then a program or an E-mail address must be specified on the
2294command line or in the config file. If neither are available, then
2295.I mdadm
2296will not monitor anything.
2297Without
2298.B \-\-scan,
2299.I mdadm
2300will continue monitoring as long as something was found to monitor. If
2301no program or email is given, then each event is reported to
2302.BR stdout .
2303
2304The different events are:
2305
2306.RS 4
2307.TP
2308.B DeviceDisappeared
2309An md array which previously was configured appears to no longer be
2310configured. (syslog priority: Critical)
2311
2312If
2313.I mdadm
2314was told to monitor an array which is RAID0 or Linear, then it will
2315report
2316.B DeviceDisappeared
2317with the extra information
2318.BR Wrong-Level .
2319This is because RAID0 and Linear do not support the device-failed,
2320hot-spare and resync operations which are monitored.
2321
2322.TP
2323.B RebuildStarted
2324An md array started reconstruction. (syslog priority: Warning)
2325
2326.TP
2327.BI Rebuild NN
2328Where
2329.I NN
2330is a two-digit number (ie. 05, 48). This indicates that rebuild
2331has passed that many percent of the total. The events are generated
2332with fixed increment since 0. Increment size may be specified with
2333a commandline option (default is 20). (syslog priority: Warning)
2334
2335.TP
2336.B RebuildFinished
2337An md array that was rebuilding, isn't any more, either because it
2338finished normally or was aborted. (syslog priority: Warning)
2339
2340.TP
2341.B Fail
2342An active component device of an array has been marked as
2343faulty. (syslog priority: Critical)
2344
2345.TP
2346.B FailSpare
2347A spare component device which was being rebuilt to replace a faulty
2348device has failed. (syslog priority: Critical)
2349
2350.TP
2351.B SpareActive
2352A spare component device which was being rebuilt to replace a faulty
2353device has been successfully rebuilt and has been made active.
2354(syslog priority: Info)
2355
2356.TP
2357.B NewArray
2358A new md array has been detected in the
2359.B /proc/mdstat
2360file. (syslog priority: Info)
2361
2362.TP
2363.B DegradedArray
2364A newly noticed array appears to be degraded. This message is not
2365generated when
2366.I mdadm
2367notices a drive failure which causes degradation, but only when
2368.I mdadm
2369notices that an array is degraded when it first sees the array.
2370(syslog priority: Critical)
2371
2372.TP
2373.B MoveSpare
2374A spare drive has been moved from one array in a
2375.B spare-group
2376or
2377.B domain
2378to another to allow a failed drive to be replaced.
2379(syslog priority: Info)
2380
2381.TP
2382.B SparesMissing
2383If
2384.I mdadm
2385has been told, via the config file, that an array should have a certain
2386number of spare devices, and
2387.I mdadm
2388detects that it has fewer than this number when it first sees the
2389array, it will report a
2390.B SparesMissing
2391message.
2392(syslog priority: Warning)
2393
2394.TP
2395.B TestMessage
2396An array was found at startup, and the
2397.B \-\-test
2398flag was given.
2399(syslog priority: Info)
2400.RE
2401
2402Only
2403.B Fail,
2404.B FailSpare,
2405.B DegradedArray,
2406.B SparesMissing
2407and
2408.B TestMessage
2409cause Email to be sent. All events cause the program to be run.
2410The program is run with two or three arguments: the event
2411name, the array device and possibly a second device.
2412
2413Each event has an associated array device (e.g.
2414.BR /dev/md1 )
2415and possibly a second device. For
2416.BR Fail ,
2417.BR FailSpare ,
2418and
2419.B SpareActive
2420the second device is the relevant component device.
2421For
2422.B MoveSpare
2423the second device is the array that the spare was moved from.
2424
2425For
2426.I mdadm
2427to move spares from one array to another, the different arrays need to
2428be labeled with the same
2429.B spare-group
2430or the spares must be allowed to migrate through matching POLICY domains
2431in the configuration file. The
2432.B spare-group
2433name can be any string; it is only necessary that different spare
2434groups use different names.
2435
2436When
2437.I mdadm
2438detects that an array in a spare group has fewer active
2439devices than necessary for the complete array, and has no spare
2440devices, it will look for another array in the same spare group that
2441has a full complement of working drive and a spare. It will then
2442attempt to remove the spare from the second drive and add it to the
2443first.
2444If the removal succeeds but the adding fails, then it is added back to
2445the original array.
2446
2447If the spare group for a degraded array is not defined,
2448.I mdadm
2449will look at the rules of spare migration specified by POLICY lines in
2450.B mdadm.conf
2451and then follow similar steps as above if a matching spare is found.
2452
2453.SH GROW MODE
2454The GROW mode is used for changing the size or shape of an active
2455array.
2456For this to work, the kernel must support the necessary change.
2457Various types of growth are being added during 2.6 development.
2458
2459Currently the supported changes include
2460.IP \(bu 4
2461change the "size" attribute for RAID1, RAID4, RAID5 and RAID6.
2462.IP \(bu 4
2463increase or decrease the "raid\-devices" attribute of RAID0, RAID1, RAID4,
2464RAID5, and RAID6.
2465.IP \(bu 4
2466change the chunk-size and layout of RAID0, RAID4, RAID5, RAID6 and RAID10.
2467.IP \(bu 4
2468convert between RAID1 and RAID5, between RAID5 and RAID6, between
2469RAID0, RAID4, and RAID5, and between RAID0 and RAID10 (in the near-2 mode).
2470.IP \(bu 4
2471add a write-intent bitmap to any array which supports these bitmaps, or
2472remove a write-intent bitmap from such an array.
2473.PP
2474
2475Using GROW on containers is currently supported only for Intel's IMSM
2476container format. The number of devices in a container can be
2477increased - which affects all arrays in the container - or an array
2478in a container can be converted between levels where those levels are
2479supported by the container, and the conversion is on of those listed
2480above. Resizing arrays in an IMSM container with
2481.B "--grow --size"
2482is not yet supported.
2483
2484Grow functionality (e.g. expand a number of raid devices) for Intel's
2485IMSM container format has an experimental status. It is guarded by the
2486.B MDADM_EXPERIMENTAL
2487environment variable which must be set to '1' for a GROW command to
2488succeed.
2489This is for the following reasons:
2490
2491.IP 1.
2492Intel's native IMSM check-pointing is not fully tested yet.
2493This can causes IMSM incompatibility during the grow process: an array
2494which is growing cannot roam between Microsoft Windows(R) and Linux
2495systems.
2496
2497.IP 2.
2498Interrupting a grow operation is not recommended, because it
2499has not been fully tested for Intel's IMSM container format yet.
2500
2501.PP
2502Note: Intel's native checkpointing doesn't use
2503.B --backup-file
2504option and it is transparent for assembly feature.
2505
2506.SS SIZE CHANGES
2507Normally when an array is built the "size" is taken from the smallest
2508of the drives. If all the small drives in an arrays are, one at a
2509time, removed and replaced with larger drives, then you could have an
2510array of large drives with only a small amount used. In this
2511situation, changing the "size" with "GROW" mode will allow the extra
2512space to start being used. If the size is increased in this way, a
2513"resync" process will start to make sure the new parts of the array
2514are synchronised.
2515
2516Note that when an array changes size, any filesystem that may be
2517stored in the array will not automatically grow or shrink to use or
2518vacate the space. The
2519filesystem will need to be explicitly told to use the extra space
2520after growing, or to reduce its size
2521.B prior
2522to shrinking the array.
2523
2524Also the size of an array cannot be changed while it has an active
2525bitmap. If an array has a bitmap, it must be removed before the size
2526can be changed. Once the change is complete a new bitmap can be created.
2527
2528.SS RAID\-DEVICES CHANGES
2529
2530A RAID1 array can work with any number of devices from 1 upwards
2531(though 1 is not very useful). There may be times which you want to
2532increase or decrease the number of active devices. Note that this is
2533different to hot-add or hot-remove which changes the number of
2534inactive devices.
2535
2536When reducing the number of devices in a RAID1 array, the slots which
2537are to be removed from the array must already be vacant. That is, the
2538devices which were in those slots must be failed and removed.
2539
2540When the number of devices is increased, any hot spares that are
2541present will be activated immediately.
2542
2543Changing the number of active devices in a RAID5 or RAID6 is much more
2544effort. Every block in the array will need to be read and written
2545back to a new location. From 2.6.17, the Linux Kernel is able to
2546increase the number of devices in a RAID5 safely, including restarting
2547an interrupted "reshape". From 2.6.31, the Linux Kernel is able to
2548increase or decrease the number of devices in a RAID5 or RAID6.
2549
2550From 2.6.35, the Linux Kernel is able to convert a RAID0 in to a RAID4
2551or RAID5.
2552.I mdadm
2553uses this functionality and the ability to add
2554devices to a RAID4 to allow devices to be added to a RAID0. When
2555requested to do this,
2556.I mdadm
2557will convert the RAID0 to a RAID4, add the necessary disks and make
2558the reshape happen, and then convert the RAID4 back to RAID0.
2559
2560When decreasing the number of devices, the size of the array will also
2561decrease. If there was data in the array, it could get destroyed and
2562this is not reversible, so you should firstly shrink the filesystem on
2563the array to fit within the new size. To help prevent accidents,
2564.I mdadm
2565requires that the size of the array be decreased first with
2566.BR "mdadm --grow --array-size" .
2567This is a reversible change which simply makes the end of the array
2568inaccessible. The integrity of any data can then be checked before
2569the non-reversible reduction in the number of devices is request.
2570
2571When relocating the first few stripes on a RAID5 or RAID6, it is not
2572possible to keep the data on disk completely consistent and
2573crash-proof. To provide the required safety, mdadm disables writes to
2574the array while this "critical section" is reshaped, and takes a
2575backup of the data that is in that section. For grows, this backup may be
2576stored in any spare devices that the array has, however it can also be
2577stored in a separate file specified with the
2578.B \-\-backup\-file
2579option, and is required to be specified for shrinks, RAID level
2580changes and layout changes. If this option is used, and the system
2581does crash during the critical period, the same file must be passed to
2582.B \-\-assemble
2583to restore the backup and reassemble the array. When shrinking rather
2584than growing the array, the reshape is done from the end towards the
2585beginning, so the "critical section" is at the end of the reshape.
2586
2587.SS LEVEL CHANGES
2588
2589Changing the RAID level of any array happens instantaneously. However
2590in the RAID5 to RAID6 case this requires a non-standard layout of the
2591RAID6 data, and in the RAID6 to RAID5 case that non-standard layout is
2592required before the change can be accomplished. So while the level
2593change is instant, the accompanying layout change can take quite a
2594long time. A
2595.B \-\-backup\-file
2596is required. If the array is not simultaneously being grown or
2597shrunk, so that the array size will remain the same - for example,
2598reshaping a 3-drive RAID5 into a 4-drive RAID6 - the backup file will
2599be used not just for a "cricital section" but throughout the reshape
2600operation, as described below under LAYOUT CHANGES.
2601
2602.SS CHUNK-SIZE AND LAYOUT CHANGES
2603
2604Changing the chunk-size of layout without also changing the number of
2605devices as the same time will involve re-writing all blocks in-place.
2606To ensure against data loss in the case of a crash, a
2607.B --backup-file
2608must be provided for these changes. Small sections of the array will
2609be copied to the backup file while they are being rearranged. This
2610means that all the data is copied twice, once to the backup and once
2611to the new layout on the array, so this type of reshape will go very
2612slowly.
2613
2614If the reshape is interrupted for any reason, this backup file must be
2615made available to
2616.B "mdadm --assemble"
2617so the array can be reassembled. Consequently the file cannot be
2618stored on the device being reshaped.
2619
2620
2621.SS BITMAP CHANGES
2622
2623A write-intent bitmap can be added to, or removed from, an active
2624array. Either internal bitmaps, or bitmaps stored in a separate file,
2625can be added. Note that if you add a bitmap stored in a file which is
2626in a filesystem that is on the RAID array being affected, the system
2627will deadlock. The bitmap must be on a separate filesystem.
2628
2629.SH INCREMENTAL MODE
2630
2631.HP 12
2632Usage:
2633.B mdadm \-\-incremental
2634.RB [ \-\-run ]
2635.RB [ \-\-quiet ]
2636.I component-device
2637.HP 12
2638Usage:
2639.B mdadm \-\-incremental \-\-fail
2640.I component-device
2641.HP 12
2642Usage:
2643.B mdadm \-\-incremental \-\-rebuild\-map
2644.HP 12
2645Usage:
2646.B mdadm \-\-incremental \-\-run \-\-scan
2647
2648.PP
2649This mode is designed to be used in conjunction with a device
2650discovery system. As devices are found in a system, they can be
2651passed to
2652.B "mdadm \-\-incremental"
2653to be conditionally added to an appropriate array.
2654
2655Conversely, it can also be used with the
2656.B \-\-fail
2657flag to do just the opposite and find whatever array a particular device
2658is part of and remove the device from that array.
2659
2660If the device passed is a
2661.B CONTAINER
2662device created by a previous call to
2663.IR mdadm ,
2664then rather than trying to add that device to an array, all the arrays
2665described by the metadata of the container will be started.
2666
2667.I mdadm
2668performs a number of tests to determine if the device is part of an
2669array, and which array it should be part of. If an appropriate array
2670is found, or can be created,
2671.I mdadm
2672adds the device to the array and conditionally starts the array.
2673
2674Note that
2675.I mdadm
2676will normally only add devices to an array which were previously working
2677(active or spare) parts of that array. The support for automatic
2678inclusion of a new drive as a spare in some array requires
2679a configuration through POLICY in config file.
2680
2681The tests that
2682.I mdadm
2683makes are as follow:
2684.IP +
2685Is the device permitted by
2686.BR mdadm.conf ?
2687That is, is it listed in a
2688.B DEVICES
2689line in that file. If
2690.B DEVICES
2691is absent then the default it to allow any device. Similar if
2692.B DEVICES
2693contains the special word
2694.B partitions
2695then any device is allowed. Otherwise the device name given to
2696.I mdadm
2697must match one of the names or patterns in a
2698.B DEVICES
2699line.
2700
2701.IP +
2702Does the device have a valid md superblock? If a specific metadata
2703version is requested with
2704.B \-\-metadata
2705or
2706.B \-e
2707then only that style of metadata is accepted, otherwise
2708.I mdadm
2709finds any known version of metadata. If no
2710.I md
2711metadata is found, the device may be still added to an array
2712as a spare if POLICY allows.
2713
2714.ig
2715.IP +
2716Does the metadata match an expected array?
2717The metadata can match in two ways. Either there is an array listed
2718in
2719.B mdadm.conf
2720which identifies the array (either by UUID, by name, by device list,
2721or by minor-number), or the array was created with a
2722.B homehost
2723specified and that
2724.B homehost
2725matches the one in
2726.B mdadm.conf
2727or on the command line.
2728If
2729.I mdadm
2730is not able to positively identify the array as belonging to the
2731current host, the device will be rejected.
2732..
2733
2734.PP
2735.I mdadm
2736keeps a list of arrays that it has partially assembled in
2737.BR {MAP_PATH} .
2738If no array exists which matches
2739the metadata on the new device,
2740.I mdadm
2741must choose a device name and unit number. It does this based on any
2742name given in
2743.B mdadm.conf
2744or any name information stored in the metadata. If this name
2745suggests a unit number, that number will be used, otherwise a free
2746unit number will be chosen. Normally
2747.I mdadm
2748will prefer to create a partitionable array, however if the
2749.B CREATE
2750line in
2751.B mdadm.conf
2752suggests that a non-partitionable array is preferred, that will be
2753honoured.
2754
2755If the array is not found in the config file and its metadata does not
2756identify it as belonging to the "homehost", then
2757.I mdadm
2758will choose a name for the array which is certain not to conflict with
2759any array which does belong to this host. It does this be adding an
2760underscore and a small number to the name preferred by the metadata.
2761
2762Once an appropriate array is found or created and the device is added,
2763.I mdadm
2764must decide if the array is ready to be started. It will
2765normally compare the number of available (non-spare) devices to the
2766number of devices that the metadata suggests need to be active. If
2767there are at least that many, the array will be started. This means
2768that if any devices are missing the array will not be restarted.
2769
2770As an alternative,
2771.B \-\-run
2772may be passed to
2773.I mdadm
2774in which case the array will be run as soon as there are enough
2775devices present for the data to be accessible. For a RAID1, that
2776means one device will start the array. For a clean RAID5, the array
2777will be started as soon as all but one drive is present.
2778
2779Note that neither of these approaches is really ideal. If it can
2780be known that all device discovery has completed, then
2781.br
2782.B " mdadm \-IRs"
2783.br
2784can be run which will try to start all arrays that are being
2785incrementally assembled. They are started in "read-auto" mode in
2786which they are read-only until the first write request. This means
2787that no metadata updates are made and no attempt at resync or recovery
2788happens. Further devices that are found before the first write can
2789still be added safely.
2790
2791.SH ENVIRONMENT
2792This section describes environment variables that affect how mdadm
2793operates.
2794
2795.TP
2796.B MDADM_NO_MDMON
2797Setting this value to 1 will prevent mdadm from automatically launching
2798mdmon. This variable is intended primarily for debugging mdadm/mdmon.
2799
2800.TP
2801.B MDADM_NO_UDEV
2802Normally,
2803.I mdadm
2804does not create any device nodes in /dev, but leaves that task to
2805.IR udev .
2806If
2807.I udev
2808appears not to be configured, or if this environment variable is set
2809to '1', the
2810.I mdadm
2811will create and devices that are needed.
2812
2813.TP
2814.B IMSM_NO_PLATFORM
2815A key value of IMSM metadata is that it allows interoperability with
2816boot ROMs on Intel platforms, and with other major operating systems.
2817Consequently,
2818.I mdadm
2819will only allow an IMSM array to be created or modified if detects
2820that it is running on an Intel platform which supports IMSM, and
2821supports the particular configuration of IMSM that is being requested
2822(some functionality requires newer OROM support).
2823
2824These checks can be suppressed by setting IMSM_NO_PLATFORM=1 in the
2825environment. This can be useful for testing or for disaster
2826recovery. You should be aware that interoperability may be
2827compromised by setting this value.
2828.SH EXAMPLES
2829
2830.B " mdadm \-\-query /dev/name-of-device"
2831.br
2832This will find out if a given device is a RAID array, or is part of
2833one, and will provide brief information about the device.
2834
2835.B " mdadm \-\-assemble \-\-scan"
2836.br
2837This will assemble and start all arrays listed in the standard config
2838file. This command will typically go in a system startup file.
2839
2840.B " mdadm \-\-stop \-\-scan"
2841.br
2842This will shut down all arrays that can be shut down (i.e. are not
2843currently in use). This will typically go in a system shutdown script.
2844
2845.B " mdadm \-\-follow \-\-scan \-\-delay=120"
2846.br
2847If (and only if) there is an Email address or program given in the
2848standard config file, then
2849monitor the status of all arrays listed in that file by
2850polling them ever 2 minutes.
2851
2852.B " mdadm \-\-create /dev/md0 \-\-level=1 \-\-raid\-devices=2 /dev/hd[ac]1"
2853.br
2854Create /dev/md0 as a RAID1 array consisting of /dev/hda1 and /dev/hdc1.
2855
2856.br
2857.B " echo 'DEVICE /dev/hd*[0\-9] /dev/sd*[0\-9]' > mdadm.conf"
2858.br
2859.B " mdadm \-\-detail \-\-scan >> mdadm.conf"
2860.br
2861This will create a prototype config file that describes currently
2862active arrays that are known to be made from partitions of IDE or SCSI drives.
2863This file should be reviewed before being used as it may
2864contain unwanted detail.
2865
2866.B " echo 'DEVICE /dev/hd[a\-z] /dev/sd*[a\-z]' > mdadm.conf"
2867.br
2868.B " mdadm \-\-examine \-\-scan \-\-config=mdadm.conf >> mdadm.conf"
2869.br
2870This will find arrays which could be assembled from existing IDE and
2871SCSI whole drives (not partitions), and store the information in the
2872format of a config file.
2873This file is very likely to contain unwanted detail, particularly
2874the
2875.B devices=
2876entries. It should be reviewed and edited before being used as an
2877actual config file.
2878
2879.B " mdadm \-\-examine \-\-brief \-\-scan \-\-config=partitions"
2880.br
2881.B " mdadm \-Ebsc partitions"
2882.br
2883Create a list of devices by reading
2884.BR /proc/partitions ,
2885scan these for RAID superblocks, and printout a brief listing of all
2886that were found.
2887
2888.B " mdadm \-Ac partitions \-m 0 /dev/md0"
2889.br
2890Scan all partitions and devices listed in
2891.BR /proc/partitions
2892and assemble
2893.B /dev/md0
2894out of all such devices with a RAID superblock with a minor number of 0.
2895
2896.B " mdadm \-\-monitor \-\-scan \-\-daemonise > /run/mdadm/mon.pid"
2897.br
2898If config file contains a mail address or alert program, run mdadm in
2899the background in monitor mode monitoring all md devices. Also write
2900pid of mdadm daemon to
2901.BR /run/mdadm/mon.pid .
2902
2903.B " mdadm \-Iq /dev/somedevice"
2904.br
2905Try to incorporate newly discovered device into some array as
2906appropriate.
2907
2908.B " mdadm \-\-incremental \-\-rebuild\-map \-\-run \-\-scan"
2909.br
2910Rebuild the array map from any current arrays, and then start any that
2911can be started.
2912
2913.B " mdadm /dev/md4 --fail detached --remove detached"
2914.br
2915Any devices which are components of /dev/md4 will be marked as faulty
2916and then remove from the array.
2917
2918.B " mdadm --grow /dev/md4 --level=6 --backup-file=/root/backup-md4"
2919.br
2920The array
2921.B /dev/md4
2922which is currently a RAID5 array will be converted to RAID6. There
2923should normally already be a spare drive attached to the array as a
2924RAID6 needs one more drive than a matching RAID5.
2925
2926.B " mdadm --create /dev/md/ddf --metadata=ddf --raid-disks 6 /dev/sd[a-f]"
2927.br
2928Create a DDF array over 6 devices.
2929
2930.B " mdadm --create /dev/md/home -n3 -l5 -z 30000000 /dev/md/ddf"
2931.br
2932Create a RAID5 array over any 3 devices in the given DDF set. Use
2933only 30 gigabytes of each device.
2934
2935.B " mdadm -A /dev/md/ddf1 /dev/sd[a-f]"
2936.br
2937Assemble a pre-exist ddf array.
2938
2939.B " mdadm -I /dev/md/ddf1"
2940.br
2941Assemble all arrays contained in the ddf array, assigning names as
2942appropriate.
2943
2944.B " mdadm \-\-create \-\-help"
2945.br
2946Provide help about the Create mode.
2947
2948.B " mdadm \-\-config \-\-help"
2949.br
2950Provide help about the format of the config file.
2951
2952.B " mdadm \-\-help"
2953.br
2954Provide general help.
2955
2956.SH FILES
2957
2958.SS /proc/mdstat
2959
2960If you're using the
2961.B /proc
2962filesystem,
2963.B /proc/mdstat
2964lists all active md devices with information about them.
2965.I mdadm
2966uses this to find arrays when
2967.B \-\-scan
2968is given in Misc mode, and to monitor array reconstruction
2969on Monitor mode.
2970
2971.SS /etc/mdadm.conf
2972
2973The config file lists which devices may be scanned to see if
2974they contain MD super block, and gives identifying information
2975(e.g. UUID) about known MD arrays. See
2976.BR mdadm.conf (5)
2977for more details.
2978
2979.SS {MAP_PATH}
2980When
2981.B \-\-incremental
2982mode is used, this file gets a list of arrays currently being created.
2983
2984.SH DEVICE NAMES
2985
2986.I mdadm
2987understand two sorts of names for array devices.
2988
2989The first is the so-called 'standard' format name, which matches the
2990names used by the kernel and which appear in
2991.IR /proc/mdstat .
2992
2993The second sort can be freely chosen, but must reside in
2994.IR /dev/md/ .
2995When giving a device name to
2996.I mdadm
2997to create or assemble an array, either full path name such as
2998.I /dev/md0
2999or
3000.I /dev/md/home
3001can be given, or just the suffix of the second sort of name, such as
3002.I home
3003can be given.
3004
3005When
3006.I mdadm
3007chooses device names during auto-assembly or incremental assembly, it
3008will sometimes add a small sequence number to the end of the name to
3009avoid conflicted between multiple arrays that have the same name. If
3010.I mdadm
3011can reasonably determine that the array really is meant for this host,
3012either by a hostname in the metadata, or by the presence of the array
3013in
3014.BR mdadm.conf ,
3015then it will leave off the suffix if possible.
3016Also if the homehost is specified as
3017.B <ignore>
3018.I mdadm
3019will only use a suffix if a different array of the same name already
3020exists or is listed in the config file.
3021
3022The standard names for non-partitioned arrays (the only sort of md
3023array available in 2.4 and earlier) are of the form
3024.IP
3025.RB /dev/md NN
3026.PP
3027where NN is a number.
3028The standard names for partitionable arrays (as available from 2.6
3029onwards) are of the form:
3030.IP
3031.RB /dev/md_d NN
3032.PP
3033Partition numbers should be indicated by adding "pMM" to these, thus "/dev/md/d1p2".
3034.PP
3035From kernel version 2.6.28 the "non-partitioned array" can actually
3036be partitioned. So the "md_d\fBNN\fP"
3037names are no longer needed, and
3038partitions such as "/dev/md\fBNN\fPp\fBXX\fp"
3039are possible.
3040.PP
3041From kernel version 2.6.29 standard names can be non-numeric following
3042the form:
3043.IP
3044.RB /dev/md_ XXX
3045.PP
3046where
3047.B XXX
3048is any string. These names are supported by
3049.I mdadm
3050since version 3.3 provided they are enabled in
3051.IR mdadm.conf .
3052
3053.SH NOTE
3054.I mdadm
3055was previously known as
3056.IR mdctl .
3057
3058.SH SEE ALSO
3059For further information on mdadm usage, MD and the various levels of
3060RAID, see:
3061.IP
3062.B http://raid.wiki.kernel.org/
3063.PP
3064(based upon Jakob \(/Ostergaard's Software\-RAID.HOWTO)
3065.PP
3066The latest version of
3067.I mdadm
3068should always be available from
3069.IP
3070.B http://www.kernel.org/pub/linux/utils/raid/mdadm/
3071.PP
3072Related man pages:
3073.PP
3074.IR mdmon (8),
3075.IR mdadm.conf (5),
3076.IR md (4).