]> git.ipfire.org Git - thirdparty/mdadm.git/blame_incremental - mdadm.8.in
Add data_offset arg to ->init_super and use it in super1.c
[thirdparty/mdadm.git] / mdadm.8.in
... / ...
CommitLineData
1.\" -*- nroff -*-
2.\" Copyright Neil Brown and others.
3.\" This program is free software; you can redistribute it and/or modify
4.\" it under the terms of the GNU General Public License as published by
5.\" the Free Software Foundation; either version 2 of the License, or
6.\" (at your option) any later version.
7.\" See file COPYING in distribution for details.
8.TH MDADM 8 "" v3.2.5
9.SH NAME
10mdadm \- manage MD devices
11.I aka
12Linux Software RAID
13
14.SH SYNOPSIS
15
16.BI mdadm " [mode] <raiddevice> [options] <component-devices>"
17
18.SH DESCRIPTION
19RAID devices are virtual devices created from two or more
20real block devices. This allows multiple devices (typically disk
21drives or partitions thereof) to be combined into a single device to
22hold (for example) a single filesystem.
23Some RAID levels include redundancy and so can survive some degree of
24device failure.
25
26Linux Software RAID devices are implemented through the md (Multiple
27Devices) device driver.
28
29Currently, Linux supports
30.B LINEAR
31md devices,
32.B RAID0
33(striping),
34.B RAID1
35(mirroring),
36.BR RAID4 ,
37.BR RAID5 ,
38.BR RAID6 ,
39.BR RAID10 ,
40.BR MULTIPATH ,
41.BR FAULTY ,
42and
43.BR CONTAINER .
44
45.B MULTIPATH
46is not a Software RAID mechanism, but does involve
47multiple devices:
48each device is a path to one common physical storage device.
49New installations should not use md/multipath as it is not well
50supported and has no ongoing development. Use the Device Mapper based
51multipath-tools instead.
52
53.B FAULTY
54is also not true RAID, and it only involves one device. It
55provides a layer over a true device that can be used to inject faults.
56
57.B CONTAINER
58is different again. A
59.B CONTAINER
60is a collection of devices that are
61managed as a set. This is similar to the set of devices connected to
62a hardware RAID controller. The set of devices may contain a number
63of different RAID arrays each utilising some (or all) of the blocks from a
64number of the devices in the set. For example, two devices in a 5-device set
65might form a RAID1 using the whole devices. The remaining three might
66have a RAID5 over the first half of each device, and a RAID0 over the
67second half.
68
69With a
70.BR CONTAINER ,
71there is one set of metadata that describes all of
72the arrays in the container. So when
73.I mdadm
74creates a
75.B CONTAINER
76device, the device just represents the metadata. Other normal arrays (RAID1
77etc) can be created inside the container.
78
79.SH MODES
80mdadm has several major modes of operation:
81.TP
82.B Assemble
83Assemble the components of a previously created
84array into an active array. Components can be explicitly given
85or can be searched for.
86.I mdadm
87checks that the components
88do form a bona fide array, and can, on request, fiddle superblock
89information so as to assemble a faulty array.
90
91.TP
92.B Build
93Build an array that doesn't have per-device metadata (superblocks). For these
94sorts of arrays,
95.I mdadm
96cannot differentiate between initial creation and subsequent assembly
97of an array. It also cannot perform any checks that appropriate
98components have been requested. Because of this, the
99.B Build
100mode should only be used together with a complete understanding of
101what you are doing.
102
103.TP
104.B Create
105Create a new array with per-device metadata (superblocks).
106Appropriate metadata is written to each device, and then the array
107comprising those devices is activated. A 'resync' process is started
108to make sure that the array is consistent (e.g. both sides of a mirror
109contain the same data) but the content of the device is left otherwise
110untouched.
111The array can be used as soon as it has been created. There is no
112need to wait for the initial resync to finish.
113
114.TP
115.B "Follow or Monitor"
116Monitor one or more md devices and act on any state changes. This is
117only meaningful for RAID1, 4, 5, 6, 10 or multipath arrays, as
118only these have interesting state. RAID0 or Linear never have
119missing, spare, or failed drives, so there is nothing to monitor.
120
121.TP
122.B "Grow"
123Grow (or shrink) an array, or otherwise reshape it in some way.
124Currently supported growth options including changing the active size
125of component devices and changing the number of active devices in
126Linear and RAID levels 0/1/4/5/6,
127changing the RAID level between 0, 1, 5, and 6, and between 0 and 10,
128changing the chunk size and layout for RAID 0,4,5,6, as well as adding or
129removing a write-intent bitmap.
130
131.TP
132.B "Incremental Assembly"
133Add a single device to an appropriate array. If the addition of the
134device makes the array runnable, the array will be started.
135This provides a convenient interface to a
136.I hot-plug
137system. As each device is detected,
138.I mdadm
139has a chance to include it in some array as appropriate.
140Optionally, when the
141.I \-\-fail
142flag is passed in we will remove the device from any active array
143instead of adding it.
144
145If a
146.B CONTAINER
147is passed to
148.I mdadm
149in this mode, then any arrays within that container will be assembled
150and started.
151
152.TP
153.B Manage
154This is for doing things to specific components of an array such as
155adding new spares and removing faulty devices.
156
157.TP
158.B Misc
159This is an 'everything else' mode that supports operations on active
160arrays, operations on component devices such as erasing old superblocks, and
161information gathering operations.
162.\"This mode allows operations on independent devices such as examine MD
163.\"superblocks, erasing old superblocks and stopping active arrays.
164
165.TP
166.B Auto-detect
167This mode does not act on a specific device or array, but rather it
168requests the Linux Kernel to activate any auto-detected arrays.
169.SH OPTIONS
170
171.SH Options for selecting a mode are:
172
173.TP
174.BR \-A ", " \-\-assemble
175Assemble a pre-existing array.
176
177.TP
178.BR \-B ", " \-\-build
179Build a legacy array without superblocks.
180
181.TP
182.BR \-C ", " \-\-create
183Create a new array.
184
185.TP
186.BR \-F ", " \-\-follow ", " \-\-monitor
187Select
188.B Monitor
189mode.
190
191.TP
192.BR \-G ", " \-\-grow
193Change the size or shape of an active array.
194
195.TP
196.BR \-I ", " \-\-incremental
197Add/remove a single device to/from an appropriate array, and possibly start the array.
198
199.TP
200.B \-\-auto-detect
201Request that the kernel starts any auto-detected arrays. This can only
202work if
203.I md
204is compiled into the kernel \(em not if it is a module.
205Arrays can be auto-detected by the kernel if all the components are in
206primary MS-DOS partitions with partition type
207.BR FD ,
208and all use v0.90 metadata.
209In-kernel autodetect is not recommended for new installations. Using
210.I mdadm
211to detect and assemble arrays \(em possibly in an
212.I initrd
213\(em is substantially more flexible and should be preferred.
214
215.P
216If a device is given before any options, or if the first option is
217.BR \-\-add ,
218.BR \-\-fail ,
219or
220.BR \-\-remove ,
221then the MANAGE mode is assumed.
222Anything other than these will cause the
223.B Misc
224mode to be assumed.
225
226.SH Options that are not mode-specific are:
227
228.TP
229.BR \-h ", " \-\-help
230Display general help message or, after one of the above options, a
231mode-specific help message.
232
233.TP
234.B \-\-help\-options
235Display more detailed help about command line parsing and some commonly
236used options.
237
238.TP
239.BR \-V ", " \-\-version
240Print version information for mdadm.
241
242.TP
243.BR \-v ", " \-\-verbose
244Be more verbose about what is happening. This can be used twice to be
245extra-verbose.
246The extra verbosity currently only affects
247.B \-\-detail \-\-scan
248and
249.BR "\-\-examine \-\-scan" .
250
251.TP
252.BR \-q ", " \-\-quiet
253Avoid printing purely informative messages. With this,
254.I mdadm
255will be silent unless there is something really important to report.
256
257.TP
258.BR \-\-offroot
259Set first character of argv[0] to @ to indicate mdadm was launched
260from initrd/initramfs and should not be shutdown by systemd as part of
261the regular shutdown process. This option is normally only used by
262the system's initscripts. Please see here for more details on how
263systemd handled argv[0]:
264.IP
265.B http://www.freedesktop.org/wiki/Software/systemd/RootStorageDaemons
266.PP
267
268
269.TP
270.BR \-f ", " \-\-force
271Be more forceful about certain operations. See the various modes for
272the exact meaning of this option in different contexts.
273
274.TP
275.BR \-c ", " \-\-config=
276Specify the config file. Default is to use
277.BR /etc/mdadm.conf ,
278or if that is missing then
279.BR /etc/mdadm/mdadm.conf .
280If the config file given is
281.B "partitions"
282then nothing will be read, but
283.I mdadm
284will act as though the config file contained exactly
285.B "DEVICE partitions containers"
286and will read
287.B /proc/partitions
288to find a list of devices to scan, and
289.B /proc/mdstat
290to find a list of containers to examine.
291If the word
292.B "none"
293is given for the config file, then
294.I mdadm
295will act as though the config file were empty.
296
297.TP
298.BR \-s ", " \-\-scan
299Scan config file or
300.B /proc/mdstat
301for missing information.
302In general, this option gives
303.I mdadm
304permission to get any missing information (like component devices,
305array devices, array identities, and alert destination) from the
306configuration file (see previous option);
307one exception is MISC mode when using
308.B \-\-detail
309or
310.B \-\-stop,
311in which case
312.B \-\-scan
313says to get a list of array devices from
314.BR /proc/mdstat .
315
316.TP
317.BR \-e ", " \-\-metadata=
318Declare the style of RAID metadata (superblock) to be used. The
319default is {DEFAULT_METADATA} for
320.BR \-\-create ,
321and to guess for other operations.
322The default can be overridden by setting the
323.B metadata
324value for the
325.B CREATE
326keyword in
327.BR mdadm.conf .
328
329Options are:
330.RS
331.ie '{DEFAULT_METADATA}'0.90'
332.IP "0, 0.90, default"
333.el
334.IP "0, 0.90"
335..
336Use the original 0.90 format superblock. This format limits arrays to
33728 component devices and limits component devices of levels 1 and
338greater to 2 terabytes. It is also possible for there to be confusion
339about whether the superblock applies to a whole device or just the
340last partition, if that partition starts on a 64K boundary.
341.ie '{DEFAULT_METADATA}'0.90'
342.IP "1, 1.0, 1.1, 1.2"
343.el
344.IP "1, 1.0, 1.1, 1.2 default"
345..
346Use the new version-1 format superblock. This has fewer restrictions.
347It can easily be moved between hosts with different endian-ness, and a
348recovery operation can be checkpointed and restarted. The different
349sub-versions store the superblock at different locations on the
350device, either at the end (for 1.0), at the start (for 1.1) or 4K from
351the start (for 1.2). "1" is equivalent to "1.2" (the commonly
352preferred 1.x format).
353'if '{DEFAULT_METADATA}'1.2' "default" is equivalent to "1.2".
354.IP ddf
355Use the "Industry Standard" DDF (Disk Data Format) format defined by
356SNIA.
357When creating a DDF array a
358.B CONTAINER
359will be created, and normal arrays can be created in that container.
360.IP imsm
361Use the Intel(R) Matrix Storage Manager metadata format. This creates a
362.B CONTAINER
363which is managed in a similar manner to DDF, and is supported by an
364option-rom on some platforms:
365.IP
366.B http://www.intel.com/design/chipsets/matrixstorage_sb.htm
367.PP
368.RE
369
370.TP
371.B \-\-homehost=
372This will override any
373.B HOMEHOST
374setting in the config file and provides the identity of the host which
375should be considered the home for any arrays.
376
377When creating an array, the
378.B homehost
379will be recorded in the metadata. For version-1 superblocks, it will
380be prefixed to the array name. For version-0.90 superblocks, part of
381the SHA1 hash of the hostname will be stored in the later half of the
382UUID.
383
384When reporting information about an array, any array which is tagged
385for the given homehost will be reported as such.
386
387When using Auto-Assemble, only arrays tagged for the given homehost
388will be allowed to use 'local' names (i.e. not ending in '_' followed
389by a digit string). See below under
390.BR "Auto Assembly" .
391
392.TP
393.B \-\-prefer=
394When
395.I mdadm
396needs to print the name for a device it normally finds the name in
397.B /dev
398which refers to the device and is shortest. When a path component is
399given with
400.B \-\-prefer
401.I mdadm
402will prefer a longer name if it contains that component. For example
403.B \-\-prefer=by-uuid
404will prefer a name in a subdirectory of
405.B /dev
406called
407.BR by-uuid .
408
409This functionality is currently only provided by
410.B \-\-detail
411and
412.BR \-\-monitor .
413
414.SH For create, build, or grow:
415
416.TP
417.BR \-n ", " \-\-raid\-devices=
418Specify the number of active devices in the array. This, plus the
419number of spare devices (see below) must equal the number of
420.I component-devices
421(including "\fBmissing\fP" devices)
422that are listed on the command line for
423.BR \-\-create .
424Setting a value of 1 is probably
425a mistake and so requires that
426.B \-\-force
427be specified first. A value of 1 will then be allowed for linear,
428multipath, RAID0 and RAID1. It is never allowed for RAID4, RAID5 or RAID6.
429.br
430This number can only be changed using
431.B \-\-grow
432for RAID1, RAID4, RAID5 and RAID6 arrays, and only on kernels which provide
433the necessary support.
434
435.TP
436.BR \-x ", " \-\-spare\-devices=
437Specify the number of spare (eXtra) devices in the initial array.
438Spares can also be added
439and removed later. The number of component devices listed
440on the command line must equal the number of RAID devices plus the
441number of spare devices.
442
443.TP
444.BR \-z ", " \-\-size=
445Amount (in Kibibytes) of space to use from each drive in RAID levels 1/4/5/6.
446This must be a multiple of the chunk size, and must leave about 128Kb
447of space at the end of the drive for the RAID superblock.
448If this is not specified
449(as it normally is not) the smallest drive (or partition) sets the
450size, though if there is a variance among the drives of greater than 1%, a warning is
451issued.
452
453A suffix of 'M' or 'G' can be given to indicate Megabytes or
454Gigabytes respectively.
455
456Sometimes a replacement drive can be a little smaller than the
457original drives though this should be minimised by IDEMA standards.
458Such a replacement drive will be rejected by
459.IR md .
460To guard against this it can be useful to set the initial size
461slightly smaller than the smaller device with the aim that it will
462still be larger than any replacement.
463
464This value can be set with
465.B \-\-grow
466for RAID level 1/4/5/6 though
467.B CONTAINER
468based arrays such as those with IMSM metadata may not be able to
469support this.
470If the array was created with a size smaller than the currently
471active drives, the extra space can be accessed using
472.BR \-\-grow .
473The size can be given as
474.B max
475which means to choose the largest size that fits on all current drives.
476
477Before reducing the size of the array (with
478.BR "\-\-grow \-\-size=" )
479you should make sure that space isn't needed. If the device holds a
480filesystem, you would need to resize the filesystem to use less space.
481
482After reducing the array size you should check that the data stored in
483the device is still available. If the device holds a filesystem, then
484an 'fsck' of the filesystem is a minimum requirement. If there are
485problems the array can be made bigger again with no loss with another
486.B "\-\-grow \-\-size="
487command.
488
489This value cannot be used when creating a
490.B CONTAINER
491such as with DDF and IMSM metadata, though it perfectly valid when
492creating an array inside a container.
493
494.TP
495.BR \-Z ", " \-\-array\-size=
496This is only meaningful with
497.B \-\-grow
498and its effect is not persistent: when the array is stopped and
499restarted the default array size will be restored.
500
501Setting the array-size causes the array to appear smaller to programs
502that access the data. This is particularly needed before reshaping an
503array so that it will be smaller. As the reshape is not reversible,
504but setting the size with
505.B \-\-array-size
506is, it is required that the array size is reduced as appropriate
507before the number of devices in the array is reduced.
508
509Before reducing the size of the array you should make sure that space
510isn't needed. If the device holds a filesystem, you would need to
511resize the filesystem to use less space.
512
513After reducing the array size you should check that the data stored in
514the device is still available. If the device holds a filesystem, then
515an 'fsck' of the filesystem is a minimum requirement. If there are
516problems the array can be made bigger again with no loss with another
517.B "\-\-grow \-\-array\-size="
518command.
519
520A suffix of 'M' or 'G' can be given to indicate Megabytes or
521Gigabytes respectively.
522A value of
523.B max
524restores the apparent size of the array to be whatever the real
525amount of available space is.
526
527.TP
528.BR \-c ", " \-\-chunk=
529Specify chunk size of kibibytes. The default when creating an
530array is 512KB. To ensure compatibility with earlier versions, the
531default when Building and array with no persistent metadata is 64KB.
532This is only meaningful for RAID0, RAID4, RAID5, RAID6, and RAID10.
533
534RAID4, RAID5, RAID6, and RAID10 require the chunk size to be a power
535of 2. In any case it must be a multiple of 4KB.
536
537A suffix of 'M' or 'G' can be given to indicate Megabytes or
538Gigabytes respectively.
539
540.TP
541.BR \-\-rounding=
542Specify rounding factor for a Linear array. The size of each
543component will be rounded down to a multiple of this size.
544This is a synonym for
545.B \-\-chunk
546but highlights the different meaning for Linear as compared to other
547RAID levels. The default is 64K if a kernel earlier than 2.6.16 is in
548use, and is 0K (i.e. no rounding) in later kernels.
549
550.TP
551.BR \-l ", " \-\-level=
552Set RAID level. When used with
553.BR \-\-create ,
554options are: linear, raid0, 0, stripe, raid1, 1, mirror, raid4, 4,
555raid5, 5, raid6, 6, raid10, 10, multipath, mp, faulty, container.
556Obviously some of these are synonymous.
557
558When a
559.B CONTAINER
560metadata type is requested, only the
561.B container
562level is permitted, and it does not need to be explicitly given.
563
564When used with
565.BR \-\-build ,
566only linear, stripe, raid0, 0, raid1, multipath, mp, and faulty are valid.
567
568Can be used with
569.B \-\-grow
570to change the RAID level in some cases. See LEVEL CHANGES below.
571
572.TP
573.BR \-p ", " \-\-layout=
574This option configures the fine details of data layout for RAID5, RAID6,
575and RAID10 arrays, and controls the failure modes for
576.IR faulty .
577
578The layout of the RAID5 parity block can be one of
579.BR left\-asymmetric ,
580.BR left\-symmetric ,
581.BR right\-asymmetric ,
582.BR right\-symmetric ,
583.BR la ", " ra ", " ls ", " rs .
584The default is
585.BR left\-symmetric .
586
587It is also possible to cause RAID5 to use a RAID4-like layout by
588choosing
589.BR parity\-first ,
590or
591.BR parity\-last .
592
593Finally for RAID5 there are DDF\-compatible layouts,
594.BR ddf\-zero\-restart ,
595.BR ddf\-N\-restart ,
596and
597.BR ddf\-N\-continue .
598
599These same layouts are available for RAID6. There are also 4 layouts
600that will provide an intermediate stage for converting between RAID5
601and RAID6. These provide a layout which is identical to the
602corresponding RAID5 layout on the first N\-1 devices, and has the 'Q'
603syndrome (the second 'parity' block used by RAID6) on the last device.
604These layouts are:
605.BR left\-symmetric\-6 ,
606.BR right\-symmetric\-6 ,
607.BR left\-asymmetric\-6 ,
608.BR right\-asymmetric\-6 ,
609and
610.BR parity\-first\-6 .
611
612When setting the failure mode for level
613.I faulty,
614the options are:
615.BR write\-transient ", " wt ,
616.BR read\-transient ", " rt ,
617.BR write\-persistent ", " wp ,
618.BR read\-persistent ", " rp ,
619.BR write\-all ,
620.BR read\-fixable ", " rf ,
621.BR clear ", " flush ", " none .
622
623Each failure mode can be followed by a number, which is used as a period
624between fault generation. Without a number, the fault is generated
625once on the first relevant request. With a number, the fault will be
626generated after that many requests, and will continue to be generated
627every time the period elapses.
628
629Multiple failure modes can be current simultaneously by using the
630.B \-\-grow
631option to set subsequent failure modes.
632
633"clear" or "none" will remove any pending or periodic failure modes,
634and "flush" will clear any persistent faults.
635
636Finally, the layout options for RAID10 are one of 'n', 'o' or 'f' followed
637by a small number. The default is 'n2'. The supported options are:
638
639.I 'n'
640signals 'near' copies. Multiple copies of one data block are at
641similar offsets in different devices.
642
643.I 'o'
644signals 'offset' copies. Rather than the chunks being duplicated
645within a stripe, whole stripes are duplicated but are rotated by one
646device so duplicate blocks are on different devices. Thus subsequent
647copies of a block are in the next drive, and are one chunk further
648down.
649
650.I 'f'
651signals 'far' copies
652(multiple copies have very different offsets).
653See md(4) for more detail about 'near', 'offset', and 'far'.
654
655The number is the number of copies of each datablock. 2 is normal, 3
656can be useful. This number can be at most equal to the number of
657devices in the array. It does not need to divide evenly into that
658number (e.g. it is perfectly legal to have an 'n2' layout for an array
659with an odd number of devices).
660
661When an array is converted between RAID5 and RAID6 an intermediate
662RAID6 layout is used in which the second parity block (Q) is always on
663the last device. To convert a RAID5 to RAID6 and leave it in this new
664layout (which does not require re-striping) use
665.BR \-\-layout=preserve .
666This will try to avoid any restriping.
667
668The converse of this is
669.B \-\-layout=normalise
670which will change a non-standard RAID6 layout into a more standard
671arrangement.
672
673.TP
674.BR \-\-parity=
675same as
676.B \-\-layout
677(thus explaining the p of
678.BR \-p ).
679
680.TP
681.BR \-b ", " \-\-bitmap=
682Specify a file to store a write-intent bitmap in. The file should not
683exist unless
684.B \-\-force
685is also given. The same file should be provided
686when assembling the array. If the word
687.B "internal"
688is given, then the bitmap is stored with the metadata on the array,
689and so is replicated on all devices. If the word
690.B "none"
691is given with
692.B \-\-grow
693mode, then any bitmap that is present is removed.
694
695To help catch typing errors, the filename must contain at least one
696slash ('/') if it is a real file (not 'internal' or 'none').
697
698Note: external bitmaps are only known to work on ext2 and ext3.
699Storing bitmap files on other filesystems may result in serious problems.
700
701.TP
702.BR \-\-bitmap\-chunk=
703Set the chunksize of the bitmap. Each bit corresponds to that many
704Kilobytes of storage.
705When using a file based bitmap, the default is to use the smallest
706size that is at-least 4 and requires no more than 2^21 chunks.
707When using an
708.B internal
709bitmap, the chunksize defaults to 64Meg, or larger if necessary to
710fit the bitmap into the available space.
711
712A suffix of 'M' or 'G' can be given to indicate Megabytes or
713Gigabytes respectively.
714
715.TP
716.BR \-W ", " \-\-write\-mostly
717subsequent devices listed in a
718.BR \-\-build ,
719.BR \-\-create ,
720or
721.B \-\-add
722command will be flagged as 'write-mostly'. This is valid for RAID1
723only and means that the 'md' driver will avoid reading from these
724devices if at all possible. This can be useful if mirroring over a
725slow link.
726
727.TP
728.BR \-\-write\-behind=
729Specify that write-behind mode should be enabled (valid for RAID1
730only). If an argument is specified, it will set the maximum number
731of outstanding writes allowed. The default value is 256.
732A write-intent bitmap is required in order to use write-behind
733mode, and write-behind is only attempted on drives marked as
734.IR write-mostly .
735
736.TP
737.BR \-\-assume\-clean
738Tell
739.I mdadm
740that the array pre-existed and is known to be clean. It can be useful
741when trying to recover from a major failure as you can be sure that no
742data will be affected unless you actually write to the array. It can
743also be used when creating a RAID1 or RAID10 if you want to avoid the
744initial resync, however this practice \(em while normally safe \(em is not
745recommended. Use this only if you really know what you are doing.
746.IP
747When the devices that will be part of a new array were filled
748with zeros before creation the operator knows the array is
749actually clean. If that is the case, such as after running
750badblocks, this argument can be used to tell mdadm the
751facts the operator knows.
752.IP
753When an array is resized to a larger size with
754.B "\-\-grow \-\-size="
755the new space is normally resynced in that same way that the whole
756array is resynced at creation. From Linux version 3.0,
757.B \-\-assume\-clean
758can be used with that command to avoid the automatic resync.
759
760.TP
761.BR \-\-backup\-file=
762This is needed when
763.B \-\-grow
764is used to increase the number of raid-devices in a RAID5 or RAID6 if
765there are no spare devices available, or to shrink, change RAID level
766or layout. See the GROW MODE section below on RAID\-DEVICES CHANGES.
767The file must be stored on a separate device, not on the RAID array
768being reshaped.
769
770.TP
771.BR \-\-continue
772This option is complementary to the
773.B \-\-freeze-reshape
774option for assembly. It is needed when
775.B \-\-grow
776operation is interrupted and it is not restarted automatically due to
777.B \-\-freeze-reshape
778usage during array assembly. This option is used together with
779.BR \-G
780, (
781.BR \-\-grow
782) command and device for a pending reshape to be continued.
783All parameters required for reshape continuation will be read from array metadata.
784If initial
785.BR \-\-grow
786command had required
787.BR \-\-backup\-file=
788option to be set, continuation option will require to have exactly the same
789backup file given as well.
790.IP
791Any other parameter passed together with
792.BR \-\-continue
793option will be ignored.
794
795.TP
796.BR \-N ", " \-\-name=
797Set a
798.B name
799for the array. This is currently only effective when creating an
800array with a version-1 superblock, or an array in a DDF container.
801The name is a simple textual string that can be used to identify array
802components when assembling. If name is needed but not specified, it
803is taken from the basename of the device that is being created.
804e.g. when creating
805.I /dev/md/home
806the
807.B name
808will default to
809.IR home .
810
811.TP
812.BR \-R ", " \-\-run
813Insist that
814.I mdadm
815run the array, even if some of the components
816appear to be active in another array or filesystem. Normally
817.I mdadm
818will ask for confirmation before including such components in an
819array. This option causes that question to be suppressed.
820
821.TP
822.BR \-f ", " \-\-force
823Insist that
824.I mdadm
825accept the geometry and layout specified without question. Normally
826.I mdadm
827will not allow creation of an array with only one device, and will try
828to create a RAID5 array with one missing drive (as this makes the
829initial resync work faster). With
830.BR \-\-force ,
831.I mdadm
832will not try to be so clever.
833
834.TP
835.BR \-o ", " \-\-readonly
836Start the array
837.B read only
838rather than read-write as normal. No writes will be allowed to the
839array, and no resync, recovery, or reshape will be started.
840
841.TP
842.BR \-a ", " "\-\-auto{=yes,md,mdp,part,p}{NN}"
843Instruct mdadm how to create the device file if needed, possibly allocating
844an unused minor number. "md" causes a non-partitionable array
845to be used (though since Linux 2.6.28, these array devices are in fact
846partitionable). "mdp", "part" or "p" causes a partitionable array (2.6 and
847later) to be used. "yes" requires the named md device to have
848a 'standard' format, and the type and minor number will be determined
849from this. With mdadm 3.0, device creation is normally left up to
850.I udev
851so this option is unlikely to be needed.
852See DEVICE NAMES below.
853
854The argument can also come immediately after
855"\-a". e.g. "\-ap".
856
857If
858.B \-\-auto
859is not given on the command line or in the config file, then
860the default will be
861.BR \-\-auto=yes .
862
863If
864.B \-\-scan
865is also given, then any
866.I auto=
867entries in the config file will override the
868.B \-\-auto
869instruction given on the command line.
870
871For partitionable arrays,
872.I mdadm
873will create the device file for the whole array and for the first 4
874partitions. A different number of partitions can be specified at the
875end of this option (e.g.
876.BR \-\-auto=p7 ).
877If the device name ends with a digit, the partition names add a 'p',
878and a number, e.g.
879.IR /dev/md/home1p3 .
880If there is no trailing digit, then the partition names just have a
881number added, e.g.
882.IR /dev/md/scratch3 .
883
884If the md device name is in a 'standard' format as described in DEVICE
885NAMES, then it will be created, if necessary, with the appropriate
886device number based on that name. If the device name is not in one of these
887formats, then a unused device number will be allocated. The device
888number will be considered unused if there is no active array for that
889number, and there is no entry in /dev for that number and with a
890non-standard name. Names that are not in 'standard' format are only
891allowed in "/dev/md/".
892
893This is meaningful with
894.B \-\-create
895or
896.BR \-\-build .
897
898.ig XX
899.\".TP
900.\".BR \-\-symlink = no
901.\"Normally when
902.\".B \-\-auto
903.\"causes
904.\".I mdadm
905.\"to create devices in
906.\".B /dev/md/
907.\"it will also create symlinks from
908.\".B /dev/
909.\"with names starting with
910.\".B md
911.\"or
912.\".BR md_ .
913.\"Use
914.\".B \-\-symlink=no
915.\"to suppress this, or
916.\".B \-\-symlink=yes
917.\"to enforce this even if it is suppressing
918.\".IR mdadm.conf .
919.\"
920.XX
921
922.TP
923.BR \-a ", " "\-\-add"
924This option can be used in Grow mode in two cases.
925
926If the target array is a Linear array, then
927.B \-\-add
928can be used to add one or more devices to the array. They
929are simply catenated on to the end of the array. Once added, the
930devices cannot be removed.
931
932If the
933.B \-\-raid\-disks
934option is being used to increase the number of devices in an array,
935then
936.B \-\-add
937can be used to add some extra devices to be included in the array.
938In most cases this is not needed as the extra devices can be added as
939spares first, and then the number of raid-disks can be changed.
940However for RAID0, it is not possible to add spares. So to increase
941the number of devices in a RAID0, it is necessary to set the new
942number of devices, and to add the new devices, in the same command.
943
944.SH For assemble:
945
946.TP
947.BR \-u ", " \-\-uuid=
948uuid of array to assemble. Devices which don't have this uuid are
949excluded
950
951.TP
952.BR \-m ", " \-\-super\-minor=
953Minor number of device that array was created for. Devices which
954don't have this minor number are excluded. If you create an array as
955/dev/md1, then all superblocks will contain the minor number 1, even if
956the array is later assembled as /dev/md2.
957
958Giving the literal word "dev" for
959.B \-\-super\-minor
960will cause
961.I mdadm
962to use the minor number of the md device that is being assembled.
963e.g. when assembling
964.BR /dev/md0 ,
965.B \-\-super\-minor=dev
966will look for super blocks with a minor number of 0.
967
968.B \-\-super\-minor
969is only relevant for v0.90 metadata, and should not normally be used.
970Using
971.B \-\-uuid
972is much safer.
973
974.TP
975.BR \-N ", " \-\-name=
976Specify the name of the array to assemble. This must be the name
977that was specified when creating the array. It must either match
978the name stored in the superblock exactly, or it must match
979with the current
980.I homehost
981prefixed to the start of the given name.
982
983.TP
984.BR \-f ", " \-\-force
985Assemble the array even if the metadata on some devices appears to be
986out-of-date. If
987.I mdadm
988cannot find enough working devices to start the array, but can find
989some devices that are recorded as having failed, then it will mark
990those devices as working so that the array can be started.
991An array which requires
992.B \-\-force
993to be started may contain data corruption. Use it carefully.
994
995.TP
996.BR \-R ", " \-\-run
997Attempt to start the array even if fewer drives were given than were
998present last time the array was active. Normally if not all the
999expected drives are found and
1000.B \-\-scan
1001is not used, then the array will be assembled but not started.
1002With
1003.B \-\-run
1004an attempt will be made to start it anyway.
1005
1006.TP
1007.B \-\-no\-degraded
1008This is the reverse of
1009.B \-\-run
1010in that it inhibits the startup of array unless all expected drives
1011are present. This is only needed with
1012.B \-\-scan,
1013and can be used if the physical connections to devices are
1014not as reliable as you would like.
1015
1016.TP
1017.BR \-a ", " "\-\-auto{=no,yes,md,mdp,part}"
1018See this option under Create and Build options.
1019
1020.TP
1021.BR \-b ", " \-\-bitmap=
1022Specify the bitmap file that was given when the array was created. If
1023an array has an
1024.B internal
1025bitmap, there is no need to specify this when assembling the array.
1026
1027.TP
1028.BR \-\-backup\-file=
1029If
1030.B \-\-backup\-file
1031was used while reshaping an array (e.g. changing number of devices or
1032chunk size) and the system crashed during the critical section, then the same
1033.B \-\-backup\-file
1034must be presented to
1035.B \-\-assemble
1036to allow possibly corrupted data to be restored, and the reshape
1037to be completed.
1038
1039.TP
1040.BR \-\-invalid\-backup
1041If the file needed for the above option is not available for any
1042reason an empty file can be given together with this option to
1043indicate that the backup file is invalid. In this case the data that
1044was being rearranged at the time of the crash could be irrecoverably
1045lost, but the rest of the array may still be recoverable. This option
1046should only be used as a last resort if there is no way to recover the
1047backup file.
1048
1049
1050.TP
1051.BR \-U ", " \-\-update=
1052Update the superblock on each device while assembling the array. The
1053argument given to this flag can be one of
1054.BR sparc2.2 ,
1055.BR summaries ,
1056.BR uuid ,
1057.BR name ,
1058.BR homehost ,
1059.BR resync ,
1060.BR byteorder ,
1061.BR devicesize ,
1062.BR no\-bitmap ,
1063.BR bbl ,
1064.BR no-\bbl ,
1065or
1066.BR super\-minor .
1067
1068The
1069.B sparc2.2
1070option will adjust the superblock of an array what was created on a Sparc
1071machine running a patched 2.2 Linux kernel. This kernel got the
1072alignment of part of the superblock wrong. You can use the
1073.B "\-\-examine \-\-sparc2.2"
1074option to
1075.I mdadm
1076to see what effect this would have.
1077
1078The
1079.B super\-minor
1080option will update the
1081.B "preferred minor"
1082field on each superblock to match the minor number of the array being
1083assembled.
1084This can be useful if
1085.B \-\-examine
1086reports a different "Preferred Minor" to
1087.BR \-\-detail .
1088In some cases this update will be performed automatically
1089by the kernel driver. In particular the update happens automatically
1090at the first write to an array with redundancy (RAID level 1 or
1091greater) on a 2.6 (or later) kernel.
1092
1093The
1094.B uuid
1095option will change the uuid of the array. If a UUID is given with the
1096.B \-\-uuid
1097option that UUID will be used as a new UUID and will
1098.B NOT
1099be used to help identify the devices in the array.
1100If no
1101.B \-\-uuid
1102is given, a random UUID is chosen.
1103
1104The
1105.B name
1106option will change the
1107.I name
1108of the array as stored in the superblock. This is only supported for
1109version-1 superblocks.
1110
1111The
1112.B homehost
1113option will change the
1114.I homehost
1115as recorded in the superblock. For version-0 superblocks, this is the
1116same as updating the UUID.
1117For version-1 superblocks, this involves updating the name.
1118
1119The
1120.B resync
1121option will cause the array to be marked
1122.I dirty
1123meaning that any redundancy in the array (e.g. parity for RAID5,
1124copies for RAID1) may be incorrect. This will cause the RAID system
1125to perform a "resync" pass to make sure that all redundant information
1126is correct.
1127
1128The
1129.B byteorder
1130option allows arrays to be moved between machines with different
1131byte-order.
1132When assembling such an array for the first time after a move, giving
1133.B "\-\-update=byteorder"
1134will cause
1135.I mdadm
1136to expect superblocks to have their byteorder reversed, and will
1137correct that order before assembling the array. This is only valid
1138with original (Version 0.90) superblocks.
1139
1140The
1141.B summaries
1142option will correct the summaries in the superblock. That is the
1143counts of total, working, active, failed, and spare devices.
1144
1145The
1146.B devicesize
1147option will rarely be of use. It applies to version 1.1 and 1.2 metadata
1148only (where the metadata is at the start of the device) and is only
1149useful when the component device has changed size (typically become
1150larger). The version 1 metadata records the amount of the device that
1151can be used to store data, so if a device in a version 1.1 or 1.2
1152array becomes larger, the metadata will still be visible, but the
1153extra space will not. In this case it might be useful to assemble the
1154array with
1155.BR \-\-update=devicesize .
1156This will cause
1157.I mdadm
1158to determine the maximum usable amount of space on each device and
1159update the relevant field in the metadata.
1160
1161The
1162.B no\-bitmap
1163option can be used when an array has an internal bitmap which is
1164corrupt in some way so that assembling the array normally fails. It
1165will cause any internal bitmap to be ignored.
1166
1167The
1168.B bbl
1169option will reserve space in each device for a bad block list. This
1170will be 4K in size and positioned near the end of any free space
1171between the superblock and the data.
1172
1173The
1174.B no\-bbl
1175option will cause any reservation of space for a bad block list to be
1176removed. If the bad block list contains entries, this will fail, as
1177removing the list could cause data corruption.
1178
1179.TP
1180.BR \-\-freeze\-reshape
1181Option is intended to be used in start-up scripts during initrd boot phase.
1182When array under reshape is assembled during initrd phase, this option
1183stops reshape after reshape critical section is being restored. This happens
1184before file system pivot operation and avoids loss of file system context.
1185Losing file system context would cause reshape to be broken.
1186
1187Reshape can be continued later using the
1188.B \-\-continue
1189option for the grow command.
1190
1191.SH For Manage mode:
1192
1193.TP
1194.BR \-t ", " \-\-test
1195Unless a more serious error occurred,
1196.I mdadm
1197will exit with a status of 2 if no changes were made to the array and
11980 if at least one change was made.
1199This can be useful when an indirect specifier such as
1200.BR missing ,
1201.B detached
1202or
1203.B faulty
1204is used in requesting an operation on the array.
1205.B \-\-test
1206will report failure if these specifiers didn't find any match.
1207
1208.TP
1209.BR \-a ", " \-\-add
1210hot-add listed devices.
1211If a device appears to have recently been part of the array
1212(possibly it failed or was removed) the device is re\-added as described
1213in the next point.
1214If that fails or the device was never part of the array, the device is
1215added as a hot-spare.
1216If the array is degraded, it will immediately start to rebuild data
1217onto that spare.
1218
1219Note that this and the following options are only meaningful on array
1220with redundancy. They don't apply to RAID0 or Linear.
1221
1222.TP
1223.BR \-\-re\-add
1224re\-add a device that was previous removed from an array.
1225If the metadata on the device reports that it is a member of the
1226array, and the slot that it used is still vacant, then the device will
1227be added back to the array in the same position. This will normally
1228cause the data for that device to be recovered. However based on the
1229event count on the device, the recovery may only require sections that
1230are flagged a write-intent bitmap to be recovered or may not require
1231any recovery at all.
1232
1233When used on an array that has no metadata (i.e. it was built with
1234.BR \-\-build)
1235it will be assumed that bitmap-based recovery is enough to make the
1236device fully consistent with the array.
1237
1238When used with v1.x metadata,
1239.B \-\-re\-add
1240can be accompanied by
1241.BR \-\-update=devicesize ,
1242.BR \-\-update=bbl ", or"
1243.BR \-\-update=no\-bbl .
1244See the description of these option when used in Assemble mode for an
1245explanation of their use.
1246
1247If the device name given is
1248.B missing
1249then mdadm will try to find any device that looks like it should be
1250part of the array but isn't and will try to re\-add all such devices.
1251
1252.TP
1253.BR \-r ", " \-\-remove
1254remove listed devices. They must not be active. i.e. they should
1255be failed or spare devices. As well as the name of a device file
1256(e.g.
1257.BR /dev/sda1 )
1258the words
1259.B failed
1260and
1261.B detached
1262can be given to
1263.BR \-\-remove .
1264The first causes all failed device to be removed. The second causes
1265any device which is no longer connected to the system (i.e an 'open'
1266returns
1267.BR ENXIO )
1268to be removed. This will only succeed for devices that are spares or
1269have already been marked as failed.
1270
1271.TP
1272.BR \-f ", " \-\-fail
1273mark listed devices as faulty.
1274As well as the name of a device file, the word
1275.B detached
1276can be given. This will cause any device that has been detached from
1277the system to be marked as failed. It can then be removed.
1278
1279.TP
1280.BR \-\-set\-faulty
1281same as
1282.BR \-\-fail .
1283
1284.TP
1285.BR \-\-write\-mostly
1286Subsequent devices that are added or re\-added will have the 'write-mostly'
1287flag set. This is only valid for RAID1 and means that the 'md' driver
1288will avoid reading from these devices if possible.
1289.TP
1290.BR \-\-readwrite
1291Subsequent devices that are added or re\-added will have the 'write-mostly'
1292flag cleared.
1293
1294.P
1295Each of these options requires that the first device listed is the array
1296to be acted upon, and the remainder are component devices to be added,
1297removed, marked as faulty, etc. Several different operations can be
1298specified for different devices, e.g.
1299.in +5
1300mdadm /dev/md0 \-\-add /dev/sda1 \-\-fail /dev/sdb1 \-\-remove /dev/sdb1
1301.in -5
1302Each operation applies to all devices listed until the next
1303operation.
1304
1305If an array is using a write-intent bitmap, then devices which have
1306been removed can be re\-added in a way that avoids a full
1307reconstruction but instead just updates the blocks that have changed
1308since the device was removed. For arrays with persistent metadata
1309(superblocks) this is done automatically. For arrays created with
1310.B \-\-build
1311mdadm needs to be told that this device we removed recently with
1312.BR \-\-re\-add .
1313
1314Devices can only be removed from an array if they are not in active
1315use, i.e. that must be spares or failed devices. To remove an active
1316device, it must first be marked as
1317.B faulty.
1318
1319.SH For Misc mode:
1320
1321.TP
1322.BR \-Q ", " \-\-query
1323Examine a device to see
1324(1) if it is an md device and (2) if it is a component of an md
1325array.
1326Information about what is discovered is presented.
1327
1328.TP
1329.BR \-D ", " \-\-detail
1330Print details of one or more md devices.
1331
1332.TP
1333.BR \-\-detail\-platform
1334Print details of the platform's RAID capabilities (firmware / hardware
1335topology) for a given metadata format. If used without argument, mdadm
1336will scan all controllers looking for their capabilities. Otherwise, mdadm
1337will only look at the controller specified by the argument in form of an
1338absolute filepath or a link, e.g.
1339.IR /sys/devices/pci0000:00/0000:00:1f.2 .
1340
1341.TP
1342.BR \-Y ", " \-\-export
1343When used with
1344.B \-\-detail , \-\-detail-platform
1345or
1346.BR \-\-examine ,
1347output will be formatted as
1348.B key=value
1349pairs for easy import into the environment.
1350
1351.TP
1352.BR \-E ", " \-\-examine
1353Print contents of the metadata stored on the named device(s).
1354Note the contrast between
1355.B \-\-examine
1356and
1357.BR \-\-detail .
1358.B \-\-examine
1359applies to devices which are components of an array, while
1360.B \-\-detail
1361applies to a whole array which is currently active.
1362.TP
1363.B \-\-sparc2.2
1364If an array was created on a SPARC machine with a 2.2 Linux kernel
1365patched with RAID support, the superblock will have been created
1366incorrectly, or at least incompatibly with 2.4 and later kernels.
1367Using the
1368.B \-\-sparc2.2
1369flag with
1370.B \-\-examine
1371will fix the superblock before displaying it. If this appears to do
1372the right thing, then the array can be successfully assembled using
1373.BR "\-\-assemble \-\-update=sparc2.2" .
1374
1375.TP
1376.BR \-X ", " \-\-examine\-bitmap
1377Report information about a bitmap file.
1378The argument is either an external bitmap file or an array component
1379in case of an internal bitmap. Note that running this on an array
1380device (e.g.
1381.BR /dev/md0 )
1382does not report the bitmap for that array.
1383
1384.TP
1385.BR \-R ", " \-\-run
1386start a partially assembled array. If
1387.B \-\-assemble
1388did not find enough devices to fully start the array, it might leaving
1389it partially assembled. If you wish, you can then use
1390.B \-\-run
1391to start the array in degraded mode.
1392
1393.TP
1394.BR \-S ", " \-\-stop
1395deactivate array, releasing all resources.
1396
1397.TP
1398.BR \-o ", " \-\-readonly
1399mark array as readonly.
1400
1401.TP
1402.BR \-w ", " \-\-readwrite
1403mark array as readwrite.
1404
1405.TP
1406.B \-\-zero\-superblock
1407If the device contains a valid md superblock, the block is
1408overwritten with zeros. With
1409.B \-\-force
1410the block where the superblock would be is overwritten even if it
1411doesn't appear to be valid.
1412
1413.TP
1414.B \-\-kill\-subarray=
1415If the device is a container and the argument to \-\-kill\-subarray
1416specifies an inactive subarray in the container, then the subarray is
1417deleted. Deleting all subarrays will leave an 'empty-container' or
1418spare superblock on the drives. See \-\-zero\-superblock for completely
1419removing a superblock. Note that some formats depend on the subarray
1420index for generating a UUID, this command will fail if it would change
1421the UUID of an active subarray.
1422
1423.TP
1424.B \-\-update\-subarray=
1425If the device is a container and the argument to \-\-update\-subarray
1426specifies a subarray in the container, then attempt to update the given
1427superblock field in the subarray. See below in
1428.B MISC MODE
1429for details.
1430
1431.TP
1432.BR \-t ", " \-\-test
1433When used with
1434.BR \-\-detail ,
1435the exit status of
1436.I mdadm
1437is set to reflect the status of the device. See below in
1438.B MISC MODE
1439for details.
1440
1441.TP
1442.BR \-W ", " \-\-wait
1443For each md device given, wait for any resync, recovery, or reshape
1444activity to finish before returning.
1445.I mdadm
1446will return with success if it actually waited for every device
1447listed, otherwise it will return failure.
1448
1449.TP
1450.BR \-\-wait\-clean
1451For each md device given, or each device in /proc/mdstat if
1452.B \-\-scan
1453is given, arrange for the array to be marked clean as soon as possible.
1454.I mdadm
1455will return with success if the array uses external metadata and we
1456successfully waited. For native arrays this returns immediately as the
1457kernel handles dirty-clean transitions at shutdown. No action is taken
1458if safe-mode handling is disabled.
1459
1460.SH For Incremental Assembly mode:
1461.TP
1462.BR \-\-rebuild\-map ", " \-r
1463Rebuild the map file
1464.RB ( {MAP_PATH} )
1465that
1466.I mdadm
1467uses to help track which arrays are currently being assembled.
1468
1469.TP
1470.BR \-\-run ", " \-R
1471Run any array assembled as soon as a minimal number of devices are
1472available, rather than waiting until all expected devices are present.
1473
1474.TP
1475.BR \-\-scan ", " \-s
1476Only meaningful with
1477.B \-R
1478this will scan the
1479.B map
1480file for arrays that are being incrementally assembled and will try to
1481start any that are not already started. If any such array is listed
1482in
1483.B mdadm.conf
1484as requiring an external bitmap, that bitmap will be attached first.
1485
1486.TP
1487.BR \-\-fail ", " \-f
1488This allows the hot-plug system to remove devices that have fully disappeared
1489from the kernel. It will first fail and then remove the device from any
1490array it belongs to.
1491The device name given should be a kernel device name such as "sda",
1492not a name in
1493.IR /dev .
1494
1495.TP
1496.BR \-\-path=
1497Only used with \-\-fail. The 'path' given will be recorded so that if
1498a new device appears at the same location it can be automatically
1499added to the same array. This allows the failed device to be
1500automatically replaced by a new device without metadata if it appears
1501at specified path. This option is normally only set by a
1502.I udev
1503script.
1504
1505.SH For Monitor mode:
1506.TP
1507.BR \-m ", " \-\-mail
1508Give a mail address to send alerts to.
1509
1510.TP
1511.BR \-p ", " \-\-program ", " \-\-alert
1512Give a program to be run whenever an event is detected.
1513
1514.TP
1515.BR \-y ", " \-\-syslog
1516Cause all events to be reported through 'syslog'. The messages have
1517facility of 'daemon' and varying priorities.
1518
1519.TP
1520.BR \-d ", " \-\-delay
1521Give a delay in seconds.
1522.I mdadm
1523polls the md arrays and then waits this many seconds before polling
1524again. The default is 60 seconds. Since 2.6.16, there is no need to
1525reduce this as the kernel alerts
1526.I mdadm
1527immediately when there is any change.
1528
1529.TP
1530.BR \-r ", " \-\-increment
1531Give a percentage increment.
1532.I mdadm
1533will generate RebuildNN events with the given percentage increment.
1534
1535.TP
1536.BR \-f ", " \-\-daemonise
1537Tell
1538.I mdadm
1539to run as a background daemon if it decides to monitor anything. This
1540causes it to fork and run in the child, and to disconnect from the
1541terminal. The process id of the child is written to stdout.
1542This is useful with
1543.B \-\-scan
1544which will only continue monitoring if a mail address or alert program
1545is found in the config file.
1546
1547.TP
1548.BR \-i ", " \-\-pid\-file
1549When
1550.I mdadm
1551is running in daemon mode, write the pid of the daemon process to
1552the specified file, instead of printing it on standard output.
1553
1554.TP
1555.BR \-1 ", " \-\-oneshot
1556Check arrays only once. This will generate
1557.B NewArray
1558events and more significantly
1559.B DegradedArray
1560and
1561.B SparesMissing
1562events. Running
1563.in +5
1564.B " mdadm \-\-monitor \-\-scan \-1"
1565.in -5
1566from a cron script will ensure regular notification of any degraded arrays.
1567
1568.TP
1569.BR \-t ", " \-\-test
1570Generate a
1571.B TestMessage
1572alert for every array found at startup. This alert gets mailed and
1573passed to the alert program. This can be used for testing that alert
1574message do get through successfully.
1575
1576.TP
1577.BR \-\-no\-sharing
1578This inhibits the functionality for moving spares between arrays.
1579Only one monitoring process started with
1580.B \-\-scan
1581but without this flag is allowed, otherwise the two could interfere
1582with each other.
1583
1584.SH ASSEMBLE MODE
1585
1586.HP 12
1587Usage:
1588.B mdadm \-\-assemble
1589.I md-device options-and-component-devices...
1590.HP 12
1591Usage:
1592.B mdadm \-\-assemble \-\-scan
1593.I md-devices-and-options...
1594.HP 12
1595Usage:
1596.B mdadm \-\-assemble \-\-scan
1597.I options...
1598
1599.PP
1600This usage assembles one or more RAID arrays from pre-existing components.
1601For each array, mdadm needs to know the md device, the identity of the
1602array, and a number of component-devices. These can be found in a number of ways.
1603
1604In the first usage example (without the
1605.BR \-\-scan )
1606the first device given is the md device.
1607In the second usage example, all devices listed are treated as md
1608devices and assembly is attempted.
1609In the third (where no devices are listed) all md devices that are
1610listed in the configuration file are assembled. If no arrays are
1611described by the configuration file, then any arrays that
1612can be found on unused devices will be assembled.
1613
1614If precisely one device is listed, but
1615.B \-\-scan
1616is not given, then
1617.I mdadm
1618acts as though
1619.B \-\-scan
1620was given and identity information is extracted from the configuration file.
1621
1622The identity can be given with the
1623.B \-\-uuid
1624option, the
1625.B \-\-name
1626option, or the
1627.B \-\-super\-minor
1628option, will be taken from the md-device record in the config file, or
1629will be taken from the super block of the first component-device
1630listed on the command line.
1631
1632Devices can be given on the
1633.B \-\-assemble
1634command line or in the config file. Only devices which have an md
1635superblock which contains the right identity will be considered for
1636any array.
1637
1638The config file is only used if explicitly named with
1639.B \-\-config
1640or requested with (a possibly implicit)
1641.BR \-\-scan .
1642In the later case,
1643.B /etc/mdadm.conf
1644or
1645.B /etc/mdadm/mdadm.conf
1646is used.
1647
1648If
1649.B \-\-scan
1650is not given, then the config file will only be used to find the
1651identity of md arrays.
1652
1653Normally the array will be started after it is assembled. However if
1654.B \-\-scan
1655is not given and not all expected drives were listed, then the array
1656is not started (to guard against usage errors). To insist that the
1657array be started in this case (as may work for RAID1, 4, 5, 6, or 10),
1658give the
1659.B \-\-run
1660flag.
1661
1662If
1663.I udev
1664is active,
1665.I mdadm
1666does not create any entries in
1667.B /dev
1668but leaves that to
1669.IR udev .
1670It does record information in
1671.B {MAP_PATH}
1672which will allow
1673.I udev
1674to choose the correct name.
1675
1676If
1677.I mdadm
1678detects that udev is not configured, it will create the devices in
1679.B /dev
1680itself.
1681
1682In Linux kernels prior to version 2.6.28 there were two distinctly
1683different types of md devices that could be created: one that could be
1684partitioned using standard partitioning tools and one that could not.
1685Since 2.6.28 that distinction is no longer relevant as both type of
1686devices can be partitioned.
1687.I mdadm
1688will normally create the type that originally could not be partitioned
1689as it has a well defined major number (9).
1690
1691Prior to 2.6.28, it is important that mdadm chooses the correct type
1692of array device to use. This can be controlled with the
1693.B \-\-auto
1694option. In particular, a value of "mdp" or "part" or "p" tells mdadm
1695to use a partitionable device rather than the default.
1696
1697In the no-udev case, the value given to
1698.B \-\-auto
1699can be suffixed by a number. This tells
1700.I mdadm
1701to create that number of partition devices rather than the default of 4.
1702
1703The value given to
1704.B \-\-auto
1705can also be given in the configuration file as a word starting
1706.B auto=
1707on the ARRAY line for the relevant array.
1708
1709.SS Auto Assembly
1710When
1711.B \-\-assemble
1712is used with
1713.B \-\-scan
1714and no devices are listed,
1715.I mdadm
1716will first attempt to assemble all the arrays listed in the config
1717file.
1718
1719If no arrays are listed in the config (other than those marked
1720.BR <ignore> )
1721it will look through the available devices for possible arrays and
1722will try to assemble anything that it finds. Arrays which are tagged
1723as belonging to the given homehost will be assembled and started
1724normally. Arrays which do not obviously belong to this host are given
1725names that are expected not to conflict with anything local, and are
1726started "read-auto" so that nothing is written to any device until the
1727array is written to. i.e. automatic resync etc is delayed.
1728
1729If
1730.I mdadm
1731finds a consistent set of devices that look like they should comprise
1732an array, and if the superblock is tagged as belonging to the given
1733home host, it will automatically choose a device name and try to
1734assemble the array. If the array uses version-0.90 metadata, then the
1735.B minor
1736number as recorded in the superblock is used to create a name in
1737.B /dev/md/
1738so for example
1739.BR /dev/md/3 .
1740If the array uses version-1 metadata, then the
1741.B name
1742from the superblock is used to similarly create a name in
1743.B /dev/md/
1744(the name will have any 'host' prefix stripped first).
1745
1746This behaviour can be modified by the
1747.I AUTO
1748line in the
1749.I mdadm.conf
1750configuration file. This line can indicate that specific metadata
1751type should, or should not, be automatically assembled. If an array
1752is found which is not listed in
1753.I mdadm.conf
1754and has a metadata format that is denied by the
1755.I AUTO
1756line, then it will not be assembled.
1757The
1758.I AUTO
1759line can also request that all arrays identified as being for this
1760homehost should be assembled regardless of their metadata type.
1761See
1762.IR mdadm.conf (5)
1763for further details.
1764
1765Note: Auto assembly cannot be used for assembling and activating some
1766arrays which are undergoing reshape. In particular as the
1767.B backup\-file
1768cannot be given, any reshape which requires a backup-file to continue
1769cannot be started by auto assembly. An array which is growing to more
1770devices and has passed the critical section can be assembled using
1771auto-assembly.
1772
1773.SH BUILD MODE
1774
1775.HP 12
1776Usage:
1777.B mdadm \-\-build
1778.I md-device
1779.BI \-\-chunk= X
1780.BI \-\-level= Y
1781.BI \-\-raid\-devices= Z
1782.I devices
1783
1784.PP
1785This usage is similar to
1786.BR \-\-create .
1787The difference is that it creates an array without a superblock. With
1788these arrays there is no difference between initially creating the array and
1789subsequently assembling the array, except that hopefully there is useful
1790data there in the second case.
1791
1792The level may raid0, linear, raid1, raid10, multipath, or faulty, or
1793one of their synonyms. All devices must be listed and the array will
1794be started once complete. It will often be appropriate to use
1795.B \-\-assume\-clean
1796with levels raid1 or raid10.
1797
1798.SH CREATE MODE
1799
1800.HP 12
1801Usage:
1802.B mdadm \-\-create
1803.I md-device
1804.BI \-\-chunk= X
1805.BI \-\-level= Y
1806.br
1807.BI \-\-raid\-devices= Z
1808.I devices
1809
1810.PP
1811This usage will initialise a new md array, associate some devices with
1812it, and activate the array.
1813
1814The named device will normally not exist when
1815.I "mdadm \-\-create"
1816is run, but will be created by
1817.I udev
1818once the array becomes active.
1819
1820As devices are added, they are checked to see if they contain RAID
1821superblocks or filesystems. They are also checked to see if the variance in
1822device size exceeds 1%.
1823
1824If any discrepancy is found, the array will not automatically be run, though
1825the presence of a
1826.B \-\-run
1827can override this caution.
1828
1829To create a "degraded" array in which some devices are missing, simply
1830give the word "\fBmissing\fP"
1831in place of a device name. This will cause
1832.I mdadm
1833to leave the corresponding slot in the array empty.
1834For a RAID4 or RAID5 array at most one slot can be
1835"\fBmissing\fP"; for a RAID6 array at most two slots.
1836For a RAID1 array, only one real device needs to be given. All of the
1837others can be
1838"\fBmissing\fP".
1839
1840When creating a RAID5 array,
1841.I mdadm
1842will automatically create a degraded array with an extra spare drive.
1843This is because building the spare into a degraded array is in general
1844faster than resyncing the parity on a non-degraded, but not clean,
1845array. This feature can be overridden with the
1846.B \-\-force
1847option.
1848
1849When creating an array with version-1 metadata a name for the array is
1850required.
1851If this is not given with the
1852.B \-\-name
1853option,
1854.I mdadm
1855will choose a name based on the last component of the name of the
1856device being created. So if
1857.B /dev/md3
1858is being created, then the name
1859.B 3
1860will be chosen.
1861If
1862.B /dev/md/home
1863is being created, then the name
1864.B home
1865will be used.
1866
1867When creating a partition based array, using
1868.I mdadm
1869with version-1.x metadata, the partition type should be set to
1870.B 0xDA
1871(non fs-data). This type selection allows for greater precision since
1872using any other [RAID auto-detect (0xFD) or a GNU/Linux partition (0x83)],
1873might create problems in the event of array recovery through a live cdrom.
1874
1875A new array will normally get a randomly assigned 128bit UUID which is
1876very likely to be unique. If you have a specific need, you can choose
1877a UUID for the array by giving the
1878.B \-\-uuid=
1879option. Be warned that creating two arrays with the same UUID is a
1880recipe for disaster. Also, using
1881.B \-\-uuid=
1882when creating a v0.90 array will silently override any
1883.B \-\-homehost=
1884setting.
1885.\"If the
1886.\".B \-\-size
1887.\"option is given, it is not necessary to list any component-devices in this command.
1888.\"They can be added later, before a
1889.\".B \-\-run.
1890.\"If no
1891.\".B \-\-size
1892.\"is given, the apparent size of the smallest drive given is used.
1893
1894If the metadata type supports it (currently only 1.x metadata), space
1895will be allocated to store a bad block list. This allows a modest
1896number of bad blocks to be recorded, allowing the drive to remain in
1897service while only partially functional.
1898
1899When creating an array within a
1900.B CONTAINER
1901.I mdadm
1902can be given either the list of devices to use, or simply the name of
1903the container. The former case gives control over which devices in
1904the container will be used for the array. The latter case allows
1905.I mdadm
1906to automatically choose which devices to use based on how much spare
1907space is available.
1908
1909The General Management options that are valid with
1910.B \-\-create
1911are:
1912.TP
1913.B \-\-run
1914insist on running the array even if some devices look like they might
1915be in use.
1916
1917.TP
1918.B \-\-readonly
1919start the array readonly \(em not supported yet.
1920
1921.SH MANAGE MODE
1922.HP 12
1923Usage:
1924.B mdadm
1925.I device
1926.I options... devices...
1927.PP
1928
1929This usage will allow individual devices in an array to be failed,
1930removed or added. It is possible to perform multiple operations with
1931on command. For example:
1932.br
1933.B " mdadm /dev/md0 \-f /dev/hda1 \-r /dev/hda1 \-a /dev/hda1"
1934.br
1935will firstly mark
1936.B /dev/hda1
1937as faulty in
1938.B /dev/md0
1939and will then remove it from the array and finally add it back
1940in as a spare. However only one md array can be affected by a single
1941command.
1942
1943When a device is added to an active array, mdadm checks to see if it
1944has metadata on it which suggests that it was recently a member of the
1945array. If it does, it tries to "re\-add" the device. If there have
1946been no changes since the device was removed, or if the array has a
1947write-intent bitmap which has recorded whatever changes there were,
1948then the device will immediately become a full member of the array and
1949those differences recorded in the bitmap will be resolved.
1950
1951.SH MISC MODE
1952.HP 12
1953Usage:
1954.B mdadm
1955.I options ...
1956.I devices ...
1957.PP
1958
1959MISC mode includes a number of distinct operations that
1960operate on distinct devices. The operations are:
1961.TP
1962.B \-\-query
1963The device is examined to see if it is
1964(1) an active md array, or
1965(2) a component of an md array.
1966The information discovered is reported.
1967
1968.TP
1969.B \-\-detail
1970The device should be an active md device.
1971.B mdadm
1972will display a detailed description of the array.
1973.B \-\-brief
1974or
1975.B \-\-scan
1976will cause the output to be less detailed and the format to be
1977suitable for inclusion in
1978.BR mdadm.conf .
1979The exit status of
1980.I mdadm
1981will normally be 0 unless
1982.I mdadm
1983failed to get useful information about the device(s); however, if the
1984.B \-\-test
1985option is given, then the exit status will be:
1986.RS
1987.TP
19880
1989The array is functioning normally.
1990.TP
19911
1992The array has at least one failed device.
1993.TP
19942
1995The array has multiple failed devices such that it is unusable.
1996.TP
19974
1998There was an error while trying to get information about the device.
1999.RE
2000
2001.TP
2002.B \-\-detail\-platform
2003Print detail of the platform's RAID capabilities (firmware / hardware
2004topology). If the metadata is specified with
2005.B \-e
2006or
2007.B \-\-metadata=
2008then the return status will be:
2009.RS
2010.TP
20110
2012metadata successfully enumerated its platform components on this system
2013.TP
20141
2015metadata is platform independent
2016.TP
20172
2018metadata failed to find its platform components on this system
2019.RE
2020
2021.TP
2022.B \-\-update\-subarray=
2023If the device is a container and the argument to \-\-update\-subarray
2024specifies a subarray in the container, then attempt to update the given
2025superblock field in the subarray. Similar to updating an array in
2026"assemble" mode, the field to update is selected by
2027.B \-U
2028or
2029.B \-\-update=
2030option. Currently only
2031.B name
2032is supported.
2033
2034The
2035.B name
2036option updates the subarray name in the metadata, it may not affect the
2037device node name or the device node symlink until the subarray is
2038re\-assembled. If updating
2039.B name
2040would change the UUID of an active subarray this operation is blocked,
2041and the command will end in an error.
2042
2043.TP
2044.B \-\-examine
2045The device should be a component of an md array.
2046.I mdadm
2047will read the md superblock of the device and display the contents.
2048If
2049.B \-\-brief
2050or
2051.B \-\-scan
2052is given, then multiple devices that are components of the one array
2053are grouped together and reported in a single entry suitable
2054for inclusion in
2055.BR mdadm.conf .
2056
2057Having
2058.B \-\-scan
2059without listing any devices will cause all devices listed in the
2060config file to be examined.
2061
2062.TP
2063.B \-\-stop
2064The devices should be active md arrays which will be deactivated, as
2065long as they are not currently in use.
2066
2067.TP
2068.B \-\-run
2069This will fully activate a partially assembled md array.
2070
2071.TP
2072.B \-\-readonly
2073This will mark an active array as read-only, providing that it is
2074not currently being used.
2075
2076.TP
2077.B \-\-readwrite
2078This will change a
2079.B readonly
2080array back to being read/write.
2081
2082.TP
2083.B \-\-scan
2084For all operations except
2085.BR \-\-examine ,
2086.B \-\-scan
2087will cause the operation to be applied to all arrays listed in
2088.BR /proc/mdstat .
2089For
2090.BR \-\-examine,
2091.B \-\-scan
2092causes all devices listed in the config file to be examined.
2093
2094.TP
2095.BR \-b ", " \-\-brief
2096Be less verbose. This is used with
2097.B \-\-detail
2098and
2099.BR \-\-examine .
2100Using
2101.B \-\-brief
2102with
2103.B \-\-verbose
2104gives an intermediate level of verbosity.
2105
2106.SH MONITOR MODE
2107
2108.HP 12
2109Usage:
2110.B mdadm \-\-monitor
2111.I options... devices...
2112
2113.PP
2114This usage causes
2115.I mdadm
2116to periodically poll a number of md arrays and to report on any events
2117noticed.
2118.I mdadm
2119will never exit once it decides that there are arrays to be checked,
2120so it should normally be run in the background.
2121
2122As well as reporting events,
2123.I mdadm
2124may move a spare drive from one array to another if they are in the
2125same
2126.B spare-group
2127or
2128.B domain
2129and if the destination array has a failed drive but no spares.
2130
2131If any devices are listed on the command line,
2132.I mdadm
2133will only monitor those devices. Otherwise all arrays listed in the
2134configuration file will be monitored. Further, if
2135.B \-\-scan
2136is given, then any other md devices that appear in
2137.B /proc/mdstat
2138will also be monitored.
2139
2140The result of monitoring the arrays is the generation of events.
2141These events are passed to a separate program (if specified) and may
2142be mailed to a given E-mail address.
2143
2144When passing events to a program, the program is run once for each event,
2145and is given 2 or 3 command-line arguments: the first is the
2146name of the event (see below), the second is the name of the
2147md device which is affected, and the third is the name of a related
2148device if relevant (such as a component device that has failed).
2149
2150If
2151.B \-\-scan
2152is given, then a program or an E-mail address must be specified on the
2153command line or in the config file. If neither are available, then
2154.I mdadm
2155will not monitor anything.
2156Without
2157.B \-\-scan,
2158.I mdadm
2159will continue monitoring as long as something was found to monitor. If
2160no program or email is given, then each event is reported to
2161.BR stdout .
2162
2163The different events are:
2164
2165.RS 4
2166.TP
2167.B DeviceDisappeared
2168An md array which previously was configured appears to no longer be
2169configured. (syslog priority: Critical)
2170
2171If
2172.I mdadm
2173was told to monitor an array which is RAID0 or Linear, then it will
2174report
2175.B DeviceDisappeared
2176with the extra information
2177.BR Wrong-Level .
2178This is because RAID0 and Linear do not support the device-failed,
2179hot-spare and resync operations which are monitored.
2180
2181.TP
2182.B RebuildStarted
2183An md array started reconstruction. (syslog priority: Warning)
2184
2185.TP
2186.BI Rebuild NN
2187Where
2188.I NN
2189is a two-digit number (ie. 05, 48). This indicates that rebuild
2190has passed that many percent of the total. The events are generated
2191with fixed increment since 0. Increment size may be specified with
2192a commandline option (default is 20). (syslog priority: Warning)
2193
2194.TP
2195.B RebuildFinished
2196An md array that was rebuilding, isn't any more, either because it
2197finished normally or was aborted. (syslog priority: Warning)
2198
2199.TP
2200.B Fail
2201An active component device of an array has been marked as
2202faulty. (syslog priority: Critical)
2203
2204.TP
2205.B FailSpare
2206A spare component device which was being rebuilt to replace a faulty
2207device has failed. (syslog priority: Critical)
2208
2209.TP
2210.B SpareActive
2211A spare component device which was being rebuilt to replace a faulty
2212device has been successfully rebuilt and has been made active.
2213(syslog priority: Info)
2214
2215.TP
2216.B NewArray
2217A new md array has been detected in the
2218.B /proc/mdstat
2219file. (syslog priority: Info)
2220
2221.TP
2222.B DegradedArray
2223A newly noticed array appears to be degraded. This message is not
2224generated when
2225.I mdadm
2226notices a drive failure which causes degradation, but only when
2227.I mdadm
2228notices that an array is degraded when it first sees the array.
2229(syslog priority: Critical)
2230
2231.TP
2232.B MoveSpare
2233A spare drive has been moved from one array in a
2234.B spare-group
2235or
2236.B domain
2237to another to allow a failed drive to be replaced.
2238(syslog priority: Info)
2239
2240.TP
2241.B SparesMissing
2242If
2243.I mdadm
2244has been told, via the config file, that an array should have a certain
2245number of spare devices, and
2246.I mdadm
2247detects that it has fewer than this number when it first sees the
2248array, it will report a
2249.B SparesMissing
2250message.
2251(syslog priority: Warning)
2252
2253.TP
2254.B TestMessage
2255An array was found at startup, and the
2256.B \-\-test
2257flag was given.
2258(syslog priority: Info)
2259.RE
2260
2261Only
2262.B Fail,
2263.B FailSpare,
2264.B DegradedArray,
2265.B SparesMissing
2266and
2267.B TestMessage
2268cause Email to be sent. All events cause the program to be run.
2269The program is run with two or three arguments: the event
2270name, the array device and possibly a second device.
2271
2272Each event has an associated array device (e.g.
2273.BR /dev/md1 )
2274and possibly a second device. For
2275.BR Fail ,
2276.BR FailSpare ,
2277and
2278.B SpareActive
2279the second device is the relevant component device.
2280For
2281.B MoveSpare
2282the second device is the array that the spare was moved from.
2283
2284For
2285.I mdadm
2286to move spares from one array to another, the different arrays need to
2287be labeled with the same
2288.B spare-group
2289or the spares must be allowed to migrate through matching POLICY domains
2290in the configuration file. The
2291.B spare-group
2292name can be any string; it is only necessary that different spare
2293groups use different names.
2294
2295When
2296.I mdadm
2297detects that an array in a spare group has fewer active
2298devices than necessary for the complete array, and has no spare
2299devices, it will look for another array in the same spare group that
2300has a full complement of working drive and a spare. It will then
2301attempt to remove the spare from the second drive and add it to the
2302first.
2303If the removal succeeds but the adding fails, then it is added back to
2304the original array.
2305
2306If the spare group for a degraded array is not defined,
2307.I mdadm
2308will look at the rules of spare migration specified by POLICY lines in
2309.B mdadm.conf
2310and then follow similar steps as above if a matching spare is found.
2311
2312.SH GROW MODE
2313The GROW mode is used for changing the size or shape of an active
2314array.
2315For this to work, the kernel must support the necessary change.
2316Various types of growth are being added during 2.6 development.
2317
2318Currently the supported changes include
2319.IP \(bu 4
2320change the "size" attribute for RAID1, RAID4, RAID5 and RAID6.
2321.IP \(bu 4
2322increase or decrease the "raid\-devices" attribute of RAID0, RAID1, RAID4,
2323RAID5, and RAID6.
2324.IP \(bu 4
2325change the chunk-size and layout of RAID0, RAID4, RAID5 and RAID6.
2326.IP \(bu 4
2327convert between RAID1 and RAID5, between RAID5 and RAID6, between
2328RAID0, RAID4, and RAID5, and between RAID0 and RAID10 (in the near-2 mode).
2329.IP \(bu 4
2330add a write-intent bitmap to any array which supports these bitmaps, or
2331remove a write-intent bitmap from such an array.
2332.PP
2333
2334Using GROW on containers is currently supported only for Intel's IMSM
2335container format. The number of devices in a container can be
2336increased - which affects all arrays in the container - or an array
2337in a container can be converted between levels where those levels are
2338supported by the container, and the conversion is on of those listed
2339above. Resizing arrays in an IMSM container with
2340.B "--grow --size"
2341is not yet supported.
2342
2343Grow functionality (e.g. expand a number of raid devices) for Intel's
2344IMSM container format has an experimental status. It is guarded by the
2345.B MDADM_EXPERIMENTAL
2346environment variable which must be set to '1' for a GROW command to
2347succeed.
2348This is for the following reasons:
2349
2350.IP 1.
2351Intel's native IMSM check-pointing is not fully tested yet.
2352This can causes IMSM incompatibility during the grow process: an array
2353which is growing cannot roam between Microsoft Windows(R) and Linux
2354systems.
2355
2356.IP 2.
2357Interrupting a grow operation is not recommended, because it
2358has not been fully tested for Intel's IMSM container format yet.
2359
2360.PP
2361Note: Intel's native checkpointing doesn't use
2362.B --backup-file
2363option and it is transparent for assembly feature.
2364
2365.SS SIZE CHANGES
2366Normally when an array is built the "size" is taken from the smallest
2367of the drives. If all the small drives in an arrays are, one at a
2368time, removed and replaced with larger drives, then you could have an
2369array of large drives with only a small amount used. In this
2370situation, changing the "size" with "GROW" mode will allow the extra
2371space to start being used. If the size is increased in this way, a
2372"resync" process will start to make sure the new parts of the array
2373are synchronised.
2374
2375Note that when an array changes size, any filesystem that may be
2376stored in the array will not automatically grow or shrink to use or
2377vacate the space. The
2378filesystem will need to be explicitly told to use the extra space
2379after growing, or to reduce its size
2380.B prior
2381to shrinking the array.
2382
2383Also the size of an array cannot be changed while it has an active
2384bitmap. If an array has a bitmap, it must be removed before the size
2385can be changed. Once the change is complete a new bitmap can be created.
2386
2387.SS RAID\-DEVICES CHANGES
2388
2389A RAID1 array can work with any number of devices from 1 upwards
2390(though 1 is not very useful). There may be times which you want to
2391increase or decrease the number of active devices. Note that this is
2392different to hot-add or hot-remove which changes the number of
2393inactive devices.
2394
2395When reducing the number of devices in a RAID1 array, the slots which
2396are to be removed from the array must already be vacant. That is, the
2397devices which were in those slots must be failed and removed.
2398
2399When the number of devices is increased, any hot spares that are
2400present will be activated immediately.
2401
2402Changing the number of active devices in a RAID5 or RAID6 is much more
2403effort. Every block in the array will need to be read and written
2404back to a new location. From 2.6.17, the Linux Kernel is able to
2405increase the number of devices in a RAID5 safely, including restarting
2406an interrupted "reshape". From 2.6.31, the Linux Kernel is able to
2407increase or decrease the number of devices in a RAID5 or RAID6.
2408
2409From 2.6.35, the Linux Kernel is able to convert a RAID0 in to a RAID4
2410or RAID5.
2411.I mdadm
2412uses this functionality and the ability to add
2413devices to a RAID4 to allow devices to be added to a RAID0. When
2414requested to do this,
2415.I mdadm
2416will convert the RAID0 to a RAID4, add the necessary disks and make
2417the reshape happen, and then convert the RAID4 back to RAID0.
2418
2419When decreasing the number of devices, the size of the array will also
2420decrease. If there was data in the array, it could get destroyed and
2421this is not reversible, so you should firstly shrink the filesystem on
2422the array to fit within the new size. To help prevent accidents,
2423.I mdadm
2424requires that the size of the array be decreased first with
2425.BR "mdadm --grow --array-size" .
2426This is a reversible change which simply makes the end of the array
2427inaccessible. The integrity of any data can then be checked before
2428the non-reversible reduction in the number of devices is request.
2429
2430When relocating the first few stripes on a RAID5 or RAID6, it is not
2431possible to keep the data on disk completely consistent and
2432crash-proof. To provide the required safety, mdadm disables writes to
2433the array while this "critical section" is reshaped, and takes a
2434backup of the data that is in that section. For grows, this backup may be
2435stored in any spare devices that the array has, however it can also be
2436stored in a separate file specified with the
2437.B \-\-backup\-file
2438option, and is required to be specified for shrinks, RAID level
2439changes and layout changes. If this option is used, and the system
2440does crash during the critical period, the same file must be passed to
2441.B \-\-assemble
2442to restore the backup and reassemble the array. When shrinking rather
2443than growing the array, the reshape is done from the end towards the
2444beginning, so the "critical section" is at the end of the reshape.
2445
2446.SS LEVEL CHANGES
2447
2448Changing the RAID level of any array happens instantaneously. However
2449in the RAID5 to RAID6 case this requires a non-standard layout of the
2450RAID6 data, and in the RAID6 to RAID5 case that non-standard layout is
2451required before the change can be accomplished. So while the level
2452change is instant, the accompanying layout change can take quite a
2453long time. A
2454.B \-\-backup\-file
2455is required. If the array is not simultaneously being grown or
2456shrunk, so that the array size will remain the same - for example,
2457reshaping a 3-drive RAID5 into a 4-drive RAID6 - the backup file will
2458be used not just for a "cricital section" but throughout the reshape
2459operation, as described below under LAYOUT CHANGES.
2460
2461.SS CHUNK-SIZE AND LAYOUT CHANGES
2462
2463Changing the chunk-size of layout without also changing the number of
2464devices as the same time will involve re-writing all blocks in-place.
2465To ensure against data loss in the case of a crash, a
2466.B --backup-file
2467must be provided for these changes. Small sections of the array will
2468be copied to the backup file while they are being rearranged. This
2469means that all the data is copied twice, once to the backup and once
2470to the new layout on the array, so this type of reshape will go very
2471slowly.
2472
2473If the reshape is interrupted for any reason, this backup file must be
2474made available to
2475.B "mdadm --assemble"
2476so the array can be reassembled. Consequently the file cannot be
2477stored on the device being reshaped.
2478
2479
2480.SS BITMAP CHANGES
2481
2482A write-intent bitmap can be added to, or removed from, an active
2483array. Either internal bitmaps, or bitmaps stored in a separate file,
2484can be added. Note that if you add a bitmap stored in a file which is
2485in a filesystem that is on the RAID array being affected, the system
2486will deadlock. The bitmap must be on a separate filesystem.
2487
2488.SH INCREMENTAL MODE
2489
2490.HP 12
2491Usage:
2492.B mdadm \-\-incremental
2493.RB [ \-\-run ]
2494.RB [ \-\-quiet ]
2495.I component-device
2496.HP 12
2497Usage:
2498.B mdadm \-\-incremental \-\-fail
2499.I component-device
2500.HP 12
2501Usage:
2502.B mdadm \-\-incremental \-\-rebuild\-map
2503.HP 12
2504Usage:
2505.B mdadm \-\-incremental \-\-run \-\-scan
2506
2507.PP
2508This mode is designed to be used in conjunction with a device
2509discovery system. As devices are found in a system, they can be
2510passed to
2511.B "mdadm \-\-incremental"
2512to be conditionally added to an appropriate array.
2513
2514Conversely, it can also be used with the
2515.B \-\-fail
2516flag to do just the opposite and find whatever array a particular device
2517is part of and remove the device from that array.
2518
2519If the device passed is a
2520.B CONTAINER
2521device created by a previous call to
2522.IR mdadm ,
2523then rather than trying to add that device to an array, all the arrays
2524described by the metadata of the container will be started.
2525
2526.I mdadm
2527performs a number of tests to determine if the device is part of an
2528array, and which array it should be part of. If an appropriate array
2529is found, or can be created,
2530.I mdadm
2531adds the device to the array and conditionally starts the array.
2532
2533Note that
2534.I mdadm
2535will normally only add devices to an array which were previously working
2536(active or spare) parts of that array. The support for automatic
2537inclusion of a new drive as a spare in some array requires
2538a configuration through POLICY in config file.
2539
2540The tests that
2541.I mdadm
2542makes are as follow:
2543.IP +
2544Is the device permitted by
2545.BR mdadm.conf ?
2546That is, is it listed in a
2547.B DEVICES
2548line in that file. If
2549.B DEVICES
2550is absent then the default it to allow any device. Similar if
2551.B DEVICES
2552contains the special word
2553.B partitions
2554then any device is allowed. Otherwise the device name given to
2555.I mdadm
2556must match one of the names or patterns in a
2557.B DEVICES
2558line.
2559
2560.IP +
2561Does the device have a valid md superblock? If a specific metadata
2562version is requested with
2563.B \-\-metadata
2564or
2565.B \-e
2566then only that style of metadata is accepted, otherwise
2567.I mdadm
2568finds any known version of metadata. If no
2569.I md
2570metadata is found, the device may be still added to an array
2571as a spare if POLICY allows.
2572
2573.ig
2574.IP +
2575Does the metadata match an expected array?
2576The metadata can match in two ways. Either there is an array listed
2577in
2578.B mdadm.conf
2579which identifies the array (either by UUID, by name, by device list,
2580or by minor-number), or the array was created with a
2581.B homehost
2582specified and that
2583.B homehost
2584matches the one in
2585.B mdadm.conf
2586or on the command line.
2587If
2588.I mdadm
2589is not able to positively identify the array as belonging to the
2590current host, the device will be rejected.
2591..
2592
2593.PP
2594.I mdadm
2595keeps a list of arrays that it has partially assembled in
2596.BR {MAP_PATH} .
2597If no array exists which matches
2598the metadata on the new device,
2599.I mdadm
2600must choose a device name and unit number. It does this based on any
2601name given in
2602.B mdadm.conf
2603or any name information stored in the metadata. If this name
2604suggests a unit number, that number will be used, otherwise a free
2605unit number will be chosen. Normally
2606.I mdadm
2607will prefer to create a partitionable array, however if the
2608.B CREATE
2609line in
2610.B mdadm.conf
2611suggests that a non-partitionable array is preferred, that will be
2612honoured.
2613
2614If the array is not found in the config file and its metadata does not
2615identify it as belonging to the "homehost", then
2616.I mdadm
2617will choose a name for the array which is certain not to conflict with
2618any array which does belong to this host. It does this be adding an
2619underscore and a small number to the name preferred by the metadata.
2620
2621Once an appropriate array is found or created and the device is added,
2622.I mdadm
2623must decide if the array is ready to be started. It will
2624normally compare the number of available (non-spare) devices to the
2625number of devices that the metadata suggests need to be active. If
2626there are at least that many, the array will be started. This means
2627that if any devices are missing the array will not be restarted.
2628
2629As an alternative,
2630.B \-\-run
2631may be passed to
2632.I mdadm
2633in which case the array will be run as soon as there are enough
2634devices present for the data to be accessible. For a RAID1, that
2635means one device will start the array. For a clean RAID5, the array
2636will be started as soon as all but one drive is present.
2637
2638Note that neither of these approaches is really ideal. If it can
2639be known that all device discovery has completed, then
2640.br
2641.B " mdadm \-IRs"
2642.br
2643can be run which will try to start all arrays that are being
2644incrementally assembled. They are started in "read-auto" mode in
2645which they are read-only until the first write request. This means
2646that no metadata updates are made and no attempt at resync or recovery
2647happens. Further devices that are found before the first write can
2648still be added safely.
2649
2650.SH ENVIRONMENT
2651This section describes environment variables that affect how mdadm
2652operates.
2653
2654.TP
2655.B MDADM_NO_MDMON
2656Setting this value to 1 will prevent mdadm from automatically launching
2657mdmon. This variable is intended primarily for debugging mdadm/mdmon.
2658
2659.TP
2660.B MDADM_NO_UDEV
2661Normally,
2662.I mdadm
2663does not create any device nodes in /dev, but leaves that task to
2664.IR udev .
2665If
2666.I udev
2667appears not to be configured, or if this environment variable is set
2668to '1', the
2669.I mdadm
2670will create and devices that are needed.
2671
2672.SH EXAMPLES
2673
2674.B " mdadm \-\-query /dev/name-of-device"
2675.br
2676This will find out if a given device is a RAID array, or is part of
2677one, and will provide brief information about the device.
2678
2679.B " mdadm \-\-assemble \-\-scan"
2680.br
2681This will assemble and start all arrays listed in the standard config
2682file. This command will typically go in a system startup file.
2683
2684.B " mdadm \-\-stop \-\-scan"
2685.br
2686This will shut down all arrays that can be shut down (i.e. are not
2687currently in use). This will typically go in a system shutdown script.
2688
2689.B " mdadm \-\-follow \-\-scan \-\-delay=120"
2690.br
2691If (and only if) there is an Email address or program given in the
2692standard config file, then
2693monitor the status of all arrays listed in that file by
2694polling them ever 2 minutes.
2695
2696.B " mdadm \-\-create /dev/md0 \-\-level=1 \-\-raid\-devices=2 /dev/hd[ac]1"
2697.br
2698Create /dev/md0 as a RAID1 array consisting of /dev/hda1 and /dev/hdc1.
2699
2700.br
2701.B " echo 'DEVICE /dev/hd*[0\-9] /dev/sd*[0\-9]' > mdadm.conf"
2702.br
2703.B " mdadm \-\-detail \-\-scan >> mdadm.conf"
2704.br
2705This will create a prototype config file that describes currently
2706active arrays that are known to be made from partitions of IDE or SCSI drives.
2707This file should be reviewed before being used as it may
2708contain unwanted detail.
2709
2710.B " echo 'DEVICE /dev/hd[a\-z] /dev/sd*[a\-z]' > mdadm.conf"
2711.br
2712.B " mdadm \-\-examine \-\-scan \-\-config=mdadm.conf >> mdadm.conf"
2713.br
2714This will find arrays which could be assembled from existing IDE and
2715SCSI whole drives (not partitions), and store the information in the
2716format of a config file.
2717This file is very likely to contain unwanted detail, particularly
2718the
2719.B devices=
2720entries. It should be reviewed and edited before being used as an
2721actual config file.
2722
2723.B " mdadm \-\-examine \-\-brief \-\-scan \-\-config=partitions"
2724.br
2725.B " mdadm \-Ebsc partitions"
2726.br
2727Create a list of devices by reading
2728.BR /proc/partitions ,
2729scan these for RAID superblocks, and printout a brief listing of all
2730that were found.
2731
2732.B " mdadm \-Ac partitions \-m 0 /dev/md0"
2733.br
2734Scan all partitions and devices listed in
2735.BR /proc/partitions
2736and assemble
2737.B /dev/md0
2738out of all such devices with a RAID superblock with a minor number of 0.
2739
2740.B " mdadm \-\-monitor \-\-scan \-\-daemonise > /run/mdadm/mon.pid"
2741.br
2742If config file contains a mail address or alert program, run mdadm in
2743the background in monitor mode monitoring all md devices. Also write
2744pid of mdadm daemon to
2745.BR /run/mdadm/mon.pid .
2746
2747.B " mdadm \-Iq /dev/somedevice"
2748.br
2749Try to incorporate newly discovered device into some array as
2750appropriate.
2751
2752.B " mdadm \-\-incremental \-\-rebuild\-map \-\-run \-\-scan"
2753.br
2754Rebuild the array map from any current arrays, and then start any that
2755can be started.
2756
2757.B " mdadm /dev/md4 --fail detached --remove detached"
2758.br
2759Any devices which are components of /dev/md4 will be marked as faulty
2760and then remove from the array.
2761
2762.B " mdadm --grow /dev/md4 --level=6 --backup-file=/root/backup-md4"
2763.br
2764The array
2765.B /dev/md4
2766which is currently a RAID5 array will be converted to RAID6. There
2767should normally already be a spare drive attached to the array as a
2768RAID6 needs one more drive than a matching RAID5.
2769
2770.B " mdadm --create /dev/md/ddf --metadata=ddf --raid-disks 6 /dev/sd[a-f]"
2771.br
2772Create a DDF array over 6 devices.
2773
2774.B " mdadm --create /dev/md/home -n3 -l5 -z 30000000 /dev/md/ddf"
2775.br
2776Create a RAID5 array over any 3 devices in the given DDF set. Use
2777only 30 gigabytes of each device.
2778
2779.B " mdadm -A /dev/md/ddf1 /dev/sd[a-f]"
2780.br
2781Assemble a pre-exist ddf array.
2782
2783.B " mdadm -I /dev/md/ddf1"
2784.br
2785Assemble all arrays contained in the ddf array, assigning names as
2786appropriate.
2787
2788.B " mdadm \-\-create \-\-help"
2789.br
2790Provide help about the Create mode.
2791
2792.B " mdadm \-\-config \-\-help"
2793.br
2794Provide help about the format of the config file.
2795
2796.B " mdadm \-\-help"
2797.br
2798Provide general help.
2799
2800.SH FILES
2801
2802.SS /proc/mdstat
2803
2804If you're using the
2805.B /proc
2806filesystem,
2807.B /proc/mdstat
2808lists all active md devices with information about them.
2809.I mdadm
2810uses this to find arrays when
2811.B \-\-scan
2812is given in Misc mode, and to monitor array reconstruction
2813on Monitor mode.
2814
2815.SS /etc/mdadm.conf
2816
2817The config file lists which devices may be scanned to see if
2818they contain MD super block, and gives identifying information
2819(e.g. UUID) about known MD arrays. See
2820.BR mdadm.conf (5)
2821for more details.
2822
2823.SS {MAP_PATH}
2824When
2825.B \-\-incremental
2826mode is used, this file gets a list of arrays currently being created.
2827
2828.SH DEVICE NAMES
2829
2830.I mdadm
2831understand two sorts of names for array devices.
2832
2833The first is the so-called 'standard' format name, which matches the
2834names used by the kernel and which appear in
2835.IR /proc/mdstat .
2836
2837The second sort can be freely chosen, but must reside in
2838.IR /dev/md/ .
2839When giving a device name to
2840.I mdadm
2841to create or assemble an array, either full path name such as
2842.I /dev/md0
2843or
2844.I /dev/md/home
2845can be given, or just the suffix of the second sort of name, such as
2846.I home
2847can be given.
2848
2849When
2850.I mdadm
2851chooses device names during auto-assembly or incremental assembly, it
2852will sometimes add a small sequence number to the end of the name to
2853avoid conflicted between multiple arrays that have the same name. If
2854.I mdadm
2855can reasonably determine that the array really is meant for this host,
2856either by a hostname in the metadata, or by the presence of the array
2857in
2858.BR mdadm.conf ,
2859then it will leave off the suffix if possible.
2860Also if the homehost is specified as
2861.B <ignore>
2862.I mdadm
2863will only use a suffix if a different array of the same name already
2864exists or is listed in the config file.
2865
2866The standard names for non-partitioned arrays (the only sort of md
2867array available in 2.4 and earlier) are of the form
2868.IP
2869/dev/mdNN
2870.PP
2871where NN is a number.
2872The standard names for partitionable arrays (as available from 2.6
2873onwards) are of the form
2874.IP
2875/dev/md_dNN
2876.PP
2877Partition numbers should be indicated by added "pMM" to these, thus "/dev/md/d1p2".
2878.PP
2879From kernel version, 2.6.28 the "non-partitioned array" can actually
2880be partitioned. So the "md_dNN" names are no longer needed, and
2881partitions such as "/dev/mdNNpXX" are possible.
2882
2883.SH NOTE
2884.I mdadm
2885was previously known as
2886.IR mdctl .
2887.P
2888.I mdadm
2889is completely separate from the
2890.I raidtools
2891package, and does not use the
2892.I /etc/raidtab
2893configuration file at all.
2894
2895.SH SEE ALSO
2896For further information on mdadm usage, MD and the various levels of
2897RAID, see:
2898.IP
2899.B http://raid.wiki.kernel.org/
2900.PP
2901(based upon Jakob \(/Ostergaard's Software\-RAID.HOWTO)
2902.\".PP
2903.\"for new releases of the RAID driver check out:
2904.\"
2905.\".IP
2906.\".UR ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
2907.\"ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
2908.\".UE
2909.\".PP
2910.\"or
2911.\".IP
2912.\".UR http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2913.\"http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2914.\".UE
2915.PP
2916The latest version of
2917.I mdadm
2918should always be available from
2919.IP
2920.B http://www.kernel.org/pub/linux/utils/raid/mdadm/
2921.PP
2922Related man pages:
2923.PP
2924.IR mdmon (8),
2925.IR mdadm.conf (5),
2926.IR md (4).
2927.PP
2928.IR raidtab (5),
2929.IR raid0run (8),
2930.IR raidstop (8),
2931.IR mkraid (8).