]> git.ipfire.org Git - thirdparty/mdadm.git/blame_incremental - mdadm.8.in
Grow/raid10: support reducing the devices in a RAID10.
[thirdparty/mdadm.git] / mdadm.8.in
... / ...
CommitLineData
1.\" -*- nroff -*-
2.\" Copyright Neil Brown and others.
3.\" This program is free software; you can redistribute it and/or modify
4.\" it under the terms of the GNU General Public License as published by
5.\" the Free Software Foundation; either version 2 of the License, or
6.\" (at your option) any later version.
7.\" See file COPYING in distribution for details.
8.TH MDADM 8 "" v3.2.5
9.SH NAME
10mdadm \- manage MD devices
11.I aka
12Linux Software RAID
13
14.SH SYNOPSIS
15
16.BI mdadm " [mode] <raiddevice> [options] <component-devices>"
17
18.SH DESCRIPTION
19RAID devices are virtual devices created from two or more
20real block devices. This allows multiple devices (typically disk
21drives or partitions thereof) to be combined into a single device to
22hold (for example) a single filesystem.
23Some RAID levels include redundancy and so can survive some degree of
24device failure.
25
26Linux Software RAID devices are implemented through the md (Multiple
27Devices) device driver.
28
29Currently, Linux supports
30.B LINEAR
31md devices,
32.B RAID0
33(striping),
34.B RAID1
35(mirroring),
36.BR RAID4 ,
37.BR RAID5 ,
38.BR RAID6 ,
39.BR RAID10 ,
40.BR MULTIPATH ,
41.BR FAULTY ,
42and
43.BR CONTAINER .
44
45.B MULTIPATH
46is not a Software RAID mechanism, but does involve
47multiple devices:
48each device is a path to one common physical storage device.
49New installations should not use md/multipath as it is not well
50supported and has no ongoing development. Use the Device Mapper based
51multipath-tools instead.
52
53.B FAULTY
54is also not true RAID, and it only involves one device. It
55provides a layer over a true device that can be used to inject faults.
56
57.B CONTAINER
58is different again. A
59.B CONTAINER
60is a collection of devices that are
61managed as a set. This is similar to the set of devices connected to
62a hardware RAID controller. The set of devices may contain a number
63of different RAID arrays each utilising some (or all) of the blocks from a
64number of the devices in the set. For example, two devices in a 5-device set
65might form a RAID1 using the whole devices. The remaining three might
66have a RAID5 over the first half of each device, and a RAID0 over the
67second half.
68
69With a
70.BR CONTAINER ,
71there is one set of metadata that describes all of
72the arrays in the container. So when
73.I mdadm
74creates a
75.B CONTAINER
76device, the device just represents the metadata. Other normal arrays (RAID1
77etc) can be created inside the container.
78
79.SH MODES
80mdadm has several major modes of operation:
81.TP
82.B Assemble
83Assemble the components of a previously created
84array into an active array. Components can be explicitly given
85or can be searched for.
86.I mdadm
87checks that the components
88do form a bona fide array, and can, on request, fiddle superblock
89information so as to assemble a faulty array.
90
91.TP
92.B Build
93Build an array that doesn't have per-device metadata (superblocks). For these
94sorts of arrays,
95.I mdadm
96cannot differentiate between initial creation and subsequent assembly
97of an array. It also cannot perform any checks that appropriate
98components have been requested. Because of this, the
99.B Build
100mode should only be used together with a complete understanding of
101what you are doing.
102
103.TP
104.B Create
105Create a new array with per-device metadata (superblocks).
106Appropriate metadata is written to each device, and then the array
107comprising those devices is activated. A 'resync' process is started
108to make sure that the array is consistent (e.g. both sides of a mirror
109contain the same data) but the content of the device is left otherwise
110untouched.
111The array can be used as soon as it has been created. There is no
112need to wait for the initial resync to finish.
113
114.TP
115.B "Follow or Monitor"
116Monitor one or more md devices and act on any state changes. This is
117only meaningful for RAID1, 4, 5, 6, 10 or multipath arrays, as
118only these have interesting state. RAID0 or Linear never have
119missing, spare, or failed drives, so there is nothing to monitor.
120
121.TP
122.B "Grow"
123Grow (or shrink) an array, or otherwise reshape it in some way.
124Currently supported growth options including changing the active size
125of component devices and changing the number of active devices in
126Linear and RAID levels 0/1/4/5/6,
127changing the RAID level between 0, 1, 5, and 6, and between 0 and 10,
128changing the chunk size and layout for RAID 0,4,5,6, as well as adding or
129removing a write-intent bitmap.
130
131.TP
132.B "Incremental Assembly"
133Add a single device to an appropriate array. If the addition of the
134device makes the array runnable, the array will be started.
135This provides a convenient interface to a
136.I hot-plug
137system. As each device is detected,
138.I mdadm
139has a chance to include it in some array as appropriate.
140Optionally, when the
141.I \-\-fail
142flag is passed in we will remove the device from any active array
143instead of adding it.
144
145If a
146.B CONTAINER
147is passed to
148.I mdadm
149in this mode, then any arrays within that container will be assembled
150and started.
151
152.TP
153.B Manage
154This is for doing things to specific components of an array such as
155adding new spares and removing faulty devices.
156
157.TP
158.B Misc
159This is an 'everything else' mode that supports operations on active
160arrays, operations on component devices such as erasing old superblocks, and
161information gathering operations.
162.\"This mode allows operations on independent devices such as examine MD
163.\"superblocks, erasing old superblocks and stopping active arrays.
164
165.TP
166.B Auto-detect
167This mode does not act on a specific device or array, but rather it
168requests the Linux Kernel to activate any auto-detected arrays.
169.SH OPTIONS
170
171.SH Options for selecting a mode are:
172
173.TP
174.BR \-A ", " \-\-assemble
175Assemble a pre-existing array.
176
177.TP
178.BR \-B ", " \-\-build
179Build a legacy array without superblocks.
180
181.TP
182.BR \-C ", " \-\-create
183Create a new array.
184
185.TP
186.BR \-F ", " \-\-follow ", " \-\-monitor
187Select
188.B Monitor
189mode.
190
191.TP
192.BR \-G ", " \-\-grow
193Change the size or shape of an active array.
194
195.TP
196.BR \-I ", " \-\-incremental
197Add/remove a single device to/from an appropriate array, and possibly start the array.
198
199.TP
200.B \-\-auto-detect
201Request that the kernel starts any auto-detected arrays. This can only
202work if
203.I md
204is compiled into the kernel \(em not if it is a module.
205Arrays can be auto-detected by the kernel if all the components are in
206primary MS-DOS partitions with partition type
207.BR FD ,
208and all use v0.90 metadata.
209In-kernel autodetect is not recommended for new installations. Using
210.I mdadm
211to detect and assemble arrays \(em possibly in an
212.I initrd
213\(em is substantially more flexible and should be preferred.
214
215.P
216If a device is given before any options, or if the first option is
217.BR \-\-add ,
218.BR \-\-fail ,
219or
220.BR \-\-remove ,
221then the MANAGE mode is assumed.
222Anything other than these will cause the
223.B Misc
224mode to be assumed.
225
226.SH Options that are not mode-specific are:
227
228.TP
229.BR \-h ", " \-\-help
230Display general help message or, after one of the above options, a
231mode-specific help message.
232
233.TP
234.B \-\-help\-options
235Display more detailed help about command line parsing and some commonly
236used options.
237
238.TP
239.BR \-V ", " \-\-version
240Print version information for mdadm.
241
242.TP
243.BR \-v ", " \-\-verbose
244Be more verbose about what is happening. This can be used twice to be
245extra-verbose.
246The extra verbosity currently only affects
247.B \-\-detail \-\-scan
248and
249.BR "\-\-examine \-\-scan" .
250
251.TP
252.BR \-q ", " \-\-quiet
253Avoid printing purely informative messages. With this,
254.I mdadm
255will be silent unless there is something really important to report.
256
257.TP
258.BR \-\-offroot
259Set first character of argv[0] to @ to indicate mdadm was launched
260from initrd/initramfs and should not be shutdown by systemd as part of
261the regular shutdown process. This option is normally only used by
262the system's initscripts. Please see here for more details on how
263systemd handled argv[0]:
264.IP
265.B http://www.freedesktop.org/wiki/Software/systemd/RootStorageDaemons
266.PP
267
268
269.TP
270.BR \-f ", " \-\-force
271Be more forceful about certain operations. See the various modes for
272the exact meaning of this option in different contexts.
273
274.TP
275.BR \-c ", " \-\-config=
276Specify the config file. Default is to use
277.BR /etc/mdadm.conf ,
278or if that is missing then
279.BR /etc/mdadm/mdadm.conf .
280If the config file given is
281.B "partitions"
282then nothing will be read, but
283.I mdadm
284will act as though the config file contained exactly
285.B "DEVICE partitions containers"
286and will read
287.B /proc/partitions
288to find a list of devices to scan, and
289.B /proc/mdstat
290to find a list of containers to examine.
291If the word
292.B "none"
293is given for the config file, then
294.I mdadm
295will act as though the config file were empty.
296
297.TP
298.BR \-s ", " \-\-scan
299Scan config file or
300.B /proc/mdstat
301for missing information.
302In general, this option gives
303.I mdadm
304permission to get any missing information (like component devices,
305array devices, array identities, and alert destination) from the
306configuration file (see previous option);
307one exception is MISC mode when using
308.B \-\-detail
309or
310.B \-\-stop,
311in which case
312.B \-\-scan
313says to get a list of array devices from
314.BR /proc/mdstat .
315
316.TP
317.BR \-e ", " \-\-metadata=
318Declare the style of RAID metadata (superblock) to be used. The
319default is {DEFAULT_METADATA} for
320.BR \-\-create ,
321and to guess for other operations.
322The default can be overridden by setting the
323.B metadata
324value for the
325.B CREATE
326keyword in
327.BR mdadm.conf .
328
329Options are:
330.RS
331.ie '{DEFAULT_METADATA}'0.90'
332.IP "0, 0.90, default"
333.el
334.IP "0, 0.90"
335..
336Use the original 0.90 format superblock. This format limits arrays to
33728 component devices and limits component devices of levels 1 and
338greater to 2 terabytes. It is also possible for there to be confusion
339about whether the superblock applies to a whole device or just the
340last partition, if that partition starts on a 64K boundary.
341.ie '{DEFAULT_METADATA}'0.90'
342.IP "1, 1.0, 1.1, 1.2"
343.el
344.IP "1, 1.0, 1.1, 1.2 default"
345..
346Use the new version-1 format superblock. This has fewer restrictions.
347It can easily be moved between hosts with different endian-ness, and a
348recovery operation can be checkpointed and restarted. The different
349sub-versions store the superblock at different locations on the
350device, either at the end (for 1.0), at the start (for 1.1) or 4K from
351the start (for 1.2). "1" is equivalent to "1.2" (the commonly
352preferred 1.x format).
353'if '{DEFAULT_METADATA}'1.2' "default" is equivalent to "1.2".
354.IP ddf
355Use the "Industry Standard" DDF (Disk Data Format) format defined by
356SNIA.
357When creating a DDF array a
358.B CONTAINER
359will be created, and normal arrays can be created in that container.
360.IP imsm
361Use the Intel(R) Matrix Storage Manager metadata format. This creates a
362.B CONTAINER
363which is managed in a similar manner to DDF, and is supported by an
364option-rom on some platforms:
365.IP
366.B http://www.intel.com/design/chipsets/matrixstorage_sb.htm
367.PP
368.RE
369
370.TP
371.B \-\-homehost=
372This will override any
373.B HOMEHOST
374setting in the config file and provides the identity of the host which
375should be considered the home for any arrays.
376
377When creating an array, the
378.B homehost
379will be recorded in the metadata. For version-1 superblocks, it will
380be prefixed to the array name. For version-0.90 superblocks, part of
381the SHA1 hash of the hostname will be stored in the later half of the
382UUID.
383
384When reporting information about an array, any array which is tagged
385for the given homehost will be reported as such.
386
387When using Auto-Assemble, only arrays tagged for the given homehost
388will be allowed to use 'local' names (i.e. not ending in '_' followed
389by a digit string). See below under
390.BR "Auto Assembly" .
391
392.TP
393.B \-\-prefer=
394When
395.I mdadm
396needs to print the name for a device it normally finds the name in
397.B /dev
398which refers to the device and is shortest. When a path component is
399given with
400.B \-\-prefer
401.I mdadm
402will prefer a longer name if it contains that component. For example
403.B \-\-prefer=by-uuid
404will prefer a name in a subdirectory of
405.B /dev
406called
407.BR by-uuid .
408
409This functionality is currently only provided by
410.B \-\-detail
411and
412.BR \-\-monitor .
413
414.SH For create, build, or grow:
415
416.TP
417.BR \-n ", " \-\-raid\-devices=
418Specify the number of active devices in the array. This, plus the
419number of spare devices (see below) must equal the number of
420.I component-devices
421(including "\fBmissing\fP" devices)
422that are listed on the command line for
423.BR \-\-create .
424Setting a value of 1 is probably
425a mistake and so requires that
426.B \-\-force
427be specified first. A value of 1 will then be allowed for linear,
428multipath, RAID0 and RAID1. It is never allowed for RAID4, RAID5 or RAID6.
429.br
430This number can only be changed using
431.B \-\-grow
432for RAID1, RAID4, RAID5 and RAID6 arrays, and only on kernels which provide
433the necessary support.
434
435.TP
436.BR \-x ", " \-\-spare\-devices=
437Specify the number of spare (eXtra) devices in the initial array.
438Spares can also be added
439and removed later. The number of component devices listed
440on the command line must equal the number of RAID devices plus the
441number of spare devices.
442
443.TP
444.BR \-z ", " \-\-size=
445Amount (in Kibibytes) of space to use from each drive in RAID levels 1/4/5/6.
446This must be a multiple of the chunk size, and must leave about 128Kb
447of space at the end of the drive for the RAID superblock.
448If this is not specified
449(as it normally is not) the smallest drive (or partition) sets the
450size, though if there is a variance among the drives of greater than 1%, a warning is
451issued.
452
453A suffix of 'M' or 'G' can be given to indicate Megabytes or
454Gigabytes respectively.
455
456Sometimes a replacement drive can be a little smaller than the
457original drives though this should be minimised by IDEMA standards.
458Such a replacement drive will be rejected by
459.IR md .
460To guard against this it can be useful to set the initial size
461slightly smaller than the smaller device with the aim that it will
462still be larger than any replacement.
463
464This value can be set with
465.B \-\-grow
466for RAID level 1/4/5/6 though
467.B CONTAINER
468based arrays such as those with IMSM metadata may not be able to
469support this.
470If the array was created with a size smaller than the currently
471active drives, the extra space can be accessed using
472.BR \-\-grow .
473The size can be given as
474.B max
475which means to choose the largest size that fits on all current drives.
476
477Before reducing the size of the array (with
478.BR "\-\-grow \-\-size=" )
479you should make sure that space isn't needed. If the device holds a
480filesystem, you would need to resize the filesystem to use less space.
481
482After reducing the array size you should check that the data stored in
483the device is still available. If the device holds a filesystem, then
484an 'fsck' of the filesystem is a minimum requirement. If there are
485problems the array can be made bigger again with no loss with another
486.B "\-\-grow \-\-size="
487command.
488
489This value cannot be used when creating a
490.B CONTAINER
491such as with DDF and IMSM metadata, though it perfectly valid when
492creating an array inside a container.
493
494.TP
495.BR \-Z ", " \-\-array\-size=
496This is only meaningful with
497.B \-\-grow
498and its effect is not persistent: when the array is stopped and
499restarted the default array size will be restored.
500
501Setting the array-size causes the array to appear smaller to programs
502that access the data. This is particularly needed before reshaping an
503array so that it will be smaller. As the reshape is not reversible,
504but setting the size with
505.B \-\-array-size
506is, it is required that the array size is reduced as appropriate
507before the number of devices in the array is reduced.
508
509Before reducing the size of the array you should make sure that space
510isn't needed. If the device holds a filesystem, you would need to
511resize the filesystem to use less space.
512
513After reducing the array size you should check that the data stored in
514the device is still available. If the device holds a filesystem, then
515an 'fsck' of the filesystem is a minimum requirement. If there are
516problems the array can be made bigger again with no loss with another
517.B "\-\-grow \-\-array\-size="
518command.
519
520A suffix of 'M' or 'G' can be given to indicate Megabytes or
521Gigabytes respectively.
522A value of
523.B max
524restores the apparent size of the array to be whatever the real
525amount of available space is.
526
527.TP
528.BR \-c ", " \-\-chunk=
529Specify chunk size of kibibytes. The default when creating an
530array is 512KB. To ensure compatibility with earlier versions, the
531default when Building and array with no persistent metadata is 64KB.
532This is only meaningful for RAID0, RAID4, RAID5, RAID6, and RAID10.
533
534RAID4, RAID5, RAID6, and RAID10 require the chunk size to be a power
535of 2. In any case it must be a multiple of 4KB.
536
537A suffix of 'M' or 'G' can be given to indicate Megabytes or
538Gigabytes respectively.
539
540.TP
541.BR \-\-rounding=
542Specify rounding factor for a Linear array. The size of each
543component will be rounded down to a multiple of this size.
544This is a synonym for
545.B \-\-chunk
546but highlights the different meaning for Linear as compared to other
547RAID levels. The default is 64K if a kernel earlier than 2.6.16 is in
548use, and is 0K (i.e. no rounding) in later kernels.
549
550.TP
551.BR \-l ", " \-\-level=
552Set RAID level. When used with
553.BR \-\-create ,
554options are: linear, raid0, 0, stripe, raid1, 1, mirror, raid4, 4,
555raid5, 5, raid6, 6, raid10, 10, multipath, mp, faulty, container.
556Obviously some of these are synonymous.
557
558When a
559.B CONTAINER
560metadata type is requested, only the
561.B container
562level is permitted, and it does not need to be explicitly given.
563
564When used with
565.BR \-\-build ,
566only linear, stripe, raid0, 0, raid1, multipath, mp, and faulty are valid.
567
568Can be used with
569.B \-\-grow
570to change the RAID level in some cases. See LEVEL CHANGES below.
571
572.TP
573.BR \-p ", " \-\-layout=
574This option configures the fine details of data layout for RAID5, RAID6,
575and RAID10 arrays, and controls the failure modes for
576.IR faulty .
577
578The layout of the RAID5 parity block can be one of
579.BR left\-asymmetric ,
580.BR left\-symmetric ,
581.BR right\-asymmetric ,
582.BR right\-symmetric ,
583.BR la ", " ra ", " ls ", " rs .
584The default is
585.BR left\-symmetric .
586
587It is also possible to cause RAID5 to use a RAID4-like layout by
588choosing
589.BR parity\-first ,
590or
591.BR parity\-last .
592
593Finally for RAID5 there are DDF\-compatible layouts,
594.BR ddf\-zero\-restart ,
595.BR ddf\-N\-restart ,
596and
597.BR ddf\-N\-continue .
598
599These same layouts are available for RAID6. There are also 4 layouts
600that will provide an intermediate stage for converting between RAID5
601and RAID6. These provide a layout which is identical to the
602corresponding RAID5 layout on the first N\-1 devices, and has the 'Q'
603syndrome (the second 'parity' block used by RAID6) on the last device.
604These layouts are:
605.BR left\-symmetric\-6 ,
606.BR right\-symmetric\-6 ,
607.BR left\-asymmetric\-6 ,
608.BR right\-asymmetric\-6 ,
609and
610.BR parity\-first\-6 .
611
612When setting the failure mode for level
613.I faulty,
614the options are:
615.BR write\-transient ", " wt ,
616.BR read\-transient ", " rt ,
617.BR write\-persistent ", " wp ,
618.BR read\-persistent ", " rp ,
619.BR write\-all ,
620.BR read\-fixable ", " rf ,
621.BR clear ", " flush ", " none .
622
623Each failure mode can be followed by a number, which is used as a period
624between fault generation. Without a number, the fault is generated
625once on the first relevant request. With a number, the fault will be
626generated after that many requests, and will continue to be generated
627every time the period elapses.
628
629Multiple failure modes can be current simultaneously by using the
630.B \-\-grow
631option to set subsequent failure modes.
632
633"clear" or "none" will remove any pending or periodic failure modes,
634and "flush" will clear any persistent faults.
635
636Finally, the layout options for RAID10 are one of 'n', 'o' or 'f' followed
637by a small number. The default is 'n2'. The supported options are:
638
639.I 'n'
640signals 'near' copies. Multiple copies of one data block are at
641similar offsets in different devices.
642
643.I 'o'
644signals 'offset' copies. Rather than the chunks being duplicated
645within a stripe, whole stripes are duplicated but are rotated by one
646device so duplicate blocks are on different devices. Thus subsequent
647copies of a block are in the next drive, and are one chunk further
648down.
649
650.I 'f'
651signals 'far' copies
652(multiple copies have very different offsets).
653See md(4) for more detail about 'near', 'offset', and 'far'.
654
655The number is the number of copies of each datablock. 2 is normal, 3
656can be useful. This number can be at most equal to the number of
657devices in the array. It does not need to divide evenly into that
658number (e.g. it is perfectly legal to have an 'n2' layout for an array
659with an odd number of devices).
660
661When an array is converted between RAID5 and RAID6 an intermediate
662RAID6 layout is used in which the second parity block (Q) is always on
663the last device. To convert a RAID5 to RAID6 and leave it in this new
664layout (which does not require re-striping) use
665.BR \-\-layout=preserve .
666This will try to avoid any restriping.
667
668The converse of this is
669.B \-\-layout=normalise
670which will change a non-standard RAID6 layout into a more standard
671arrangement.
672
673.TP
674.BR \-\-parity=
675same as
676.B \-\-layout
677(thus explaining the p of
678.BR \-p ).
679
680.TP
681.BR \-b ", " \-\-bitmap=
682Specify a file to store a write-intent bitmap in. The file should not
683exist unless
684.B \-\-force
685is also given. The same file should be provided
686when assembling the array. If the word
687.B "internal"
688is given, then the bitmap is stored with the metadata on the array,
689and so is replicated on all devices. If the word
690.B "none"
691is given with
692.B \-\-grow
693mode, then any bitmap that is present is removed.
694
695To help catch typing errors, the filename must contain at least one
696slash ('/') if it is a real file (not 'internal' or 'none').
697
698Note: external bitmaps are only known to work on ext2 and ext3.
699Storing bitmap files on other filesystems may result in serious problems.
700
701.TP
702.BR \-\-bitmap\-chunk=
703Set the chunksize of the bitmap. Each bit corresponds to that many
704Kilobytes of storage.
705When using a file based bitmap, the default is to use the smallest
706size that is at-least 4 and requires no more than 2^21 chunks.
707When using an
708.B internal
709bitmap, the chunksize defaults to 64Meg, or larger if necessary to
710fit the bitmap into the available space.
711
712A suffix of 'M' or 'G' can be given to indicate Megabytes or
713Gigabytes respectively.
714
715.TP
716.BR \-W ", " \-\-write\-mostly
717subsequent devices listed in a
718.BR \-\-build ,
719.BR \-\-create ,
720or
721.B \-\-add
722command will be flagged as 'write-mostly'. This is valid for RAID1
723only and means that the 'md' driver will avoid reading from these
724devices if at all possible. This can be useful if mirroring over a
725slow link.
726
727.TP
728.BR \-\-write\-behind=
729Specify that write-behind mode should be enabled (valid for RAID1
730only). If an argument is specified, it will set the maximum number
731of outstanding writes allowed. The default value is 256.
732A write-intent bitmap is required in order to use write-behind
733mode, and write-behind is only attempted on drives marked as
734.IR write-mostly .
735
736.TP
737.BR \-\-assume\-clean
738Tell
739.I mdadm
740that the array pre-existed and is known to be clean. It can be useful
741when trying to recover from a major failure as you can be sure that no
742data will be affected unless you actually write to the array. It can
743also be used when creating a RAID1 or RAID10 if you want to avoid the
744initial resync, however this practice \(em while normally safe \(em is not
745recommended. Use this only if you really know what you are doing.
746.IP
747When the devices that will be part of a new array were filled
748with zeros before creation the operator knows the array is
749actually clean. If that is the case, such as after running
750badblocks, this argument can be used to tell mdadm the
751facts the operator knows.
752.IP
753When an array is resized to a larger size with
754.B "\-\-grow \-\-size="
755the new space is normally resynced in that same way that the whole
756array is resynced at creation. From Linux version 3.0,
757.B \-\-assume\-clean
758can be used with that command to avoid the automatic resync.
759
760.TP
761.BR \-\-backup\-file=
762This is needed when
763.B \-\-grow
764is used to increase the number of raid-devices in a RAID5 or RAID6 if
765there are no spare devices available, or to shrink, change RAID level
766or layout. See the GROW MODE section below on RAID\-DEVICES CHANGES.
767The file must be stored on a separate device, not on the RAID array
768being reshaped.
769
770.TP
771.B \-\-data\-offset=
772Arrays with 1.x metadata can leave a gap between the start of the
773device and the start of array data. This gap can be used for various
774metadata. The start of data is known as the
775.IR data\-offset .
776Normally an appropriate data offset is computed automatically.
777However it can be useful to set it explicitly such as when re-creating
778an array which was originally created using a different version of
779.I mdadm
780which computed a different offset.
781
782Setting the offset explicitly over-rides the default. The value given
783is in Kilobytes unless an 'M' or 'G' suffix is given.
784
785Since Linux 3.4,
786.B \-\-data\-offset
787can also be used with
788.B --grow
789for some RAID levels (initially on RAID10). This allows the
790data-offset to be changed as part of the reshape process. When the
791data offset is changed, no backup file is required as the difference
792in offsets is used to provide the same functionality.
793
794When the new offset is earlier than the old offset, the number of
795devices in the array cannot shrink. When it is after the old offset,
796the number of devices in the array cannot increase.
797
798.TP
799.BR \-\-continue
800This option is complementary to the
801.B \-\-freeze-reshape
802option for assembly. It is needed when
803.B \-\-grow
804operation is interrupted and it is not restarted automatically due to
805.B \-\-freeze-reshape
806usage during array assembly. This option is used together with
807.BR \-G
808, (
809.BR \-\-grow
810) command and device for a pending reshape to be continued.
811All parameters required for reshape continuation will be read from array metadata.
812If initial
813.BR \-\-grow
814command had required
815.BR \-\-backup\-file=
816option to be set, continuation option will require to have exactly the same
817backup file given as well.
818.IP
819Any other parameter passed together with
820.BR \-\-continue
821option will be ignored.
822
823.TP
824.BR \-N ", " \-\-name=
825Set a
826.B name
827for the array. This is currently only effective when creating an
828array with a version-1 superblock, or an array in a DDF container.
829The name is a simple textual string that can be used to identify array
830components when assembling. If name is needed but not specified, it
831is taken from the basename of the device that is being created.
832e.g. when creating
833.I /dev/md/home
834the
835.B name
836will default to
837.IR home .
838
839.TP
840.BR \-R ", " \-\-run
841Insist that
842.I mdadm
843run the array, even if some of the components
844appear to be active in another array or filesystem. Normally
845.I mdadm
846will ask for confirmation before including such components in an
847array. This option causes that question to be suppressed.
848
849.TP
850.BR \-f ", " \-\-force
851Insist that
852.I mdadm
853accept the geometry and layout specified without question. Normally
854.I mdadm
855will not allow creation of an array with only one device, and will try
856to create a RAID5 array with one missing drive (as this makes the
857initial resync work faster). With
858.BR \-\-force ,
859.I mdadm
860will not try to be so clever.
861
862.TP
863.BR \-o ", " \-\-readonly
864Start the array
865.B read only
866rather than read-write as normal. No writes will be allowed to the
867array, and no resync, recovery, or reshape will be started.
868
869.TP
870.BR \-a ", " "\-\-auto{=yes,md,mdp,part,p}{NN}"
871Instruct mdadm how to create the device file if needed, possibly allocating
872an unused minor number. "md" causes a non-partitionable array
873to be used (though since Linux 2.6.28, these array devices are in fact
874partitionable). "mdp", "part" or "p" causes a partitionable array (2.6 and
875later) to be used. "yes" requires the named md device to have
876a 'standard' format, and the type and minor number will be determined
877from this. With mdadm 3.0, device creation is normally left up to
878.I udev
879so this option is unlikely to be needed.
880See DEVICE NAMES below.
881
882The argument can also come immediately after
883"\-a". e.g. "\-ap".
884
885If
886.B \-\-auto
887is not given on the command line or in the config file, then
888the default will be
889.BR \-\-auto=yes .
890
891If
892.B \-\-scan
893is also given, then any
894.I auto=
895entries in the config file will override the
896.B \-\-auto
897instruction given on the command line.
898
899For partitionable arrays,
900.I mdadm
901will create the device file for the whole array and for the first 4
902partitions. A different number of partitions can be specified at the
903end of this option (e.g.
904.BR \-\-auto=p7 ).
905If the device name ends with a digit, the partition names add a 'p',
906and a number, e.g.
907.IR /dev/md/home1p3 .
908If there is no trailing digit, then the partition names just have a
909number added, e.g.
910.IR /dev/md/scratch3 .
911
912If the md device name is in a 'standard' format as described in DEVICE
913NAMES, then it will be created, if necessary, with the appropriate
914device number based on that name. If the device name is not in one of these
915formats, then a unused device number will be allocated. The device
916number will be considered unused if there is no active array for that
917number, and there is no entry in /dev for that number and with a
918non-standard name. Names that are not in 'standard' format are only
919allowed in "/dev/md/".
920
921This is meaningful with
922.B \-\-create
923or
924.BR \-\-build .
925
926.ig XX
927.\".TP
928.\".BR \-\-symlink = no
929.\"Normally when
930.\".B \-\-auto
931.\"causes
932.\".I mdadm
933.\"to create devices in
934.\".B /dev/md/
935.\"it will also create symlinks from
936.\".B /dev/
937.\"with names starting with
938.\".B md
939.\"or
940.\".BR md_ .
941.\"Use
942.\".B \-\-symlink=no
943.\"to suppress this, or
944.\".B \-\-symlink=yes
945.\"to enforce this even if it is suppressing
946.\".IR mdadm.conf .
947.\"
948.XX
949
950.TP
951.BR \-a ", " "\-\-add"
952This option can be used in Grow mode in two cases.
953
954If the target array is a Linear array, then
955.B \-\-add
956can be used to add one or more devices to the array. They
957are simply catenated on to the end of the array. Once added, the
958devices cannot be removed.
959
960If the
961.B \-\-raid\-disks
962option is being used to increase the number of devices in an array,
963then
964.B \-\-add
965can be used to add some extra devices to be included in the array.
966In most cases this is not needed as the extra devices can be added as
967spares first, and then the number of raid-disks can be changed.
968However for RAID0, it is not possible to add spares. So to increase
969the number of devices in a RAID0, it is necessary to set the new
970number of devices, and to add the new devices, in the same command.
971
972.SH For assemble:
973
974.TP
975.BR \-u ", " \-\-uuid=
976uuid of array to assemble. Devices which don't have this uuid are
977excluded
978
979.TP
980.BR \-m ", " \-\-super\-minor=
981Minor number of device that array was created for. Devices which
982don't have this minor number are excluded. If you create an array as
983/dev/md1, then all superblocks will contain the minor number 1, even if
984the array is later assembled as /dev/md2.
985
986Giving the literal word "dev" for
987.B \-\-super\-minor
988will cause
989.I mdadm
990to use the minor number of the md device that is being assembled.
991e.g. when assembling
992.BR /dev/md0 ,
993.B \-\-super\-minor=dev
994will look for super blocks with a minor number of 0.
995
996.B \-\-super\-minor
997is only relevant for v0.90 metadata, and should not normally be used.
998Using
999.B \-\-uuid
1000is much safer.
1001
1002.TP
1003.BR \-N ", " \-\-name=
1004Specify the name of the array to assemble. This must be the name
1005that was specified when creating the array. It must either match
1006the name stored in the superblock exactly, or it must match
1007with the current
1008.I homehost
1009prefixed to the start of the given name.
1010
1011.TP
1012.BR \-f ", " \-\-force
1013Assemble the array even if the metadata on some devices appears to be
1014out-of-date. If
1015.I mdadm
1016cannot find enough working devices to start the array, but can find
1017some devices that are recorded as having failed, then it will mark
1018those devices as working so that the array can be started.
1019An array which requires
1020.B \-\-force
1021to be started may contain data corruption. Use it carefully.
1022
1023.TP
1024.BR \-R ", " \-\-run
1025Attempt to start the array even if fewer drives were given than were
1026present last time the array was active. Normally if not all the
1027expected drives are found and
1028.B \-\-scan
1029is not used, then the array will be assembled but not started.
1030With
1031.B \-\-run
1032an attempt will be made to start it anyway.
1033
1034.TP
1035.B \-\-no\-degraded
1036This is the reverse of
1037.B \-\-run
1038in that it inhibits the startup of array unless all expected drives
1039are present. This is only needed with
1040.B \-\-scan,
1041and can be used if the physical connections to devices are
1042not as reliable as you would like.
1043
1044.TP
1045.BR \-a ", " "\-\-auto{=no,yes,md,mdp,part}"
1046See this option under Create and Build options.
1047
1048.TP
1049.BR \-b ", " \-\-bitmap=
1050Specify the bitmap file that was given when the array was created. If
1051an array has an
1052.B internal
1053bitmap, there is no need to specify this when assembling the array.
1054
1055.TP
1056.BR \-\-backup\-file=
1057If
1058.B \-\-backup\-file
1059was used while reshaping an array (e.g. changing number of devices or
1060chunk size) and the system crashed during the critical section, then the same
1061.B \-\-backup\-file
1062must be presented to
1063.B \-\-assemble
1064to allow possibly corrupted data to be restored, and the reshape
1065to be completed.
1066
1067.TP
1068.BR \-\-invalid\-backup
1069If the file needed for the above option is not available for any
1070reason an empty file can be given together with this option to
1071indicate that the backup file is invalid. In this case the data that
1072was being rearranged at the time of the crash could be irrecoverably
1073lost, but the rest of the array may still be recoverable. This option
1074should only be used as a last resort if there is no way to recover the
1075backup file.
1076
1077
1078.TP
1079.BR \-U ", " \-\-update=
1080Update the superblock on each device while assembling the array. The
1081argument given to this flag can be one of
1082.BR sparc2.2 ,
1083.BR summaries ,
1084.BR uuid ,
1085.BR name ,
1086.BR homehost ,
1087.BR resync ,
1088.BR byteorder ,
1089.BR devicesize ,
1090.BR no\-bitmap ,
1091.BR bbl ,
1092.BR no-\bbl ,
1093or
1094.BR super\-minor .
1095
1096The
1097.B sparc2.2
1098option will adjust the superblock of an array what was created on a Sparc
1099machine running a patched 2.2 Linux kernel. This kernel got the
1100alignment of part of the superblock wrong. You can use the
1101.B "\-\-examine \-\-sparc2.2"
1102option to
1103.I mdadm
1104to see what effect this would have.
1105
1106The
1107.B super\-minor
1108option will update the
1109.B "preferred minor"
1110field on each superblock to match the minor number of the array being
1111assembled.
1112This can be useful if
1113.B \-\-examine
1114reports a different "Preferred Minor" to
1115.BR \-\-detail .
1116In some cases this update will be performed automatically
1117by the kernel driver. In particular the update happens automatically
1118at the first write to an array with redundancy (RAID level 1 or
1119greater) on a 2.6 (or later) kernel.
1120
1121The
1122.B uuid
1123option will change the uuid of the array. If a UUID is given with the
1124.B \-\-uuid
1125option that UUID will be used as a new UUID and will
1126.B NOT
1127be used to help identify the devices in the array.
1128If no
1129.B \-\-uuid
1130is given, a random UUID is chosen.
1131
1132The
1133.B name
1134option will change the
1135.I name
1136of the array as stored in the superblock. This is only supported for
1137version-1 superblocks.
1138
1139The
1140.B homehost
1141option will change the
1142.I homehost
1143as recorded in the superblock. For version-0 superblocks, this is the
1144same as updating the UUID.
1145For version-1 superblocks, this involves updating the name.
1146
1147The
1148.B resync
1149option will cause the array to be marked
1150.I dirty
1151meaning that any redundancy in the array (e.g. parity for RAID5,
1152copies for RAID1) may be incorrect. This will cause the RAID system
1153to perform a "resync" pass to make sure that all redundant information
1154is correct.
1155
1156The
1157.B byteorder
1158option allows arrays to be moved between machines with different
1159byte-order.
1160When assembling such an array for the first time after a move, giving
1161.B "\-\-update=byteorder"
1162will cause
1163.I mdadm
1164to expect superblocks to have their byteorder reversed, and will
1165correct that order before assembling the array. This is only valid
1166with original (Version 0.90) superblocks.
1167
1168The
1169.B summaries
1170option will correct the summaries in the superblock. That is the
1171counts of total, working, active, failed, and spare devices.
1172
1173The
1174.B devicesize
1175option will rarely be of use. It applies to version 1.1 and 1.2 metadata
1176only (where the metadata is at the start of the device) and is only
1177useful when the component device has changed size (typically become
1178larger). The version 1 metadata records the amount of the device that
1179can be used to store data, so if a device in a version 1.1 or 1.2
1180array becomes larger, the metadata will still be visible, but the
1181extra space will not. In this case it might be useful to assemble the
1182array with
1183.BR \-\-update=devicesize .
1184This will cause
1185.I mdadm
1186to determine the maximum usable amount of space on each device and
1187update the relevant field in the metadata.
1188
1189The
1190.B no\-bitmap
1191option can be used when an array has an internal bitmap which is
1192corrupt in some way so that assembling the array normally fails. It
1193will cause any internal bitmap to be ignored.
1194
1195The
1196.B bbl
1197option will reserve space in each device for a bad block list. This
1198will be 4K in size and positioned near the end of any free space
1199between the superblock and the data.
1200
1201The
1202.B no\-bbl
1203option will cause any reservation of space for a bad block list to be
1204removed. If the bad block list contains entries, this will fail, as
1205removing the list could cause data corruption.
1206
1207.TP
1208.BR \-\-freeze\-reshape
1209Option is intended to be used in start-up scripts during initrd boot phase.
1210When array under reshape is assembled during initrd phase, this option
1211stops reshape after reshape critical section is being restored. This happens
1212before file system pivot operation and avoids loss of file system context.
1213Losing file system context would cause reshape to be broken.
1214
1215Reshape can be continued later using the
1216.B \-\-continue
1217option for the grow command.
1218
1219.SH For Manage mode:
1220
1221.TP
1222.BR \-t ", " \-\-test
1223Unless a more serious error occurred,
1224.I mdadm
1225will exit with a status of 2 if no changes were made to the array and
12260 if at least one change was made.
1227This can be useful when an indirect specifier such as
1228.BR missing ,
1229.B detached
1230or
1231.B faulty
1232is used in requesting an operation on the array.
1233.B \-\-test
1234will report failure if these specifiers didn't find any match.
1235
1236.TP
1237.BR \-a ", " \-\-add
1238hot-add listed devices.
1239If a device appears to have recently been part of the array
1240(possibly it failed or was removed) the device is re\-added as described
1241in the next point.
1242If that fails or the device was never part of the array, the device is
1243added as a hot-spare.
1244If the array is degraded, it will immediately start to rebuild data
1245onto that spare.
1246
1247Note that this and the following options are only meaningful on array
1248with redundancy. They don't apply to RAID0 or Linear.
1249
1250.TP
1251.BR \-\-re\-add
1252re\-add a device that was previous removed from an array.
1253If the metadata on the device reports that it is a member of the
1254array, and the slot that it used is still vacant, then the device will
1255be added back to the array in the same position. This will normally
1256cause the data for that device to be recovered. However based on the
1257event count on the device, the recovery may only require sections that
1258are flagged a write-intent bitmap to be recovered or may not require
1259any recovery at all.
1260
1261When used on an array that has no metadata (i.e. it was built with
1262.BR \-\-build)
1263it will be assumed that bitmap-based recovery is enough to make the
1264device fully consistent with the array.
1265
1266When used with v1.x metadata,
1267.B \-\-re\-add
1268can be accompanied by
1269.BR \-\-update=devicesize ,
1270.BR \-\-update=bbl ", or"
1271.BR \-\-update=no\-bbl .
1272See the description of these option when used in Assemble mode for an
1273explanation of their use.
1274
1275If the device name given is
1276.B missing
1277then mdadm will try to find any device that looks like it should be
1278part of the array but isn't and will try to re\-add all such devices.
1279
1280.TP
1281.BR \-r ", " \-\-remove
1282remove listed devices. They must not be active. i.e. they should
1283be failed or spare devices. As well as the name of a device file
1284(e.g.
1285.BR /dev/sda1 )
1286the words
1287.B failed
1288and
1289.B detached
1290can be given to
1291.BR \-\-remove .
1292The first causes all failed device to be removed. The second causes
1293any device which is no longer connected to the system (i.e an 'open'
1294returns
1295.BR ENXIO )
1296to be removed. This will only succeed for devices that are spares or
1297have already been marked as failed.
1298
1299.TP
1300.BR \-f ", " \-\-fail
1301mark listed devices as faulty.
1302As well as the name of a device file, the word
1303.B detached
1304can be given. This will cause any device that has been detached from
1305the system to be marked as failed. It can then be removed.
1306
1307.TP
1308.BR \-\-set\-faulty
1309same as
1310.BR \-\-fail .
1311
1312.TP
1313.BR \-\-write\-mostly
1314Subsequent devices that are added or re\-added will have the 'write-mostly'
1315flag set. This is only valid for RAID1 and means that the 'md' driver
1316will avoid reading from these devices if possible.
1317.TP
1318.BR \-\-readwrite
1319Subsequent devices that are added or re\-added will have the 'write-mostly'
1320flag cleared.
1321
1322.P
1323Each of these options requires that the first device listed is the array
1324to be acted upon, and the remainder are component devices to be added,
1325removed, marked as faulty, etc. Several different operations can be
1326specified for different devices, e.g.
1327.in +5
1328mdadm /dev/md0 \-\-add /dev/sda1 \-\-fail /dev/sdb1 \-\-remove /dev/sdb1
1329.in -5
1330Each operation applies to all devices listed until the next
1331operation.
1332
1333If an array is using a write-intent bitmap, then devices which have
1334been removed can be re\-added in a way that avoids a full
1335reconstruction but instead just updates the blocks that have changed
1336since the device was removed. For arrays with persistent metadata
1337(superblocks) this is done automatically. For arrays created with
1338.B \-\-build
1339mdadm needs to be told that this device we removed recently with
1340.BR \-\-re\-add .
1341
1342Devices can only be removed from an array if they are not in active
1343use, i.e. that must be spares or failed devices. To remove an active
1344device, it must first be marked as
1345.B faulty.
1346
1347.SH For Misc mode:
1348
1349.TP
1350.BR \-Q ", " \-\-query
1351Examine a device to see
1352(1) if it is an md device and (2) if it is a component of an md
1353array.
1354Information about what is discovered is presented.
1355
1356.TP
1357.BR \-D ", " \-\-detail
1358Print details of one or more md devices.
1359
1360.TP
1361.BR \-\-detail\-platform
1362Print details of the platform's RAID capabilities (firmware / hardware
1363topology) for a given metadata format. If used without argument, mdadm
1364will scan all controllers looking for their capabilities. Otherwise, mdadm
1365will only look at the controller specified by the argument in form of an
1366absolute filepath or a link, e.g.
1367.IR /sys/devices/pci0000:00/0000:00:1f.2 .
1368
1369.TP
1370.BR \-Y ", " \-\-export
1371When used with
1372.B \-\-detail , \-\-detail-platform
1373or
1374.BR \-\-examine ,
1375output will be formatted as
1376.B key=value
1377pairs for easy import into the environment.
1378
1379.TP
1380.BR \-E ", " \-\-examine
1381Print contents of the metadata stored on the named device(s).
1382Note the contrast between
1383.B \-\-examine
1384and
1385.BR \-\-detail .
1386.B \-\-examine
1387applies to devices which are components of an array, while
1388.B \-\-detail
1389applies to a whole array which is currently active.
1390.TP
1391.B \-\-sparc2.2
1392If an array was created on a SPARC machine with a 2.2 Linux kernel
1393patched with RAID support, the superblock will have been created
1394incorrectly, or at least incompatibly with 2.4 and later kernels.
1395Using the
1396.B \-\-sparc2.2
1397flag with
1398.B \-\-examine
1399will fix the superblock before displaying it. If this appears to do
1400the right thing, then the array can be successfully assembled using
1401.BR "\-\-assemble \-\-update=sparc2.2" .
1402
1403.TP
1404.BR \-X ", " \-\-examine\-bitmap
1405Report information about a bitmap file.
1406The argument is either an external bitmap file or an array component
1407in case of an internal bitmap. Note that running this on an array
1408device (e.g.
1409.BR /dev/md0 )
1410does not report the bitmap for that array.
1411
1412.TP
1413.BR \-R ", " \-\-run
1414start a partially assembled array. If
1415.B \-\-assemble
1416did not find enough devices to fully start the array, it might leaving
1417it partially assembled. If you wish, you can then use
1418.B \-\-run
1419to start the array in degraded mode.
1420
1421.TP
1422.BR \-S ", " \-\-stop
1423deactivate array, releasing all resources.
1424
1425.TP
1426.BR \-o ", " \-\-readonly
1427mark array as readonly.
1428
1429.TP
1430.BR \-w ", " \-\-readwrite
1431mark array as readwrite.
1432
1433.TP
1434.B \-\-zero\-superblock
1435If the device contains a valid md superblock, the block is
1436overwritten with zeros. With
1437.B \-\-force
1438the block where the superblock would be is overwritten even if it
1439doesn't appear to be valid.
1440
1441.TP
1442.B \-\-kill\-subarray=
1443If the device is a container and the argument to \-\-kill\-subarray
1444specifies an inactive subarray in the container, then the subarray is
1445deleted. Deleting all subarrays will leave an 'empty-container' or
1446spare superblock on the drives. See \-\-zero\-superblock for completely
1447removing a superblock. Note that some formats depend on the subarray
1448index for generating a UUID, this command will fail if it would change
1449the UUID of an active subarray.
1450
1451.TP
1452.B \-\-update\-subarray=
1453If the device is a container and the argument to \-\-update\-subarray
1454specifies a subarray in the container, then attempt to update the given
1455superblock field in the subarray. See below in
1456.B MISC MODE
1457for details.
1458
1459.TP
1460.BR \-t ", " \-\-test
1461When used with
1462.BR \-\-detail ,
1463the exit status of
1464.I mdadm
1465is set to reflect the status of the device. See below in
1466.B MISC MODE
1467for details.
1468
1469.TP
1470.BR \-W ", " \-\-wait
1471For each md device given, wait for any resync, recovery, or reshape
1472activity to finish before returning.
1473.I mdadm
1474will return with success if it actually waited for every device
1475listed, otherwise it will return failure.
1476
1477.TP
1478.BR \-\-wait\-clean
1479For each md device given, or each device in /proc/mdstat if
1480.B \-\-scan
1481is given, arrange for the array to be marked clean as soon as possible.
1482.I mdadm
1483will return with success if the array uses external metadata and we
1484successfully waited. For native arrays this returns immediately as the
1485kernel handles dirty-clean transitions at shutdown. No action is taken
1486if safe-mode handling is disabled.
1487
1488.SH For Incremental Assembly mode:
1489.TP
1490.BR \-\-rebuild\-map ", " \-r
1491Rebuild the map file
1492.RB ( {MAP_PATH} )
1493that
1494.I mdadm
1495uses to help track which arrays are currently being assembled.
1496
1497.TP
1498.BR \-\-run ", " \-R
1499Run any array assembled as soon as a minimal number of devices are
1500available, rather than waiting until all expected devices are present.
1501
1502.TP
1503.BR \-\-scan ", " \-s
1504Only meaningful with
1505.B \-R
1506this will scan the
1507.B map
1508file for arrays that are being incrementally assembled and will try to
1509start any that are not already started. If any such array is listed
1510in
1511.B mdadm.conf
1512as requiring an external bitmap, that bitmap will be attached first.
1513
1514.TP
1515.BR \-\-fail ", " \-f
1516This allows the hot-plug system to remove devices that have fully disappeared
1517from the kernel. It will first fail and then remove the device from any
1518array it belongs to.
1519The device name given should be a kernel device name such as "sda",
1520not a name in
1521.IR /dev .
1522
1523.TP
1524.BR \-\-path=
1525Only used with \-\-fail. The 'path' given will be recorded so that if
1526a new device appears at the same location it can be automatically
1527added to the same array. This allows the failed device to be
1528automatically replaced by a new device without metadata if it appears
1529at specified path. This option is normally only set by a
1530.I udev
1531script.
1532
1533.SH For Monitor mode:
1534.TP
1535.BR \-m ", " \-\-mail
1536Give a mail address to send alerts to.
1537
1538.TP
1539.BR \-p ", " \-\-program ", " \-\-alert
1540Give a program to be run whenever an event is detected.
1541
1542.TP
1543.BR \-y ", " \-\-syslog
1544Cause all events to be reported through 'syslog'. The messages have
1545facility of 'daemon' and varying priorities.
1546
1547.TP
1548.BR \-d ", " \-\-delay
1549Give a delay in seconds.
1550.I mdadm
1551polls the md arrays and then waits this many seconds before polling
1552again. The default is 60 seconds. Since 2.6.16, there is no need to
1553reduce this as the kernel alerts
1554.I mdadm
1555immediately when there is any change.
1556
1557.TP
1558.BR \-r ", " \-\-increment
1559Give a percentage increment.
1560.I mdadm
1561will generate RebuildNN events with the given percentage increment.
1562
1563.TP
1564.BR \-f ", " \-\-daemonise
1565Tell
1566.I mdadm
1567to run as a background daemon if it decides to monitor anything. This
1568causes it to fork and run in the child, and to disconnect from the
1569terminal. The process id of the child is written to stdout.
1570This is useful with
1571.B \-\-scan
1572which will only continue monitoring if a mail address or alert program
1573is found in the config file.
1574
1575.TP
1576.BR \-i ", " \-\-pid\-file
1577When
1578.I mdadm
1579is running in daemon mode, write the pid of the daemon process to
1580the specified file, instead of printing it on standard output.
1581
1582.TP
1583.BR \-1 ", " \-\-oneshot
1584Check arrays only once. This will generate
1585.B NewArray
1586events and more significantly
1587.B DegradedArray
1588and
1589.B SparesMissing
1590events. Running
1591.in +5
1592.B " mdadm \-\-monitor \-\-scan \-1"
1593.in -5
1594from a cron script will ensure regular notification of any degraded arrays.
1595
1596.TP
1597.BR \-t ", " \-\-test
1598Generate a
1599.B TestMessage
1600alert for every array found at startup. This alert gets mailed and
1601passed to the alert program. This can be used for testing that alert
1602message do get through successfully.
1603
1604.TP
1605.BR \-\-no\-sharing
1606This inhibits the functionality for moving spares between arrays.
1607Only one monitoring process started with
1608.B \-\-scan
1609but without this flag is allowed, otherwise the two could interfere
1610with each other.
1611
1612.SH ASSEMBLE MODE
1613
1614.HP 12
1615Usage:
1616.B mdadm \-\-assemble
1617.I md-device options-and-component-devices...
1618.HP 12
1619Usage:
1620.B mdadm \-\-assemble \-\-scan
1621.I md-devices-and-options...
1622.HP 12
1623Usage:
1624.B mdadm \-\-assemble \-\-scan
1625.I options...
1626
1627.PP
1628This usage assembles one or more RAID arrays from pre-existing components.
1629For each array, mdadm needs to know the md device, the identity of the
1630array, and a number of component-devices. These can be found in a number of ways.
1631
1632In the first usage example (without the
1633.BR \-\-scan )
1634the first device given is the md device.
1635In the second usage example, all devices listed are treated as md
1636devices and assembly is attempted.
1637In the third (where no devices are listed) all md devices that are
1638listed in the configuration file are assembled. If no arrays are
1639described by the configuration file, then any arrays that
1640can be found on unused devices will be assembled.
1641
1642If precisely one device is listed, but
1643.B \-\-scan
1644is not given, then
1645.I mdadm
1646acts as though
1647.B \-\-scan
1648was given and identity information is extracted from the configuration file.
1649
1650The identity can be given with the
1651.B \-\-uuid
1652option, the
1653.B \-\-name
1654option, or the
1655.B \-\-super\-minor
1656option, will be taken from the md-device record in the config file, or
1657will be taken from the super block of the first component-device
1658listed on the command line.
1659
1660Devices can be given on the
1661.B \-\-assemble
1662command line or in the config file. Only devices which have an md
1663superblock which contains the right identity will be considered for
1664any array.
1665
1666The config file is only used if explicitly named with
1667.B \-\-config
1668or requested with (a possibly implicit)
1669.BR \-\-scan .
1670In the later case,
1671.B /etc/mdadm.conf
1672or
1673.B /etc/mdadm/mdadm.conf
1674is used.
1675
1676If
1677.B \-\-scan
1678is not given, then the config file will only be used to find the
1679identity of md arrays.
1680
1681Normally the array will be started after it is assembled. However if
1682.B \-\-scan
1683is not given and not all expected drives were listed, then the array
1684is not started (to guard against usage errors). To insist that the
1685array be started in this case (as may work for RAID1, 4, 5, 6, or 10),
1686give the
1687.B \-\-run
1688flag.
1689
1690If
1691.I udev
1692is active,
1693.I mdadm
1694does not create any entries in
1695.B /dev
1696but leaves that to
1697.IR udev .
1698It does record information in
1699.B {MAP_PATH}
1700which will allow
1701.I udev
1702to choose the correct name.
1703
1704If
1705.I mdadm
1706detects that udev is not configured, it will create the devices in
1707.B /dev
1708itself.
1709
1710In Linux kernels prior to version 2.6.28 there were two distinctly
1711different types of md devices that could be created: one that could be
1712partitioned using standard partitioning tools and one that could not.
1713Since 2.6.28 that distinction is no longer relevant as both type of
1714devices can be partitioned.
1715.I mdadm
1716will normally create the type that originally could not be partitioned
1717as it has a well defined major number (9).
1718
1719Prior to 2.6.28, it is important that mdadm chooses the correct type
1720of array device to use. This can be controlled with the
1721.B \-\-auto
1722option. In particular, a value of "mdp" or "part" or "p" tells mdadm
1723to use a partitionable device rather than the default.
1724
1725In the no-udev case, the value given to
1726.B \-\-auto
1727can be suffixed by a number. This tells
1728.I mdadm
1729to create that number of partition devices rather than the default of 4.
1730
1731The value given to
1732.B \-\-auto
1733can also be given in the configuration file as a word starting
1734.B auto=
1735on the ARRAY line for the relevant array.
1736
1737.SS Auto Assembly
1738When
1739.B \-\-assemble
1740is used with
1741.B \-\-scan
1742and no devices are listed,
1743.I mdadm
1744will first attempt to assemble all the arrays listed in the config
1745file.
1746
1747If no arrays are listed in the config (other than those marked
1748.BR <ignore> )
1749it will look through the available devices for possible arrays and
1750will try to assemble anything that it finds. Arrays which are tagged
1751as belonging to the given homehost will be assembled and started
1752normally. Arrays which do not obviously belong to this host are given
1753names that are expected not to conflict with anything local, and are
1754started "read-auto" so that nothing is written to any device until the
1755array is written to. i.e. automatic resync etc is delayed.
1756
1757If
1758.I mdadm
1759finds a consistent set of devices that look like they should comprise
1760an array, and if the superblock is tagged as belonging to the given
1761home host, it will automatically choose a device name and try to
1762assemble the array. If the array uses version-0.90 metadata, then the
1763.B minor
1764number as recorded in the superblock is used to create a name in
1765.B /dev/md/
1766so for example
1767.BR /dev/md/3 .
1768If the array uses version-1 metadata, then the
1769.B name
1770from the superblock is used to similarly create a name in
1771.B /dev/md/
1772(the name will have any 'host' prefix stripped first).
1773
1774This behaviour can be modified by the
1775.I AUTO
1776line in the
1777.I mdadm.conf
1778configuration file. This line can indicate that specific metadata
1779type should, or should not, be automatically assembled. If an array
1780is found which is not listed in
1781.I mdadm.conf
1782and has a metadata format that is denied by the
1783.I AUTO
1784line, then it will not be assembled.
1785The
1786.I AUTO
1787line can also request that all arrays identified as being for this
1788homehost should be assembled regardless of their metadata type.
1789See
1790.IR mdadm.conf (5)
1791for further details.
1792
1793Note: Auto assembly cannot be used for assembling and activating some
1794arrays which are undergoing reshape. In particular as the
1795.B backup\-file
1796cannot be given, any reshape which requires a backup-file to continue
1797cannot be started by auto assembly. An array which is growing to more
1798devices and has passed the critical section can be assembled using
1799auto-assembly.
1800
1801.SH BUILD MODE
1802
1803.HP 12
1804Usage:
1805.B mdadm \-\-build
1806.I md-device
1807.BI \-\-chunk= X
1808.BI \-\-level= Y
1809.BI \-\-raid\-devices= Z
1810.I devices
1811
1812.PP
1813This usage is similar to
1814.BR \-\-create .
1815The difference is that it creates an array without a superblock. With
1816these arrays there is no difference between initially creating the array and
1817subsequently assembling the array, except that hopefully there is useful
1818data there in the second case.
1819
1820The level may raid0, linear, raid1, raid10, multipath, or faulty, or
1821one of their synonyms. All devices must be listed and the array will
1822be started once complete. It will often be appropriate to use
1823.B \-\-assume\-clean
1824with levels raid1 or raid10.
1825
1826.SH CREATE MODE
1827
1828.HP 12
1829Usage:
1830.B mdadm \-\-create
1831.I md-device
1832.BI \-\-chunk= X
1833.BI \-\-level= Y
1834.br
1835.BI \-\-raid\-devices= Z
1836.I devices
1837
1838.PP
1839This usage will initialise a new md array, associate some devices with
1840it, and activate the array.
1841
1842The named device will normally not exist when
1843.I "mdadm \-\-create"
1844is run, but will be created by
1845.I udev
1846once the array becomes active.
1847
1848As devices are added, they are checked to see if they contain RAID
1849superblocks or filesystems. They are also checked to see if the variance in
1850device size exceeds 1%.
1851
1852If any discrepancy is found, the array will not automatically be run, though
1853the presence of a
1854.B \-\-run
1855can override this caution.
1856
1857To create a "degraded" array in which some devices are missing, simply
1858give the word "\fBmissing\fP"
1859in place of a device name. This will cause
1860.I mdadm
1861to leave the corresponding slot in the array empty.
1862For a RAID4 or RAID5 array at most one slot can be
1863"\fBmissing\fP"; for a RAID6 array at most two slots.
1864For a RAID1 array, only one real device needs to be given. All of the
1865others can be
1866"\fBmissing\fP".
1867
1868When creating a RAID5 array,
1869.I mdadm
1870will automatically create a degraded array with an extra spare drive.
1871This is because building the spare into a degraded array is in general
1872faster than resyncing the parity on a non-degraded, but not clean,
1873array. This feature can be overridden with the
1874.B \-\-force
1875option.
1876
1877When creating an array with version-1 metadata a name for the array is
1878required.
1879If this is not given with the
1880.B \-\-name
1881option,
1882.I mdadm
1883will choose a name based on the last component of the name of the
1884device being created. So if
1885.B /dev/md3
1886is being created, then the name
1887.B 3
1888will be chosen.
1889If
1890.B /dev/md/home
1891is being created, then the name
1892.B home
1893will be used.
1894
1895When creating a partition based array, using
1896.I mdadm
1897with version-1.x metadata, the partition type should be set to
1898.B 0xDA
1899(non fs-data). This type selection allows for greater precision since
1900using any other [RAID auto-detect (0xFD) or a GNU/Linux partition (0x83)],
1901might create problems in the event of array recovery through a live cdrom.
1902
1903A new array will normally get a randomly assigned 128bit UUID which is
1904very likely to be unique. If you have a specific need, you can choose
1905a UUID for the array by giving the
1906.B \-\-uuid=
1907option. Be warned that creating two arrays with the same UUID is a
1908recipe for disaster. Also, using
1909.B \-\-uuid=
1910when creating a v0.90 array will silently override any
1911.B \-\-homehost=
1912setting.
1913.\"If the
1914.\".B \-\-size
1915.\"option is given, it is not necessary to list any component-devices in this command.
1916.\"They can be added later, before a
1917.\".B \-\-run.
1918.\"If no
1919.\".B \-\-size
1920.\"is given, the apparent size of the smallest drive given is used.
1921
1922If the metadata type supports it (currently only 1.x metadata), space
1923will be allocated to store a bad block list. This allows a modest
1924number of bad blocks to be recorded, allowing the drive to remain in
1925service while only partially functional.
1926
1927When creating an array within a
1928.B CONTAINER
1929.I mdadm
1930can be given either the list of devices to use, or simply the name of
1931the container. The former case gives control over which devices in
1932the container will be used for the array. The latter case allows
1933.I mdadm
1934to automatically choose which devices to use based on how much spare
1935space is available.
1936
1937The General Management options that are valid with
1938.B \-\-create
1939are:
1940.TP
1941.B \-\-run
1942insist on running the array even if some devices look like they might
1943be in use.
1944
1945.TP
1946.B \-\-readonly
1947start the array readonly \(em not supported yet.
1948
1949.SH MANAGE MODE
1950.HP 12
1951Usage:
1952.B mdadm
1953.I device
1954.I options... devices...
1955.PP
1956
1957This usage will allow individual devices in an array to be failed,
1958removed or added. It is possible to perform multiple operations with
1959on command. For example:
1960.br
1961.B " mdadm /dev/md0 \-f /dev/hda1 \-r /dev/hda1 \-a /dev/hda1"
1962.br
1963will firstly mark
1964.B /dev/hda1
1965as faulty in
1966.B /dev/md0
1967and will then remove it from the array and finally add it back
1968in as a spare. However only one md array can be affected by a single
1969command.
1970
1971When a device is added to an active array, mdadm checks to see if it
1972has metadata on it which suggests that it was recently a member of the
1973array. If it does, it tries to "re\-add" the device. If there have
1974been no changes since the device was removed, or if the array has a
1975write-intent bitmap which has recorded whatever changes there were,
1976then the device will immediately become a full member of the array and
1977those differences recorded in the bitmap will be resolved.
1978
1979.SH MISC MODE
1980.HP 12
1981Usage:
1982.B mdadm
1983.I options ...
1984.I devices ...
1985.PP
1986
1987MISC mode includes a number of distinct operations that
1988operate on distinct devices. The operations are:
1989.TP
1990.B \-\-query
1991The device is examined to see if it is
1992(1) an active md array, or
1993(2) a component of an md array.
1994The information discovered is reported.
1995
1996.TP
1997.B \-\-detail
1998The device should be an active md device.
1999.B mdadm
2000will display a detailed description of the array.
2001.B \-\-brief
2002or
2003.B \-\-scan
2004will cause the output to be less detailed and the format to be
2005suitable for inclusion in
2006.BR mdadm.conf .
2007The exit status of
2008.I mdadm
2009will normally be 0 unless
2010.I mdadm
2011failed to get useful information about the device(s); however, if the
2012.B \-\-test
2013option is given, then the exit status will be:
2014.RS
2015.TP
20160
2017The array is functioning normally.
2018.TP
20191
2020The array has at least one failed device.
2021.TP
20222
2023The array has multiple failed devices such that it is unusable.
2024.TP
20254
2026There was an error while trying to get information about the device.
2027.RE
2028
2029.TP
2030.B \-\-detail\-platform
2031Print detail of the platform's RAID capabilities (firmware / hardware
2032topology). If the metadata is specified with
2033.B \-e
2034or
2035.B \-\-metadata=
2036then the return status will be:
2037.RS
2038.TP
20390
2040metadata successfully enumerated its platform components on this system
2041.TP
20421
2043metadata is platform independent
2044.TP
20452
2046metadata failed to find its platform components on this system
2047.RE
2048
2049.TP
2050.B \-\-update\-subarray=
2051If the device is a container and the argument to \-\-update\-subarray
2052specifies a subarray in the container, then attempt to update the given
2053superblock field in the subarray. Similar to updating an array in
2054"assemble" mode, the field to update is selected by
2055.B \-U
2056or
2057.B \-\-update=
2058option. Currently only
2059.B name
2060is supported.
2061
2062The
2063.B name
2064option updates the subarray name in the metadata, it may not affect the
2065device node name or the device node symlink until the subarray is
2066re\-assembled. If updating
2067.B name
2068would change the UUID of an active subarray this operation is blocked,
2069and the command will end in an error.
2070
2071.TP
2072.B \-\-examine
2073The device should be a component of an md array.
2074.I mdadm
2075will read the md superblock of the device and display the contents.
2076If
2077.B \-\-brief
2078or
2079.B \-\-scan
2080is given, then multiple devices that are components of the one array
2081are grouped together and reported in a single entry suitable
2082for inclusion in
2083.BR mdadm.conf .
2084
2085Having
2086.B \-\-scan
2087without listing any devices will cause all devices listed in the
2088config file to be examined.
2089
2090.TP
2091.B \-\-stop
2092The devices should be active md arrays which will be deactivated, as
2093long as they are not currently in use.
2094
2095.TP
2096.B \-\-run
2097This will fully activate a partially assembled md array.
2098
2099.TP
2100.B \-\-readonly
2101This will mark an active array as read-only, providing that it is
2102not currently being used.
2103
2104.TP
2105.B \-\-readwrite
2106This will change a
2107.B readonly
2108array back to being read/write.
2109
2110.TP
2111.B \-\-scan
2112For all operations except
2113.BR \-\-examine ,
2114.B \-\-scan
2115will cause the operation to be applied to all arrays listed in
2116.BR /proc/mdstat .
2117For
2118.BR \-\-examine,
2119.B \-\-scan
2120causes all devices listed in the config file to be examined.
2121
2122.TP
2123.BR \-b ", " \-\-brief
2124Be less verbose. This is used with
2125.B \-\-detail
2126and
2127.BR \-\-examine .
2128Using
2129.B \-\-brief
2130with
2131.B \-\-verbose
2132gives an intermediate level of verbosity.
2133
2134.SH MONITOR MODE
2135
2136.HP 12
2137Usage:
2138.B mdadm \-\-monitor
2139.I options... devices...
2140
2141.PP
2142This usage causes
2143.I mdadm
2144to periodically poll a number of md arrays and to report on any events
2145noticed.
2146.I mdadm
2147will never exit once it decides that there are arrays to be checked,
2148so it should normally be run in the background.
2149
2150As well as reporting events,
2151.I mdadm
2152may move a spare drive from one array to another if they are in the
2153same
2154.B spare-group
2155or
2156.B domain
2157and if the destination array has a failed drive but no spares.
2158
2159If any devices are listed on the command line,
2160.I mdadm
2161will only monitor those devices. Otherwise all arrays listed in the
2162configuration file will be monitored. Further, if
2163.B \-\-scan
2164is given, then any other md devices that appear in
2165.B /proc/mdstat
2166will also be monitored.
2167
2168The result of monitoring the arrays is the generation of events.
2169These events are passed to a separate program (if specified) and may
2170be mailed to a given E-mail address.
2171
2172When passing events to a program, the program is run once for each event,
2173and is given 2 or 3 command-line arguments: the first is the
2174name of the event (see below), the second is the name of the
2175md device which is affected, and the third is the name of a related
2176device if relevant (such as a component device that has failed).
2177
2178If
2179.B \-\-scan
2180is given, then a program or an E-mail address must be specified on the
2181command line or in the config file. If neither are available, then
2182.I mdadm
2183will not monitor anything.
2184Without
2185.B \-\-scan,
2186.I mdadm
2187will continue monitoring as long as something was found to monitor. If
2188no program or email is given, then each event is reported to
2189.BR stdout .
2190
2191The different events are:
2192
2193.RS 4
2194.TP
2195.B DeviceDisappeared
2196An md array which previously was configured appears to no longer be
2197configured. (syslog priority: Critical)
2198
2199If
2200.I mdadm
2201was told to monitor an array which is RAID0 or Linear, then it will
2202report
2203.B DeviceDisappeared
2204with the extra information
2205.BR Wrong-Level .
2206This is because RAID0 and Linear do not support the device-failed,
2207hot-spare and resync operations which are monitored.
2208
2209.TP
2210.B RebuildStarted
2211An md array started reconstruction. (syslog priority: Warning)
2212
2213.TP
2214.BI Rebuild NN
2215Where
2216.I NN
2217is a two-digit number (ie. 05, 48). This indicates that rebuild
2218has passed that many percent of the total. The events are generated
2219with fixed increment since 0. Increment size may be specified with
2220a commandline option (default is 20). (syslog priority: Warning)
2221
2222.TP
2223.B RebuildFinished
2224An md array that was rebuilding, isn't any more, either because it
2225finished normally or was aborted. (syslog priority: Warning)
2226
2227.TP
2228.B Fail
2229An active component device of an array has been marked as
2230faulty. (syslog priority: Critical)
2231
2232.TP
2233.B FailSpare
2234A spare component device which was being rebuilt to replace a faulty
2235device has failed. (syslog priority: Critical)
2236
2237.TP
2238.B SpareActive
2239A spare component device which was being rebuilt to replace a faulty
2240device has been successfully rebuilt and has been made active.
2241(syslog priority: Info)
2242
2243.TP
2244.B NewArray
2245A new md array has been detected in the
2246.B /proc/mdstat
2247file. (syslog priority: Info)
2248
2249.TP
2250.B DegradedArray
2251A newly noticed array appears to be degraded. This message is not
2252generated when
2253.I mdadm
2254notices a drive failure which causes degradation, but only when
2255.I mdadm
2256notices that an array is degraded when it first sees the array.
2257(syslog priority: Critical)
2258
2259.TP
2260.B MoveSpare
2261A spare drive has been moved from one array in a
2262.B spare-group
2263or
2264.B domain
2265to another to allow a failed drive to be replaced.
2266(syslog priority: Info)
2267
2268.TP
2269.B SparesMissing
2270If
2271.I mdadm
2272has been told, via the config file, that an array should have a certain
2273number of spare devices, and
2274.I mdadm
2275detects that it has fewer than this number when it first sees the
2276array, it will report a
2277.B SparesMissing
2278message.
2279(syslog priority: Warning)
2280
2281.TP
2282.B TestMessage
2283An array was found at startup, and the
2284.B \-\-test
2285flag was given.
2286(syslog priority: Info)
2287.RE
2288
2289Only
2290.B Fail,
2291.B FailSpare,
2292.B DegradedArray,
2293.B SparesMissing
2294and
2295.B TestMessage
2296cause Email to be sent. All events cause the program to be run.
2297The program is run with two or three arguments: the event
2298name, the array device and possibly a second device.
2299
2300Each event has an associated array device (e.g.
2301.BR /dev/md1 )
2302and possibly a second device. For
2303.BR Fail ,
2304.BR FailSpare ,
2305and
2306.B SpareActive
2307the second device is the relevant component device.
2308For
2309.B MoveSpare
2310the second device is the array that the spare was moved from.
2311
2312For
2313.I mdadm
2314to move spares from one array to another, the different arrays need to
2315be labeled with the same
2316.B spare-group
2317or the spares must be allowed to migrate through matching POLICY domains
2318in the configuration file. The
2319.B spare-group
2320name can be any string; it is only necessary that different spare
2321groups use different names.
2322
2323When
2324.I mdadm
2325detects that an array in a spare group has fewer active
2326devices than necessary for the complete array, and has no spare
2327devices, it will look for another array in the same spare group that
2328has a full complement of working drive and a spare. It will then
2329attempt to remove the spare from the second drive and add it to the
2330first.
2331If the removal succeeds but the adding fails, then it is added back to
2332the original array.
2333
2334If the spare group for a degraded array is not defined,
2335.I mdadm
2336will look at the rules of spare migration specified by POLICY lines in
2337.B mdadm.conf
2338and then follow similar steps as above if a matching spare is found.
2339
2340.SH GROW MODE
2341The GROW mode is used for changing the size or shape of an active
2342array.
2343For this to work, the kernel must support the necessary change.
2344Various types of growth are being added during 2.6 development.
2345
2346Currently the supported changes include
2347.IP \(bu 4
2348change the "size" attribute for RAID1, RAID4, RAID5 and RAID6.
2349.IP \(bu 4
2350increase or decrease the "raid\-devices" attribute of RAID0, RAID1, RAID4,
2351RAID5, and RAID6.
2352.IP \(bu 4
2353change the chunk-size and layout of RAID0, RAID4, RAID5 and RAID6.
2354.IP \(bu 4
2355convert between RAID1 and RAID5, between RAID5 and RAID6, between
2356RAID0, RAID4, and RAID5, and between RAID0 and RAID10 (in the near-2 mode).
2357.IP \(bu 4
2358add a write-intent bitmap to any array which supports these bitmaps, or
2359remove a write-intent bitmap from such an array.
2360.PP
2361
2362Using GROW on containers is currently supported only for Intel's IMSM
2363container format. The number of devices in a container can be
2364increased - which affects all arrays in the container - or an array
2365in a container can be converted between levels where those levels are
2366supported by the container, and the conversion is on of those listed
2367above. Resizing arrays in an IMSM container with
2368.B "--grow --size"
2369is not yet supported.
2370
2371Grow functionality (e.g. expand a number of raid devices) for Intel's
2372IMSM container format has an experimental status. It is guarded by the
2373.B MDADM_EXPERIMENTAL
2374environment variable which must be set to '1' for a GROW command to
2375succeed.
2376This is for the following reasons:
2377
2378.IP 1.
2379Intel's native IMSM check-pointing is not fully tested yet.
2380This can causes IMSM incompatibility during the grow process: an array
2381which is growing cannot roam between Microsoft Windows(R) and Linux
2382systems.
2383
2384.IP 2.
2385Interrupting a grow operation is not recommended, because it
2386has not been fully tested for Intel's IMSM container format yet.
2387
2388.PP
2389Note: Intel's native checkpointing doesn't use
2390.B --backup-file
2391option and it is transparent for assembly feature.
2392
2393.SS SIZE CHANGES
2394Normally when an array is built the "size" is taken from the smallest
2395of the drives. If all the small drives in an arrays are, one at a
2396time, removed and replaced with larger drives, then you could have an
2397array of large drives with only a small amount used. In this
2398situation, changing the "size" with "GROW" mode will allow the extra
2399space to start being used. If the size is increased in this way, a
2400"resync" process will start to make sure the new parts of the array
2401are synchronised.
2402
2403Note that when an array changes size, any filesystem that may be
2404stored in the array will not automatically grow or shrink to use or
2405vacate the space. The
2406filesystem will need to be explicitly told to use the extra space
2407after growing, or to reduce its size
2408.B prior
2409to shrinking the array.
2410
2411Also the size of an array cannot be changed while it has an active
2412bitmap. If an array has a bitmap, it must be removed before the size
2413can be changed. Once the change is complete a new bitmap can be created.
2414
2415.SS RAID\-DEVICES CHANGES
2416
2417A RAID1 array can work with any number of devices from 1 upwards
2418(though 1 is not very useful). There may be times which you want to
2419increase or decrease the number of active devices. Note that this is
2420different to hot-add or hot-remove which changes the number of
2421inactive devices.
2422
2423When reducing the number of devices in a RAID1 array, the slots which
2424are to be removed from the array must already be vacant. That is, the
2425devices which were in those slots must be failed and removed.
2426
2427When the number of devices is increased, any hot spares that are
2428present will be activated immediately.
2429
2430Changing the number of active devices in a RAID5 or RAID6 is much more
2431effort. Every block in the array will need to be read and written
2432back to a new location. From 2.6.17, the Linux Kernel is able to
2433increase the number of devices in a RAID5 safely, including restarting
2434an interrupted "reshape". From 2.6.31, the Linux Kernel is able to
2435increase or decrease the number of devices in a RAID5 or RAID6.
2436
2437From 2.6.35, the Linux Kernel is able to convert a RAID0 in to a RAID4
2438or RAID5.
2439.I mdadm
2440uses this functionality and the ability to add
2441devices to a RAID4 to allow devices to be added to a RAID0. When
2442requested to do this,
2443.I mdadm
2444will convert the RAID0 to a RAID4, add the necessary disks and make
2445the reshape happen, and then convert the RAID4 back to RAID0.
2446
2447When decreasing the number of devices, the size of the array will also
2448decrease. If there was data in the array, it could get destroyed and
2449this is not reversible, so you should firstly shrink the filesystem on
2450the array to fit within the new size. To help prevent accidents,
2451.I mdadm
2452requires that the size of the array be decreased first with
2453.BR "mdadm --grow --array-size" .
2454This is a reversible change which simply makes the end of the array
2455inaccessible. The integrity of any data can then be checked before
2456the non-reversible reduction in the number of devices is request.
2457
2458When relocating the first few stripes on a RAID5 or RAID6, it is not
2459possible to keep the data on disk completely consistent and
2460crash-proof. To provide the required safety, mdadm disables writes to
2461the array while this "critical section" is reshaped, and takes a
2462backup of the data that is in that section. For grows, this backup may be
2463stored in any spare devices that the array has, however it can also be
2464stored in a separate file specified with the
2465.B \-\-backup\-file
2466option, and is required to be specified for shrinks, RAID level
2467changes and layout changes. If this option is used, and the system
2468does crash during the critical period, the same file must be passed to
2469.B \-\-assemble
2470to restore the backup and reassemble the array. When shrinking rather
2471than growing the array, the reshape is done from the end towards the
2472beginning, so the "critical section" is at the end of the reshape.
2473
2474.SS LEVEL CHANGES
2475
2476Changing the RAID level of any array happens instantaneously. However
2477in the RAID5 to RAID6 case this requires a non-standard layout of the
2478RAID6 data, and in the RAID6 to RAID5 case that non-standard layout is
2479required before the change can be accomplished. So while the level
2480change is instant, the accompanying layout change can take quite a
2481long time. A
2482.B \-\-backup\-file
2483is required. If the array is not simultaneously being grown or
2484shrunk, so that the array size will remain the same - for example,
2485reshaping a 3-drive RAID5 into a 4-drive RAID6 - the backup file will
2486be used not just for a "cricital section" but throughout the reshape
2487operation, as described below under LAYOUT CHANGES.
2488
2489.SS CHUNK-SIZE AND LAYOUT CHANGES
2490
2491Changing the chunk-size of layout without also changing the number of
2492devices as the same time will involve re-writing all blocks in-place.
2493To ensure against data loss in the case of a crash, a
2494.B --backup-file
2495must be provided for these changes. Small sections of the array will
2496be copied to the backup file while they are being rearranged. This
2497means that all the data is copied twice, once to the backup and once
2498to the new layout on the array, so this type of reshape will go very
2499slowly.
2500
2501If the reshape is interrupted for any reason, this backup file must be
2502made available to
2503.B "mdadm --assemble"
2504so the array can be reassembled. Consequently the file cannot be
2505stored on the device being reshaped.
2506
2507
2508.SS BITMAP CHANGES
2509
2510A write-intent bitmap can be added to, or removed from, an active
2511array. Either internal bitmaps, or bitmaps stored in a separate file,
2512can be added. Note that if you add a bitmap stored in a file which is
2513in a filesystem that is on the RAID array being affected, the system
2514will deadlock. The bitmap must be on a separate filesystem.
2515
2516.SH INCREMENTAL MODE
2517
2518.HP 12
2519Usage:
2520.B mdadm \-\-incremental
2521.RB [ \-\-run ]
2522.RB [ \-\-quiet ]
2523.I component-device
2524.HP 12
2525Usage:
2526.B mdadm \-\-incremental \-\-fail
2527.I component-device
2528.HP 12
2529Usage:
2530.B mdadm \-\-incremental \-\-rebuild\-map
2531.HP 12
2532Usage:
2533.B mdadm \-\-incremental \-\-run \-\-scan
2534
2535.PP
2536This mode is designed to be used in conjunction with a device
2537discovery system. As devices are found in a system, they can be
2538passed to
2539.B "mdadm \-\-incremental"
2540to be conditionally added to an appropriate array.
2541
2542Conversely, it can also be used with the
2543.B \-\-fail
2544flag to do just the opposite and find whatever array a particular device
2545is part of and remove the device from that array.
2546
2547If the device passed is a
2548.B CONTAINER
2549device created by a previous call to
2550.IR mdadm ,
2551then rather than trying to add that device to an array, all the arrays
2552described by the metadata of the container will be started.
2553
2554.I mdadm
2555performs a number of tests to determine if the device is part of an
2556array, and which array it should be part of. If an appropriate array
2557is found, or can be created,
2558.I mdadm
2559adds the device to the array and conditionally starts the array.
2560
2561Note that
2562.I mdadm
2563will normally only add devices to an array which were previously working
2564(active or spare) parts of that array. The support for automatic
2565inclusion of a new drive as a spare in some array requires
2566a configuration through POLICY in config file.
2567
2568The tests that
2569.I mdadm
2570makes are as follow:
2571.IP +
2572Is the device permitted by
2573.BR mdadm.conf ?
2574That is, is it listed in a
2575.B DEVICES
2576line in that file. If
2577.B DEVICES
2578is absent then the default it to allow any device. Similar if
2579.B DEVICES
2580contains the special word
2581.B partitions
2582then any device is allowed. Otherwise the device name given to
2583.I mdadm
2584must match one of the names or patterns in a
2585.B DEVICES
2586line.
2587
2588.IP +
2589Does the device have a valid md superblock? If a specific metadata
2590version is requested with
2591.B \-\-metadata
2592or
2593.B \-e
2594then only that style of metadata is accepted, otherwise
2595.I mdadm
2596finds any known version of metadata. If no
2597.I md
2598metadata is found, the device may be still added to an array
2599as a spare if POLICY allows.
2600
2601.ig
2602.IP +
2603Does the metadata match an expected array?
2604The metadata can match in two ways. Either there is an array listed
2605in
2606.B mdadm.conf
2607which identifies the array (either by UUID, by name, by device list,
2608or by minor-number), or the array was created with a
2609.B homehost
2610specified and that
2611.B homehost
2612matches the one in
2613.B mdadm.conf
2614or on the command line.
2615If
2616.I mdadm
2617is not able to positively identify the array as belonging to the
2618current host, the device will be rejected.
2619..
2620
2621.PP
2622.I mdadm
2623keeps a list of arrays that it has partially assembled in
2624.BR {MAP_PATH} .
2625If no array exists which matches
2626the metadata on the new device,
2627.I mdadm
2628must choose a device name and unit number. It does this based on any
2629name given in
2630.B mdadm.conf
2631or any name information stored in the metadata. If this name
2632suggests a unit number, that number will be used, otherwise a free
2633unit number will be chosen. Normally
2634.I mdadm
2635will prefer to create a partitionable array, however if the
2636.B CREATE
2637line in
2638.B mdadm.conf
2639suggests that a non-partitionable array is preferred, that will be
2640honoured.
2641
2642If the array is not found in the config file and its metadata does not
2643identify it as belonging to the "homehost", then
2644.I mdadm
2645will choose a name for the array which is certain not to conflict with
2646any array which does belong to this host. It does this be adding an
2647underscore and a small number to the name preferred by the metadata.
2648
2649Once an appropriate array is found or created and the device is added,
2650.I mdadm
2651must decide if the array is ready to be started. It will
2652normally compare the number of available (non-spare) devices to the
2653number of devices that the metadata suggests need to be active. If
2654there are at least that many, the array will be started. This means
2655that if any devices are missing the array will not be restarted.
2656
2657As an alternative,
2658.B \-\-run
2659may be passed to
2660.I mdadm
2661in which case the array will be run as soon as there are enough
2662devices present for the data to be accessible. For a RAID1, that
2663means one device will start the array. For a clean RAID5, the array
2664will be started as soon as all but one drive is present.
2665
2666Note that neither of these approaches is really ideal. If it can
2667be known that all device discovery has completed, then
2668.br
2669.B " mdadm \-IRs"
2670.br
2671can be run which will try to start all arrays that are being
2672incrementally assembled. They are started in "read-auto" mode in
2673which they are read-only until the first write request. This means
2674that no metadata updates are made and no attempt at resync or recovery
2675happens. Further devices that are found before the first write can
2676still be added safely.
2677
2678.SH ENVIRONMENT
2679This section describes environment variables that affect how mdadm
2680operates.
2681
2682.TP
2683.B MDADM_NO_MDMON
2684Setting this value to 1 will prevent mdadm from automatically launching
2685mdmon. This variable is intended primarily for debugging mdadm/mdmon.
2686
2687.TP
2688.B MDADM_NO_UDEV
2689Normally,
2690.I mdadm
2691does not create any device nodes in /dev, but leaves that task to
2692.IR udev .
2693If
2694.I udev
2695appears not to be configured, or if this environment variable is set
2696to '1', the
2697.I mdadm
2698will create and devices that are needed.
2699
2700.SH EXAMPLES
2701
2702.B " mdadm \-\-query /dev/name-of-device"
2703.br
2704This will find out if a given device is a RAID array, or is part of
2705one, and will provide brief information about the device.
2706
2707.B " mdadm \-\-assemble \-\-scan"
2708.br
2709This will assemble and start all arrays listed in the standard config
2710file. This command will typically go in a system startup file.
2711
2712.B " mdadm \-\-stop \-\-scan"
2713.br
2714This will shut down all arrays that can be shut down (i.e. are not
2715currently in use). This will typically go in a system shutdown script.
2716
2717.B " mdadm \-\-follow \-\-scan \-\-delay=120"
2718.br
2719If (and only if) there is an Email address or program given in the
2720standard config file, then
2721monitor the status of all arrays listed in that file by
2722polling them ever 2 minutes.
2723
2724.B " mdadm \-\-create /dev/md0 \-\-level=1 \-\-raid\-devices=2 /dev/hd[ac]1"
2725.br
2726Create /dev/md0 as a RAID1 array consisting of /dev/hda1 and /dev/hdc1.
2727
2728.br
2729.B " echo 'DEVICE /dev/hd*[0\-9] /dev/sd*[0\-9]' > mdadm.conf"
2730.br
2731.B " mdadm \-\-detail \-\-scan >> mdadm.conf"
2732.br
2733This will create a prototype config file that describes currently
2734active arrays that are known to be made from partitions of IDE or SCSI drives.
2735This file should be reviewed before being used as it may
2736contain unwanted detail.
2737
2738.B " echo 'DEVICE /dev/hd[a\-z] /dev/sd*[a\-z]' > mdadm.conf"
2739.br
2740.B " mdadm \-\-examine \-\-scan \-\-config=mdadm.conf >> mdadm.conf"
2741.br
2742This will find arrays which could be assembled from existing IDE and
2743SCSI whole drives (not partitions), and store the information in the
2744format of a config file.
2745This file is very likely to contain unwanted detail, particularly
2746the
2747.B devices=
2748entries. It should be reviewed and edited before being used as an
2749actual config file.
2750
2751.B " mdadm \-\-examine \-\-brief \-\-scan \-\-config=partitions"
2752.br
2753.B " mdadm \-Ebsc partitions"
2754.br
2755Create a list of devices by reading
2756.BR /proc/partitions ,
2757scan these for RAID superblocks, and printout a brief listing of all
2758that were found.
2759
2760.B " mdadm \-Ac partitions \-m 0 /dev/md0"
2761.br
2762Scan all partitions and devices listed in
2763.BR /proc/partitions
2764and assemble
2765.B /dev/md0
2766out of all such devices with a RAID superblock with a minor number of 0.
2767
2768.B " mdadm \-\-monitor \-\-scan \-\-daemonise > /run/mdadm/mon.pid"
2769.br
2770If config file contains a mail address or alert program, run mdadm in
2771the background in monitor mode monitoring all md devices. Also write
2772pid of mdadm daemon to
2773.BR /run/mdadm/mon.pid .
2774
2775.B " mdadm \-Iq /dev/somedevice"
2776.br
2777Try to incorporate newly discovered device into some array as
2778appropriate.
2779
2780.B " mdadm \-\-incremental \-\-rebuild\-map \-\-run \-\-scan"
2781.br
2782Rebuild the array map from any current arrays, and then start any that
2783can be started.
2784
2785.B " mdadm /dev/md4 --fail detached --remove detached"
2786.br
2787Any devices which are components of /dev/md4 will be marked as faulty
2788and then remove from the array.
2789
2790.B " mdadm --grow /dev/md4 --level=6 --backup-file=/root/backup-md4"
2791.br
2792The array
2793.B /dev/md4
2794which is currently a RAID5 array will be converted to RAID6. There
2795should normally already be a spare drive attached to the array as a
2796RAID6 needs one more drive than a matching RAID5.
2797
2798.B " mdadm --create /dev/md/ddf --metadata=ddf --raid-disks 6 /dev/sd[a-f]"
2799.br
2800Create a DDF array over 6 devices.
2801
2802.B " mdadm --create /dev/md/home -n3 -l5 -z 30000000 /dev/md/ddf"
2803.br
2804Create a RAID5 array over any 3 devices in the given DDF set. Use
2805only 30 gigabytes of each device.
2806
2807.B " mdadm -A /dev/md/ddf1 /dev/sd[a-f]"
2808.br
2809Assemble a pre-exist ddf array.
2810
2811.B " mdadm -I /dev/md/ddf1"
2812.br
2813Assemble all arrays contained in the ddf array, assigning names as
2814appropriate.
2815
2816.B " mdadm \-\-create \-\-help"
2817.br
2818Provide help about the Create mode.
2819
2820.B " mdadm \-\-config \-\-help"
2821.br
2822Provide help about the format of the config file.
2823
2824.B " mdadm \-\-help"
2825.br
2826Provide general help.
2827
2828.SH FILES
2829
2830.SS /proc/mdstat
2831
2832If you're using the
2833.B /proc
2834filesystem,
2835.B /proc/mdstat
2836lists all active md devices with information about them.
2837.I mdadm
2838uses this to find arrays when
2839.B \-\-scan
2840is given in Misc mode, and to monitor array reconstruction
2841on Monitor mode.
2842
2843.SS /etc/mdadm.conf
2844
2845The config file lists which devices may be scanned to see if
2846they contain MD super block, and gives identifying information
2847(e.g. UUID) about known MD arrays. See
2848.BR mdadm.conf (5)
2849for more details.
2850
2851.SS {MAP_PATH}
2852When
2853.B \-\-incremental
2854mode is used, this file gets a list of arrays currently being created.
2855
2856.SH DEVICE NAMES
2857
2858.I mdadm
2859understand two sorts of names for array devices.
2860
2861The first is the so-called 'standard' format name, which matches the
2862names used by the kernel and which appear in
2863.IR /proc/mdstat .
2864
2865The second sort can be freely chosen, but must reside in
2866.IR /dev/md/ .
2867When giving a device name to
2868.I mdadm
2869to create or assemble an array, either full path name such as
2870.I /dev/md0
2871or
2872.I /dev/md/home
2873can be given, or just the suffix of the second sort of name, such as
2874.I home
2875can be given.
2876
2877When
2878.I mdadm
2879chooses device names during auto-assembly or incremental assembly, it
2880will sometimes add a small sequence number to the end of the name to
2881avoid conflicted between multiple arrays that have the same name. If
2882.I mdadm
2883can reasonably determine that the array really is meant for this host,
2884either by a hostname in the metadata, or by the presence of the array
2885in
2886.BR mdadm.conf ,
2887then it will leave off the suffix if possible.
2888Also if the homehost is specified as
2889.B <ignore>
2890.I mdadm
2891will only use a suffix if a different array of the same name already
2892exists or is listed in the config file.
2893
2894The standard names for non-partitioned arrays (the only sort of md
2895array available in 2.4 and earlier) are of the form
2896.IP
2897/dev/mdNN
2898.PP
2899where NN is a number.
2900The standard names for partitionable arrays (as available from 2.6
2901onwards) are of the form
2902.IP
2903/dev/md_dNN
2904.PP
2905Partition numbers should be indicated by added "pMM" to these, thus "/dev/md/d1p2".
2906.PP
2907From kernel version, 2.6.28 the "non-partitioned array" can actually
2908be partitioned. So the "md_dNN" names are no longer needed, and
2909partitions such as "/dev/mdNNpXX" are possible.
2910
2911.SH NOTE
2912.I mdadm
2913was previously known as
2914.IR mdctl .
2915.P
2916.I mdadm
2917is completely separate from the
2918.I raidtools
2919package, and does not use the
2920.I /etc/raidtab
2921configuration file at all.
2922
2923.SH SEE ALSO
2924For further information on mdadm usage, MD and the various levels of
2925RAID, see:
2926.IP
2927.B http://raid.wiki.kernel.org/
2928.PP
2929(based upon Jakob \(/Ostergaard's Software\-RAID.HOWTO)
2930.\".PP
2931.\"for new releases of the RAID driver check out:
2932.\"
2933.\".IP
2934.\".UR ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
2935.\"ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
2936.\".UE
2937.\".PP
2938.\"or
2939.\".IP
2940.\".UR http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2941.\"http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2942.\".UE
2943.PP
2944The latest version of
2945.I mdadm
2946should always be available from
2947.IP
2948.B http://www.kernel.org/pub/linux/utils/raid/mdadm/
2949.PP
2950Related man pages:
2951.PP
2952.IR mdmon (8),
2953.IR mdadm.conf (5),
2954.IR md (4).
2955.PP
2956.IR raidtab (5),
2957.IR raid0run (8),
2958.IR raidstop (8),
2959.IR mkraid (8).