]> git.ipfire.org Git - thirdparty/mdadm.git/blame_incremental - mdadm.8
ddf: Set container_member from subarray in getinfo_super.
[thirdparty/mdadm.git] / mdadm.8
... / ...
CommitLineData
1.\" -*- nroff -*-
2.\" Copyright Neil Brown and others.
3.\" This program is free software; you can redistribute it and/or modify
4.\" it under the terms of the GNU General Public License as published by
5.\" the Free Software Foundation; either version 2 of the License, or
6.\" (at your option) any later version.
7.\" See file COPYING in distribution for details.
8.TH MDADM 8 "" v2.6.7
9.SH NAME
10mdadm \- manage MD devices
11.I aka
12Linux Software RAID
13
14.SH SYNOPSIS
15
16.BI mdadm " [mode] <raiddevice> [options] <component-devices>"
17
18.SH DESCRIPTION
19RAID devices are virtual devices created from two or more
20real block devices. This allows multiple devices (typically disk
21drives or partitions thereof) to be combined into a single device to
22hold (for example) a single filesystem.
23Some RAID levels include redundancy and so can survive some degree of
24device failure.
25
26Linux Software RAID devices are implemented through the md (Multiple
27Devices) device driver.
28
29Currently, Linux supports
30.B LINEAR
31md devices,
32.B RAID0
33(striping),
34.B RAID1
35(mirroring),
36.BR RAID4 ,
37.BR RAID5 ,
38.BR RAID6 ,
39.BR RAID10 ,
40.BR MULTIPATH ,
41and
42.BR FAULTY .
43
44.B MULTIPATH
45is not a Software RAID mechanism, but does involve
46multiple devices:
47each device is a path to one common physical storage device.
48
49.B FAULTY
50is also not true RAID, and it only involves one device. It
51provides a layer over a true device that can be used to inject faults.
52
53.\".B mdadm
54.\"is a program that can be used to create, manage, and monitor
55.\"MD devices. As
56.\"such it provides a similar set of functionality to the
57.\".B raidtools
58.\"packages.
59.\"The key differences between
60.\".B mdadm
61.\"and
62.\".B raidtools
63.\"are:
64.\".IP \(bu 4
65.\".B mdadm
66.\"is a single program and not a collection of programs.
67.\".IP \(bu 4
68.\".B mdadm
69.\"can perform (almost) all of its functions without having a
70.\"configuration file and does not use one by default. Also
71.\".B mdadm
72.\"helps with management of the configuration
73.\"file.
74.\".IP \(bu 4
75.\".B mdadm
76.\"can provide information about your arrays (through Query, Detail, and Examine)
77.\"that
78.\".B raidtools
79.\"cannot.
80.\".P
81.\".I mdadm
82.\"does not use
83.\".IR /etc/raidtab ,
84.\"the
85.\".B raidtools
86.\"configuration file, at all. It has a different configuration file
87.\"with a different format and a different purpose.
88
89.SH MODES
90mdadm has several major modes of operation:
91.TP
92.B Assemble
93Assemble the components of a previously created
94array into an active array. Components can be explicitly given
95or can be searched for.
96.B mdadm
97checks that the components
98do form a bona fide array, and can, on request, fiddle superblock
99information so as to assemble a faulty array.
100
101.TP
102.B Build
103Build an array that doesn't have per-device superblocks. For these
104sorts of arrays,
105.I mdadm
106cannot differentiate between initial creation and subsequent assembly
107of an array. It also cannot perform any checks that appropriate
108components have been requested. Because of this, the
109.B Build
110mode should only be used together with a complete understanding of
111what you are doing.
112
113.TP
114.B Create
115Create a new array with per-device superblocks.
116.\"It can progress
117.\"in several step create-add-add-run or it can all happen with one command.
118
119.TP
120.B "Follow or Monitor"
121Monitor one or more md devices and act on any state changes. This is
122only meaningful for raid1, 4, 5, 6, 10 or multipath arrays, as
123only these have interesting state. raid0 or linear never have
124missing, spare, or failed drives, so there is nothing to monitor.
125
126.TP
127.B "Grow"
128Grow (or shrink) an array, or otherwise reshape it in some way.
129Currently supported growth options including changing the active size
130of component devices and changing the number of active devices in RAID
131levels 1/4/5/6, as well as adding or removing a write-intent bitmap.
132
133.TP
134.B "Incremental Assembly"
135Add a single device to an appropriate array. If the addition of the
136device makes the array runnable, the array will be started.
137This provides a convenient interface to a
138.I hot-plug
139system. As each device is detected,
140.I mdadm
141has a chance to include it in some array as appropriate.
142
143.TP
144.B Manage
145This is for doing things to specific components of an array such as
146adding new spares and removing faulty devices.
147
148.TP
149.B Misc
150This is an 'everything else' mode that supports operations on active
151arrays, operations on component devices such as erasing old superblocks, and
152information gathering operations.
153.\"This mode allows operations on independent devices such as examine MD
154.\"superblocks, erasing old superblocks and stopping active arrays.
155
156.TP
157.B Auto-detect
158This mode does not act on a specific device or array, but rather it
159requests the Linux Kernel to activate any auto-detected arrays.
160.SH OPTIONS
161
162.SH Options for selecting a mode are:
163
164.TP
165.BR \-A ", " \-\-assemble
166Assemble a pre-existing array.
167
168.TP
169.BR \-B ", " \-\-build
170Build a legacy array without superblocks.
171
172.TP
173.BR \-C ", " \-\-create
174Create a new array.
175
176.TP
177.BR \-F ", " \-\-follow ", " \-\-monitor
178Select
179.B Monitor
180mode.
181
182.TP
183.BR \-G ", " \-\-grow
184Change the size or shape of an active array.
185
186.TP
187.BR \-I ", " \-\-incremental
188Add a single device into an appropriate array, and possibly start the array.
189
190.TP
191.B \-\-auto-detect
192Request that the kernel starts any auto-detected arrays. This can only
193work if
194.I md
195is compiled into the kernel \(em not if it is a module.
196Arrays can be auto-detected by the kernel if all the components are in
197primary MS-DOS partitions with partition type
198.BR FD .
199In-kernel autodetect is not recommended for new installations. Using
200.I mdadm
201to detect and assemble arrays \(em possibly in an
202.I initrd
203\(em is substantially more flexible and should be preferred.
204
205.P
206If a device is given before any options, or if the first option is
207.BR \-\-add ,
208.BR \-\-fail ,
209or
210.BR \-\-remove ,
211then the MANAGE mode is assume.
212Anything other than these will cause the
213.B Misc
214mode to be assumed.
215
216.SH Options that are not mode-specific are:
217
218.TP
219.BR \-h ", " \-\-help
220Display general help message or, after one of the above options, a
221mode-specific help message.
222
223.TP
224.B \-\-help\-options
225Display more detailed help about command line parsing and some commonly
226used options.
227
228.TP
229.BR \-V ", " \-\-version
230Print version information for mdadm.
231
232.TP
233.BR \-v ", " \-\-verbose
234Be more verbose about what is happening. This can be used twice to be
235extra-verbose.
236The extra verbosity currently only affects
237.B \-\-detail \-\-scan
238and
239.BR "\-\-examine \-\-scan" .
240
241.TP
242.BR \-q ", " \-\-quiet
243Avoid printing purely informative messages. With this,
244.B mdadm
245will be silent unless there is something really important to report.
246
247.TP
248.BR \-b ", " \-\-brief
249Be less verbose. This is used with
250.B \-\-detail
251and
252.BR \-\-examine .
253Using
254.B \-\-brief
255with
256.B \-\-verbose
257gives an intermediate level of verbosity.
258
259.TP
260.BR \-f ", " \-\-force
261Be more forceful about certain operations. See the various modes for
262the exact meaning of this option in different contexts.
263
264.TP
265.BR \-c ", " \-\-config=
266Specify the config file. Default is to use
267.BR /etc/mdadm.conf ,
268or if that is missing then
269.BR /etc/mdadm/mdadm.conf .
270If the config file given is
271.B "partitions"
272then nothing will be read, but
273.I mdadm
274will act as though the config file contained exactly
275.B "DEVICE partitions"
276and will read
277.B /proc/partitions
278to find a list of devices to scan.
279If the word
280.B "none"
281is given for the config file, then
282.I mdadm
283will act as though the config file were empty.
284
285.TP
286.BR \-s ", " \-\-scan
287Scan config file or
288.B /proc/mdstat
289for missing information.
290In general, this option gives
291.B mdadm
292permission to get any missing information (like component devices,
293array devices, array identities, and alert destination) from the
294configuration file (see previous option);
295one exception is MISC mode when using
296.B \-\-detail
297or
298.B \-\-stop,
299in which case
300.B \-\-scan
301says to get a list of array devices from
302.BR /proc/mdstat .
303
304.TP
305.B \-e ", " \-\-metadata=
306Declare the style of superblock (raid metadata) to be used. The
307default is 0.90 for
308.BR \-\-create ,
309and to guess for other operations.
310The default can be overridden by setting the
311.B metadata
312value for the
313.B CREATE
314keyword in
315.BR mdadm.conf .
316
317Options are:
318.RS
319.IP "0, 0.90, default"
320Use the original 0.90 format superblock. This format limits arrays to
32128 component devices and limits component devices of levels 1 and
322greater to 2 terabytes.
323.IP "1, 1.0, 1.1, 1.2"
324Use the new version-1 format superblock. This has few restrictions.
325The different sub-versions store the superblock at different locations
326on the device, either at the end (for 1.0), at the start (for 1.1) or
3274K from the start (for 1.2).
328.RE
329
330.TP
331.B \-\-homehost=
332This will override any
333.B HOMEHOST
334setting in the config file and provides the identity of the host which
335should be considered the home for any arrays.
336
337When creating an array, the
338.B homehost
339will be recorded in the superblock. For version-1 superblocks, it will
340be prefixed to the array name. For version-0.90 superblocks, part of
341the SHA1 hash of the hostname will be stored in the later half of the
342UUID.
343
344When reporting information about an array, any array which is tagged
345for the given homehost will be reported as such.
346
347When using Auto-Assemble, only arrays tagged for the given homehost
348will be assembled.
349
350.SH For create, build, or grow:
351
352.TP
353.BR \-n ", " \-\-raid\-devices=
354Specify the number of active devices in the array. This, plus the
355number of spare devices (see below) must equal the number of
356.I component-devices
357(including "\fBmissing\fP" devices)
358that are listed on the command line for
359.BR \-\-create .
360Setting a value of 1 is probably
361a mistake and so requires that
362.B \-\-force
363be specified first. A value of 1 will then be allowed for linear,
364multipath, raid0 and raid1. It is never allowed for raid4 or raid5.
365.br
366This number can only be changed using
367.B \-\-grow
368for RAID1, RAID5 and RAID6 arrays, and only on kernels which provide
369necessary support.
370
371.TP
372.BR \-x ", " \-\-spare\-devices=
373Specify the number of spare (eXtra) devices in the initial array.
374Spares can also be added
375and removed later. The number of component devices listed
376on the command line must equal the number of raid devices plus the
377number of spare devices.
378
379
380.TP
381.BR \-z ", " \-\-size=
382Amount (in Kibibytes) of space to use from each drive in RAID level 1/4/5/6.
383This must be a multiple of the chunk size, and must leave about 128Kb
384of space at the end of the drive for the RAID superblock.
385If this is not specified
386(as it normally is not) the smallest drive (or partition) sets the
387size, though if there is a variance among the drives of greater than 1%, a warning is
388issued.
389
390This value can be set with
391.B \-\-grow
392for RAID level 1/4/5/6. If the array was created with a size smaller
393than the currently active drives, the extra space can be accessed
394using
395.BR \-\-grow .
396The size can be given as
397.B max
398which means to choose the largest size that fits on all current drives.
399
400.TP
401.BR \-c ", " \-\-chunk=
402Specify chunk size of kibibytes. The default is 64.
403
404.TP
405.BR \-\-rounding=
406Specify rounding factor for linear array (==chunk size)
407
408.TP
409.BR \-l ", " \-\-level=
410Set raid level. When used with
411.BR \-\-create ,
412options are: linear, raid0, 0, stripe, raid1, 1, mirror, raid4, 4,
413raid5, 5, raid6, 6, raid10, 10, multipath, mp, faulty. Obviously some of these are synonymous.
414
415When used with
416.BR \-\-build ,
417only linear, stripe, raid0, 0, raid1, multipath, mp, and faulty are valid.
418
419Not yet supported with
420.BR \-\-grow .
421
422.TP
423.BR \-p ", " \-\-layout=
424This option configures the fine details of data layout for raid5,
425and raid10 arrays, and controls the failure modes for
426.IR faulty .
427
428The layout of the raid5 parity block can be one of
429.BR left\-asymmetric ,
430.BR left\-symmetric ,
431.BR right\-asymmetric ,
432.BR right\-symmetric ,
433.BR la ", " ra ", " ls ", " rs .
434The default is
435.BR left\-symmetric .
436
437When setting the failure mode for level
438.I faulty,
439the options are:
440.BR write\-transient ", " wt ,
441.BR read\-transient ", " rt ,
442.BR write\-persistent ", " wp ,
443.BR read\-persistent ", " rp ,
444.BR write\-all ,
445.BR read\-fixable ", " rf ,
446.BR clear ", " flush ", " none .
447
448Each failure mode can be followed by a number, which is used as a period
449between fault generation. Without a number, the fault is generated
450once on the first relevant request. With a number, the fault will be
451generated after that many requests, and will continue to be generated
452every time the period elapses.
453
454Multiple failure modes can be current simultaneously by using the
455.B \-\-grow
456option to set subsequent failure modes.
457
458"clear" or "none" will remove any pending or periodic failure modes,
459and "flush" will clear any persistent faults.
460
461To set the parity with
462.BR \-\-grow ,
463the level of the array ("faulty")
464must be specified before the fault mode is specified.
465
466Finally, the layout options for RAID10 are one of 'n', 'o' or 'f' followed
467by a small number. The default is 'n2'. The supported options are:
468
469.I 'n'
470signals 'near' copies. Multiple copies of one data block are at
471similar offsets in different devices.
472
473.I 'o'
474signals 'offset' copies. Rather than the chunks being duplicated
475within a stripe, whole stripes are duplicated but are rotated by one
476device so duplicate blocks are on different devices. Thus subsequent
477copies of a block are in the next drive, and are one chunk further
478down.
479
480.I 'f'
481signals 'far' copies
482(multiple copies have very different offsets).
483See md(4) for more detail about 'near' and 'far'.
484
485The number is the number of copies of each datablock. 2 is normal, 3
486can be useful. This number can be at most equal to the number of
487devices in the array. It does not need to divide evenly into that
488number (e.g. it is perfectly legal to have an 'n2' layout for an array
489with an odd number of devices).
490
491.TP
492.BR \-\-parity=
493same as
494.B \-\-layout
495(thus explaining the p of
496.BR \-p ).
497
498.TP
499.BR \-b ", " \-\-bitmap=
500Specify a file to store a write-intent bitmap in. The file should not
501exist unless
502.B \-\-force
503is also given. The same file should be provided
504when assembling the array. If the word
505.B "internal"
506is given, then the bitmap is stored with the metadata on the array,
507and so is replicated on all devices. If the word
508.B "none"
509is given with
510.B \-\-grow
511mode, then any bitmap that is present is removed.
512
513To help catch typing errors, the filename must contain at least one
514slash ('/') if it is a real file (not 'internal' or 'none').
515
516Note: external bitmaps are only known to work on ext2 and ext3.
517Storing bitmap files on other filesystems may result in serious problems.
518
519.TP
520.BR \-\-bitmap\-chunk=
521Set the chunksize of the bitmap. Each bit corresponds to that many
522Kilobytes of storage.
523When using a file based bitmap, the default is to use the smallest
524size that is at-least 4 and requires no more than 2^21 chunks.
525When using an
526.B internal
527bitmap, the chunksize is automatically determined to make best use of
528available space.
529
530
531.TP
532.BR \-W ", " \-\-write\-mostly
533subsequent devices lists in a
534.BR \-\-build ,
535.BR \-\-create ,
536or
537.B \-\-add
538command will be flagged as 'write-mostly'. This is valid for RAID1
539only and means that the 'md' driver will avoid reading from these
540devices if at all possible. This can be useful if mirroring over a
541slow link.
542
543.TP
544.BR \-\-write\-behind=
545Specify that write-behind mode should be enabled (valid for RAID1
546only). If an argument is specified, it will set the maximum number
547of outstanding writes allowed. The default value is 256.
548A write-intent bitmap is required in order to use write-behind
549mode, and write-behind is only attempted on drives marked as
550.IR write-mostly .
551
552.TP
553.BR \-\-assume\-clean
554Tell
555.I mdadm
556that the array pre-existed and is known to be clean. It can be useful
557when trying to recover from a major failure as you can be sure that no
558data will be affected unless you actually write to the array. It can
559also be used when creating a RAID1 or RAID10 if you want to avoid the
560initial resync, however this practice \(em while normally safe \(em is not
561recommended. Use this only if you really know what you are doing.
562
563.TP
564.BR \-\-backup\-file=
565This is needed when
566.B \-\-grow
567is used to increase the number of
568raid-devices in a RAID5 if there are no spare devices available.
569See the section below on RAID_DEVICE CHANGES. The file should be
570stored on a separate device, not on the raid array being reshaped.
571
572.TP
573.BR \-N ", " \-\-name=
574Set a
575.B name
576for the array. This is currently only effective when creating an
577array with a version-1 superblock. The name is a simple textual
578string that can be used to identify array components when assembling.
579
580.TP
581.BR \-R ", " \-\-run
582Insist that
583.I mdadm
584run the array, even if some of the components
585appear to be active in another array or filesystem. Normally
586.I mdadm
587will ask for confirmation before including such components in an
588array. This option causes that question to be suppressed.
589
590.TP
591.BR \-f ", " \-\-force
592Insist that
593.I mdadm
594accept the geometry and layout specified without question. Normally
595.I mdadm
596will not allow creation of an array with only one device, and will try
597to create a raid5 array with one missing drive (as this makes the
598initial resync work faster). With
599.BR \-\-force ,
600.I mdadm
601will not try to be so clever.
602
603.TP
604.BR \-a ", " "\-\-auto{=no,yes,md,mdp,part,p}{NN}"
605Instruct mdadm to create the device file if needed, possibly allocating
606an unused minor number. "md" causes a non-partitionable array
607to be used. "mdp", "part" or "p" causes a partitionable array (2.6 and
608later) to be used. "yes" requires the named md device to have
609a 'standard' format, and the type and minor number will be determined
610from this. See DEVICE NAMES below.
611
612The argument can also come immediately after
613"\-a". e.g. "\-ap".
614
615If
616.B \-\-auto
617is not given on the command line or in the config file, then
618the default will be
619.BR \-\-auto=yes .
620
621If
622.B \-\-scan
623is also given, then any
624.I auto=
625entries in the config file will override the
626.B \-\-auto
627instruction given on the command line.
628
629For partitionable arrays,
630.I mdadm
631will create the device file for the whole array and for the first 4
632partitions. A different number of partitions can be specified at the
633end of this option (e.g.
634.BR \-\-auto=p7 ).
635If the device name ends with a digit, the partition names add a 'p',
636and a number, e.g. "/dev/home1p3". If there is no
637trailing digit, then the partition names just have a number added,
638e.g. "/dev/scratch3".
639
640If the md device name is in a 'standard' format as described in DEVICE
641NAMES, then it will be created, if necessary, with the appropriate
642number based on that name. If the device name is not in one of these
643formats, then a unused minor number will be allocated. The minor
644number will be considered unused if there is no active array for that
645number, and there is no entry in /dev for that number and with a
646non-standard name.
647
648.TP
649.BR \-\-symlink = no
650Normally when
651.B \-\-auto
652causes
653.I mdadm
654to create devices in
655.B /dev/md/
656it will also create symlinks from
657.B /dev/
658with names starting with
659.B md
660or
661.BR md_ .
662Use
663.B \-\-symlink=no
664to suppress this, or
665.B \-\-symlink=yes
666to enforce this even if it is suppressing
667.IR mdadm.conf .
668
669
670.SH For assemble:
671
672.TP
673.BR \-u ", " \-\-uuid=
674uuid of array to assemble. Devices which don't have this uuid are
675excluded
676
677.TP
678.BR \-m ", " \-\-super\-minor=
679Minor number of device that array was created for. Devices which
680don't have this minor number are excluded. If you create an array as
681/dev/md1, then all superblocks will contain the minor number 1, even if
682the array is later assembled as /dev/md2.
683
684Giving the literal word "dev" for
685.B \-\-super\-minor
686will cause
687.I mdadm
688to use the minor number of the md device that is being assembled.
689e.g. when assembling
690.BR /dev/md0 ,
691.M \-\-super\-minor=dev
692will look for super blocks with a minor number of 0.
693
694.TP
695.BR \-N ", " \-\-name=
696Specify the name of the array to assemble. This must be the name
697that was specified when creating the array. It must either match
698the name stored in the superblock exactly, or it must match
699with the current
700.I homehost
701prefixed to the start of the given name.
702
703.TP
704.BR \-f ", " \-\-force
705Assemble the array even if some superblocks appear out-of-date
706
707.TP
708.BR \-R ", " \-\-run
709Attempt to start the array even if fewer drives were given than were
710present last time the array was active. Normally if not all the
711expected drives are found and
712.B \-\-scan
713is not used, then the array will be assembled but not started.
714With
715.B \-\-run
716an attempt will be made to start it anyway.
717
718.TP
719.B \-\-no\-degraded
720This is the reverse of
721.B \-\-run
722in that it inhibits the startup of array unless all expected drives
723are present. This is only needed with
724.B \-\-scan,
725and can be used if the physical connections to devices are
726not as reliable as you would like.
727
728.TP
729.BR \-a ", " "\-\-auto{=no,yes,md,mdp,part}"
730See this option under Create and Build options.
731
732.TP
733.BR \-b ", " \-\-bitmap=
734Specify the bitmap file that was given when the array was created. If
735an array has an
736.B internal
737bitmap, there is no need to specify this when assembling the array.
738
739.TP
740.BR \-\-backup\-file=
741If
742.B \-\-backup\-file
743was used to grow the number of raid-devices in a RAID5, and the system
744crashed during the critical section, then the same
745.B \-\-backup\-file
746must be presented to
747.B \-\-assemble
748to allow possibly corrupted data to be restored.
749
750.TP
751.BR \-U ", " \-\-update=
752Update the superblock on each device while assembling the array. The
753argument given to this flag can be one of
754.BR sparc2.2 ,
755.BR summaries ,
756.BR uuid ,
757.BR name ,
758.BR homehost ,
759.BR resync ,
760.BR byteorder ,
761.BR devicesize ,
762or
763.BR super\-minor .
764
765The
766.B sparc2.2
767option will adjust the superblock of an array what was created on a Sparc
768machine running a patched 2.2 Linux kernel. This kernel got the
769alignment of part of the superblock wrong. You can use the
770.B "\-\-examine \-\-sparc2.2"
771option to
772.I mdadm
773to see what effect this would have.
774
775The
776.B super\-minor
777option will update the
778.B "preferred minor"
779field on each superblock to match the minor number of the array being
780assembled.
781This can be useful if
782.B \-\-examine
783reports a different "Preferred Minor" to
784.BR \-\-detail .
785In some cases this update will be performed automatically
786by the kernel driver. In particular the update happens automatically
787at the first write to an array with redundancy (RAID level 1 or
788greater) on a 2.6 (or later) kernel.
789
790The
791.B uuid
792option will change the uuid of the array. If a UUID is given with the
793.B \-\-uuid
794option that UUID will be used as a new UUID and will
795.B NOT
796be used to help identify the devices in the array.
797If no
798.B \-\-uuid
799is given, a random UUID is chosen.
800
801The
802.B name
803option will change the
804.I name
805of the array as stored in the superblock. This is only supported for
806version-1 superblocks.
807
808The
809.B homehost
810option will change the
811.I homehost
812as recorded in the superblock. For version-0 superblocks, this is the
813same as updating the UUID.
814For version-1 superblocks, this involves updating the name.
815
816The
817.B resync
818option will cause the array to be marked
819.I dirty
820meaning that any redundancy in the array (e.g. parity for raid5,
821copies for raid1) may be incorrect. This will cause the raid system
822to perform a "resync" pass to make sure that all redundant information
823is correct.
824
825The
826.B byteorder
827option allows arrays to be moved between machines with different
828byte-order.
829When assembling such an array for the first time after a move, giving
830.B "\-\-update=byteorder"
831will cause
832.I mdadm
833to expect superblocks to have their byteorder reversed, and will
834correct that order before assembling the array. This is only valid
835with original (Version 0.90) superblocks.
836
837The
838.B summaries
839option will correct the summaries in the superblock. That is the
840counts of total, working, active, failed, and spare devices.
841
842The
843.B devicesize
844will rarely be of use. It applies to version 1.1 and 1.2 metadata
845only (where the metadata is at the start of the device) and is only
846useful when the component device has changed size (typically become
847larger). The version 1 metadata records the amount of the device that
848can be used to store data, so if a device in a version 1.1 or 1.2
849array becomes larger, the metadata will still be visible, but the
850extra space will not. In this case it might be useful to assemble the
851array with
852.BR \-\-update=devicesize .
853This will cause
854.I mdadm
855to determine the maximum usable amount of space on each device and
856update the relevant field in the metadata.
857
858.TP
859.B \-\-auto\-update\-homehost
860This flag is only meaningful with auto-assembly (see discussion below).
861In that situation, if no suitable arrays are found for this homehost,
862.I mdadm
863will rescan for any arrays at all and will assemble them and update the
864homehost to match the current host.
865
866.SH For Manage mode:
867
868.TP
869.BR \-a ", " \-\-add
870hot-add listed devices.
871
872.TP
873.BR \-\-re\-add
874re-add a device that was recently removed from an array.
875
876.TP
877.BR \-r ", " \-\-remove
878remove listed devices. They must not be active. i.e. they should
879be failed or spare devices. As well as the name of a device file
880(e.g.
881.BR /dev/sda1 )
882the words
883.B failed
884and
885.B detached
886can be given to
887.BR \-\-remove .
888The first causes all failed device to be removed. The second causes
889any device which is no longer connected to the system (i.e an 'open'
890returns
891.BR ENXIO )
892to be removed. This will only succeed for devices that are spares or
893have already been marked as failed.
894
895.TP
896.BR \-f ", " \-\-fail
897mark listed devices as faulty.
898As well as the name of a device file, the word
899.B detached
900can be given. This will cause any device that has been detached from
901the system to be marked as failed. It can then be removed.
902
903.TP
904.BR \-\-set\-faulty
905same as
906.BR \-\-fail .
907
908.P
909Each of these options require that the first device listed is the array
910to be acted upon, and the remainder are component devices to be added,
911removed, or marked as faulty. Several different operations can be
912specified for different devices, e.g.
913.in +5
914mdadm /dev/md0 \-\-add /dev/sda1 \-\-fail /dev/sdb1 \-\-remove /dev/sdb1
915.in -5
916Each operation applies to all devices listed until the next
917operation.
918
919If an array is using a write-intent bitmap, then devices which have
920been removed can be re-added in a way that avoids a full
921reconstruction but instead just updates the blocks that have changed
922since the device was removed. For arrays with persistent metadata
923(superblocks) this is done automatically. For arrays created with
924.B \-\-build
925mdadm needs to be told that this device we removed recently with
926.BR \-\-re\-add .
927
928Devices can only be removed from an array if they are not in active
929use, i.e. that must be spares or failed devices. To remove an active
930device, it must first be marked as
931.B faulty.
932
933.SH For Misc mode:
934
935.TP
936.BR \-Q ", " \-\-query
937Examine a device to see
938(1) if it is an md device and (2) if it is a component of an md
939array.
940Information about what is discovered is presented.
941
942.TP
943.BR \-D ", " \-\-detail
944Print detail of one or more md devices.
945
946.TP
947.BR \-Y ", " \-\-export
948When used with
949.B \-\-detail
950or
951.BR \-\-examine ,
952output will be formatted as
953.B key=value
954pairs for easy import into the environment.
955
956.TP
957.BR \-E ", " \-\-examine
958Print content of md superblock on device(s).
959.TP
960.B \-\-sparc2.2
961If an array was created on a 2.2 Linux kernel patched with RAID
962support, the superblock will have been created incorrectly, or at
963least incompatibly with 2.4 and later kernels. Using the
964.B \-\-sparc2.2
965flag with
966.B \-\-examine
967will fix the superblock before displaying it. If this appears to do
968the right thing, then the array can be successfully assembled using
969.BR "\-\-assemble \-\-update=sparc2.2" .
970
971.TP
972.BR \-X ", " \-\-examine\-bitmap
973Report information about a bitmap file.
974The argument is either an external bitmap file or an array component
975in case of an internal bitmap.
976
977.TP
978.BR \-R ", " \-\-run
979start a partially built array.
980
981.TP
982.BR \-S ", " \-\-stop
983deactivate array, releasing all resources.
984
985.TP
986.BR \-o ", " \-\-readonly
987mark array as readonly.
988
989.TP
990.BR \-w ", " \-\-readwrite
991mark array as readwrite.
992
993.TP
994.B \-\-zero\-superblock
995If the device contains a valid md superblock, the block is
996overwritten with zeros. With
997.B \-\-force
998the block where the superblock would be is overwritten even if it
999doesn't appear to be valid.
1000
1001.TP
1002.BR \-t ", " \-\-test
1003When used with
1004.BR \-\-detail ,
1005the exit status of
1006.I mdadm
1007is set to reflect the status of the device.
1008
1009.TP
1010.BR \-W ", " \-\-wait
1011For each md device given, wait for any resync, recovery, or reshape
1012activity to finish before returning.
1013.I mdadm
1014will return with success if it actually waited for every device
1015listed, otherwise it will return failure.
1016
1017.SH For Incremental Assembly mode:
1018.TP
1019.BR \-\-rebuild\-map ", " \-r
1020Rebuild the map file
1021.RB ( /var/run/mdadm/map )
1022that
1023.I mdadm
1024uses to help track which arrays are currently being assembled.
1025
1026.TP
1027.BR \-\-run ", " \-R
1028Run any array assembled as soon as a minimal number of devices are
1029available, rather than waiting until all expected devices are present.
1030
1031.TP
1032.BR \-\-scan ", " \-s
1033Only meaningful with
1034.B \-R
1035this will scan the
1036.B map
1037file for arrays that are being incrementally assembled and will try to
1038start any that are not already started. If any such array is listed
1039in
1040.B mdadm.conf
1041as requiring an external bitmap, that bitmap will be attached first.
1042
1043.SH For Monitor mode:
1044.TP
1045.BR \-m ", " \-\-mail
1046Give a mail address to send alerts to.
1047
1048.TP
1049.BR \-p ", " \-\-program ", " \-\-alert
1050Give a program to be run whenever an event is detected.
1051
1052.TP
1053.BR \-y ", " \-\-syslog
1054Cause all events to be reported through 'syslog'. The messages have
1055facility of 'daemon' and varying priorities.
1056
1057.TP
1058.BR \-d ", " \-\-delay
1059Give a delay in seconds.
1060.B mdadm
1061polls the md arrays and then waits this many seconds before polling
1062again. The default is 60 seconds.
1063
1064.TP
1065.BR \-f ", " \-\-daemonise
1066Tell
1067.B mdadm
1068to run as a background daemon if it decides to monitor anything. This
1069causes it to fork and run in the child, and to disconnect form the
1070terminal. The process id of the child is written to stdout.
1071This is useful with
1072.B \-\-scan
1073which will only continue monitoring if a mail address or alert program
1074is found in the config file.
1075
1076.TP
1077.BR \-i ", " \-\-pid\-file
1078When
1079.B mdadm
1080is running in daemon mode, write the pid of the daemon process to
1081the specified file, instead of printing it on standard output.
1082
1083.TP
1084.BR \-1 ", " \-\-oneshot
1085Check arrays only once. This will generate
1086.B NewArray
1087events and more significantly
1088.B DegradedArray
1089and
1090.B SparesMissing
1091events. Running
1092.in +5
1093.B " mdadm \-\-monitor \-\-scan \-1"
1094.in -5
1095from a cron script will ensure regular notification of any degraded arrays.
1096
1097.TP
1098.BR \-t ", " \-\-test
1099Generate a
1100.B TestMessage
1101alert for every array found at startup. This alert gets mailed and
1102passed to the alert program. This can be used for testing that alert
1103message do get through successfully.
1104
1105.SH ASSEMBLE MODE
1106
1107.HP 12
1108Usage:
1109.B mdadm \-\-assemble
1110.I md-device options-and-component-devices...
1111.HP 12
1112Usage:
1113.B mdadm \-\-assemble \-\-scan
1114.I md-devices-and-options...
1115.HP 12
1116Usage:
1117.B mdadm \-\-assemble \-\-scan
1118.I options...
1119
1120.PP
1121This usage assembles one or more raid arrays from pre-existing components.
1122For each array, mdadm needs to know the md device, the identity of the
1123array, and a number of component-devices. These can be found in a number of ways.
1124
1125In the first usage example (without the
1126.BR \-\-scan )
1127the first device given is the md device.
1128In the second usage example, all devices listed are treated as md
1129devices and assembly is attempted.
1130In the third (where no devices are listed) all md devices that are
1131listed in the configuration file are assembled.
1132
1133If precisely one device is listed, but
1134.B \-\-scan
1135is not given, then
1136.I mdadm
1137acts as though
1138.B \-\-scan
1139was given and identity information is extracted from the configuration file.
1140
1141The identity can be given with the
1142.B \-\-uuid
1143option, with the
1144.B \-\-super\-minor
1145option, will be taken from the md-device record in the config file, or
1146will be taken from the super block of the first component-device
1147listed on the command line.
1148
1149Devices can be given on the
1150.B \-\-assemble
1151command line or in the config file. Only devices which have an md
1152superblock which contains the right identity will be considered for
1153any array.
1154
1155The config file is only used if explicitly named with
1156.B \-\-config
1157or requested with (a possibly implicit)
1158.BR \-\-scan .
1159In the later case,
1160.B /etc/mdadm.conf
1161is used.
1162
1163If
1164.B \-\-scan
1165is not given, then the config file will only be used to find the
1166identity of md arrays.
1167
1168Normally the array will be started after it is assembled. However if
1169.B \-\-scan
1170is not given and insufficient drives were listed to start a complete
1171(non-degraded) array, then the array is not started (to guard against
1172usage errors). To insist that the array be started in this case (as
1173may work for RAID1, 4, 5, 6, or 10), give the
1174.B \-\-run
1175flag.
1176
1177If the md device does not exist, then it will be created providing the
1178intent is clear. i.e. the name must be in a standard form, or the
1179.B \-\-auto
1180option must be given to clarify how and whether the device should be
1181created.
1182This can be useful for handling partitioned devices (which don't have
1183a stable device number \(em it can change after a reboot) and when using
1184"udev" to manage your
1185.B /dev
1186tree (udev cannot handle md devices because of the unusual device
1187initialisation conventions).
1188
1189If the option to "auto" is "mdp" or "part" or (on the command line
1190only) "p", then mdadm will create a partitionable array, using the
1191first free one that is not in use and does not already have an entry
1192in /dev (apart from numeric /dev/md* entries).
1193
1194If the option to "auto" is "yes" or "md" or (on the command line)
1195nothing, then mdadm will create a traditional, non-partitionable md
1196array.
1197
1198It is expected that the "auto" functionality will be used to create
1199device entries with meaningful names such as "/dev/md/home" or
1200"/dev/md/root", rather than names based on the numerical array number.
1201
1202When using option "auto" to create a partitionable array, the device
1203files for the first 4 partitions are also created. If a different
1204number is required it can be simply appended to the auto option.
1205e.g. "auto=part8". Partition names are created by appending a digit
1206string to the device name, with an intervening "p" if the device name
1207ends with a digit.
1208
1209The
1210.B \-\-auto
1211option is also available in Build and Create modes. As those modes do
1212not use a config file, the "auto=" config option does not apply to
1213these modes.
1214
1215.SS Auto Assembly
1216When
1217.B \-\-assemble
1218is used with
1219.B \-\-scan
1220and no devices are listed,
1221.I mdadm
1222will first attempt to assemble all the arrays listed in the config
1223file.
1224
1225If a
1226.B homehost
1227has been specified (either in the config file or on the command line),
1228.I mdadm
1229will look further for possible arrays and will try to assemble
1230anything that it finds which is tagged as belonging to the given
1231homehost. This is the only situation where
1232.I mdadm
1233will assemble arrays without being given specific device name or
1234identity information for the array.
1235
1236If
1237.I mdadm
1238finds a consistent set of devices that look like they should comprise
1239an array, and if the superblock is tagged as belonging to the given
1240home host, it will automatically choose a device name and try to
1241assemble the array. If the array uses version-0.90 metadata, then the
1242.B minor
1243number as recorded in the superblock is used to create a name in
1244.B /dev/md/
1245so for example
1246.BR /dev/md/3 .
1247If the array uses version-1 metadata, then the
1248.B name
1249from the superblock is used to similarly create a name in
1250.BR /dev/md
1251(the name will have any 'host' prefix stripped first).
1252
1253If
1254.I mdadm
1255cannot find any array for the given host at all, and if
1256.B \-\-auto\-update\-homehost
1257is given, then
1258.I mdadm
1259will search again for any array (not just an array created for this
1260host) and will assemble each assuming
1261.BR \-\-update=homehost .
1262This will change the host tag in the superblock so that on the next run,
1263these arrays will be found without the second pass. The intention of
1264this feature is to support transitioning a set of md arrays to using
1265homehost tagging.
1266
1267The reason for requiring arrays to be tagged with the homehost for
1268auto assembly is to guard against problems that can arise when moving
1269devices from one host to another.
1270
1271.SH BUILD MODE
1272
1273.HP 12
1274Usage:
1275.B mdadm \-\-build
1276.I md-device
1277.BI \-\-chunk= X
1278.BI \-\-level= Y
1279.BI \-\-raid\-devices= Z
1280.I devices
1281
1282.PP
1283This usage is similar to
1284.BR \-\-create .
1285The difference is that it creates an array without a superblock. With
1286these arrays there is no difference between initially creating the array and
1287subsequently assembling the array, except that hopefully there is useful
1288data there in the second case.
1289
1290The level may raid0, linear, multipath, or faulty, or one of their
1291synonyms. All devices must be listed and the array will be started
1292once complete.
1293
1294.SH CREATE MODE
1295
1296.HP 12
1297Usage:
1298.B mdadm \-\-create
1299.I md-device
1300.BI \-\-chunk= X
1301.BI \-\-level= Y
1302.br
1303.BI \-\-raid\-devices= Z
1304.I devices
1305
1306.PP
1307This usage will initialise a new md array, associate some devices with
1308it, and activate the array.
1309
1310If the
1311.B \-\-auto
1312option is given (as described in more detail in the section on
1313Assemble mode), then the md device will be created with a suitable
1314device number if necessary.
1315
1316As devices are added, they are checked to see if they contain raid
1317superblocks or filesystems. They are also checked to see if the variance in
1318device size exceeds 1%.
1319
1320If any discrepancy is found, the array will not automatically be run, though
1321the presence of a
1322.B \-\-run
1323can override this caution.
1324
1325To create a "degraded" array in which some devices are missing, simply
1326give the word "\fBmissing\fP"
1327in place of a device name. This will cause
1328.B mdadm
1329to leave the corresponding slot in the array empty.
1330For a RAID4 or RAID5 array at most one slot can be
1331"\fBmissing\fP"; for a RAID6 array at most two slots.
1332For a RAID1 array, only one real device needs to be given. All of the
1333others can be
1334"\fBmissing\fP".
1335
1336When creating a RAID5 array,
1337.B mdadm
1338will automatically create a degraded array with an extra spare drive.
1339This is because building the spare into a degraded array is in general faster than resyncing
1340the parity on a non-degraded, but not clean, array. This feature can
1341be overridden with the
1342.B \-\-force
1343option.
1344
1345When creating an array with version-1 metadata a name for the host is
1346required.
1347If this is not given with the
1348.B \-\-name
1349option,
1350.I mdadm
1351will chose a name based on the last component of the name of the
1352device being created. So if
1353.B /dev/md3
1354is being created, then the name
1355.B 3
1356will be chosen.
1357If
1358.B /dev/md/home
1359is being created, then the name
1360.B home
1361will be used.
1362
1363A new array will normally get a randomly assigned 128bit UUID which is
1364very likely to be unique. If you have a specific need, you can choose
1365a UUID for the array by giving the
1366.B \-\-uuid=
1367option. Be warned that creating two arrays with the same UUID is a
1368recipe for disaster. Also, using
1369.B \-\-uuid=
1370when creating a v0.90 array will silently override any
1371.B \-\-homehost=
1372setting.
1373.\"If the
1374.\".B \-\-size
1375.\"option is given, it is not necessary to list any component-devices in this command.
1376.\"They can be added later, before a
1377.\".B \-\-run.
1378.\"If no
1379.\".B \-\-size
1380.\"is given, the apparent size of the smallest drive given is used.
1381
1382The General Management options that are valid with
1383.B \-\-create
1384are:
1385.TP
1386.B \-\-run
1387insist on running the array even if some devices look like they might
1388be in use.
1389
1390.TP
1391.B \-\-readonly
1392start the array readonly \(em not supported yet.
1393
1394
1395.SH MANAGE MODE
1396.HP 12
1397Usage:
1398.B mdadm
1399.I device
1400.I options... devices...
1401.PP
1402
1403This usage will allow individual devices in an array to be failed,
1404removed or added. It is possible to perform multiple operations with
1405on command. For example:
1406.br
1407.B " mdadm /dev/md0 \-f /dev/hda1 \-r /dev/hda1 \-a /dev/hda1"
1408.br
1409will firstly mark
1410.B /dev/hda1
1411as faulty in
1412.B /dev/md0
1413and will then remove it from the array and finally add it back
1414in as a spare. However only one md array can be affected by a single
1415command.
1416
1417.SH MISC MODE
1418.HP 12
1419Usage:
1420.B mdadm
1421.I options ...
1422.I devices ...
1423.PP
1424
1425MISC mode includes a number of distinct operations that
1426operate on distinct devices. The operations are:
1427.TP
1428.B \-\-query
1429The device is examined to see if it is
1430(1) an active md array, or
1431(2) a component of an md array.
1432The information discovered is reported.
1433
1434.TP
1435.B \-\-detail
1436The device should be an active md device.
1437.B mdadm
1438will display a detailed description of the array.
1439.B \-\-brief
1440or
1441.B \-\-scan
1442will cause the output to be less detailed and the format to be
1443suitable for inclusion in
1444.BR /etc/mdadm.conf .
1445The exit status of
1446.I mdadm
1447will normally be 0 unless
1448.I mdadm
1449failed to get useful information about the device(s); however, if the
1450.B \-\-test
1451option is given, then the exit status will be:
1452.RS
1453.TP
14540
1455The array is functioning normally.
1456.TP
14571
1458The array has at least one failed device.
1459.TP
14602
1461The array has multiple failed devices such that it is unusable.
1462.TP
14634
1464There was an error while trying to get information about the device.
1465.RE
1466
1467.TP
1468.B \-\-examine
1469The device should be a component of an md array.
1470.B mdadm
1471will read the md superblock of the device and display the contents.
1472If
1473.B \-\-brief
1474or
1475.B \-\-scan
1476is given, then multiple devices that are components of the one array
1477are grouped together and reported in a single entry suitable
1478for inclusion in
1479.BR /etc/mdadm.conf .
1480
1481Having
1482.B \-\-scan
1483without listing any devices will cause all devices listed in the
1484config file to be examined.
1485
1486.TP
1487.B \-\-stop
1488The devices should be active md arrays which will be deactivated, as
1489long as they are not currently in use.
1490
1491.TP
1492.B \-\-run
1493This will fully activate a partially assembled md array.
1494
1495.TP
1496.B \-\-readonly
1497This will mark an active array as read-only, providing that it is
1498not currently being used.
1499
1500.TP
1501.B \-\-readwrite
1502This will change a
1503.B readonly
1504array back to being read/write.
1505
1506.TP
1507.B \-\-scan
1508For all operations except
1509.BR \-\-examine ,
1510.B \-\-scan
1511will cause the operation to be applied to all arrays listed in
1512.BR /proc/mdstat .
1513For
1514.BR \-\-examine,
1515.B \-\-scan
1516causes all devices listed in the config file to be examined.
1517
1518
1519.SH MONITOR MODE
1520
1521.HP 12
1522Usage:
1523.B mdadm \-\-monitor
1524.I options... devices...
1525
1526.PP
1527This usage causes
1528.B mdadm
1529to periodically poll a number of md arrays and to report on any events
1530noticed.
1531.B mdadm
1532will never exit once it decides that there are arrays to be checked,
1533so it should normally be run in the background.
1534
1535As well as reporting events,
1536.B mdadm
1537may move a spare drive from one array to another if they are in the
1538same
1539.B spare-group
1540and if the destination array has a failed drive but no spares.
1541
1542If any devices are listed on the command line,
1543.B mdadm
1544will only monitor those devices. Otherwise all arrays listed in the
1545configuration file will be monitored. Further, if
1546.B \-\-scan
1547is given, then any other md devices that appear in
1548.B /proc/mdstat
1549will also be monitored.
1550
1551The result of monitoring the arrays is the generation of events.
1552These events are passed to a separate program (if specified) and may
1553be mailed to a given E-mail address.
1554
1555When passing events to a program, the program is run once for each event,
1556and is given 2 or 3 command-line arguments: the first is the
1557name of the event (see below), the second is the name of the
1558md device which is affected, and the third is the name of a related
1559device if relevant (such as a component device that has failed).
1560
1561If
1562.B \-\-scan
1563is given, then a program or an E-mail address must be specified on the
1564command line or in the config file. If neither are available, then
1565.B mdadm
1566will not monitor anything.
1567Without
1568.B \-\-scan,
1569.B mdadm
1570will continue monitoring as long as something was found to monitor. If
1571no program or email is given, then each event is reported to
1572.BR stdout .
1573
1574The different events are:
1575
1576.RS 4
1577.TP
1578.B DeviceDisappeared
1579An md array which previously was configured appears to no longer be
1580configured. (syslog priority: Critical)
1581
1582If
1583.I mdadm
1584was told to monitor an array which is RAID0 or Linear, then it will
1585report
1586.B DeviceDisappeared
1587with the extra information
1588.BR Wrong-Level .
1589This is because RAID0 and Linear do not support the device-failed,
1590hot-spare and resync operations which are monitored.
1591
1592.TP
1593.B RebuildStarted
1594An md array started reconstruction. (syslog priority: Warning)
1595
1596.TP
1597.BI Rebuild NN
1598Where
1599.I NN
1600is 20, 40, 60, or 80, this indicates that rebuild has passed that many
1601percentage of the total. (syslog priority: Warning)
1602
1603.TP
1604.B RebuildFinished
1605An md array that was rebuilding, isn't any more, either because it
1606finished normally or was aborted. (syslog priority: Warning)
1607
1608.TP
1609.B Fail
1610An active component device of an array has been marked as
1611faulty. (syslog priority: Critical)
1612
1613.TP
1614.B FailSpare
1615A spare component device which was being rebuilt to replace a faulty
1616device has failed. (syslog priority: Critical)
1617
1618.TP
1619.B SpareActive
1620A spare component device which was being rebuilt to replace a faulty
1621device has been successfully rebuilt and has been made active.
1622(syslog priority: Info)
1623
1624.TP
1625.B NewArray
1626A new md array has been detected in the
1627.B /proc/mdstat
1628file. (syslog priority: Info)
1629
1630.TP
1631.B DegradedArray
1632A newly noticed array appears to be degraded. This message is not
1633generated when
1634.I mdadm
1635notices a drive failure which causes degradation, but only when
1636.I mdadm
1637notices that an array is degraded when it first sees the array.
1638(syslog priority: Critical)
1639
1640.TP
1641.B MoveSpare
1642A spare drive has been moved from one array in a
1643.B spare-group
1644to another to allow a failed drive to be replaced.
1645(syslog priority: Info)
1646
1647.TP
1648.B SparesMissing
1649If
1650.I mdadm
1651has been told, via the config file, that an array should have a certain
1652number of spare devices, and
1653.I mdadm
1654detects that it has fewer than this number when it first sees the
1655array, it will report a
1656.B SparesMissing
1657message.
1658(syslog priority: Warning)
1659
1660.TP
1661.B TestMessage
1662An array was found at startup, and the
1663.B \-\-test
1664flag was given.
1665(syslog priority: Info)
1666.RE
1667
1668Only
1669.B Fail,
1670.B FailSpare,
1671.B DegradedArray,
1672.B SparesMissing
1673and
1674.B TestMessage
1675cause Email to be sent. All events cause the program to be run.
1676The program is run with two or three arguments: the event
1677name, the array device and possibly a second device.
1678
1679Each event has an associated array device (e.g.
1680.BR /dev/md1 )
1681and possibly a second device. For
1682.BR Fail ,
1683.BR FailSpare ,
1684and
1685.B SpareActive
1686the second device is the relevant component device.
1687For
1688.B MoveSpare
1689the second device is the array that the spare was moved from.
1690
1691For
1692.B mdadm
1693to move spares from one array to another, the different arrays need to
1694be labeled with the same
1695.B spare-group
1696in the configuration file. The
1697.B spare-group
1698name can be any string; it is only necessary that different spare
1699groups use different names.
1700
1701When
1702.B mdadm
1703detects that an array in a spare group has fewer active
1704devices than necessary for the complete array, and has no spare
1705devices, it will look for another array in the same spare group that
1706has a full complement of working drive and a spare. It will then
1707attempt to remove the spare from the second drive and add it to the
1708first.
1709If the removal succeeds but the adding fails, then it is added back to
1710the original array.
1711
1712.SH GROW MODE
1713The GROW mode is used for changing the size or shape of an active
1714array.
1715For this to work, the kernel must support the necessary change.
1716Various types of growth are being added during 2.6 development,
1717including restructuring a raid5 array to have more active devices.
1718
1719Currently the only support available is to
1720.IP \(bu 4
1721change the "size" attribute
1722for RAID1, RAID5 and RAID6.
1723.IP \(bu 4
1724increase the "raid-disks" attribute of RAID1, RAID5, and RAID6.
1725.IP \(bu 4
1726add a write-intent bitmap to any array which supports these bitmaps, or
1727remove a write-intent bitmap from such an array.
1728.PP
1729
1730.SS SIZE CHANGES
1731Normally when an array is built the "size" it taken from the smallest
1732of the drives. If all the small drives in an arrays are, one at a
1733time, removed and replaced with larger drives, then you could have an
1734array of large drives with only a small amount used. In this
1735situation, changing the "size" with "GROW" mode will allow the extra
1736space to start being used. If the size is increased in this way, a
1737"resync" process will start to make sure the new parts of the array
1738are synchronised.
1739
1740Note that when an array changes size, any filesystem that may be
1741stored in the array will not automatically grow to use the space. The
1742filesystem will need to be explicitly told to use the extra space.
1743
1744.SS RAID-DEVICES CHANGES
1745
1746A RAID1 array can work with any number of devices from 1 upwards
1747(though 1 is not very useful). There may be times which you want to
1748increase or decrease the number of active devices. Note that this is
1749different to hot-add or hot-remove which changes the number of
1750inactive devices.
1751
1752When reducing the number of devices in a RAID1 array, the slots which
1753are to be removed from the array must already be vacant. That is, the
1754devices which were in those slots must be failed and removed.
1755
1756When the number of devices is increased, any hot spares that are
1757present will be activated immediately.
1758
1759Increasing the number of active devices in a RAID5 is much more
1760effort. Every block in the array will need to be read and written
1761back to a new location. From 2.6.17, the Linux Kernel is able to do
1762this safely, including restart and interrupted "reshape".
1763
1764When relocating the first few stripes on a raid5, it is not possible
1765to keep the data on disk completely consistent and crash-proof. To
1766provide the required safety, mdadm disables writes to the array while
1767this "critical section" is reshaped, and takes a backup of the data
1768that is in that section. This backup is normally stored in any spare
1769devices that the array has, however it can also be stored in a
1770separate file specified with the
1771.B \-\-backup\-file
1772option. If this option is used, and the system does crash during the
1773critical period, the same file must be passed to
1774.B \-\-assemble
1775to restore the backup and reassemble the array.
1776
1777.SS BITMAP CHANGES
1778
1779A write-intent bitmap can be added to, or removed from, an active
1780array. Either internal bitmaps, or bitmaps stored in a separate file,
1781can be added. Note that if you add a bitmap stored in a file which is
1782in a filesystem that is on the raid array being affected, the system
1783will deadlock. The bitmap must be on a separate filesystem.
1784
1785.SH INCREMENTAL MODE
1786
1787.HP 12
1788Usage:
1789.B mdadm \-\-incremental
1790.RB [ \-\-run ]
1791.RB [ \-\-quiet ]
1792.I component-device
1793.HP 12
1794Usage:
1795.B mdadm \-\-incremental \-\-rebuild
1796.HP 12
1797Usage:
1798.B mdadm \-\-incremental \-\-run \-\-scan
1799
1800
1801.PP
1802This mode is designed to be used in conjunction with a device
1803discovery system. As devices are found in a system, they can be
1804passed to
1805.B "mdadm \-\-incremental"
1806to be conditionally added to an appropriate array.
1807
1808.I mdadm
1809performs a number of tests to determine if the device is part of an
1810array, and which array it should be part of. If an appropriate array
1811is found, or can be created,
1812.I mdadm
1813adds the device to the array and conditionally starts the array.
1814
1815Note that
1816.I mdadm
1817will only add devices to an array which were previously working
1818(active or spare) parts of that array. It does not currently support
1819automatic inclusion of a new drive as a spare in some array.
1820
1821.B "mdadm \-\-incremental"
1822requires a bug-fix in all kernels through 2.6.19.
1823Hopefully, this will be fixed in 2.6.20; alternately, apply the patch
1824which is included with the mdadm source distribution. If
1825.I mdadm
1826detects that this bug is present, it will abort any attempt to use
1827.BR \-\-incremental .
1828
1829The tests that
1830.I mdadm
1831makes are as follow:
1832.IP +
1833Is the device permitted by
1834.BR mdadm.conf ?
1835That is, is it listed in a
1836.B DEVICES
1837line in that file. If
1838.B DEVICES
1839is absent then the default it to allow any device. Similar if
1840.B DEVICES
1841contains the special word
1842.B partitions
1843then any device is allowed. Otherwise the device name given to
1844.I mdadm
1845must match one of the names or patterns in a
1846.B DEVICES
1847line.
1848
1849.IP +
1850Does the device have a valid md superblock. If a specific metadata
1851version is request with
1852.B \-\-metadata
1853or
1854.B \-e
1855then only that style of metadata is accepted, otherwise
1856.I mdadm
1857finds any known version of metadata. If no
1858.I md
1859metadata is found, the device is rejected.
1860
1861.IP +
1862Does the metadata match an expected array?
1863The metadata can match in two ways. Either there is an array listed
1864in
1865.B mdadm.conf
1866which identifies the array (either by UUID, by name, by device list,
1867or by minor-number), or the array was created with a
1868.B homehost
1869specified and that
1870.B homehost
1871matches the one in
1872.B mdadm.conf
1873or on the command line.
1874If
1875.I mdadm
1876is not able to positively identify the array as belonging to the
1877current host, the device will be rejected.
1878
1879.IP +
1880.I mdadm
1881keeps a list of arrays that it has partially assembled in
1882.B /var/run/mdadm/map
1883(or
1884.B /var/run/mdadm.map
1885if the directory doesn't exist). If no array exists which matches
1886the metadata on the new device,
1887.I mdadm
1888must choose a device name and unit number. It does this based on any
1889name given in
1890.B mdadm.conf
1891or any name information stored in the metadata. If this name
1892suggests a unit number, that number will be used, otherwise a free
1893unit number will be chosen. Normally
1894.I mdadm
1895will prefer to create a partitionable array, however if the
1896.B CREATE
1897line in
1898.B mdadm.conf
1899suggests that a non-partitionable array is preferred, that will be
1900honoured.
1901
1902.IP +
1903Once an appropriate array is found or created and the device is added,
1904.I mdadm
1905must decide if the array is ready to be started. It will
1906normally compare the number of available (non-spare) devices to the
1907number of devices that the metadata suggests need to be active. If
1908there are at least that many, the array will be started. This means
1909that if any devices are missing the array will not be restarted.
1910
1911As an alternative,
1912.B \-\-run
1913may be passed to
1914.B mdadm
1915in which case the array will be run as soon as there are enough
1916devices present for the data to be accessible. For a raid1, that
1917means one device will start the array. For a clean raid5, the array
1918will be started as soon as all but one drive is present.
1919
1920Note that neither of these approaches is really ideal. If it can
1921be known that all device discovery has completed, then
1922.br
1923.B " mdadm \-IRs"
1924.br
1925can be run which will try to start all arrays that are being
1926incrementally assembled. They are started in "read-auto" mode in
1927which they are read-only until the first write request. This means
1928that no metadata updates are made and no attempt at resync or recovery
1929happens. Further devices that are found before the first write can
1930still be added safely.
1931
1932.SH EXAMPLES
1933
1934.B " mdadm \-\-query /dev/name-of-device"
1935.br
1936This will find out if a given device is a raid array, or is part of
1937one, and will provide brief information about the device.
1938
1939.B " mdadm \-\-assemble \-\-scan"
1940.br
1941This will assemble and start all arrays listed in the standard config
1942file. This command will typically go in a system startup file.
1943
1944.B " mdadm \-\-stop \-\-scan"
1945.br
1946This will shut down all arrays that can be shut down (i.e. are not
1947currently in use). This will typically go in a system shutdown script.
1948
1949.B " mdadm \-\-follow \-\-scan \-\-delay=120"
1950.br
1951If (and only if) there is an Email address or program given in the
1952standard config file, then
1953monitor the status of all arrays listed in that file by
1954polling them ever 2 minutes.
1955
1956.B " mdadm \-\-create /dev/md0 \-\-level=1 \-\-raid\-devices=2 /dev/hd[ac]1"
1957.br
1958Create /dev/md0 as a RAID1 array consisting of /dev/hda1 and /dev/hdc1.
1959
1960.br
1961.B " echo 'DEVICE /dev/hd*[0\-9] /dev/sd*[0\-9]' > mdadm.conf"
1962.br
1963.B " mdadm \-\-detail \-\-scan >> mdadm.conf"
1964.br
1965This will create a prototype config file that describes currently
1966active arrays that are known to be made from partitions of IDE or SCSI drives.
1967This file should be reviewed before being used as it may
1968contain unwanted detail.
1969
1970.B " echo 'DEVICE /dev/hd[a\-z] /dev/sd*[a\-z]' > mdadm.conf"
1971.br
1972.B " mdadm \-\-examine \-\-scan \-\-config=mdadm.conf >> mdadm.conf"
1973.br
1974This will find arrays which could be assembled from existing IDE and
1975SCSI whole drives (not partitions), and store the information in the
1976format of a config file.
1977This file is very likely to contain unwanted detail, particularly
1978the
1979.B devices=
1980entries. It should be reviewed and edited before being used as an
1981actual config file.
1982
1983.B " mdadm \-\-examine \-\-brief \-\-scan \-\-config=partitions"
1984.br
1985.B " mdadm \-Ebsc partitions"
1986.br
1987Create a list of devices by reading
1988.BR /proc/partitions ,
1989scan these for RAID superblocks, and printout a brief listing of all
1990that were found.
1991
1992.B " mdadm \-Ac partitions \-m 0 /dev/md0"
1993.br
1994Scan all partitions and devices listed in
1995.BR /proc/partitions
1996and assemble
1997.B /dev/md0
1998out of all such devices with a RAID superblock with a minor number of 0.
1999
2000.B " mdadm \-\-monitor \-\-scan \-\-daemonise > /var/run/mdadm"
2001.br
2002If config file contains a mail address or alert program, run mdadm in
2003the background in monitor mode monitoring all md devices. Also write
2004pid of mdadm daemon to
2005.BR /var/run/mdadm .
2006
2007.B " mdadm \-Iq /dev/somedevice"
2008.br
2009Try to incorporate newly discovered device into some array as
2010appropriate.
2011
2012.B " mdadm \-\-incremental \-\-rebuild \-\-run \-\-scan"
2013.br
2014Rebuild the array map from any current arrays, and then start any that
2015can be started.
2016
2017.B " mdadm /dev/md4 --fail detached --remove detached"
2018.br
2019Any devices which are components of /dev/md4 will be marked as faulty
2020and then remove from the array.
2021
2022.B " mdadm \-\-create \-\-help"
2023.br
2024Provide help about the Create mode.
2025
2026.B " mdadm \-\-config \-\-help"
2027.br
2028Provide help about the format of the config file.
2029
2030.B " mdadm \-\-help"
2031.br
2032Provide general help.
2033
2034
2035.SH FILES
2036
2037.SS /proc/mdstat
2038
2039If you're using the
2040.B /proc
2041filesystem,
2042.B /proc/mdstat
2043lists all active md devices with information about them.
2044.B mdadm
2045uses this to find arrays when
2046.B \-\-scan
2047is given in Misc mode, and to monitor array reconstruction
2048on Monitor mode.
2049
2050
2051.SS /etc/mdadm.conf
2052
2053The config file lists which devices may be scanned to see if
2054they contain MD super block, and gives identifying information
2055(e.g. UUID) about known MD arrays. See
2056.BR mdadm.conf (5)
2057for more details.
2058
2059.SS /var/run/mdadm/map
2060When
2061.B \-\-incremental
2062mode is used, this file gets a list of arrays currently being created.
2063If
2064.B /var/run/mdadm
2065does not exist as a directory, then
2066.B /var/run/mdadm.map
2067is used instead.
2068
2069.SH DEVICE NAMES
2070
2071While entries in the /dev directory can have any format you like,
2072.I mdadm
2073has an understanding of 'standard' formats which it uses to guide its
2074behaviour when creating device files via the
2075.B \-\-auto
2076option.
2077
2078The standard names for non-partitioned arrays (the only sort of md
2079array available in 2.4 and earlier) are either of
2080.IP
2081/dev/mdNN
2082.br
2083/dev/md/NN
2084.PP
2085where NN is a number.
2086The standard names for partitionable arrays (as available from 2.6
2087onwards) are either of
2088.IP
2089/dev/md/dNN
2090.br
2091/dev/md_dNN
2092.PP
2093Partition numbers should be indicated by added "pMM" to these, thus "/dev/md/d1p2".
2094
2095.SH NOTE
2096.B mdadm
2097was previously known as
2098.BR mdctl .
2099.P
2100.B mdadm
2101is completely separate from the
2102.B raidtools
2103package, and does not use the
2104.I /etc/raidtab
2105configuration file at all.
2106
2107.SH SEE ALSO
2108For further information on mdadm usage, MD and the various levels of
2109RAID, see:
2110
2111.IP
2112.UR http://linux-raid.osdl.org/
2113http://linux\-raid.osdl.org/
2114.UE
2115.PP
2116(based upon Jakob \(/Ostergaard's Software\-RAID.HOWTO)
2117.\".PP
2118.\"for new releases of the RAID driver check out:
2119.\"
2120.\".IP
2121.\".UR ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
2122.\"ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
2123.\".UE
2124.\".PP
2125.\"or
2126.\".IP
2127.\".UR http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2128.\"http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2129.\".UE
2130.PP
2131The latest version of
2132.I mdadm
2133should always be available from
2134.IP
2135.UR http://www.kernel.org/pub/linux/utils/raid/mdadm/
2136http://www.kernel.org/pub/linux/utils/raid/mdadm/
2137.UE
2138.PP
2139.IR mdadm.conf (5),
2140.IR md (4).
2141.PP
2142.IR raidtab (5),
2143.IR raid0run (8),
2144.IR raidstop (8),
2145.IR mkraid (8).