]> git.ipfire.org Git - thirdparty/mdadm.git/blame_incremental - mdadm.8
Make device-special files for partitions when using --incremental
[thirdparty/mdadm.git] / mdadm.8
... / ...
CommitLineData
1.\" -*- nroff -*-
2.\" Copyright Neil Brown and others.
3.\" This program is free software; you can redistribute it and/or modify
4.\" it under the terms of the GNU General Public License as published by
5.\" the Free Software Foundation; either version 2 of the License, or
6.\" (at your option) any later version.
7.\" See file COPYING in distribution for details.
8.TH MDADM 8 "" v2.6.4
9.SH NAME
10mdadm \- manage MD devices
11.I aka
12Linux Software RAID
13
14.SH SYNOPSIS
15
16.BI mdadm " [mode] <raiddevice> [options] <component-devices>"
17
18.SH DESCRIPTION
19RAID devices are virtual devices created from two or more
20real block devices. This allows multiple devices (typically disk
21drives or partitions thereof) to be combined into a single device to
22hold (for example) a single filesystem.
23Some RAID levels include redundancy and so can survive some degree of
24device failure.
25
26Linux Software RAID devices are implemented through the md (Multiple
27Devices) device driver.
28
29Currently, Linux supports
30.B LINEAR
31md devices,
32.B RAID0
33(striping),
34.B RAID1
35(mirroring),
36.BR RAID4 ,
37.BR RAID5 ,
38.BR RAID6 ,
39.BR RAID10 ,
40.BR MULTIPATH ,
41and
42.BR FAULTY .
43
44.B MULTIPATH
45is not a Software RAID mechanism, but does involve
46multiple devices:
47each device is a path to one common physical storage device.
48
49.B FAULTY
50is also not true RAID, and it only involves one device. It
51provides a layer over a true device that can be used to inject faults.
52
53.\".B mdadm
54.\"is a program that can be used to create, manage, and monitor
55.\"MD devices. As
56.\"such it provides a similar set of functionality to the
57.\".B raidtools
58.\"packages.
59.\"The key differences between
60.\".B mdadm
61.\"and
62.\".B raidtools
63.\"are:
64.\".IP \(bu 4
65.\".B mdadm
66.\"is a single program and not a collection of programs.
67.\".IP \(bu 4
68.\".B mdadm
69.\"can perform (almost) all of its functions without having a
70.\"configuration file and does not use one by default. Also
71.\".B mdadm
72.\"helps with management of the configuration
73.\"file.
74.\".IP \(bu 4
75.\".B mdadm
76.\"can provide information about your arrays (through Query, Detail, and Examine)
77.\"that
78.\".B raidtools
79.\"cannot.
80.\".P
81.\".I mdadm
82.\"does not use
83.\".IR /etc/raidtab ,
84.\"the
85.\".B raidtools
86.\"configuration file, at all. It has a different configuration file
87.\"with a different format and a different purpose.
88
89.SH MODES
90mdadm has several major modes of operation:
91.TP
92.B Assemble
93Assemble the components of a previously created
94array into an active array. Components can be explicitly given
95or can be searched for.
96.B mdadm
97checks that the components
98do form a bona fide array, and can, on request, fiddle superblock
99information so as to assemble a faulty array.
100
101.TP
102.B Build
103Build an array that doesn't have per-device superblocks. For these
104sorts of arrays,
105.I mdadm
106cannot differentiate between initial creation and subsequent assembly
107of an array. It also cannot perform any checks that appropriate
108components have been requested. Because of this, the
109.B Build
110mode should only be used together with a complete understanding of
111what you are doing.
112
113.TP
114.B Create
115Create a new array with per-device superblocks.
116.\"It can progress
117.\"in several step create-add-add-run or it can all happen with one command.
118
119.TP
120.B "Follow or Monitor"
121Monitor one or more md devices and act on any state changes. This is
122only meaningful for raid1, 4, 5, 6, 10 or multipath arrays, as
123only these have interesting state. raid0 or linear never have
124missing, spare, or failed drives, so there is nothing to monitor.
125
126.TP
127.B "Grow"
128Grow (or shrink) an array, or otherwise reshape it in some way.
129Currently supported growth options including changing the active size
130of component devices and changing the number of active devices in RAID
131levels 1/4/5/6, as well as adding or removing a write-intent bitmap.
132
133.TP
134.B "Incremental Assembly"
135Add a single device to an appropriate array. If the addition of the
136device makes the array runnable, the array will be started.
137This provides a convenient interface to a
138.I hot-plug
139system. As each device is detected,
140.I mdadm
141has a chance to include it in some array as appropriate.
142
143.TP
144.B Manage
145This is for doing things to specific components of an array such as
146adding new spares and removing faulty devices.
147
148.TP
149.B Misc
150This is an 'everything else' mode that supports operations on active
151arrays, operations on component devices such as erasing old superblocks, and
152information gathering operations.
153.\"This mode allows operations on independent devices such as examine MD
154.\"superblocks, erasing old superblocks and stopping active arrays.
155
156.TP
157.B Auto-detect
158This mode does not act on a specific device or array, but rather it
159requests the Linux Kernel to activate any auto-detected arrays.
160.SH OPTIONS
161
162.SH Options for selecting a mode are:
163
164.TP
165.BR \-A ", " \-\-assemble
166Assemble a pre-existing array.
167
168.TP
169.BR \-B ", " \-\-build
170Build a legacy array without superblocks.
171
172.TP
173.BR \-C ", " \-\-create
174Create a new array.
175
176.TP
177.BR \-F ", " \-\-follow ", " \-\-monitor
178Select
179.B Monitor
180mode.
181
182.TP
183.BR \-G ", " \-\-grow
184Change the size or shape of an active array.
185
186.TP
187.BR \-I ", " \-\-incremental
188Add a single device into an appropriate array, and possibly start the array.
189
190.TP
191.B \-\-auto-detect
192Request that the kernel starts any auto-detected arrays. This can only
193work if
194.I md
195is compiled into the kernel \(em not if it is a module.
196Arrays can be auto-detected by the kernel if all the components are in
197primary MS-DOS partitions with partition type
198.BR FD .
199In-kernel autodetect is not recommended for new installations. Using
200.I mdadm
201to detect and assemble arrays \(em possibly in an
202.I initrd
203\(em is substantially more flexible and should be preferred.
204
205.P
206If a device is given before any options, or if the first option is
207.BR \-\-add ,
208.BR \-\-fail ,
209or
210.BR \-\-remove ,
211then the MANAGE mode is assume.
212Anything other than these will cause the
213.B Misc
214mode to be assumed.
215
216.SH Options that are not mode-specific are:
217
218.TP
219.BR \-h ", " \-\-help
220Display general help message or, after one of the above options, a
221mode-specific help message.
222
223.TP
224.B \-\-help\-options
225Display more detailed help about command line parsing and some commonly
226used options.
227
228.TP
229.BR \-V ", " \-\-version
230Print version information for mdadm.
231
232.TP
233.BR \-v ", " \-\-verbose
234Be more verbose about what is happening. This can be used twice to be
235extra-verbose.
236The extra verbosity currently only affects
237.B \-\-detail \-\-scan
238and
239.BR "\-\-examine \-\-scan" .
240
241.TP
242.BR \-q ", " \-\-quiet
243Avoid printing purely informative messages. With this,
244.B mdadm
245will be silent unless there is something really important to report.
246
247.TP
248.BR \-b ", " \-\-brief
249Be less verbose. This is used with
250.B \-\-detail
251and
252.BR \-\-examine .
253Using
254.B \-\-brief
255with
256.B \-\-verbose
257gives an intermediate level of verbosity.
258
259.TP
260.BR \-f ", " \-\-force
261Be more forceful about certain operations. See the various modes for
262the exact meaning of this option in different contexts.
263
264.TP
265.BR \-c ", " \-\-config=
266Specify the config file. Default is to use
267.BR /etc/mdadm.conf ,
268or if that is missing then
269.BR /etc/mdadm/mdadm.conf .
270If the config file given is
271.B "partitions"
272then nothing will be read, but
273.I mdadm
274will act as though the config file contained exactly
275.B "DEVICE partitions"
276and will read
277.B /proc/partitions
278to find a list of devices to scan.
279If the word
280.B "none"
281is given for the config file, then
282.I mdadm
283will act as though the config file were empty.
284
285.TP
286.BR \-s ", " \-\-scan
287Scan config file or
288.B /proc/mdstat
289for missing information.
290In general, this option gives
291.B mdadm
292permission to get any missing information (like component devices,
293array devices, array identities, and alert destination) from the
294configuration file (see previous option);
295one exception is MISC mode when using
296.B \-\-detail
297or
298.B \-\-stop,
299in which case
300.B \-\-scan
301says to get a list of array devices from
302.BR /proc/mdstat .
303
304.TP
305.B \-e ", " \-\-metadata=
306Declare the style of superblock (raid metadata) to be used. The
307default is 0.90 for
308.BR \-\-create ,
309and to guess for other operations.
310The default can be overridden by setting the
311.B metadata
312value for the
313.B CREATE
314keyword in
315.BR mdadm.conf .
316
317Options are:
318.RS
319.IP "0, 0.90, default"
320Use the original 0.90 format superblock. This format limits arrays to
32128 component devices and limits component devices of levels 1 and
322greater to 2 terabytes.
323.IP "1, 1.0, 1.1, 1.2"
324Use the new version-1 format superblock. This has few restrictions.
325The different sub-versions store the superblock at different locations
326on the device, either at the end (for 1.0), at the start (for 1.1) or
3274K from the start (for 1.2).
328.RE
329
330.TP
331.B \-\-homehost=
332This will override any
333.B HOMEHOST
334setting in the config file and provides the identity of the host which
335should be considered the home for any arrays.
336
337When creating an array, the
338.B homehost
339will be recorded in the superblock. For version-1 superblocks, it will
340be prefixed to the array name. For version-0.90 superblocks, part of
341the SHA1 hash of the hostname will be stored in the later half of the
342UUID.
343
344When reporting information about an array, any array which is tagged
345for the given homehost will be reported as such.
346
347When using Auto-Assemble, only arrays tagged for the given homehost
348will be assembled.
349
350.SH For create, build, or grow:
351
352.TP
353.BR \-n ", " \-\-raid\-devices=
354Specify the number of active devices in the array. This, plus the
355number of spare devices (see below) must equal the number of
356.I component-devices
357(including "\fBmissing\fP" devices)
358that are listed on the command line for
359.BR \-\-create .
360Setting a value of 1 is probably
361a mistake and so requires that
362.B \-\-force
363be specified first. A value of 1 will then be allowed for linear,
364multipath, raid0 and raid1. It is never allowed for raid4 or raid5.
365.br
366This number can only be changed using
367.B \-\-grow
368for RAID1, RAID5 and RAID6 arrays, and only on kernels which provide
369necessary support.
370
371.TP
372.BR \-x ", " \-\-spare\-devices=
373Specify the number of spare (eXtra) devices in the initial array.
374Spares can also be added
375and removed later. The number of component devices listed
376on the command line must equal the number of raid devices plus the
377number of spare devices.
378
379
380.TP
381.BR \-z ", " \-\-size=
382Amount (in Kibibytes) of space to use from each drive in RAID level 1/4/5/6.
383This must be a multiple of the chunk size, and must leave about 128Kb
384of space at the end of the drive for the RAID superblock.
385If this is not specified
386(as it normally is not) the smallest drive (or partition) sets the
387size, though if there is a variance among the drives of greater than 1%, a warning is
388issued.
389
390This value can be set with
391.B \-\-grow
392for RAID level 1/4/5/6. If the array was created with a size smaller
393than the currently active drives, the extra space can be accessed
394using
395.BR \-\-grow .
396The size can be given as
397.B max
398which means to choose the largest size that fits on all current drives.
399
400.TP
401.BR \-c ", " \-\-chunk=
402Specify chunk size of kibibytes. The default is 64.
403
404.TP
405.BR \-\-rounding=
406Specify rounding factor for linear array (==chunk size)
407
408.TP
409.BR \-l ", " \-\-level=
410Set raid level. When used with
411.BR \-\-create ,
412options are: linear, raid0, 0, stripe, raid1, 1, mirror, raid4, 4,
413raid5, 5, raid6, 6, raid10, 10, multipath, mp, faulty. Obviously some of these are synonymous.
414
415When used with
416.BR \-\-build ,
417only linear, stripe, raid0, 0, raid1, multipath, mp, and faulty are valid.
418
419Not yet supported with
420.BR \-\-grow .
421
422.TP
423.BR \-p ", " \-\-layout=
424This option configures the fine details of data layout for raid5,
425and raid10 arrays, and controls the failure modes for
426.IR faulty .
427
428The layout of the raid5 parity block can be one of
429.BR left\-asymmetric ,
430.BR left\-symmetric ,
431.BR right\-asymmetric ,
432.BR right\-symmetric ,
433.BR la ", " ra ", " ls ", " rs .
434The default is
435.BR left\-symmetric .
436
437When setting the failure mode for level
438.I faulty,
439the options are:
440.BR write\-transient ", " wt ,
441.BR read\-transient ", " rt ,
442.BR write\-persistent ", " wp ,
443.BR read\-persistent ", " rp ,
444.BR write\-all ,
445.BR read\-fixable ", " rf ,
446.BR clear ", " flush ", " none .
447
448Each failure mode can be followed by a number, which is used as a period
449between fault generation. Without a number, the fault is generated
450once on the first relevant request. With a number, the fault will be
451generated after that many requests, and will continue to be generated
452every time the period elapses.
453
454Multiple failure modes can be current simultaneously by using the
455.B \-\-grow
456option to set subsequent failure modes.
457
458"clear" or "none" will remove any pending or periodic failure modes,
459and "flush" will clear any persistent faults.
460
461To set the parity with
462.BR \-\-grow ,
463the level of the array ("faulty")
464must be specified before the fault mode is specified.
465
466Finally, the layout options for RAID10 are one of 'n', 'o' or 'f' followed
467by a small number. The default is 'n2'. The supported options are:
468
469.I 'n'
470signals 'near' copies. Multiple copies of one data block are at
471similar offsets in different devices.
472
473.I 'o'
474signals 'offset' copies. Rather than the chunks being duplicated
475within a stripe, whole stripes are duplicated but are rotated by one
476device so duplicate blocks are on different devices. Thus subsequent
477copies of a block are in the next drive, and are one chunk further
478down.
479
480.I 'f'
481signals 'far' copies
482(multiple copies have very different offsets).
483See md(4) for more detail about 'near' and 'far'.
484
485The number is the number of copies of each datablock. 2 is normal, 3
486can be useful. This number can be at most equal to the number of
487devices in the array. It does not need to divide evenly into that
488number (e.g. it is perfectly legal to have an 'n2' layout for an array
489with an odd number of devices).
490
491.TP
492.BR \-\-parity=
493same as
494.B \-\-layout
495(thus explaining the p of
496.BR \-p ).
497
498.TP
499.BR \-b ", " \-\-bitmap=
500Specify a file to store a write-intent bitmap in. The file should not
501exist unless
502.B \-\-force
503is also given. The same file should be provided
504when assembling the array. If the word
505.B "internal"
506is given, then the bitmap is stored with the metadata on the array,
507and so is replicated on all devices. If the word
508.B "none"
509is given with
510.B \-\-grow
511mode, then any bitmap that is present is removed.
512
513To help catch typing errors, the filename must contain at least one
514slash ('/') if it is a real file (not 'internal' or 'none').
515
516Note: external bitmaps are only known to work on ext2 and ext3.
517Storing bitmap files on other filesystems may result in serious problems.
518
519.TP
520.BR \-\-bitmap\-chunk=
521Set the chunksize of the bitmap. Each bit corresponds to that many
522Kilobytes of storage.
523When using a file based bitmap, the default is to use the smallest
524size that is at-least 4 and requires no more than 2^21 chunks.
525When using an
526.B internal
527bitmap, the chunksize is automatically determined to make best use of
528available space.
529
530
531.TP
532.BR \-W ", " \-\-write\-mostly
533subsequent devices lists in a
534.BR \-\-build ,
535.BR \-\-create ,
536or
537.B \-\-add
538command will be flagged as 'write-mostly'. This is valid for RAID1
539only and means that the 'md' driver will avoid reading from these
540devices if at all possible. This can be useful if mirroring over a
541slow link.
542
543.TP
544.BR \-\-write\-behind=
545Specify that write-behind mode should be enabled (valid for RAID1
546only). If an argument is specified, it will set the maximum number
547of outstanding writes allowed. The default value is 256.
548A write-intent bitmap is required in order to use write-behind
549mode, and write-behind is only attempted on drives marked as
550.IR write-mostly .
551
552.TP
553.BR \-\-assume\-clean
554Tell
555.I mdadm
556that the array pre-existed and is known to be clean. It can be useful
557when trying to recover from a major failure as you can be sure that no
558data will be affected unless you actually write to the array. It can
559also be used when creating a RAID1 or RAID10 if you want to avoid the
560initial resync, however this practice \(em while normally safe \(em is not
561recommended. Use this only if you really know what you are doing.
562
563.TP
564.BR \-\-backup\-file=
565This is needed when
566.B \-\-grow
567is used to increase the number of
568raid-devices in a RAID5 if there are no spare devices available.
569See the section below on RAID_DEVICE CHANGES. The file should be
570stored on a separate device, not on the raid array being reshaped.
571
572.TP
573.BR \-N ", " \-\-name=
574Set a
575.B name
576for the array. This is currently only effective when creating an
577array with a version-1 superblock. The name is a simple textual
578string that can be used to identify array components when assembling.
579
580.TP
581.BR \-R ", " \-\-run
582Insist that
583.I mdadm
584run the array, even if some of the components
585appear to be active in another array or filesystem. Normally
586.I mdadm
587will ask for confirmation before including such components in an
588array. This option causes that question to be suppressed.
589
590.TP
591.BR \-f ", " \-\-force
592Insist that
593.I mdadm
594accept the geometry and layout specified without question. Normally
595.I mdadm
596will not allow creation of an array with only one device, and will try
597to create a raid5 array with one missing drive (as this makes the
598initial resync work faster). With
599.BR \-\-force ,
600.I mdadm
601will not try to be so clever.
602
603.TP
604.BR \-a ", " "\-\-auto{=no,yes,md,mdp,part,p}{NN}"
605Instruct mdadm to create the device file if needed, possibly allocating
606an unused minor number. "md" causes a non-partitionable array
607to be used. "mdp", "part" or "p" causes a partitionable array (2.6 and
608later) to be used. "yes" requires the named md device to have
609a 'standard' format, and the type and minor number will be determined
610from this. See DEVICE NAMES below.
611
612The argument can also come immediately after
613"\-a". e.g. "\-ap".
614
615If
616.B \-\-auto
617is not given on the command line or in the config file, then
618the default will be
619.BR \-\-auto=yes .
620
621If
622.B \-\-scan
623is also given, then any
624.I auto=
625entries in the config file will override the
626.B \-\-auto
627instruction given on the command line.
628
629For partitionable arrays,
630.I mdadm
631will create the device file for the whole array and for the first 4
632partitions. A different number of partitions can be specified at the
633end of this option (e.g.
634.BR \-\-auto=p7 ).
635If the device name ends with a digit, the partition names add a 'p',
636and a number, e.g. "/dev/home1p3". If there is no
637trailing digit, then the partition names just have a number added,
638e.g. "/dev/scratch3".
639
640If the md device name is in a 'standard' format as described in DEVICE
641NAMES, then it will be created, if necessary, with the appropriate
642number based on that name. If the device name is not in one of these
643formats, then a unused minor number will be allocated. The minor
644number will be considered unused if there is no active array for that
645number, and there is no entry in /dev for that number and with a
646non-standard name.
647
648.TP
649.BR \-\-symlink = no
650Normally when
651.B \-\-auto
652causes
653.I mdadm
654to create devices in
655.B /dev/md/
656it will also create symlinks from
657.B /dev/
658with names starting with
659.B md
660or
661.BR md_ .
662Use
663.B \-\-symlink=no
664to suppress this, or
665.B \-\-symlink=yes
666to enforce this even if it is suppressing
667.IR mdadm.conf .
668
669
670.SH For assemble:
671
672.TP
673.BR \-u ", " \-\-uuid=
674uuid of array to assemble. Devices which don't have this uuid are
675excluded
676
677.TP
678.BR \-m ", " \-\-super\-minor=
679Minor number of device that array was created for. Devices which
680don't have this minor number are excluded. If you create an array as
681/dev/md1, then all superblocks will contain the minor number 1, even if
682the array is later assembled as /dev/md2.
683
684Giving the literal word "dev" for
685.B \-\-super\-minor
686will cause
687.I mdadm
688to use the minor number of the md device that is being assembled.
689e.g. when assembling
690.BR /dev/md0 ,
691.M \-\-super\-minor=dev
692will look for super blocks with a minor number of 0.
693
694.TP
695.BR \-N ", " \-\-name=
696Specify the name of the array to assemble. This must be the name
697that was specified when creating the array. It must either match
698the name stored in the superblock exactly, or it must match
699with the current
700.I homehost
701prefixed to the start of the given name.
702
703.TP
704.BR \-f ", " \-\-force
705Assemble the array even if some superblocks appear out-of-date
706
707.TP
708.BR \-R ", " \-\-run
709Attempt to start the array even if fewer drives were given than were
710present last time the array was active. Normally if not all the
711expected drives are found and
712.B \-\-scan
713is not used, then the array will be assembled but not started.
714With
715.B \-\-run
716an attempt will be made to start it anyway.
717
718.TP
719.B \-\-no\-degraded
720This is the reverse of
721.B \-\-run
722in that it inhibits the startup of array unless all expected drives
723are present. This is only needed with
724.B \-\-scan,
725and can be used if the physical connections to devices are
726not as reliable as you would like.
727
728.TP
729.BR \-a ", " "\-\-auto{=no,yes,md,mdp,part}"
730See this option under Create and Build options.
731
732.TP
733.BR \-b ", " \-\-bitmap=
734Specify the bitmap file that was given when the array was created. If
735an array has an
736.B internal
737bitmap, there is no need to specify this when assembling the array.
738
739.TP
740.BR \-\-backup\-file=
741If
742.B \-\-backup\-file
743was used to grow the number of raid-devices in a RAID5, and the system
744crashed during the critical section, then the same
745.B \-\-backup\-file
746must be presented to
747.B \-\-assemble
748to allow possibly corrupted data to be restored.
749
750.TP
751.BR \-U ", " \-\-update=
752Update the superblock on each device while assembling the array. The
753argument given to this flag can be one of
754.BR sparc2.2 ,
755.BR summaries ,
756.BR uuid ,
757.BR name ,
758.BR homehost ,
759.BR resync ,
760.BR byteorder ,
761.BR devicesize ,
762or
763.BR super\-minor .
764
765The
766.B sparc2.2
767option will adjust the superblock of an array what was created on a Sparc
768machine running a patched 2.2 Linux kernel. This kernel got the
769alignment of part of the superblock wrong. You can use the
770.B "\-\-examine \-\-sparc2.2"
771option to
772.I mdadm
773to see what effect this would have.
774
775The
776.B super\-minor
777option will update the
778.B "preferred minor"
779field on each superblock to match the minor number of the array being
780assembled.
781This can be useful if
782.B \-\-examine
783reports a different "Preferred Minor" to
784.BR \-\-detail .
785In some cases this update will be performed automatically
786by the kernel driver. In particular the update happens automatically
787at the first write to an array with redundancy (RAID level 1 or
788greater) on a 2.6 (or later) kernel.
789
790The
791.B uuid
792option will change the uuid of the array. If a UUID is given with the
793.B \-\-uuid
794option that UUID will be used as a new UUID and will
795.B NOT
796be used to help identify the devices in the array.
797If no
798.B \-\-uuid
799is given, a random UUID is chosen.
800
801The
802.B name
803option will change the
804.I name
805of the array as stored in the superblock. This is only supported for
806version-1 superblocks.
807
808The
809.B homehost
810option will change the
811.I homehost
812as recorded in the superblock. For version-0 superblocks, this is the
813same as updating the UUID.
814For version-1 superblocks, this involves updating the name.
815
816The
817.B resync
818option will cause the array to be marked
819.I dirty
820meaning that any redundancy in the array (e.g. parity for raid5,
821copies for raid1) may be incorrect. This will cause the raid system
822to perform a "resync" pass to make sure that all redundant information
823is correct.
824
825The
826.B byteorder
827option allows arrays to be moved between machines with different
828byte-order.
829When assembling such an array for the first time after a move, giving
830.B "\-\-update=byteorder"
831will cause
832.I mdadm
833to expect superblocks to have their byteorder reversed, and will
834correct that order before assembling the array. This is only valid
835with original (Version 0.90) superblocks.
836
837The
838.B summaries
839option will correct the summaries in the superblock. That is the
840counts of total, working, active, failed, and spare devices.
841
842The
843.B devicesize
844will rarely be of use. It applies to version 1.1 and 1.2 metadata
845only (where the metadata is at the start of the device) and is only
846useful when the component device has changed size (typically become
847larger). The version 1 metadata records the amount of the device that
848can be used to store data, so if a device in a version 1.1 or 1.2
849array becomes larger, the metadata will still be visible, but the
850extra space will not. In this case it might be useful to assemble the
851array with
852.BR \-\-update=devicesize .
853This will cause
854.I mdadm
855to determine the maximum usable amount of space on each device and
856update the relevant field in the metadata.
857
858.TP
859.B \-\-auto\-update\-homehost
860This flag is only meaningful with auto-assembly (see discussion below).
861In that situation, if no suitable arrays are found for this homehost,
862.I mdadm
863will rescan for any arrays at all and will assemble them and update the
864homehost to match the current host.
865
866.SH For Manage mode:
867
868.TP
869.BR \-a ", " \-\-add
870hot-add listed devices.
871
872.TP
873.BR \-\-re\-add
874re-add a device that was recently removed from an array.
875
876.TP
877.BR \-r ", " \-\-remove
878remove listed devices. They must not be active. i.e. they should
879be failed or spare devices. As well as the name of a device file
880(e.g.
881.BR /dev/sda1 )
882the words
883.B failed
884and
885.B detached
886can be given to
887.BR \-\-remove .
888The first causes all failed device to be removed. The second causes
889any device which is no longer connected to the system (i.e an 'open'
890returns
891.BR ENXIO )
892to be removed. This will only succeed for devices that are spares or
893have already been marked as failed.
894
895.TP
896.BR \-f ", " \-\-fail
897mark listed devices as faulty.
898As well as the name of a device file, the word
899.B detached
900can be given. This will cause any device that has been detached from
901the system to be marked as failed. It can then be removed.
902
903.TP
904.BR \-\-set\-faulty
905same as
906.BR \-\-fail .
907
908.P
909Each of these options require that the first device listed is the array
910to be acted upon, and the remainder are component devices to be added,
911removed, or marked as faulty. Several different operations can be
912specified for different devices, e.g.
913.in +5
914mdadm /dev/md0 \-\-add /dev/sda1 \-\-fail /dev/sdb1 \-\-remove /dev/sdb1
915.in -5
916Each operation applies to all devices listed until the next
917operation.
918
919If an array is using a write-intent bitmap, then devices which have
920been removed can be re-added in a way that avoids a full
921reconstruction but instead just updates the blocks that have changed
922since the device was removed. For arrays with persistent metadata
923(superblocks) this is done automatically. For arrays created with
924.B \-\-build
925mdadm needs to be told that this device we removed recently with
926.BR \-\-re\-add .
927
928Devices can only be removed from an array if they are not in active
929use, i.e. that must be spares or failed devices. To remove an active
930device, it must first be marked as
931.B faulty.
932
933.SH For Misc mode:
934
935.TP
936.BR \-Q ", " \-\-query
937Examine a device to see
938(1) if it is an md device and (2) if it is a component of an md
939array.
940Information about what is discovered is presented.
941
942.TP
943.BR \-D ", " \-\-detail
944Print detail of one or more md devices.
945
946.TP
947.BR \-Y ", " \-\-export
948When used with
949.BR \-\-detail ,
950output will be formatted as
951.B key=value
952pairs for easy import into the environment.
953
954.TP
955.BR \-E ", " \-\-examine
956Print content of md superblock on device(s).
957.TP
958.B \-\-sparc2.2
959If an array was created on a 2.2 Linux kernel patched with RAID
960support, the superblock will have been created incorrectly, or at
961least incompatibly with 2.4 and later kernels. Using the
962.B \-\-sparc2.2
963flag with
964.B \-\-examine
965will fix the superblock before displaying it. If this appears to do
966the right thing, then the array can be successfully assembled using
967.BR "\-\-assemble \-\-update=sparc2.2" .
968
969.TP
970.BR \-X ", " \-\-examine\-bitmap
971Report information about a bitmap file.
972The argument is either an external bitmap file or an array component
973in case of an internal bitmap.
974
975.TP
976.BR \-R ", " \-\-run
977start a partially built array.
978
979.TP
980.BR \-S ", " \-\-stop
981deactivate array, releasing all resources.
982
983.TP
984.BR \-o ", " \-\-readonly
985mark array as readonly.
986
987.TP
988.BR \-w ", " \-\-readwrite
989mark array as readwrite.
990
991.TP
992.B \-\-zero\-superblock
993If the device contains a valid md superblock, the block is
994overwritten with zeros. With
995.B \-\-force
996the block where the superblock would be is overwritten even if it
997doesn't appear to be valid.
998
999.TP
1000.BR \-t ", " \-\-test
1001When used with
1002.BR \-\-detail ,
1003the exit status of
1004.I mdadm
1005is set to reflect the status of the device.
1006
1007.TP
1008.BR \-W ", " \-\-wait
1009For each md device given, wait for any resync, recovery, or reshape
1010activity to finish before returning.
1011.I mdadm
1012will return with success if it actually waited for every device
1013listed, otherwise it will return failure.
1014
1015.SH For Incremental Assembly mode:
1016.TP
1017.BR \-\-rebuild\-map ", " \-r
1018Rebuild the map file
1019.RB ( /var/run/mdadm/map )
1020that
1021.I mdadm
1022uses to help track which arrays are currently being assembled.
1023
1024.TP
1025.BR \-\-run ", " \-R
1026Run any array assembled as soon as a minimal number of devices are
1027available, rather than waiting until all expected devices are present.
1028
1029.TP
1030.BR \-\-scan ", " \-s
1031Only meaningful with
1032.B \-R
1033this will scan the
1034.B map
1035file for arrays that are being incrementally assembled and will try to
1036start any that are not already started. If any such array is listed
1037in
1038.B mdadm.conf
1039as requiring an external bitmap, that bitmap will be attached first.
1040
1041.SH For Monitor mode:
1042.TP
1043.BR \-m ", " \-\-mail
1044Give a mail address to send alerts to.
1045
1046.TP
1047.BR \-p ", " \-\-program ", " \-\-alert
1048Give a program to be run whenever an event is detected.
1049
1050.TP
1051.BR \-y ", " \-\-syslog
1052Cause all events to be reported through 'syslog'. The messages have
1053facility of 'daemon' and varying priorities.
1054
1055.TP
1056.BR \-d ", " \-\-delay
1057Give a delay in seconds.
1058.B mdadm
1059polls the md arrays and then waits this many seconds before polling
1060again. The default is 60 seconds.
1061
1062.TP
1063.BR \-f ", " \-\-daemonise
1064Tell
1065.B mdadm
1066to run as a background daemon if it decides to monitor anything. This
1067causes it to fork and run in the child, and to disconnect form the
1068terminal. The process id of the child is written to stdout.
1069This is useful with
1070.B \-\-scan
1071which will only continue monitoring if a mail address or alert program
1072is found in the config file.
1073
1074.TP
1075.BR \-i ", " \-\-pid\-file
1076When
1077.B mdadm
1078is running in daemon mode, write the pid of the daemon process to
1079the specified file, instead of printing it on standard output.
1080
1081.TP
1082.BR \-1 ", " \-\-oneshot
1083Check arrays only once. This will generate
1084.B NewArray
1085events and more significantly
1086.B DegradedArray
1087and
1088.B SparesMissing
1089events. Running
1090.in +5
1091.B " mdadm \-\-monitor \-\-scan \-1"
1092.in -5
1093from a cron script will ensure regular notification of any degraded arrays.
1094
1095.TP
1096.BR \-t ", " \-\-test
1097Generate a
1098.B TestMessage
1099alert for every array found at startup. This alert gets mailed and
1100passed to the alert program. This can be used for testing that alert
1101message do get through successfully.
1102
1103.SH ASSEMBLE MODE
1104
1105.HP 12
1106Usage:
1107.B mdadm \-\-assemble
1108.I md-device options-and-component-devices...
1109.HP 12
1110Usage:
1111.B mdadm \-\-assemble \-\-scan
1112.I md-devices-and-options...
1113.HP 12
1114Usage:
1115.B mdadm \-\-assemble \-\-scan
1116.I options...
1117
1118.PP
1119This usage assembles one or more raid arrays from pre-existing components.
1120For each array, mdadm needs to know the md device, the identity of the
1121array, and a number of component-devices. These can be found in a number of ways.
1122
1123In the first usage example (without the
1124.BR \-\-scan )
1125the first device given is the md device.
1126In the second usage example, all devices listed are treated as md
1127devices and assembly is attempted.
1128In the third (where no devices are listed) all md devices that are
1129listed in the configuration file are assembled.
1130
1131If precisely one device is listed, but
1132.B \-\-scan
1133is not given, then
1134.I mdadm
1135acts as though
1136.B \-\-scan
1137was given and identity information is extracted from the configuration file.
1138
1139The identity can be given with the
1140.B \-\-uuid
1141option, with the
1142.B \-\-super\-minor
1143option, will be taken from the md-device record in the config file, or
1144will be taken from the super block of the first component-device
1145listed on the command line.
1146
1147Devices can be given on the
1148.B \-\-assemble
1149command line or in the config file. Only devices which have an md
1150superblock which contains the right identity will be considered for
1151any array.
1152
1153The config file is only used if explicitly named with
1154.B \-\-config
1155or requested with (a possibly implicit)
1156.BR \-\-scan .
1157In the later case,
1158.B /etc/mdadm.conf
1159is used.
1160
1161If
1162.B \-\-scan
1163is not given, then the config file will only be used to find the
1164identity of md arrays.
1165
1166Normally the array will be started after it is assembled. However if
1167.B \-\-scan
1168is not given and insufficient drives were listed to start a complete
1169(non-degraded) array, then the array is not started (to guard against
1170usage errors). To insist that the array be started in this case (as
1171may work for RAID1, 4, 5, 6, or 10), give the
1172.B \-\-run
1173flag.
1174
1175If the md device does not exist, then it will be created providing the
1176intent is clear. i.e. the name must be in a standard form, or the
1177.B \-\-auto
1178option must be given to clarify how and whether the device should be
1179created.
1180This can be useful for handling partitioned devices (which don't have
1181a stable device number \(em it can change after a reboot) and when using
1182"udev" to manage your
1183.B /dev
1184tree (udev cannot handle md devices because of the unusual device
1185initialisation conventions).
1186
1187If the option to "auto" is "mdp" or "part" or (on the command line
1188only) "p", then mdadm will create a partitionable array, using the
1189first free one that is not in use and does not already have an entry
1190in /dev (apart from numeric /dev/md* entries).
1191
1192If the option to "auto" is "yes" or "md" or (on the command line)
1193nothing, then mdadm will create a traditional, non-partitionable md
1194array.
1195
1196It is expected that the "auto" functionality will be used to create
1197device entries with meaningful names such as "/dev/md/home" or
1198"/dev/md/root", rather than names based on the numerical array number.
1199
1200When using option "auto" to create a partitionable array, the device
1201files for the first 4 partitions are also created. If a different
1202number is required it can be simply appended to the auto option.
1203e.g. "auto=part8". Partition names are created by appending a digit
1204string to the device name, with an intervening "p" if the device name
1205ends with a digit.
1206
1207The
1208.B \-\-auto
1209option is also available in Build and Create modes. As those modes do
1210not use a config file, the "auto=" config option does not apply to
1211these modes.
1212
1213.SS Auto Assembly
1214When
1215.B \-\-assemble
1216is used with
1217.B \-\-scan
1218and no devices are listed,
1219.I mdadm
1220will first attempt to assemble all the arrays listed in the config
1221file.
1222
1223If a
1224.B homehost
1225has been specified (either in the config file or on the command line),
1226.I mdadm
1227will look further for possible arrays and will try to assemble
1228anything that it finds which is tagged as belonging to the given
1229homehost. This is the only situation where
1230.I mdadm
1231will assemble arrays without being given specific device name or
1232identity information for the array.
1233
1234If
1235.I mdadm
1236finds a consistent set of devices that look like they should comprise
1237an array, and if the superblock is tagged as belonging to the given
1238home host, it will automatically choose a device name and try to
1239assemble the array. If the array uses version-0.90 metadata, then the
1240.B minor
1241number as recorded in the superblock is used to create a name in
1242.B /dev/md/
1243so for example
1244.BR /dev/md/3 .
1245If the array uses version-1 metadata, then the
1246.B name
1247from the superblock is used to similarly create a name in
1248.BR /dev/md
1249(the name will have any 'host' prefix stripped first).
1250
1251If
1252.I mdadm
1253cannot find any array for the given host at all, and if
1254.B \-\-auto\-update\-homehost
1255is given, then
1256.I mdadm
1257will search again for any array (not just an array created for this
1258host) and will assemble each assuming
1259.BR \-\-update=homehost .
1260This will change the host tag in the superblock so that on the next run,
1261these arrays will be found without the second pass. The intention of
1262this feature is to support transitioning a set of md arrays to using
1263homehost tagging.
1264
1265The reason for requiring arrays to be tagged with the homehost for
1266auto assembly is to guard against problems that can arise when moving
1267devices from one host to another.
1268
1269.SH BUILD MODE
1270
1271.HP 12
1272Usage:
1273.B mdadm \-\-build
1274.I md-device
1275.BI \-\-chunk= X
1276.BI \-\-level= Y
1277.BI \-\-raid\-devices= Z
1278.I devices
1279
1280.PP
1281This usage is similar to
1282.BR \-\-create .
1283The difference is that it creates an array without a superblock. With
1284these arrays there is no difference between initially creating the array and
1285subsequently assembling the array, except that hopefully there is useful
1286data there in the second case.
1287
1288The level may raid0, linear, multipath, or faulty, or one of their
1289synonyms. All devices must be listed and the array will be started
1290once complete.
1291
1292.SH CREATE MODE
1293
1294.HP 12
1295Usage:
1296.B mdadm \-\-create
1297.I md-device
1298.BI \-\-chunk= X
1299.BI \-\-level= Y
1300.br
1301.BI \-\-raid\-devices= Z
1302.I devices
1303
1304.PP
1305This usage will initialise a new md array, associate some devices with
1306it, and activate the array.
1307
1308If the
1309.B \-\-auto
1310option is given (as described in more detail in the section on
1311Assemble mode), then the md device will be created with a suitable
1312device number if necessary.
1313
1314As devices are added, they are checked to see if they contain raid
1315superblocks or filesystems. They are also checked to see if the variance in
1316device size exceeds 1%.
1317
1318If any discrepancy is found, the array will not automatically be run, though
1319the presence of a
1320.B \-\-run
1321can override this caution.
1322
1323To create a "degraded" array in which some devices are missing, simply
1324give the word "\fBmissing\fP"
1325in place of a device name. This will cause
1326.B mdadm
1327to leave the corresponding slot in the array empty.
1328For a RAID4 or RAID5 array at most one slot can be
1329"\fBmissing\fP"; for a RAID6 array at most two slots.
1330For a RAID1 array, only one real device needs to be given. All of the
1331others can be
1332"\fBmissing\fP".
1333
1334When creating a RAID5 array,
1335.B mdadm
1336will automatically create a degraded array with an extra spare drive.
1337This is because building the spare into a degraded array is in general faster than resyncing
1338the parity on a non-degraded, but not clean, array. This feature can
1339be overridden with the
1340.B \-\-force
1341option.
1342
1343When creating an array with version-1 metadata a name for the host is
1344required.
1345If this is not given with the
1346.B \-\-name
1347option,
1348.I mdadm
1349will chose a name based on the last component of the name of the
1350device being created. So if
1351.B /dev/md3
1352is being created, then the name
1353.B 3
1354will be chosen.
1355If
1356.B /dev/md/home
1357is being created, then the name
1358.B home
1359will be used.
1360
1361A new array will normally get a randomly assigned 128bit UUID which is
1362very likely to be unique. If you have a specific need, you can choose
1363a UUID for the array by giving the
1364.B \-\-uuid=
1365option. Be warned that creating two arrays with the same UUID is a
1366recipe for disaster. Also, using
1367.B \-\-uuid=
1368when creating a v0.90 array will silently override any
1369.B \-\-homehost=
1370setting.
1371.\"If the
1372.\".B \-\-size
1373.\"option is given, it is not necessary to list any component-devices in this command.
1374.\"They can be added later, before a
1375.\".B \-\-run.
1376.\"If no
1377.\".B \-\-size
1378.\"is given, the apparent size of the smallest drive given is used.
1379
1380The General Management options that are valid with
1381.B \-\-create
1382are:
1383.TP
1384.B \-\-run
1385insist on running the array even if some devices look like they might
1386be in use.
1387
1388.TP
1389.B \-\-readonly
1390start the array readonly \(em not supported yet.
1391
1392
1393.SH MANAGE MODE
1394.HP 12
1395Usage:
1396.B mdadm
1397.I device
1398.I options... devices...
1399.PP
1400
1401This usage will allow individual devices in an array to be failed,
1402removed or added. It is possible to perform multiple operations with
1403on command. For example:
1404.br
1405.B " mdadm /dev/md0 \-f /dev/hda1 \-r /dev/hda1 \-a /dev/hda1"
1406.br
1407will firstly mark
1408.B /dev/hda1
1409as faulty in
1410.B /dev/md0
1411and will then remove it from the array and finally add it back
1412in as a spare. However only one md array can be affected by a single
1413command.
1414
1415.SH MISC MODE
1416.HP 12
1417Usage:
1418.B mdadm
1419.I options ...
1420.I devices ...
1421.PP
1422
1423MISC mode includes a number of distinct operations that
1424operate on distinct devices. The operations are:
1425.TP
1426.B \-\-query
1427The device is examined to see if it is
1428(1) an active md array, or
1429(2) a component of an md array.
1430The information discovered is reported.
1431
1432.TP
1433.B \-\-detail
1434The device should be an active md device.
1435.B mdadm
1436will display a detailed description of the array.
1437.B \-\-brief
1438or
1439.B \-\-scan
1440will cause the output to be less detailed and the format to be
1441suitable for inclusion in
1442.BR /etc/mdadm.conf .
1443The exit status of
1444.I mdadm
1445will normally be 0 unless
1446.I mdadm
1447failed to get useful information about the device(s); however, if the
1448.B \-\-test
1449option is given, then the exit status will be:
1450.RS
1451.TP
14520
1453The array is functioning normally.
1454.TP
14551
1456The array has at least one failed device.
1457.TP
14582
1459The array has multiple failed devices such that it is unusable.
1460.TP
14614
1462There was an error while trying to get information about the device.
1463.RE
1464
1465.TP
1466.B \-\-examine
1467The device should be a component of an md array.
1468.B mdadm
1469will read the md superblock of the device and display the contents.
1470If
1471.B \-\-brief
1472or
1473.B \-\-scan
1474is given, then multiple devices that are components of the one array
1475are grouped together and reported in a single entry suitable
1476for inclusion in
1477.BR /etc/mdadm.conf .
1478
1479Having
1480.B \-\-scan
1481without listing any devices will cause all devices listed in the
1482config file to be examined.
1483
1484.TP
1485.B \-\-stop
1486The devices should be active md arrays which will be deactivated, as
1487long as they are not currently in use.
1488
1489.TP
1490.B \-\-run
1491This will fully activate a partially assembled md array.
1492
1493.TP
1494.B \-\-readonly
1495This will mark an active array as read-only, providing that it is
1496not currently being used.
1497
1498.TP
1499.B \-\-readwrite
1500This will change a
1501.B readonly
1502array back to being read/write.
1503
1504.TP
1505.B \-\-scan
1506For all operations except
1507.BR \-\-examine ,
1508.B \-\-scan
1509will cause the operation to be applied to all arrays listed in
1510.BR /proc/mdstat .
1511For
1512.BR \-\-examine,
1513.B \-\-scan
1514causes all devices listed in the config file to be examined.
1515
1516
1517.SH MONITOR MODE
1518
1519.HP 12
1520Usage:
1521.B mdadm \-\-monitor
1522.I options... devices...
1523
1524.PP
1525This usage causes
1526.B mdadm
1527to periodically poll a number of md arrays and to report on any events
1528noticed.
1529.B mdadm
1530will never exit once it decides that there are arrays to be checked,
1531so it should normally be run in the background.
1532
1533As well as reporting events,
1534.B mdadm
1535may move a spare drive from one array to another if they are in the
1536same
1537.B spare-group
1538and if the destination array has a failed drive but no spares.
1539
1540If any devices are listed on the command line,
1541.B mdadm
1542will only monitor those devices. Otherwise all arrays listed in the
1543configuration file will be monitored. Further, if
1544.B \-\-scan
1545is given, then any other md devices that appear in
1546.B /proc/mdstat
1547will also be monitored.
1548
1549The result of monitoring the arrays is the generation of events.
1550These events are passed to a separate program (if specified) and may
1551be mailed to a given E-mail address.
1552
1553When passing events to a program, the program is run once for each event,
1554and is given 2 or 3 command-line arguments: the first is the
1555name of the event (see below), the second is the name of the
1556md device which is affected, and the third is the name of a related
1557device if relevant (such as a component device that has failed).
1558
1559If
1560.B \-\-scan
1561is given, then a program or an E-mail address must be specified on the
1562command line or in the config file. If neither are available, then
1563.B mdadm
1564will not monitor anything.
1565Without
1566.B \-\-scan,
1567.B mdadm
1568will continue monitoring as long as something was found to monitor. If
1569no program or email is given, then each event is reported to
1570.BR stdout .
1571
1572The different events are:
1573
1574.RS 4
1575.TP
1576.B DeviceDisappeared
1577An md array which previously was configured appears to no longer be
1578configured. (syslog priority: Critical)
1579
1580If
1581.I mdadm
1582was told to monitor an array which is RAID0 or Linear, then it will
1583report
1584.B DeviceDisappeared
1585with the extra information
1586.BR Wrong-Level .
1587This is because RAID0 and Linear do not support the device-failed,
1588hot-spare and resync operations which are monitored.
1589
1590.TP
1591.B RebuildStarted
1592An md array started reconstruction. (syslog priority: Warning)
1593
1594.TP
1595.BI Rebuild NN
1596Where
1597.I NN
1598is 20, 40, 60, or 80, this indicates that rebuild has passed that many
1599percentage of the total. (syslog priority: Warning)
1600
1601.TP
1602.B RebuildFinished
1603An md array that was rebuilding, isn't any more, either because it
1604finished normally or was aborted. (syslog priority: Warning)
1605
1606.TP
1607.B Fail
1608An active component device of an array has been marked as
1609faulty. (syslog priority: Critical)
1610
1611.TP
1612.B FailSpare
1613A spare component device which was being rebuilt to replace a faulty
1614device has failed. (syslog priority: Critical)
1615
1616.TP
1617.B SpareActive
1618A spare component device which was being rebuilt to replace a faulty
1619device has been successfully rebuilt and has been made active.
1620(syslog priority: Info)
1621
1622.TP
1623.B NewArray
1624A new md array has been detected in the
1625.B /proc/mdstat
1626file. (syslog priority: Info)
1627
1628.TP
1629.B DegradedArray
1630A newly noticed array appears to be degraded. This message is not
1631generated when
1632.I mdadm
1633notices a drive failure which causes degradation, but only when
1634.I mdadm
1635notices that an array is degraded when it first sees the array.
1636(syslog priority: Critical)
1637
1638.TP
1639.B MoveSpare
1640A spare drive has been moved from one array in a
1641.B spare-group
1642to another to allow a failed drive to be replaced.
1643(syslog priority: Info)
1644
1645.TP
1646.B SparesMissing
1647If
1648.I mdadm
1649has been told, via the config file, that an array should have a certain
1650number of spare devices, and
1651.I mdadm
1652detects that it has fewer than this number when it first sees the
1653array, it will report a
1654.B SparesMissing
1655message.
1656(syslog priority: Warning)
1657
1658.TP
1659.B TestMessage
1660An array was found at startup, and the
1661.B \-\-test
1662flag was given.
1663(syslog priority: Info)
1664.RE
1665
1666Only
1667.B Fail,
1668.B FailSpare,
1669.B DegradedArray,
1670.B SparesMissing
1671and
1672.B TestMessage
1673cause Email to be sent. All events cause the program to be run.
1674The program is run with two or three arguments: the event
1675name, the array device and possibly a second device.
1676
1677Each event has an associated array device (e.g.
1678.BR /dev/md1 )
1679and possibly a second device. For
1680.BR Fail ,
1681.BR FailSpare ,
1682and
1683.B SpareActive
1684the second device is the relevant component device.
1685For
1686.B MoveSpare
1687the second device is the array that the spare was moved from.
1688
1689For
1690.B mdadm
1691to move spares from one array to another, the different arrays need to
1692be labeled with the same
1693.B spare-group
1694in the configuration file. The
1695.B spare-group
1696name can be any string; it is only necessary that different spare
1697groups use different names.
1698
1699When
1700.B mdadm
1701detects that an array in a spare group has fewer active
1702devices than necessary for the complete array, and has no spare
1703devices, it will look for another array in the same spare group that
1704has a full complement of working drive and a spare. It will then
1705attempt to remove the spare from the second drive and add it to the
1706first.
1707If the removal succeeds but the adding fails, then it is added back to
1708the original array.
1709
1710.SH GROW MODE
1711The GROW mode is used for changing the size or shape of an active
1712array.
1713For this to work, the kernel must support the necessary change.
1714Various types of growth are being added during 2.6 development,
1715including restructuring a raid5 array to have more active devices.
1716
1717Currently the only support available is to
1718.IP \(bu 4
1719change the "size" attribute
1720for RAID1, RAID5 and RAID6.
1721.IP \(bu 4
1722increase the "raid-disks" attribute of RAID1, RAID5, and RAID6.
1723.IP \(bu 4
1724add a write-intent bitmap to any array which supports these bitmaps, or
1725remove a write-intent bitmap from such an array.
1726.PP
1727
1728.SS SIZE CHANGES
1729Normally when an array is built the "size" it taken from the smallest
1730of the drives. If all the small drives in an arrays are, one at a
1731time, removed and replaced with larger drives, then you could have an
1732array of large drives with only a small amount used. In this
1733situation, changing the "size" with "GROW" mode will allow the extra
1734space to start being used. If the size is increased in this way, a
1735"resync" process will start to make sure the new parts of the array
1736are synchronised.
1737
1738Note that when an array changes size, any filesystem that may be
1739stored in the array will not automatically grow to use the space. The
1740filesystem will need to be explicitly told to use the extra space.
1741
1742.SS RAID-DEVICES CHANGES
1743
1744A RAID1 array can work with any number of devices from 1 upwards
1745(though 1 is not very useful). There may be times which you want to
1746increase or decrease the number of active devices. Note that this is
1747different to hot-add or hot-remove which changes the number of
1748inactive devices.
1749
1750When reducing the number of devices in a RAID1 array, the slots which
1751are to be removed from the array must already be vacant. That is, the
1752devices which were in those slots must be failed and removed.
1753
1754When the number of devices is increased, any hot spares that are
1755present will be activated immediately.
1756
1757Increasing the number of active devices in a RAID5 is much more
1758effort. Every block in the array will need to be read and written
1759back to a new location. From 2.6.17, the Linux Kernel is able to do
1760this safely, including restart and interrupted "reshape".
1761
1762When relocating the first few stripes on a raid5, it is not possible
1763to keep the data on disk completely consistent and crash-proof. To
1764provide the required safety, mdadm disables writes to the array while
1765this "critical section" is reshaped, and takes a backup of the data
1766that is in that section. This backup is normally stored in any spare
1767devices that the array has, however it can also be stored in a
1768separate file specified with the
1769.B \-\-backup\-file
1770option. If this option is used, and the system does crash during the
1771critical period, the same file must be passed to
1772.B \-\-assemble
1773to restore the backup and reassemble the array.
1774
1775.SS BITMAP CHANGES
1776
1777A write-intent bitmap can be added to, or removed from, an active
1778array. Either internal bitmaps, or bitmaps stored in a separate file,
1779can be added. Note that if you add a bitmap stored in a file which is
1780in a filesystem that is on the raid array being affected, the system
1781will deadlock. The bitmap must be on a separate filesystem.
1782
1783.SH INCREMENTAL MODE
1784
1785.HP 12
1786Usage:
1787.B mdadm \-\-incremental
1788.RB [ \-\-run ]
1789.RB [ \-\-quiet ]
1790.I component-device
1791.HP 12
1792Usage:
1793.B mdadm \-\-incremental \-\-rebuild
1794.HP 12
1795Usage:
1796.B mdadm \-\-incremental \-\-run \-\-scan
1797
1798
1799.PP
1800This mode is designed to be used in conjunction with a device
1801discovery system. As devices are found in a system, they can be
1802passed to
1803.B "mdadm \-\-incremental"
1804to be conditionally added to an appropriate array.
1805
1806.I mdadm
1807performs a number of tests to determine if the device is part of an
1808array, and which array it should be part of. If an appropriate array
1809is found, or can be created,
1810.I mdadm
1811adds the device to the array and conditionally starts the array.
1812
1813Note that
1814.I mdadm
1815will only add devices to an array which were previously working
1816(active or spare) parts of that array. It does not currently support
1817automatic inclusion of a new drive as a spare in some array.
1818
1819.B "mdadm \-\-incremental"
1820requires a bug-fix in all kernels through 2.6.19.
1821Hopefully, this will be fixed in 2.6.20; alternately, apply the patch
1822which is included with the mdadm source distribution. If
1823.I mdadm
1824detects that this bug is present, it will abort any attempt to use
1825.BR \-\-incremental .
1826
1827The tests that
1828.I mdadm
1829makes are as follow:
1830.IP +
1831Is the device permitted by
1832.BR mdadm.conf ?
1833That is, is it listed in a
1834.B DEVICES
1835line in that file. If
1836.B DEVICES
1837is absent then the default it to allow any device. Similar if
1838.B DEVICES
1839contains the special word
1840.B partitions
1841then any device is allowed. Otherwise the device name given to
1842.I mdadm
1843must match one of the names or patterns in a
1844.B DEVICES
1845line.
1846
1847.IP +
1848Does the device have a valid md superblock. If a specific metadata
1849version is request with
1850.B \-\-metadata
1851or
1852.B \-e
1853then only that style of metadata is accepted, otherwise
1854.I mdadm
1855finds any known version of metadata. If no
1856.I md
1857metadata is found, the device is rejected.
1858
1859.IP +
1860Does the metadata match an expected array?
1861The metadata can match in two ways. Either there is an array listed
1862in
1863.B mdadm.conf
1864which identifies the array (either by UUID, by name, by device list,
1865or by minor-number), or the array was created with a
1866.B homehost
1867specified and that
1868.B homehost
1869matches the one in
1870.B mdadm.conf
1871or on the command line.
1872If
1873.I mdadm
1874is not able to positively identify the array as belonging to the
1875current host, the device will be rejected.
1876
1877.IP +
1878.I mdadm
1879keeps a list of arrays that it has partially assembled in
1880.B /var/run/mdadm/map
1881(or
1882.B /var/run/mdadm.map
1883if the directory doesn't exist). If no array exists which matches
1884the metadata on the new device,
1885.I mdadm
1886must choose a device name and unit number. It does this based on any
1887name given in
1888.B mdadm.conf
1889or any name information stored in the metadata. If this name
1890suggests a unit number, that number will be used, otherwise a free
1891unit number will be chosen. Normally
1892.I mdadm
1893will prefer to create a partitionable array, however if the
1894.B CREATE
1895line in
1896.B mdadm.conf
1897suggests that a non-partitionable array is preferred, that will be
1898honoured.
1899
1900.IP +
1901Once an appropriate array is found or created and the device is added,
1902.I mdadm
1903must decide if the array is ready to be started. It will
1904normally compare the number of available (non-spare) devices to the
1905number of devices that the metadata suggests need to be active. If
1906there are at least that many, the array will be started. This means
1907that if any devices are missing the array will not be restarted.
1908
1909As an alternative,
1910.B \-\-run
1911may be passed to
1912.B mdadm
1913in which case the array will be run as soon as there are enough
1914devices present for the data to be accessible. For a raid1, that
1915means one device will start the array. For a clean raid5, the array
1916will be started as soon as all but one drive is present.
1917
1918Note that neither of these approaches is really ideal. If it can
1919be known that all device discovery has completed, then
1920.br
1921.B " mdadm \-IRs"
1922.br
1923can be run which will try to start all arrays that are being
1924incrementally assembled. They are started in "read-auto" mode in
1925which they are read-only until the first write request. This means
1926that no metadata updates are made and no attempt at resync or recovery
1927happens. Further devices that are found before the first write can
1928still be added safely.
1929
1930.SH EXAMPLES
1931
1932.B " mdadm \-\-query /dev/name-of-device"
1933.br
1934This will find out if a given device is a raid array, or is part of
1935one, and will provide brief information about the device.
1936
1937.B " mdadm \-\-assemble \-\-scan"
1938.br
1939This will assemble and start all arrays listed in the standard config
1940file. This command will typically go in a system startup file.
1941
1942.B " mdadm \-\-stop \-\-scan"
1943.br
1944This will shut down all arrays that can be shut down (i.e. are not
1945currently in use). This will typically go in a system shutdown script.
1946
1947.B " mdadm \-\-follow \-\-scan \-\-delay=120"
1948.br
1949If (and only if) there is an Email address or program given in the
1950standard config file, then
1951monitor the status of all arrays listed in that file by
1952polling them ever 2 minutes.
1953
1954.B " mdadm \-\-create /dev/md0 \-\-level=1 \-\-raid\-devices=2 /dev/hd[ac]1"
1955.br
1956Create /dev/md0 as a RAID1 array consisting of /dev/hda1 and /dev/hdc1.
1957
1958.br
1959.B " echo 'DEVICE /dev/hd*[0\-9] /dev/sd*[0\-9]' > mdadm.conf"
1960.br
1961.B " mdadm \-\-detail \-\-scan >> mdadm.conf"
1962.br
1963This will create a prototype config file that describes currently
1964active arrays that are known to be made from partitions of IDE or SCSI drives.
1965This file should be reviewed before being used as it may
1966contain unwanted detail.
1967
1968.B " echo 'DEVICE /dev/hd[a\-z] /dev/sd*[a\-z]' > mdadm.conf"
1969.br
1970.B " mdadm \-\-examine \-\-scan \-\-config=mdadm.conf >> mdadm.conf"
1971.br
1972This will find arrays which could be assembled from existing IDE and
1973SCSI whole drives (not partitions), and store the information in the
1974format of a config file.
1975This file is very likely to contain unwanted detail, particularly
1976the
1977.B devices=
1978entries. It should be reviewed and edited before being used as an
1979actual config file.
1980
1981.B " mdadm \-\-examine \-\-brief \-\-scan \-\-config=partitions"
1982.br
1983.B " mdadm \-Ebsc partitions"
1984.br
1985Create a list of devices by reading
1986.BR /proc/partitions ,
1987scan these for RAID superblocks, and printout a brief listing of all
1988that were found.
1989
1990.B " mdadm \-Ac partitions \-m 0 /dev/md0"
1991.br
1992Scan all partitions and devices listed in
1993.BR /proc/partitions
1994and assemble
1995.B /dev/md0
1996out of all such devices with a RAID superblock with a minor number of 0.
1997
1998.B " mdadm \-\-monitor \-\-scan \-\-daemonise > /var/run/mdadm"
1999.br
2000If config file contains a mail address or alert program, run mdadm in
2001the background in monitor mode monitoring all md devices. Also write
2002pid of mdadm daemon to
2003.BR /var/run/mdadm .
2004
2005.B " mdadm \-Iq /dev/somedevice"
2006.br
2007Try to incorporate newly discovered device into some array as
2008appropriate.
2009
2010.B " mdadm \-\-incremental \-\-rebuild \-\-run \-\-scan"
2011.br
2012Rebuild the array map from any current arrays, and then start any that
2013can be started.
2014
2015.B " mdadm /dev/md4 --fail detached --remove detached"
2016.br
2017Any devices which are components of /dev/md4 will be marked as faulty
2018and then remove from the array.
2019
2020.B " mdadm \-\-create \-\-help"
2021.br
2022Provide help about the Create mode.
2023
2024.B " mdadm \-\-config \-\-help"
2025.br
2026Provide help about the format of the config file.
2027
2028.B " mdadm \-\-help"
2029.br
2030Provide general help.
2031
2032
2033.SH FILES
2034
2035.SS /proc/mdstat
2036
2037If you're using the
2038.B /proc
2039filesystem,
2040.B /proc/mdstat
2041lists all active md devices with information about them.
2042.B mdadm
2043uses this to find arrays when
2044.B \-\-scan
2045is given in Misc mode, and to monitor array reconstruction
2046on Monitor mode.
2047
2048
2049.SS /etc/mdadm.conf
2050
2051The config file lists which devices may be scanned to see if
2052they contain MD super block, and gives identifying information
2053(e.g. UUID) about known MD arrays. See
2054.BR mdadm.conf (5)
2055for more details.
2056
2057.SS /var/run/mdadm/map
2058When
2059.B \-\-incremental
2060mode is used, this file gets a list of arrays currently being created.
2061If
2062.B /var/run/mdadm
2063does not exist as a directory, then
2064.B /var/run/mdadm.map
2065is used instead.
2066
2067.SH DEVICE NAMES
2068
2069While entries in the /dev directory can have any format you like,
2070.I mdadm
2071has an understanding of 'standard' formats which it uses to guide its
2072behaviour when creating device files via the
2073.B \-\-auto
2074option.
2075
2076The standard names for non-partitioned arrays (the only sort of md
2077array available in 2.4 and earlier) are either of
2078.IP
2079/dev/mdNN
2080.br
2081/dev/md/NN
2082.PP
2083where NN is a number.
2084The standard names for partitionable arrays (as available from 2.6
2085onwards) are either of
2086.IP
2087/dev/md/dNN
2088.br
2089/dev/md_dNN
2090.PP
2091Partition numbers should be indicated by added "pMM" to these, thus "/dev/md/d1p2".
2092
2093.SH NOTE
2094.B mdadm
2095was previously known as
2096.BR mdctl .
2097.P
2098.B mdadm
2099is completely separate from the
2100.B raidtools
2101package, and does not use the
2102.I /etc/raidtab
2103configuration file at all.
2104
2105.SH SEE ALSO
2106For further information on MD and the various levels of
2107RAID, see:
2108
2109.IP
2110.UR http://unthought.net/Software-RAID.HOWTO/
2111http://unthought.net/Software\-RAID.HOWTO/
2112.UE
2113.IP
2114.UR http://linux-raid.osdl.org/
2115http://linux\-raid.osdl.org/
2116.UE
2117.\".PP
2118.\"for new releases of the RAID driver check out:
2119.\"
2120.\".IP
2121.\".UR ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
2122.\"ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
2123.\".UE
2124.\".PP
2125.\"or
2126.\".IP
2127.\".UR http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2128.\"http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
2129.\".UE
2130.PP
2131The latest version of
2132.I mdadm
2133should always be available from
2134.IP
2135.UR http://www.kernel.org/pub/linux/utils/raid/mdadm/
2136http://www.kernel.org/pub/linux/utils/raid/mdadm/
2137.UE
2138.PP
2139.IR mdadm.conf (5),
2140.IR md (4).
2141.PP
2142.IR raidtab (5),
2143.IR raid0run (8),
2144.IR raidstop (8),
2145.IR mkraid (8).