]> git.ipfire.org Git - thirdparty/mdadm.git/blame_incremental - mdadm.8
Allow --update=name to update the name during assembly.
[thirdparty/mdadm.git] / mdadm.8
... / ...
CommitLineData
1.\" -*- nroff -*-
2.TH MDADM 8 "" v2.4.1
3.SH NAME
4mdadm \- manage MD devices
5.I aka
6Linux Software Raid.
7
8.SH SYNOPSIS
9
10.BI mdadm " [mode] <raiddevice> [options] <component-devices>"
11
12.SH DESCRIPTION
13RAID devices are virtual devices created from two or more
14real block devices. This allows multiple devices (typically disk
15drives or partitions there-of) to be combined into a single device to
16hold (for example) a single filesystem.
17Some RAID levels include redundancy and so can survive some degree of
18device failure.
19
20Linux Software RAID devices are implemented through the md (Multiple
21Devices) device driver.
22
23Currently, Linux supports
24.B LINEAR
25md devices,
26.B RAID0
27(striping),
28.B RAID1
29(mirroring),
30.BR RAID4 ,
31.BR RAID5 ,
32.BR RAID6 ,
33.BR RAID10 ,
34.BR MULTIPATH ,
35and
36.BR FAULTY .
37
38.B MULTIPATH
39is not a Software RAID mechanism, but does involve
40multiple devices. For
41.B MULTIPATH
42each device is a path to one common physical storage device.
43
44.B FAULTY
45is also not true RAID, and it only involves one device. It
46provides a layer over a true device that can be used to inject faults.
47
48'''.B mdadm
49'''is a program that can be used to create, manage, and monitor
50'''MD devices. As
51'''such it provides a similar set of functionality to the
52'''.B raidtools
53'''packages.
54'''The key differences between
55'''.B mdadm
56'''and
57'''.B raidtools
58'''are:
59'''.IP \(bu 4
60'''.B mdadm
61'''is a single program and not a collection of programs.
62'''.IP \(bu 4
63'''.B mdadm
64'''can perform (almost) all of its functions without having a
65'''configuration file and does not use one by default. Also
66'''.B mdadm
67'''helps with management of the configuration
68'''file.
69'''.IP \(bu 4
70'''.B mdadm
71'''can provide information about your arrays (through Query, Detail, and Examine)
72'''that
73'''.B raidtools
74'''cannot.
75'''.P
76'''.I mdadm
77'''does not use
78'''.IR /etc/raidtab ,
79'''the
80'''.B raidtools
81'''configuration file, at all. It has a different configuration file
82'''with a different format and a different purpose.
83
84.SH MODES
85mdadm has 7 major modes of operation:
86.TP
87.B Assemble
88Assemble the parts of a previously created
89array into an active array. Components can be explicitly given
90or can be searched for.
91.B mdadm
92checks that the components
93do form a bona fide array, and can, on request, fiddle superblock
94information so as to assemble a faulty array.
95
96.TP
97.B Build
98Build an array that doesn't have per-device superblocks. For these
99sorts of arrays,
100.I mdadm
101cannot differentiate between initial creation and subsequent assembly
102of an array. It also cannot perform any checks that appropriate
103devices have been requested. Because of this, the
104.B Build
105mode should only be used together with a complete understanding of
106what you are doing.
107
108.TP
109.B Create
110Create a new array with per-device superblocks.
111'''It can progress
112'''in several step create-add-add-run or it can all happen with one command.
113
114.TP
115.B "Follow or Monitor"
116Monitor one or more md devices and act on any state changes. This is
117only meaningful for raid1, 4, 5, 6, 10 or multipath arrays as
118only these have interesting state. raid0 or linear never have
119missing, spare, or failed drives, so there is nothing to monitor.
120
121.TP
122.B "Grow"
123Grow (or shrink) an array, or otherwise reshape it in some way.
124Currently supported growth options including changing the active size
125of component devices in RAID level 1/4/5/6 and changing the number of
126active devices in RAID1.
127
128.TP
129.B Manage
130This is for doing things to specific components of an array such as
131adding new spares and removing faulty devices.
132
133.TP
134.B Misc
135This is an 'everything else' mode that supports operations on active
136arrays, operations on component devices such as erasing old superblocks, and
137information gathering operations.
138'''This mode allows operations on independent devices such as examine MD
139'''superblocks, erasing old superblocks and stopping active arrays.
140
141.SH OPTIONS
142
143.SH Options for selecting a mode are:
144
145.TP
146.BR -A ", " --assemble
147Assemble a pre-existing array.
148
149.TP
150.BR -B ", " --build
151Build a legacy array without superblocks.
152
153.TP
154.BR -C ", " --create
155Create a new array.
156
157.TP
158.BR -F ", " --follow ", " --monitor
159Select
160.B Monitor
161mode.
162
163.TP
164.BR -G ", " --grow
165Change the size or shape of an active array.
166.P
167If a device is given before any options, or if the first option is
168.BR --add ,
169.BR --fail ,
170or
171.BR --remove ,
172then the MANAGE mode is assume.
173Anything other than these will cause the
174.B Misc
175mode to be assumed.
176
177.SH Options that are not mode-specific are:
178
179.TP
180.BR -h ", " --help
181Display general help message or, after one of the above options, a
182mode specific help message.
183
184.TP
185.B --help-options
186Display more detailed help about command line parsing and some commonly
187used options.
188
189.TP
190.BR -V ", " --version
191Print version information for mdadm.
192
193.TP
194.BR -v ", " --verbose
195Be more verbose about what is happening. This can be used twice to be
196extra-verbose.
197The extra verbosity currently only affects
198.B --detail --scan
199and
200.BR "--examine --scan" .
201
202.TP
203.BR -q ", " --quiet
204Avoid printing purely informative messages. With this,
205.B mdadm
206will be silent unless there is something really important to report.
207
208.TP
209.BR -b ", " --brief
210Be less verbose. This is used with
211.B --detail
212and
213.BR --examine .
214Using
215.B --brief
216with
217.B --verbose
218gives an intermediate level of verbosity.
219
220.TP
221.BR -f ", " --force
222Be more forceful about certain operations. See the various modes of
223the exact meaning of this option in different contexts.
224
225.TP
226.BR -c ", " --config=
227Specify the config file. Default is to use
228.BR /etc/mdadm.conf ,
229or if that is missing, then
230.BR /etc/mdadm/mdadm.conf .
231If the config file given is
232.B partitions
233then nothing will be read, but
234.I mdadm
235will act as though the config file contained exactly
236.B "DEVICE partitions"
237and will read
238.B /proc/partitions
239to find a list of devices to scan.
240If the word
241.B none
242is given for the config file, then
243.I mdadm
244will act as though the config file were empty.
245
246.TP
247.BR -s ", " --scan
248scan config file or
249.B /proc/mdstat
250for missing information.
251In general, this option gives
252.B mdadm
253permission to get any missing information, like component devices,
254array devices, array identities, and alert destination from the
255configuration file:
256.BR /etc/mdadm.conf .
257One exception is MISC mode when using
258.B --detail
259or
260.B --stop
261in which case
262.B --scan
263says to get a list of array devices from
264.BR /proc/mdstat .
265
266.TP
267.B -e ", " --metadata=
268Declare the style of superblock (raid metadata) to be used. The
269default is 0.90 for --create, and to guess for other operations.
270
271Options are:
272.RS
273.IP "0, 0.90, default"
274Use the original 0.90 format superblock. This format limits arrays to
27528 componenet devices and limits component devices of levels 1 and
276greater to 2 terabytes.
277.IP "1, 1.0, 1.1, 1.2"
278Use the new version-1 format superblock. This has few restrictions.
279The different subversion store the superblock at different locations
280on the device, either at the end (for 1.0), at the start (for 1.1) or
2814K from the start (for 1.2).
282.RE
283
284.SH For create, build, or grow:
285
286.TP
287.BR -n ", " --raid-devices=
288Specify the number of active devices in the array. This, plus the
289number of spare devices (see below) must equal the number of
290.I component-devices
291(including "\fBmissing\fP" devices)
292that are listed on the command line for
293.BR --create .
294Setting a value of 1 is probably
295a mistake and so requires that
296.B --force
297be specified first. A value of 1 will then be allowed for linear,
298multipath, raid0 and raid1. It is never allowed for raid4 or raid5.
299.br
300This number can only be changed using
301.B --grow
302for RAID1 arrays, and only on kernels which provide necessary support.
303
304.TP
305.BR -x ", " --spare-devices=
306Specify the number of spare (eXtra) devices in the initial array.
307Spares can also be added
308and removed later. The number of component devices listed
309on the command line must equal the number of raid devices plus the
310number of spare devices.
311
312
313.TP
314.BR -z ", " --size=
315Amount (in Kibibytes) of space to use from each drive in RAID1/4/5/6.
316This must be a multiple of the chunk size, and must leave about 128Kb
317of space at the end of the drive for the RAID superblock.
318If this is not specified
319(as it normally is not) the smallest drive (or partition) sets the
320size, though if there is a variance among the drives of greater than 1%, a warning is
321issued.
322
323This value can be set with
324.B --grow
325for RAID level 1/4/5/6. If the array was created with a size smaller
326than the currently active drives, the extra space can be accessed
327using
328.BR --grow .
329The size can be given as
330.B max
331which means to choose the largest size that fits on all current drives.
332
333.TP
334.BR -c ", " --chunk=
335Specify chunk size of kibibytes. The default is 64.
336
337.TP
338.BR --rounding=
339Specify rounding factor for linear array (==chunk size)
340
341.TP
342.BR -l ", " --level=
343Set raid level. When used with
344.IR --create ,
345options are: linear, raid0, 0, stripe, raid1, 1, mirror, raid4, 4,
346raid5, 5, raid6, 6, raid10, 10, multipath, mp, faulty. Obviously some of these are synonymous.
347
348When used with
349.IR --build ,
350only linear, stripe, raid0, 0, raid1, multipath, mp, and faulty are valid.
351
352Not yet supported with
353.IR --grow .
354
355.TP
356.BR -p ", " --layout=
357This option configures the fine details of data layout for raid5,
358and raid10 arrays, and controls the failure modes for
359.IR faulty .
360
361The layout of the raid5 parity block can be one of
362left-asymmetric,
363left-symmetric,
364right-asymmetric,
365right-symmetric,
366la, ra, ls, rs. The default is left-symmetric.
367
368When setting the failure mode for
369.I faulty
370the options are:
371write-transient,
372wt,
373read-transient,
374rt,
375write-persistent,
376wp,
377read-persistent,
378rp,
379write-all,
380read-fixable,
381rf,
382clear,
383flush,
384none.
385
386Each mode can be followed by a number which is used as a period
387between fault generation. Without a number, the fault is generated
388once on the first relevant request. With a number, the fault will be
389generated after that many request, and will continue to be generated
390every time the period elapses.
391
392Multiple failure modes can be current simultaneously by using the
393"--grow" option to set subsequent failure modes.
394
395"clear" or "none" will remove any pending or periodic failure modes,
396and "flush" will clear any persistent faults.
397
398To set the parity with "--grow", the level of the array ("faulty")
399must be specified before the fault mode is specified.
400
401Finally, the layout options for RAID10 are one of 'n', 'o' or 'p' followed
402by a small number. The default is 'n2'.
403
404.I n
405signals 'near' copies. Multiple copies of one data block are at
406similar offsets in different devices.
407
408.I o
409signals 'offset' copies. Rather than the chunks being duplicated
410within a stripe, whole stripes are duplicated but are rotated by one
411device so duplicate blocks are on different devices. Thus subsequent
412copies of a block are in the next drive, and are one chunk further
413down.
414
415.I f
416signals 'far' copies
417(multiple copies have very different offsets). See md(4) for more
418detail about 'near' and 'far'.
419
420The number is the number of copies of each datablock. 2 is normal, 3
421can be useful. This number can be at most equal to the number of
422devices in the array. It does not need to divide evenly into that
423number (e.g. it is perfectly legal to have an 'n2' layout for an array
424with an odd number of devices).
425
426.TP
427.BR --parity=
428same as --layout (thus explaining the p of
429.IR -p ).
430
431.TP
432.BR -b ", " --bitmap=
433Specify a file to store a write-intent bitmap in. The file should not
434exist unless --force is also given. The same file should be provided
435when assembling the array. If the word
436.B internal
437is given, then the bitmap is stored with the metadata on the array,
438and so is replicated on all devices. If the word
439.B none
440is given with
441.B --grow
442mode, then any bitmap that is present is removed.
443
444To help catch typing errors, the filename must contain at least one
445slash ('/') if it is a real file (not 'internal' or 'none').
446
447Note: external bitmaps are only known to work on ext2 and ext3.
448Storing bitmap files on other filesystems may result in serious problems.
449
450.TP
451.BR --bitmap-chunk=
452Set the chunksize of the bitmap. Each bit corresponds to that many
453Kilobytes of storage.
454When using a file based bitmap, the default is to use the smallest
455size that is atleast 4 and requires no more than 2^21 chunks.
456When using an
457.B internal
458bitmap, the chunksize is automatically determined to make best use of
459available space.
460
461
462.TP
463.BR -W ", " --write-mostly
464subsequent devices lists in a
465.BR --build ,
466.BR --create ,
467or
468.B --add
469command will be flagged as 'write-mostly'. This is valid for RAID1
470only and means that the 'md' driver will avoid reading from these
471devices if at all possible. This can be useful if mirroring over a
472slow link.
473
474.TP
475.BR --write-behind=
476Specify that write-behind mode should be enabled (valid for RAID1
477only). If an argument is specified, it will set the maximum number
478of outstanding writes allowed. The default value is 256.
479A write-intent bitmap is required in order to use write-behind
480mode, and write-behind is only attempted on drives marked as
481.IR write-mostly .
482
483.TP
484.BR --assume-clean
485Tell
486.I mdadm
487that the array pre-existed and is known to be clean. It can be useful
488when trying to recover from a major failure as you can be sure that no
489data will be affected unless you actually write to the array. It can
490also be used when creating a RAID1 or RAID10 if you want to avoid the
491initial resync, however this practice - while normally safe - is not
492recommended. Use this ony if you really know what you are doing.
493
494.TP
495.BR --backup-file=
496This is needed when --grow is used to increase the number of
497raid-devices in a RAID5 if there are no spare devices available.
498See the section below on RAID_DEVICE CHANGES. The file should be
499stored on a separate device, not on the raid array being reshaped.
500
501.TP
502.BR -N ", " --name=
503Set a
504.B name
505for the array. This is currently only effective when creating an
506array with a version-1 superblock. The name is a simple textual
507string that can be used to identify array components when assembling.
508
509.TP
510.BR -R ", " --run
511Insist that
512.I mdadm
513run the array, even if some of the components
514appear to be active in another array or filesystem. Normally
515.I mdadm
516will ask for confirmation before including such components in an
517array. This option causes that question to be suppressed.
518
519.TP
520.BR -f ", " --force
521Insist that
522.I mdadm
523accept the geometry and layout specified without question. Normally
524.I mdadm
525will not allow creation of an array with only one device, and will try
526to create a raid5 array with one missing drive (as this makes the
527initial resync work faster). With
528.BR --force ,
529.I mdadm
530will not try to be so clever.
531
532.TP
533.BR -a ", " "--auto{=no,yes,md,mdp,part,p}{NN}"
534Instruct mdadm to create the device file if needed, possibly allocating
535an unused minor number. "md" causes a non-partitionable array
536to be used. "mdp", "part" or "p" causes a partitionable array (2.6 and
537later) to be used. "yes" requires the named md device to have
538a 'standard' format, and the type and minor number will be determined
539from this. See DEVICE NAMES below.
540
541The argument can also come immediately after
542"-a". e.g. "-ap".
543
544If
545.I --scan
546is also given, then any
547.I auto=
548entries in the config file will over-ride the
549.I --auto
550instruction given on the command line.
551
552For partitionable arrays,
553.I mdadm
554will create the device file for the whole array and for the first 4
555partitions. A different number of partitions can be specified at the
556end of this option (e.g.
557.BR --auto=p7 ).
558If the device name ends with a digit, the partition names add a 'p',
559and a number, e.g. "/dev/home1p3". If there is no
560trailing digit, then the partition names just have a number added,
561e.g. "/dev/scratch3".
562
563If the md device name is in a 'standard' format as described in DEVICE
564NAMES, then it will be created, if necessary, with the appropriate
565number based on that name. If the device name is not in one of these
566formats, then a unused minor number will be allocated. The minor
567number will be considered unused if there is no active array for that
568number, and there is no entry in /dev for that number and with a
569non-standard name.
570
571.SH For assemble:
572
573.TP
574.BR -u ", " --uuid=
575uuid of array to assemble. Devices which don't have this uuid are
576excluded
577
578.TP
579.BR -m ", " --super-minor=
580Minor number of device that array was created for. Devices which
581don't have this minor number are excluded. If you create an array as
582/dev/md1, then all superblocks will contain the minor number 1, even if
583the array is later assembled as /dev/md2.
584
585Giving the literal word "dev" for
586.B --super-minor
587will cause
588.I mdadm
589to use the minor number of the md device that is being assembled.
590e.g. when assembling
591.BR /dev/md0 ,
592.M --super-minor=dev
593will look for super blocks with a minor number of 0.
594
595.TP
596.BR -N ", " --name=
597Specify the name of the array to assemble. This must be the name
598that was specified when creating the array.
599
600.TP
601.BR -f ", " --force
602Assemble the array even if some superblocks appear out-of-date
603
604.TP
605.BR -R ", " --run
606Attempt to start the array even if fewer drives were given than were
607present last time the array was active. Normally if not all the
608expected drives are found and
609.B --scan
610is not used, then the array will be assembled but not started.
611With
612.B --run
613an attempt will be made to start it anyway.
614
615.TP
616.B --no-degraded
617This is the reverse of
618.B --run
619in that it inhibits the started if array unless all expected drives
620are present. This is only needed with
621.B --scan
622and can be used if you physical connections to devices are
623not as reliable as you would like.
624
625.TP
626.BR -a ", " "--auto{=no,yes,md,mdp,part}"
627See this option under Create and Build options.
628
629.TP
630.BR -b ", " --bitmap=
631Specify the bitmap file that was given when the array was created. If
632an array has an
633.B internal
634bitmap, there is no need to specify this when assembling the array.
635
636.TP
637.BR --backup-file=
638If
639.B --backup-file
640was used to grow the number of raid-devices in a RAID5, and the system
641crashed during the critical section, then the same
642.B --backup-file
643must be presented to --assemble to allow possibly corrupted data to be
644restored.
645
646.TP
647.BR -U ", " --update=
648Update the superblock on each device while assembling the array. The
649argument given to this flag can be one of
650.BR sparc2.2 ,
651.BR summaries ,
652.BR uuid ,
653.BR name ,
654.BR resync ,
655.BR byteorder ,
656or
657.BR super-minor .
658
659The
660.B sparc2.2
661option will adjust the superblock of an array what was created on a Sparc
662machine running a patched 2.2 Linux kernel. This kernel got the
663alignment of part of the superblock wrong. You can use the
664.B "--examine --sparc2.2"
665option to
666.I mdadm
667to see what effect this would have.
668
669The
670.B super-minor
671option will update the
672.B "preferred minor"
673field on each superblock to match the minor number of the array being
674assembled. This is not needed on 2.6 and later kernels as they make
675this adjustment automatically.
676
677The
678.B uuid
679option will change the uuid of the array. If a UUID is given with the
680"--uuid" option that UUID will be used as a new UUID and with
681.B NOT
682be used to help identify the devices in the array.
683If no "--uuid" is given, a random uuid is chosen.
684
685The
686.B name
687option will change the
688.I name
689of the array as stored in the superblock. This is only supported for
690version-1 superblocks.
691
692The
693.B resync
694option will cause the array to be marked
695.I dirty
696meaning that any redundancy in the array (e.g. parity for raid5,
697copies for raid1) may be incorrect. This will cause the raid system
698to perform a "resync" pass to make sure that all redundant information
699is correct.
700
701The
702.B byteorder
703option allows arrays to be moved between machines with different
704byte-order.
705When assembling such an array for the first time after a move, giving
706.B "--update=byteorder"
707will cause
708.I mdadm
709to expect superblocks to have their byteorder reversed, and will
710correct that order before assembling the array. This is only valid
711with original (Version 0.90) superblocks.
712
713The
714.B summaries
715option will correct the summaries in the superblock. That is the
716counts of total, working, active, failed, and spare devices.
717
718.SH For Manage mode:
719
720.TP
721.BR -a ", " --add
722hot-add listed devices.
723
724.TP
725.BR --re-add
726re-add a device that was recently removed from an array.
727
728.TP
729.BR -r ", " --remove
730remove listed devices. They must not be active. i.e. they should
731be failed or spare devices.
732
733.TP
734.BR -f ", " --fail
735mark listed devices as faulty.
736
737.TP
738.BR --set-faulty
739same as --fail.
740
741.P
742Each of these options require that the first device list is the array
743to be acted upon and the remainder are component devices to be added,
744removed, or marked as fault. Several different operations can be
745specified for different devices, e.g.
746.in +5
747mdadm /dev/md0 --add /dev/sda1 --fail /dev/sdb1 --remove /dev/sdb1
748.in -5
749Each operation applies to all devices listed until the next
750operations.
751
752If an array is using a write-intent bitmap, then devices which have
753been removed can be re-added in a way that avoids a full
754reconstruction but instead just updated the blocks that have changed
755since the device was removed. For arrays with persistent metadata
756(superblocks) this is done automatically. For arrays created with
757.B --build
758mdadm needs to be told that this device we removed recently with
759.B --re-add.
760
761Devices can only be removed from an array if they are not in active
762use. i.e. that must be spares or failed devices. To remove an active
763device, it must be marked as
764.B faulty
765first.
766
767.SH For Misc mode:
768
769.TP
770.BR -Q ", " --query
771Examine a device to see
772(1) if it is an md device and (2) if it is a component of an md
773array.
774Information about what is discovered is presented.
775
776.TP
777.BR -D ", " --detail
778Print detail of one or more md devices.
779
780.TP
781.BR -E ", " --examine
782Print content of md superblock on device(s).
783.TP
784.B --sparc2.2
785If an array was created on a 2.2 Linux kernel patched with RAID
786support, the superblock will have been created incorrectly, or at
787least incompatibly with 2.4 and later kernels. Using the
788.B --sparc2.2
789flag with
790.B --examine
791will fix the superblock before displaying it. If this appears to do
792the right thing, then the array can be successfully assembled using
793.BR "--assemble --update=sparc2.2" .
794
795.TP
796.BR -X ", " --examine-bitmap
797Report information about a bitmap file.
798
799.TP
800.BR -R ", " --run
801start a partially built array.
802
803.TP
804.BR -S ", " --stop
805deactivate array, releasing all resources.
806
807.TP
808.BR -o ", " --readonly
809mark array as readonly.
810
811.TP
812.BR -w ", " --readwrite
813mark array as readwrite.
814
815.TP
816.B --zero-superblock
817If the device contains a valid md superblock, the block is
818over-written with zeros. With
819--force
820the block where the superblock would be is over-written even if it
821doesn't appear to be valid.
822
823.TP
824.BR -t ", " --test
825When used with
826.BR --detail ,
827the exit status of
828.I mdadm
829is set to reflect the status of the device.
830
831.SH For Monitor mode:
832.TP
833.BR -m ", " --mail
834Give a mail address to send alerts to.
835
836.TP
837.BR -p ", " --program ", " --alert
838Give a program to be run whenever an event is detected.
839
840.TP
841.BR -y ", " --syslog
842Cause all events to be reported through 'syslog'. The messages have
843facility of 'daemon' and varying priorities.
844
845.TP
846.BR -d ", " --delay
847Give a delay in seconds.
848.B mdadm
849polls the md arrays and then waits this many seconds before polling
850again. The default is 60 seconds.
851
852.TP
853.BR -f ", " --daemonise
854Tell
855.B mdadm
856to run as a background daemon if it decides to monitor anything. This
857causes it to fork and run in the child, and to disconnect form the
858terminal. The process id of the child is written to stdout.
859This is useful with
860.B --scan
861which will only continue monitoring if a mail address or alert program
862is found in the config file.
863
864.TP
865.BR -i ", " --pid-file
866When
867.B mdadm
868is running in daemon mode, write the pid of the daemon process to
869the specified file, instead of printing it on standard output.
870
871.TP
872.BR -1 ", " --oneshot
873Check arrays only once. This will generate
874.B NewArray
875events and more significantly
876.B DegradedArray
877and
878.B SparesMissing
879events. Running
880.in +5
881.B " mdadm --monitor --scan -1"
882.in -5
883from a cron script will ensure regular notification of any degraded arrays.
884
885.TP
886.BR -t ", " --test
887Generate a
888.B TestMessage
889alert for every array found at startup. This alert gets mailed and
890passed to the alert program. This can be used for testing that alert
891message do get through successfully.
892
893.SH ASSEMBLE MODE
894
895.HP 12
896Usage:
897.B mdadm --assemble
898.I md-device options-and-component-devices...
899.HP 12
900Usage:
901.B mdadm --assemble --scan
902.I md-devices-and-options...
903.HP 12
904Usage:
905.B mdadm --assemble --scan
906.I options...
907
908.PP
909This usage assembles one or more raid arrays from pre-existing components.
910For each array, mdadm needs to know the md device, the identity of the
911array, and a number of component-devices. These can be found in a number of ways.
912
913In the first usage example (without the
914.BR --scan )
915the first device given is the md device.
916In the second usage example, all devices listed are treated as md
917devices and assembly is attempted.
918In the third (where no devices are listed) all md devices that are
919listed in the configuration file are assembled.
920
921If precisely one device is listed, but
922.B --scan
923is not given, then
924.I mdadm
925acts as though
926.B --scan
927was given and identify information is extracted from the configuration file.
928
929The identity can be given with the
930.B --uuid
931option, with the
932.B --super-minor
933option, can be found in the config file, or will be taken from the
934super block on the first component-device listed on the command line.
935
936Devices can be given on the
937.B --assemble
938command line or in the config file. Only devices which have an md
939superblock which contains the right identity will be considered for
940any array.
941
942The config file is only used if explicitly named with
943.B --config
944or requested with (a possibly implicit)
945.B --scan.
946In the later case,
947.B /etc/mdadm.conf
948is used.
949
950If
951.B --scan
952is not given, then the config file will only be used to find the
953identity of md arrays.
954
955Normally the array will be started after it is assembled. However if
956.B --scan
957is not given and insufficient drives were listed to start a complete
958(non-degraded) array, then the array is not started (to guard against
959usage errors). To insist that the array be started in this case (as
960may work for RAID1, 4, 5, 6, or 10), give the
961.B --run
962flag.
963
964If an
965.B auto
966option is given, either on the command line (--auto) or in the
967configuration file (e.g. auto=part), then
968.I mdadm
969will create the md device if necessary or will re-create it if it
970doesn't look usable as it is.
971
972This can be useful for handling partitioned devices (which don't have
973a stable device number - it can change after a reboot) and when using
974"udev" to manage your
975.B /dev
976tree (udev cannot handle md devices because of the unusual device
977initialisation conventions).
978
979If the option to "auto" is "mdp" or "part" or (on the command line
980only) "p", then mdadm will create a partitionable array, using the
981first free one that is not in use, and does not already have an entry
982in /dev (apart from numeric /dev/md* entries).
983
984If the option to "auto" is "yes" or "md" or (on the command line)
985nothing, then mdadm will create a traditional, non-partitionable md
986array.
987
988It is expected that the "auto" functionality will be used to create
989device entries with meaningful names such as "/dev/md/home" or
990"/dev/md/root", rather than names based on the numerical array number.
991
992When using this option to create a partitionable array, the device
993files for the first 4 partitions are also created. If a different
994number is required it can be simply appended to the auto option.
995e.g. "auto=part8". Partition names are created by appending a digit
996string to the device name, with an intervening "p" if the device name
997ends with a digit.
998
999The
1000.B --auto
1001option is also available in Build and Create modes. As those modes do
1002not use a config file, the "auto=" config option does not apply to
1003these modes.
1004
1005.SH BUILD MODE
1006
1007.HP 12
1008Usage:
1009.B mdadm --build
1010.I device
1011.BI --chunk= X
1012.BI --level= Y
1013.BI --raid-devices= Z
1014.I devices
1015
1016.PP
1017This usage is similar to
1018.BR --create .
1019The difference is that it creates an array without a superblock. With
1020these arrays there is no difference between initially creating the array and
1021subsequently assembling the array, except that hopefully there is useful
1022data there in the second case.
1023
1024The level may raid0, linear, multipath, or faulty, or one of their
1025synonyms. All devices must be listed and the array will be started
1026once complete.
1027
1028.SH CREATE MODE
1029
1030.HP 12
1031Usage:
1032.B mdadm --create
1033.I device
1034.BI --chunk= X
1035.BI --level= Y
1036.br
1037.BI --raid-devices= Z
1038.I devices
1039
1040.PP
1041This usage will initialise a new md array, associate some devices with
1042it, and activate the array.
1043
1044If the
1045.B --auto
1046option is given (as described in more detail in the section on
1047Assemble mode), then the md device will be created with a suitable
1048device number if necessary.
1049
1050As devices are added, they are checked to see if they contain raid
1051superblocks or filesystems. They are also checked to see if the variance in
1052device size exceeds 1%.
1053
1054If any discrepancy is found, the array will not automatically be run, though
1055the presence of a
1056.B --run
1057can override this caution.
1058
1059To create a "degraded" array in which some devices are missing, simply
1060give the word "\fBmissing\fP"
1061in place of a device name. This will cause
1062.B mdadm
1063to leave the corresponding slot in the array empty.
1064For a RAID4 or RAID5 array at most one slot can be
1065"\fBmissing\fP"; for a RAID6 array at most two slots.
1066For a RAID1 array, only one real device needs to be given. All of the
1067others can be
1068"\fBmissing\fP".
1069
1070When creating a RAID5 array,
1071.B mdadm
1072will automatically create a degraded array with an extra spare drive.
1073This is because building the spare into a degraded array is in general faster than resyncing
1074the parity on a non-degraded, but not clean, array. This feature can
1075be over-ridden with the
1076.I --force
1077option.
1078
1079'''If the
1080'''.B --size
1081'''option is given, it is not necessary to list any component-devices in this command.
1082'''They can be added later, before a
1083'''.B --run.
1084'''If no
1085'''.B --size
1086'''is given, the apparent size of the smallest drive given is used.
1087
1088The General Management options that are valid with --create are:
1089.TP
1090.B --run
1091insist on running the array even if some devices look like they might
1092be in use.
1093
1094.TP
1095.B --readonly
1096start the array readonly - not supported yet.
1097
1098
1099.SH MANAGE MODE
1100.HP 12
1101Usage:
1102.B mdadm
1103.I device
1104.I options... devices...
1105.PP
1106
1107This usage will allow individual devices in an array to be failed,
1108removed or added. It is possible to perform multiple operations with
1109on command. For example:
1110.br
1111.B " mdadm /dev/md0 -f /dev/hda1 -r /dev/hda1 -a /dev/hda1"
1112.br
1113will firstly mark
1114.B /dev/hda1
1115as faulty in
1116.B /dev/md0
1117and will then remove it from the array and finally add it back
1118in as a spare. However only one md array can be affected by a single
1119command.
1120
1121.SH MISC MODE
1122.HP 12
1123Usage:
1124.B mdadm
1125.I options ...
1126.I devices ...
1127.PP
1128
1129MISC mode includes a number of distinct operations that
1130operate on distinct devices. The operations are:
1131.TP
1132--query
1133The device is examined to see if it is
1134(1) an active md array, or
1135(2) a component of an md array.
1136The information discovered is reported.
1137
1138.TP
1139--detail
1140The device should be an active md device.
1141.B mdadm
1142will display a detailed description of the array.
1143.B --brief
1144or
1145.B --scan
1146will cause the output to be less detailed and the format to be
1147suitable for inclusion in
1148.BR /etc/mdadm.conf .
1149The exit status of
1150.I mdadm
1151will normally be 0 unless
1152.I mdadm
1153failed to get useful information about the device(s). However if the
1154.B --test
1155option is given, then the exit status will be:
1156.RS
1157.TP
11580
1159The array is functioning normally.
1160.TP
11611
1162The array has at least one failed device.
1163.TP
11642
1165The array has multiple failed devices and hence is unusable (raid4 or
1166raid5).
1167.TP
11684
1169There was an error while trying to get information about the device.
1170.RE
1171
1172.TP
1173--examine
1174The device should be a component of an md array.
1175.B mdadm
1176will read the md superblock of the device and display the contents.
1177If
1178.B --brief
1179is given, or
1180.B --scan
1181then multiple devices that are components of the one array
1182are grouped together and reported in a single entry suitable
1183for inclusion in
1184.BR /etc/mdadm.conf .
1185
1186Having
1187.B --scan
1188without listing any devices will cause all devices listed in the
1189config file to be examined.
1190
1191.TP
1192--stop
1193The devices should be active md arrays which will be deactivated, as
1194long as they are not currently in use.
1195
1196.TP
1197--run
1198This will fully activate a partially assembled md array.
1199
1200.TP
1201--readonly
1202This will mark an active array as read-only, providing that it is
1203not currently being used.
1204
1205.TP
1206--readwrite
1207This will change a
1208.B readonly
1209array back to being read/write.
1210
1211.TP
1212--scan
1213For all operations except
1214.BR --examine ,
1215.B --scan
1216will cause the operation to be applied to all arrays listed in
1217.BR /proc/mdstat .
1218For
1219.BR --examine,
1220.B --scan
1221causes all devices listed in the config file to be examined.
1222
1223
1224.SH MONITOR MODE
1225
1226.HP 12
1227Usage:
1228.B mdadm --monitor
1229.I options... devices...
1230
1231.PP
1232This usage causes
1233.B mdadm
1234to periodically poll a number of md arrays and to report on any events
1235noticed.
1236.B mdadm
1237will never exit once it decides that there are arrays to be checked,
1238so it should normally be run in the background.
1239
1240As well as reporting events,
1241.B mdadm
1242may move a spare drive from one array to another if they are in the
1243same
1244.B spare-group
1245and if the destination array has a failed drive but no spares.
1246
1247If any devices are listed on the command line,
1248.B mdadm
1249will only monitor those devices. Otherwise all arrays listed in the
1250configuration file will be monitored. Further, if
1251.B --scan
1252is given, then any other md devices that appear in
1253.B /proc/mdstat
1254will also be monitored.
1255
1256The result of monitoring the arrays is the generation of events.
1257These events are passed to a separate program (if specified) and may
1258be mailed to a given E-mail address.
1259
1260When passing event to program, the program is run once for each event
1261and is given 2 or 3 command-line arguments. The first is the
1262name of the event (see below). The second is the name of the
1263md device which is affected, and the third is the name of a related
1264device if relevant, such as a component device that has failed.
1265
1266If
1267.B --scan
1268is given, then a program or an E-mail address must be specified on the
1269command line or in the config file. If neither are available, then
1270.B mdadm
1271will not monitor anything.
1272Without
1273.B --scan
1274.B mdadm
1275will continue monitoring as long as something was found to monitor. If
1276no program or email is given, then each event is reported to
1277.BR stdout .
1278
1279The different events are:
1280
1281.RS 4
1282.TP
1283.B DeviceDisappeared
1284An md array which previously was configured appears to no longer be
1285configured. (syslog priority: Critical)
1286
1287If
1288.I mdadm
1289was told to monitor an array which is RAID0 or Linear, then it will
1290report
1291.B DeviceDisappeared
1292with the extra information
1293.BR Wrong-Level .
1294This is because RAID0 and Linear do not support the device-failed,
1295hot-spare and resync operations which are monitored.
1296
1297.TP
1298.B RebuildStarted
1299An md array started reconstruction. (syslog priority: Warning)
1300
1301.TP
1302.BI Rebuild NN
1303Where
1304.I NN
1305is 20, 40, 60, or 80, this indicates that rebuild has passed that many
1306percentage of the total. (syslog priority: Warning)
1307
1308.TP
1309.B RebuildFinished
1310An md array that was rebuilding, isn't any more, either because it
1311finished normally or was aborted. (syslog priority: Warning)
1312
1313.TP
1314.B Fail
1315An active component device of an array has been marked as
1316faulty. (syslog priority: Critical)
1317
1318.TP
1319.B FailSpare
1320A spare component device which was being rebuilt to replace a faulty
1321device has failed. (syslog priority: Critial)
1322
1323.TP
1324.B SpareActive
1325A spare component device which was being rebuilt to replace a faulty
1326device has been successfully rebuilt and has been made active.
1327(syslog priority: Info)
1328
1329.TP
1330.B NewArray
1331A new md array has been detected in the
1332.B /proc/mdstat
1333file. (syslog priority: Info)
1334
1335.TP
1336.B DegradedArray
1337A newly noticed array appears to be degraded. This message is not
1338generated when
1339.I mdadm
1340notices a drive failure which causes degradation, but only when
1341.I mdadm
1342notices that an array is degraded when it first sees the array.
1343(syslog priority: Critial)
1344
1345.TP
1346.B MoveSpare
1347A spare drive has been moved from one array in a
1348.B spare-group
1349to another to allow a failed drive to be replaced.
1350(syslog priority: Info)
1351
1352.TP
1353.B SparesMissing
1354If
1355.I mdadm
1356has been told, via the config file, that an array should have a certain
1357number of spare devices, and
1358.I mdadm
1359detects that it has fewer that this number when it first sees the
1360array, it will report a
1361.B SparesMissing
1362message.
1363(syslog priority: Warning)
1364
1365.TP
1366.B TestMessage
1367An array was found at startup, and the
1368.B --test
1369flag was given.
1370(syslog priority: Info)
1371.RE
1372
1373Only
1374.B Fail ,
1375.B FailSpare ,
1376.B DegradedArray ,
1377.B SparesMissing ,
1378and
1379.B TestMessage
1380cause Email to be sent. All events cause the program to be run.
1381The program is run with two or three arguments, they being the event
1382name, the array device and possibly a second device.
1383
1384Each event has an associated array device (e.g.
1385.BR /dev/md1 )
1386and possibly a second device. For
1387.BR Fail ,
1388.BR FailSpare ,
1389and
1390.B SpareActive
1391the second device is the relevant component device.
1392For
1393.B MoveSpare
1394the second device is the array that the spare was moved from.
1395
1396For
1397.B mdadm
1398to move spares from one array to another, the different arrays need to
1399be labelled with the same
1400.B spare-group
1401in the configuration file. The
1402.B spare-group
1403name can be any string. It is only necessary that different spare
1404groups use different names.
1405
1406When
1407.B mdadm
1408detects that an array which is in a spare group has fewer active
1409devices than necessary for the complete array, and has no spare
1410devices, it will look for another array in the same spare group that
1411has a full complement of working drive and a spare. It will then
1412attempt to remove the spare from the second drive and add it to the
1413first.
1414If the removal succeeds but the adding fails, then it is added back to
1415the original array.
1416
1417.SH GROW MODE
1418The GROW mode is used for changing the size or shape of an active
1419array.
1420For this to work, the kernel must support the necessary change.
1421Various types of growth are being added during 2.6 development,
1422including restructuring a raid5 array to have more active devices.
1423
1424Currently the only support available is to
1425.IP \(bu 4
1426change the "size" attribute
1427for RAID1, RAID5 and RAID6.
1428.IP \(bu 4
1429increase the "raid-disks" attribute of RAID1 and RAID5.
1430.IP \(bu 4
1431add a write-intent bitmap to any array which support these bitmaps, or
1432remove a write-intent bitmap from such an array.
1433.PP
1434
1435.SS SIZE CHANGES
1436Normally when an array is built the "size" it taken from the smallest
1437of the drives. If all the small drives in an arrays are, one at a
1438time, removed and replaced with larger drives, then you could have an
1439array of large drives with only a small amount used. In this
1440situation, changing the "size" with "GROW" mode will allow the extra
1441space to start being used. If the size is increased in this way, a
1442"resync" process will start to make sure the new parts of the array
1443are synchronised.
1444
1445Note that when an array changes size, any filesystem that may be
1446stored in the array will not automatically grow to use the space. The
1447filesystem will need to be explicitly told to use the extra space.
1448
1449.SS RAID-DEVICES CHANGES
1450
1451A RAID1 array can work with any number of devices from 1 upwards
1452(though 1 is not very useful). There may be times which you want to
1453increase or decrease the number of active devices. Note that this is
1454different to hot-add or hot-remove which changes the number of
1455inactive devices.
1456
1457When reducing the number of devices in a RAID1 array, the slots which
1458are to be removed from the array must already be vacant. That is, the
1459devices that which were in those slots must be failed and removed.
1460
1461When the number of devices is increased, any hot spares that are
1462present will be activated immediately.
1463
1464Increasing the number of active devices in a RAID5 is much more
1465effort. Every block in the array will need to be read and written
1466back to a new location. From 2.6.17, the Linux Kernel is able to do
1467this safely, including restart and interrupted "reshape".
1468
1469When relocating the first few stripes on a raid5, it is not possible
1470to keep the data on disk completely consistent and crash-proof. To
1471provide the required safety, mdadm disables writes to the array while
1472this "critical section" is reshaped, and takes a backup of the data
1473that is in that section. This backup is normally stored in any spare
1474devices that the array has, however it can also be stored in a
1475separate file specified with the
1476.B --backup-file
1477option. If this option is used, and the system does crash during the
1478critical period, the same file must be passed to
1479.B --assemble
1480to restore the backup and reassemble the array.
1481
1482.SS BITMAP CHANGES
1483
1484A write-intent bitmap can be added to, or removed from, an active
1485array. Either internal bitmaps, or bitmaps stored in a separate file
1486can be added. Note that if you add a bitmap stored in a file which is
1487in a filesystem that is on the raid array being affected, the system
1488will deadlock. The bitmap must be on a separate filesystem.
1489
1490.SH EXAMPLES
1491
1492.B " mdadm --query /dev/name-of-device"
1493.br
1494This will find out if a given device is a raid array, or is part of
1495one, and will provide brief information about the device.
1496
1497.B " mdadm --assemble --scan"
1498.br
1499This will assemble and start all arrays listed in the standard config file
1500file. This command will typically go in a system startup file.
1501
1502.B " mdadm --stop --scan"
1503.br
1504This will shut down all array that can be shut down (i.e. are not
1505currently in use). This will typically go in a system shutdown script.
1506
1507.B " mdadm --follow --scan --delay=120"
1508.br
1509If (and only if) there is an Email address or program given in the
1510standard config file, then
1511monitor the status of all arrays listed in that file by
1512polling them ever 2 minutes.
1513
1514.B " mdadm --create /dev/md0 --level=1 --raid-devices=2 /dev/hd[ac]1"
1515.br
1516Create /dev/md0 as a RAID1 array consisting of /dev/hda1 and /dev/hdc1.
1517
1518.br
1519.B " echo 'DEVICE /dev/hd*[0-9] /dev/sd*[0-9]' > mdadm.conf"
1520.br
1521.B " mdadm --detail --scan >> mdadm.conf"
1522.br
1523This will create a prototype config file that describes currently
1524active arrays that are known to be made from partitions of IDE or SCSI drives.
1525This file should be reviewed before being used as it may
1526contain unwanted detail.
1527
1528.B " echo 'DEVICE /dev/hd[a-z] /dev/sd*[a-z]' > mdadm.conf"
1529.br
1530.B " mdadm --examine --scan --config=mdadm.conf >> mdadm.conf"
1531.ber
1532This will find what arrays could be assembled from existing IDE and
1533SCSI whole drives (not partitions) and store the information is the
1534format of a config file.
1535This file is very likely to contain unwanted detail, particularly
1536the
1537.B devices=
1538entries. It should be reviewed and edited before being used as an
1539actual config file.
1540
1541.B " mdadm --examine --brief --scan --config=partitions"
1542.br
1543.B " mdadm -Ebsc partitions"
1544.br
1545Create a list of devices by reading
1546.BR /proc/partitions ,
1547scan these for RAID superblocks, and printout a brief listing of all
1548that was found.
1549
1550.B " mdadm -Ac partitions -m 0 /dev/md0"
1551.br
1552Scan all partitions and devices listed in
1553.BR /proc/partitions
1554and assemble
1555.B /dev/md0
1556out of all such devices with a RAID superblock with a minor number of 0.
1557
1558.B " mdadm --monitor --scan --daemonise > /var/run/mdadm"
1559.br
1560If config file contains a mail address or alert program, run mdadm in
1561the background in monitor mode monitoring all md devices. Also write
1562pid of mdadm daemon to
1563.BR /var/run/mdadm .
1564
1565.B " mdadm --create --help"
1566.br
1567Provide help about the Create mode.
1568
1569.B " mdadm --config --help"
1570.br
1571Provide help about the format of the config file.
1572
1573.B " mdadm --help"
1574.br
1575Provide general help.
1576
1577
1578.SH FILES
1579
1580.SS /proc/mdstat
1581
1582If you're using the
1583.B /proc
1584filesystem,
1585.B /proc/mdstat
1586lists all active md devices with information about them.
1587.B mdadm
1588uses this to find arrays when
1589.B --scan
1590is given in Misc mode, and to monitor array reconstruction
1591on Monitor mode.
1592
1593
1594.SS /etc/mdadm.conf
1595
1596The config file lists which devices may be scanned to see if
1597they contain MD super block, and gives identifying information
1598(e.g. UUID) about known MD arrays. See
1599.BR mdadm.conf (5)
1600for more details.
1601
1602.SH DEVICE NAMES
1603
1604While entries in the /dev directory can have any format you like,
1605.I mdadm
1606has an understanding of 'standard' formats which it uses to guide its
1607behaviour when creating device files via the
1608.I --auto
1609option.
1610
1611The standard names for non-partitioned arrays (the only sort of md
1612array available in 2.4 and earlier) either of
1613.IP
1614/dev/mdNN
1615.br
1616/dev/md/NN
1617.PP
1618where NN is a number.
1619The standard names for partitionable arrays (as available from 2.6
1620onwards) is one of
1621.IP
1622/dev/md/dNN
1623.br
1624/dev/md_dNN
1625.PP
1626Partition numbers should be indicated by added "pMM" to these, thus "/dev/md/d1p2".
1627
1628.SH NOTE
1629.B mdadm
1630was previously known as
1631.BR mdctl .
1632.P
1633.B mdadm
1634is completely separate from the
1635.B raidtools
1636package, and does not use the
1637.I /etc/raidtab
1638configuration file at all.
1639
1640.SH SEE ALSO
1641For information on the various levels of
1642RAID, check out:
1643
1644.IP
1645.UR http://ostenfeld.dk/~jakob/Software-RAID.HOWTO/
1646http://ostenfeld.dk/~jakob/Software-RAID.HOWTO/
1647.UE
1648'''.PP
1649'''for new releases of the RAID driver check out:
1650'''
1651'''.IP
1652'''.UR ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
1653'''ftp://ftp.kernel.org/pub/linux/kernel/people/mingo/raid-patches
1654'''.UE
1655'''.PP
1656'''or
1657'''.IP
1658'''.UR http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
1659'''http://www.cse.unsw.edu.au/~neilb/patches/linux-stable/
1660'''.UE
1661.PP
1662The latest version of
1663.I mdadm
1664should always be available from
1665.IP
1666.UR http://www.kernel.org/pub/linux/utils/raid/mdadm/
1667http://www.kernel.org/pub/linux/utils/raid/mdadm/
1668.UE
1669.PP
1670.IR mdadm.conf (5),
1671.IR md (4).
1672.PP
1673.IR raidtab (5),
1674.IR raid0run (8),
1675.IR raidstop (8),
1676.IR mkraid (8).