#1095761 mdadm: Raid reconstruction time on large array incorrect

Package:
mdadm
Source:
mdadm
Description:
Tool to administer Linux MD arrays (software RAID)
Submitter:
Chris D
Date:
2025-02-12 21:36:01 UTC
Severity:
normal
Tags:
#1095761#5
Date:
2025-02-11 18:09:10 UTC
From:
To:
Dear Maintainer,

*** Reporter, please consider answering these questions, where
appropriate ***

    * What led up to the situation?
    * What exactly did you do (or not do) that was effective (or
      ineffective)?
    * What was the outcome of this action?
    * What outcome did you expect instead?

*** End of the template - remove these template lines ***

Raid reconstrution of failed drive, reconstruction time seemed very
slow, adjusted speed_limit max,
speed still slow, and over time, got slower.

However, after watching the system, the speed reported in /proc/mdstat
is not correct

Start of measurement:

md2 : active raid10 sdc5[2] sdd5[0] sda5[4] sdb5[1]
       15567237120 blocks super 1.2 512K chunks 2 near-copies [4/3]
[_UUU]
       [=======>.............]  recovery = 35.7% (2781375360/7783618560)
finish=5243935.0min speed=15K/sec
       bitmap: 30/116 pages [120KB], 65536KB chunk

1 hour later:

md2 : active raid10 sdc5[2] sdd5[0] sda5[4] sdb5[1]
       15567237120 blocks super 1.2 512K chunks 2 near-copies [4/3]
[_UUU]
       [=======>.............]  recovery = 38.4% (2994083648/7783618560)
finish=5674732.6min speed=14K/sec
       bitmap: 29/116 pages [116KB], 65536KB chunk

In one hour, it completed 2.7% of the reconstruction - which suggests
(100% - 38.4%) / (38.4% - 35.7%) = 22.8
hours to complete. /proc/mdstat estimates 94578.8 hours to complete.
Both the reconstruction speed of 15K/sec
and the finish time listed are incorrect. I suspect the size of the
assembled raid set is causing a problem
with the calculation of the reconstruction speed:

# vgs
   VG  #PV #LV #SN Attr   VSize   VFree
   r10   1   3   0 wz--n- <14.50t 778.07g
--- /etc/default/mdadm
AUTOCHECK=false
AUTOSCAN=true
START_DAEMON=true
DAEMON_OPTIONS="--syslog"
VERBOSE=false

       9756672 blocks super 1.2 [2/2] [UU]

md2 : active raid10 sdc5[2] sdd5[0] sda5[4] sdb5[1]
       15567237120 blocks super 1.2 512K chunks 2 near-copies [4/3]
[_UUU]
       [=======>.............]  recovery = 39.0% (3041865728/7783618560)
finish=5760598.8min speed=13K/sec
       bitmap: 29/116 pages [116KB], 65536KB chunk

md4 : active raid1 sdc3[1] sda3[0] sdd3[2](S) sdb3[3](S)
       1950720 blocks super 1.2 [2/2] [UU]

md3 : active raid1 sdc2[1] sda2[0] sdd2[2](S) sdb2[3](S)
       194560 blocks super 1.2 [2/2] [UU]

unused devices: <none>
--- /proc/partitions:
major minor  #blocks  name

    8        0 7814026584 sda
    8        1      40960 sda1
    8        2     195584 sda2
    8        3    1952768 sda3
    8        4    9765888 sda4
    8        5 7783750656 sda5
    8        6   18319360 sda6
    8       16 7814026584 sdb
    8       17      40960 sdb1
    8       18     195584 sdb2
    8       19    1952768 sdb3
    8       20    9765888 sdb4
    8       21 7783750656 sdb5
    8       22   18319360 sdb6
    8       48 7814026584 sdd
    8       49      40960 sdd1
    8       50     195584 sdd2
    8       51    1952768 sdd3
    8       52    9765888 sdd4
    8       53 7783750656 sdd5
    8       54   18319360 sdd6
    8       32 7814026584 sdc
    8       33      40960 sdc1
    8       34     195584 sdc2
    8       35    1952768 sdc3
    8       36    9765888 sdc4
    8       37 7783750656 sdc5
    8       38   18319360 sdc6
    9        3     194560 md3
    9        4    1950720 md4
    9        2 15567237120 md2
    9        5    9756672 md5
  253        0  314572800 dm-0
  253        1 14331936768 dm-1
  253        2  104857600 dm-2
--- LVM physical volumes: LVM does not seem to be used. --- mount output sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime) proc on /proc type proc (rw,nosuid,nodev,noexec,relatime) udev on /dev type devtmpfs (rw,nosuid,relatime,size=32816872k,nr_inodes=8204218,mode=755,inode64) devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000) tmpfs on /run type tmpfs (rw,nosuid,nodev,noexec,relatime,size=6568844k,mode=755,inode64) /dev/md5 on / type ext4 (rw,relatime,errors=remount-ro) securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime) tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,inode64) cgroup2 on /sys/fs/cgroup type cgroup2 (rw,nosuid,nodev,noexec,relatime) pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime) efivarfs on /sys/firmware/efi/efivars type efivarfs (rw,nosuid,nodev,noexec,relatime) bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700) systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17448) tmpfs on /run/credentials/systemd-journald.service type tmpfs (ro,nosuid,nodev,noexec,relatime,nosymfollow,size=1024k,nr_inodes=1024,mode=700,inode64,noswap) tracefs on /sys/kernel/tracing type tracefs (rw,nosuid,nodev,noexec,relatime) mqueue on /dev/mqueue type mqueue (rw,nosuid,nodev,noexec,relatime) debugfs on /sys/kernel/debug type debugfs (rw,nosuid,nodev,noexec,relatime) hugetlbfs on /dev/hugepages type hugetlbfs (rw,nosuid,nodev,relatime,pagesize=2M) configfs on /sys/kernel/config type configfs (rw,nosuid,nodev,noexec,relatime) tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k,inode64) fusectl on /sys/fs/fuse/connections type fusectl (rw,nosuid,nodev,noexec,relatime) /dev/mapper/r10-iso on /mnt/iso type ext4 (rw,relatime,stripe=256) /dev/md4 on /tmp type ext4 (rw,relatime) /dev/md3 on /boot type ext4 (rw,relatime,stripe=4) /dev/mapper/r10-movies on /mnt/movies type ext4 (rw,relatime,stripe=256) /dev/sda1 on /boot/efi type vfat (rw,relatime,fmask=0077,dmask=0077,codepage=437,iocharset=ascii,shortname=mixed,utf8,errors=remount-ro) /dev/mapper/r10-tnh on /mnt/tnh type ext4 (rw,relatime,stripe=256) binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc (rw,nosuid,nodev,noexec,relatime) lxcfs on /var/lib/lxcfs type fuse.lxcfs (rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other) tmpfs on /run/credentials/getty@tty1.service type tmpfs (ro,nosuid,nodev,noexec,relatime,nosymfollow,size=1024k,nr_inodes=1024,mode=700,inode64,noswap) tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,size=6568840k,nr_inodes=1642210,mode=700,uid=1000,gid=1000,inode64)
--- initrd.img-6.12.12-amd64: gzip: /boot/initrd.img-6.12.12-amd64: not in gzip format cpio: premature end of archive
--- initrd's /conf/conf.d/md: no conf/md file.
--- /proc/modules: raid456 200704 0 - Live 0xffffffffc086a000 async_raid6_recov 20480 1 raid456, Live 0xffffffffc085f000 async_memcpy 16384 2 raid456,async_raid6_recov, Live 0xffffffffc0855000 async_pq 16384 2 raid456,async_raid6_recov, Live 0xffffffffc0849000 async_xor 16384 3 raid456,async_raid6_recov,async_pq, Live 0xffffffffc083f000 async_tx 16384 5 raid456,async_raid6_recov,async_memcpy,async_pq,async_xor, Live 0xffffffffc0833000 raid6_pq 122880 4 btrfs,raid456,async_raid6_recov,async_pq, Live 0xffffffffc0805000 libcrc32c 12288 5 nf_nat,nf_conntrack,nf_tables,btrfs,raid456, Live 0xffffffffc07fb000 raid0 28672 0 - Live 0xffffffffc07e7000 dm_mod 221184 9 - Live 0xffffffffc07af000 raid10 77824 1 - Live 0xffffffffc07a3000 raid1 61440 3 - Live 0xffffffffc072a000 md_mod 229376 10 raid456,raid0,raid10,raid1, Live 0xffffffffc0609000
--- volume detail: /dev/sda is not recognised by mdadm. /dev/sda1 is not recognised by mdadm. /dev/sda2 is not recognised by mdadm. /dev/sda3 is not recognised by mdadm. /dev/sda4 is not recognised by mdadm. /dev/sda5 is not recognised by mdadm. /dev/sda6 is not recognised by mdadm. /dev/sdb is not recognised by mdadm. /dev/sdb1 is not recognised by mdadm. /dev/sdb2 is not recognised by mdadm. /dev/sdb3 is not recognised by mdadm. /dev/sdb4 is not recognised by mdadm. /dev/sdb5 is not recognised by mdadm. /dev/sdb6 is not recognised by mdadm. /dev/sdc is not recognised by mdadm. /dev/sdc1 is not recognised by mdadm. /dev/sdc2 is not recognised by mdadm. /dev/sdc3 is not recognised by mdadm. /dev/sdc4 is not recognised by mdadm. /dev/sdc5 is not recognised by mdadm. /dev/sdc6 is not recognised by mdadm. /dev/sdd is not recognised by mdadm. /dev/sdd1 is not recognised by mdadm. /dev/sdd2 is not recognised by mdadm. /dev/sdd3 is not recognised by mdadm. /dev/sdd4 is not recognised by mdadm. /dev/sdd5 is not recognised by mdadm. /dev/sdd6 is not recognised by mdadm.
--- /proc/cmdline BOOT_IMAGE=/vmlinuz-6.12.12-amd64 root=UUID=1e39b4a5-bdd1-4c24-9902-7dbcfc783763 ro quiet
--- grub2: set root='mduuid/71fcde6ed6a19e3b251a09bc2ae9e19f' set root='mduuid/fe2d19c27f4b18e3e607957f8e4db92e' linux /vmlinuz-6.12.12-amd64 root=UUID=1e39b4a5-bdd1-4c24-9902-7dbcfc783763 ro quiet set root='mduuid/fe2d19c27f4b18e3e607957f8e4db92e' linux /vmlinuz-6.12.12-amd64 root=UUID=1e39b4a5-bdd1-4c24-9902-7dbcfc783763 ro quiet set root='mduuid/fe2d19c27f4b18e3e607957f8e4db92e' linux /vmlinuz-6.12.12-amd64 root=UUID=1e39b4a5-bdd1-4c24-9902-7dbcfc783763 ro single dis_ucode_ldr
--- udev: ii udev 257.2-3 amd64 /dev/ and hotplug management daemon 9d7dfcdc58fa54941f8d28f6094a7a5b /lib/udev/rules.d/01-md-raid-creating.rules d21144337b6cae698cd65998d1cdc353 /lib/udev/rules.d/63-md-raid-arrays.rules 9059567e6c218117d16fd1544029e4db /lib/udev/rules.d/64-md-raid-assembly.rules 9792d581f9b0995c7e7e64ad7cc29acd /lib/udev/rules.d/69-md-clustered-confirm-device.rules c4cbda048c9704e340056e6c05855e30 /lib/udev/rules.d/99-systemd.rules
--- /dev: brw-rw---- 1 root disk 9, 2 Feb 11 04:44 /dev/md2 brw-rw---- 1 root disk 9, 3 Feb 11 04:44 /dev/md3 brw-rw---- 1 root disk 9, 4 Feb 11 04:44 /dev/md4 brw-rw---- 1 root disk 9, 5 Feb 11 04:44 /dev/md5 /dev/disk/by-diskseq: total 0 lrwxrwxrwx 1 root root 9 Feb 11 04:44 1 -> ../../sda lrwxrwxrwx 1 root root 10 Feb 11 04:44 1-part1 -> ../../sda1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 1-part2 -> ../../sda2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 1-part3 -> ../../sda3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 1-part4 -> ../../sda4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 1-part5 -> ../../sda5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 1-part6 -> ../../sda6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 2 -> ../../sdb lrwxrwxrwx 1 root root 10 Feb 11 04:44 2-part1 -> ../../sdb1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 2-part2 -> ../../sdb2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 2-part3 -> ../../sdb3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 2-part4 -> ../../sdb4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 2-part5 -> ../../sdb5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 2-part6 -> ../../sdb6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 3 -> ../../sdc lrwxrwxrwx 1 root root 10 Feb 11 04:44 3-part1 -> ../../sdc1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 3-part2 -> ../../sdc2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 3-part3 -> ../../sdc3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 3-part4 -> ../../sdc4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 3-part5 -> ../../sdc5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 3-part6 -> ../../sdc6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 4 -> ../../sdd lrwxrwxrwx 1 root root 10 Feb 11 04:44 4-part1 -> ../../sdd1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 4-part2 -> ../../sdd2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 4-part3 -> ../../sdd3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 4-part4 -> ../../sdd4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 4-part5 -> ../../sdd5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 4-part6 -> ../../sdd6 /dev/disk/by-id: total 0 lrwxrwxrwx 1 root root 9 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JT2M6 -> ../../sdb lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JT2M6-part1 -> ../../sdb1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JT2M6-part2 -> ../../sdb2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JT2M6-part3 -> ../../sdb3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JT2M6-part4 -> ../../sdb4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JT2M6-part5 -> ../../sdb5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JT2M6-part6 -> ../../sdb6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JTW7M -> ../../sdd lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JTW7M-part1 -> ../../sdd1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JTW7M-part2 -> ../../sdd2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JTW7M-part3 -> ../../sdd3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JTW7M-part4 -> ../../sdd4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JTW7M-part5 -> ../../sdd5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JTW7M-part6 -> ../../sdd6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JV52F -> ../../sdc lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JV52F-part1 -> ../../sdc1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JV52F-part2 -> ../../sdc2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JV52F-part3 -> ../../sdc3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JV52F-part4 -> ../../sdc4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JV52F-part5 -> ../../sdc5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JV52F-part6 -> ../../sdc6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JWV16 -> ../../sda lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JWV16-part1 -> ../../sda1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JWV16-part2 -> ../../sda2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JWV16-part3 -> ../../sda3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JWV16-part4 -> ../../sda4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JWV16-part5 -> ../../sda5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ata-ST8000NM0055-1RM112_ZA1JWV16-part6 -> ../../sda6 lrwxrwxrwx 1 root root 10 Feb 11 04:44 dm-name-r10-iso -> ../../dm-0 lrwxrwxrwx 1 root root 10 Feb 11 04:44 dm-name-r10-movies -> ../../dm-1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 dm-name-r10-tnh -> ../../dm-2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 dm-uuid-LVM-KFyYX9I31iV4Q8zjRQrw5yzfviqWEyScNJ1G8MhJ4HpJ3rHT3Fahw92vJg24q3CG -> ../../dm-1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 dm-uuid-LVM-KFyYX9I31iV4Q8zjRQrw5yzfviqWEyScj2N08Iqs5qZjhoa8nXY2GoJUjlJH4vqY -> ../../dm-2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 dm-uuid-LVM-KFyYX9I31iV4Q8zjRQrw5yzfviqWEyScqpIWEuyaOt3l4dog34KuKfAwExUb1TPn -> ../../dm-0 lrwxrwxrwx 1 root root 9 Feb 11 04:44 lvm-pv-uuid-YMjngp-YDbi-E7CU-Y7o8-JAtp-lONe-aH16lb -> ../../md2 lrwxrwxrwx 1 root root 9 Feb 11 04:44 md-name-k1:2 -> ../../md2 lrwxrwxrwx 1 root root 9 Feb 11 04:44 md-name-k1:3 -> ../../md3 lrwxrwxrwx 1 root root 9 Feb 11 04:44 md-name-k1:4 -> ../../md4 lrwxrwxrwx 1 root root 9 Feb 11 04:44 md-name-k1:5 -> ../../md5 lrwxrwxrwx 1 root root 9 Feb 11 04:44 md-uuid-248b15b9:2b81e826:b963923b:b9cc30b5 -> ../../md4 lrwxrwxrwx 1 root root 9 Feb 11 04:44 md-uuid-71fcde6e:d6a19e3b:251a09bc:2ae9e19f -> ../../md5 lrwxrwxrwx 1 root root 9 Feb 11 04:44 md-uuid-e08863a0:e1f0a435:cf1449cb:989ace70 -> ../../md2 lrwxrwxrwx 1 root root 9 Feb 11 04:44 md-uuid-fe2d19c2:7f4b18e3:e607957f:8e4db92e -> ../../md3 lrwxrwxrwx 1 root root 9 Feb 11 04:44 wwn-0x5000c500c6a7b3ba -> ../../sdb lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6a7b3ba-part1 -> ../../sdb1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6a7b3ba-part2 -> ../../sdb2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6a7b3ba-part3 -> ../../sdb3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6a7b3ba-part4 -> ../../sdb4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6a7b3ba-part5 -> ../../sdb5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6a7b3ba-part6 -> ../../sdb6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 wwn-0x5000c500c6aa6586 -> ../../sdd lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6aa6586-part1 -> ../../sdd1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6aa6586-part2 -> ../../sdd2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6aa6586-part3 -> ../../sdd3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6aa6586-part4 -> ../../sdd4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6aa6586-part5 -> ../../sdd5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6aa6586-part6 -> ../../sdd6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 wwn-0x5000c500c6b33705 -> ../../sdc lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6b33705-part1 -> ../../sdc1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6b33705-part2 -> ../../sdc2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6b33705-part3 -> ../../sdc3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6b33705-part4 -> ../../sdc4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6b33705-part5 -> ../../sdc5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6b33705-part6 -> ../../sdc6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 wwn-0x5000c500c6cb50e7 -> ../../sda lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6cb50e7-part1 -> ../../sda1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6cb50e7-part2 -> ../../sda2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6cb50e7-part3 -> ../../sda3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6cb50e7-part4 -> ../../sda4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6cb50e7-part5 -> ../../sda5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 wwn-0x5000c500c6cb50e7-part6 -> ../../sda6 /dev/disk/by-partlabel: total 0 lrwxrwxrwx 1 root root 10 Feb 11 04:44 primary -> ../../sda5 /dev/disk/by-partuuid: total 0 lrwxrwxrwx 1 root root 10 Feb 11 04:44 0295201a-078a-4751-b3e5-14bec404e661 -> ../../sda5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 02d4f28d-8f74-44e1-9d2a-a2136c0fb095 -> ../../sdd2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 2160c3b1-c055-492b-a33f-dd07b0993896 -> ../../sdd4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 2650a393-83c9-46e7-9e9c-23c956fdff4f -> ../../sdb4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 2ae9429e-ca02-4de7-a376-d7f17d4f4883 -> ../../sdc6 lrwxrwxrwx 1 root root 10 Feb 11 04:44 2c3f07fe-c6e9-4020-986f-6c081b213ec0 -> ../../sda2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 3cd066ff-1f58-487d-81fe-18429b536bb2 -> ../../sda6 lrwxrwxrwx 1 root root 10 Feb 11 04:44 3ef9a361-7ad9-47d9-b5da-7d5694f147e6 -> ../../sdc4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 4e555085-86a9-4912-a888-39fd1d9c85f8 -> ../../sda4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 5c527e2b-e641-42df-a63b-6bd8a4e07c7e -> ../../sdc1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 627ac3d3-03e2-4315-a762-f15e91d76b7e -> ../../sdb3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 6341d19c-57f9-4ce6-8b94-6623d6f680ba -> ../../sdb2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 83a3737d-b675-41cd-9f76-36cde8665858 -> ../../sdd6 lrwxrwxrwx 1 root root 10 Feb 11 04:44 92c38425-69ac-4e27-8498-e6cba049f6e8 -> ../../sdd1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 a1d3a9d6-97cc-47fe-b37f-cd3fe8d5ee06 -> ../../sdb1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ae468c04-77ec-4f8f-8fc6-c1130a8557c4 -> ../../sdb6 lrwxrwxrwx 1 root root 10 Feb 11 04:44 b01cdfb4-8ed0-45c5-affd-ad26cc3903f3 -> ../../sdb5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 c217d2c6-77ac-4990-8eaf-d158dc059dbb -> ../../sdd5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 d30e3572-27f9-42cd-9269-9dcd9c66d911 -> ../../sdc3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 dace39c3-b748-4c0f-9f1f-83e0317a577e -> ../../sda1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 dbd36386-cb33-4516-9c5c-2cb77d12e37c -> ../../sdc5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 e3ab6a84-3844-4957-a802-f7b81f09f742 -> ../../sdd3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 e7871c4b-cc79-4875-a1ca-1e6e13b77810 -> ../../sdc2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ecc534a0-0beb-45be-9ea6-04db41b1f8f1 -> ../../sda3 /dev/disk/by-path: total 0 lrwxrwxrwx 1 root root 9 Feb 11 04:44 pci-0000:00:17.0-ata-1 -> ../../sda lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-1-part1 -> ../../sda1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-1-part2 -> ../../sda2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-1-part3 -> ../../sda3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-1-part4 -> ../../sda4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-1-part5 -> ../../sda5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-1-part6 -> ../../sda6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 pci-0000:00:17.0-ata-1.0 -> ../../sda drwxr-xr-x 6 root root 120 Feb 11 04:44 pci-0000:00:17.0-ata-1.0-part lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-1.0-part1 -> ../../sda1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-1.0-part2 -> ../../sda2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-1.0-part3 -> ../../sda3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-1.0-part4 -> ../../sda4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-1.0-part5 -> ../../sda5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-1.0-part6 -> ../../sda6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 pci-0000:00:17.0-ata-2 -> ../../sdd lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-2-part1 -> ../../sdd1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-2-part2 -> ../../sdd2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-2-part3 -> ../../sdd3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-2-part4 -> ../../sdd4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-2-part5 -> ../../sdd5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-2-part6 -> ../../sdd6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 pci-0000:00:17.0-ata-2.0 -> ../../sdd drwxr-xr-x 6 root root 120 Feb 11 04:44 pci-0000:00:17.0-ata-2.0-part lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-2.0-part1 -> ../../sdd1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-2.0-part2 -> ../../sdd2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-2.0-part3 -> ../../sdd3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-2.0-part4 -> ../../sdd4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-2.0-part5 -> ../../sdd5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-2.0-part6 -> ../../sdd6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 pci-0000:00:17.0-ata-3 -> ../../sdb lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-3-part1 -> ../../sdb1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-3-part2 -> ../../sdb2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-3-part3 -> ../../sdb3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-3-part4 -> ../../sdb4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-3-part5 -> ../../sdb5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-3-part6 -> ../../sdb6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 pci-0000:00:17.0-ata-3.0 -> ../../sdb drwxr-xr-x 6 root root 120 Feb 11 04:44 pci-0000:00:17.0-ata-3.0-part lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-3.0-part1 -> ../../sdb1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-3.0-part2 -> ../../sdb2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-3.0-part3 -> ../../sdb3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-3.0-part4 -> ../../sdb4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-3.0-part5 -> ../../sdb5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-3.0-part6 -> ../../sdb6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 pci-0000:00:17.0-ata-4 -> ../../sdc lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-4-part1 -> ../../sdc1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-4-part2 -> ../../sdc2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-4-part3 -> ../../sdc3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-4-part4 -> ../../sdc4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-4-part5 -> ../../sdc5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-4-part6 -> ../../sdc6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 pci-0000:00:17.0-ata-4.0 -> ../../sdc drwxr-xr-x 6 root root 120 Feb 11 04:44 pci-0000:00:17.0-ata-4.0-part lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-4.0-part1 -> ../../sdc1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-4.0-part2 -> ../../sdc2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-4.0-part3 -> ../../sdc3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-4.0-part4 -> ../../sdc4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-4.0-part5 -> ../../sdc5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 pci-0000:00:17.0-ata-4.0-part6 -> ../../sdc6 /dev/disk/by-uuid: total 0 lrwxrwxrwx 1 root root 9 Feb 11 04:44 1e39b4a5-bdd1-4c24-9902-7dbcfc783763 -> ../../md5 lrwxrwxrwx 1 root root 10 Feb 11 04:44 2AB2-7ACC -> ../../sdd1 lrwxrwxrwx 1 root root 10 Feb 11 04:44 2c5211b9-b740-4a4a-b68b-5beb0be08880 -> ../../sdb6 lrwxrwxrwx 1 root root 10 Feb 11 04:44 5F5A-8348 -> ../../sda1 lrwxrwxrwx 1 root root 9 Feb 11 04:44 7049b5f5-dcdb-455b-bef8-e5ec9391b37d -> ../../md4 lrwxrwxrwx 1 root root 10 Feb 11 04:44 73669f46-4148-4ce0-9cb2-0238c3f3ff7f -> ../../sda6 lrwxrwxrwx 1 root root 10 Feb 11 04:44 7e68b450-5511-4e4a-8cb3-8c854497b180 -> ../../dm-0 lrwxrwxrwx 1 root root 10 Feb 11 04:44 a009465c-8edb-4903-9c76-249dbd4a7a62 -> ../../sdd6 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ab4c5a34-0a6f-4f62-a853-eb6966fa32c5 -> ../../sdc6 lrwxrwxrwx 1 root root 9 Feb 11 04:44 b0cd3580-c775-421c-99ad-583ef65a1dc8 -> ../../md3 lrwxrwxrwx 1 root root 10 Feb 11 04:44 ce3dc597-646c-4d4d-9329-bd3cef8ad631 -> ../../dm-2 lrwxrwxrwx 1 root root 10 Feb 11 04:44 e4dd7657-e78b-4994-a0ac-0d88533b77be -> ../../dm-1 /dev/md: total 0 lrwxrwxrwx 1 root root 6 Feb 11 04:44 2 -> ../md2 lrwxrwxrwx 1 root root 6 Feb 11 04:44 3 -> ../md3 lrwxrwxrwx 1 root root 6 Feb 11 04:44 4 -> ../md4 lrwxrwxrwx 1 root root 6 Feb 11 04:44 5 -> ../md5 Auto-generated on Tue, 11 Feb 2025 17:24:55 +0000 by mdadm bugscript
#1095761#10
Date:
2025-02-12 21:25:57 UTC
From:
To:
reconstruction finished earlier today:

md2 : active raid10 sdc5[2] sdd5[0] sda5[4] sdb5[1]
       15567237120 blocks super 1.2 512K chunks 2 near-copies [4/4]
[UUUU]
       bitmap: 1/116 pages [4KB], 65536KB chunk

So, functionally, raid reconstruction worked properly - just the
reporting of the estimated time and speed were off - and I think the
estimated time is calculated based on the speed and size left.