Issues adding OSD on 3rd node
nutt
12 Posts
May 19, 2022, 4:06 pmQuote from nutt on May 19, 2022, 4:06 pmI'm having issues adding OSD's on our 3rd node, getting the following error log below. I've tried a wipe command found on a similar post but not having any luck, any ideas?
19/05/2022 11:03:26 INFO Executing udevadm settle --timeout 30
19/05/2022 11:03:26 INFO Calling udevadm on sdd device
19/05/2022 11:03:26 INFO Executing partprobe /dev/sdd
19/05/2022 11:03:26 INFO Calling partprobe on sdd device
19/05/2022 11:03:25 INFO Starting sgdisk -t 1:103af3d7-a019-4e56-bfe0-4d664b989f40 /dev/sdd
19/05/2022 11:03:25 INFO Start setting partition type for sdd1
19/05/2022 11:03:25 INFO Mark journal partition sdd1 as available.
19/05/2022 11:03:25 ERROR Error executing : ceph-volume --log-path /opt/petasan/log lvm prepare --bluestore --data /dev/sdeNone --block.db /dev/sdd1
ceph-volume lvm prepare: error: Unable to proceed with non-existing device: /dev/sdeNone
[--journal-slots JOURNAL_SLOTS]
[--journal-size JOURNAL_SIZE]
[--filestore] [--journal JOURNAL]
[--block.wal-slots BLOCK_WAL_SLOTS]
[--block.wal-size BLOCK_WAL_SIZE]
[--block.wal BLOCK_WAL]
[--block.db-slots BLOCK_DB_SLOTS]
[--block.db-size BLOCK_DB_SIZE]
[--block.db BLOCK_DB]
[--dmcrypt] [--no-systemd] [--bluestore]
[--crush-device-class CRUSH_DEVICE_CLASS]
[--cluster-fsid CLUSTER_FSID]
[--osd-fsid OSD_FSID]
[--data-slots DATA_SLOTS] [--osd-id OSD_ID]
usage: ceph-volume lvm prepare [-h] --data DATA [--data-size DATA_SIZE]
stderr: Unknown device "/dev/sdeNone": No such file or directory
stderr: blkid: error: /dev/sdeNone: No such file or directory
19/05/2022 11:03:25 ERROR stderr: lsblk: /dev/sdeNone: not a block device
19/05/2022 11:03:25 INFO Starting : ceph-volume --log-path /opt/petasan/log lvm prepare --bluestore --data /dev/sdeNone --block.db /dev/sdd1
19/05/2022 11:03:22 INFO Executing udevadm settle --timeout 30
19/05/2022 11:03:22 INFO Calling udevadm on sdd device
19/05/2022 11:03:22 INFO Executing partprobe /dev/sdd
19/05/2022 11:03:22 INFO Calling partprobe on sdd device
19/05/2022 11:03:21 INFO Creating journal-db-2-e09794d9 partition num 1 size 61440MB on /dev/sdd
19/05/2022 11:03:20 INFO creating new journal partition.
19/05/2022 11:03:20 INFO osd.2 is removed from crush map
19/05/2022 11:03:18 INFO Start remove osd.2 from crush map
19/05/2022 11:03:18 INFO Creating data partition num 1 size 858483MB on /dev/sde
19/05/2022 11:03:18 INFO Start prepare bluestore OSD : sde
19/05/2022 11:03:18 INFO User didn't select a cache for disk sde.
19/05/2022 11:03:18 INFO User selected Auto journal, selected device is sdd disk for disk sde.
19/05/2022 11:03:15 INFO Executing : partprobe /dev/sdd
19/05/2022 11:03:15 INFO Executing : parted -s /dev/sdd mklabel gpt
19/05/2022 11:03:15 INFO Executing : dd if=/dev/zero of=/dev/sdd bs=1M count=20 oflag=direct,dsync >/dev/null 2>&1
19/05/2022 11:03:15 INFO Executing : wipefs --all /dev/sdd
19/05/2022 11:03:15 INFO Executing : dd if=/dev/zero of=/dev/sdd1 bs=1M count=20 oflag=direct,dsync >/dev/null 2>&1
19/05/2022 11:03:15 INFO Executing : wipefs --all /dev/sdd1
19/05/2022 11:03:11 INFO Start cleaning : sdd
I'm having issues adding OSD's on our 3rd node, getting the following error log below. I've tried a wipe command found on a similar post but not having any luck, any ideas?
19/05/2022 11:03:26 INFO Executing udevadm settle --timeout 30
19/05/2022 11:03:26 INFO Calling udevadm on sdd device
19/05/2022 11:03:26 INFO Executing partprobe /dev/sdd
19/05/2022 11:03:26 INFO Calling partprobe on sdd device
19/05/2022 11:03:25 INFO Starting sgdisk -t 1:103af3d7-a019-4e56-bfe0-4d664b989f40 /dev/sdd
19/05/2022 11:03:25 INFO Start setting partition type for sdd1
19/05/2022 11:03:25 INFO Mark journal partition sdd1 as available.
19/05/2022 11:03:25 ERROR Error executing : ceph-volume --log-path /opt/petasan/log lvm prepare --bluestore --data /dev/sdeNone --block.db /dev/sdd1
ceph-volume lvm prepare: error: Unable to proceed with non-existing device: /dev/sdeNone
[--journal-slots JOURNAL_SLOTS]
[--journal-size JOURNAL_SIZE]
[--filestore] [--journal JOURNAL]
[--block.wal-slots BLOCK_WAL_SLOTS]
[--block.wal-size BLOCK_WAL_SIZE]
[--block.wal BLOCK_WAL]
[--block.db-slots BLOCK_DB_SLOTS]
[--block.db-size BLOCK_DB_SIZE]
[--block.db BLOCK_DB]
[--dmcrypt] [--no-systemd] [--bluestore]
[--crush-device-class CRUSH_DEVICE_CLASS]
[--cluster-fsid CLUSTER_FSID]
[--osd-fsid OSD_FSID]
[--data-slots DATA_SLOTS] [--osd-id OSD_ID]
usage: ceph-volume lvm prepare [-h] --data DATA [--data-size DATA_SIZE]
stderr: Unknown device "/dev/sdeNone": No such file or directory
stderr: blkid: error: /dev/sdeNone: No such file or directory
19/05/2022 11:03:25 ERROR stderr: lsblk: /dev/sdeNone: not a block device
19/05/2022 11:03:25 INFO Starting : ceph-volume --log-path /opt/petasan/log lvm prepare --bluestore --data /dev/sdeNone --block.db /dev/sdd1
19/05/2022 11:03:22 INFO Executing udevadm settle --timeout 30
19/05/2022 11:03:22 INFO Calling udevadm on sdd device
19/05/2022 11:03:22 INFO Executing partprobe /dev/sdd
19/05/2022 11:03:22 INFO Calling partprobe on sdd device
19/05/2022 11:03:21 INFO Creating journal-db-2-e09794d9 partition num 1 size 61440MB on /dev/sdd
19/05/2022 11:03:20 INFO creating new journal partition.
19/05/2022 11:03:20 INFO osd.2 is removed from crush map
19/05/2022 11:03:18 INFO Start remove osd.2 from crush map
19/05/2022 11:03:18 INFO Creating data partition num 1 size 858483MB on /dev/sde
19/05/2022 11:03:18 INFO Start prepare bluestore OSD : sde
19/05/2022 11:03:18 INFO User didn't select a cache for disk sde.
19/05/2022 11:03:18 INFO User selected Auto journal, selected device is sdd disk for disk sde.
19/05/2022 11:03:15 INFO Executing : partprobe /dev/sdd
19/05/2022 11:03:15 INFO Executing : parted -s /dev/sdd mklabel gpt
19/05/2022 11:03:15 INFO Executing : dd if=/dev/zero of=/dev/sdd bs=1M count=20 oflag=direct,dsync >/dev/null 2>&1
19/05/2022 11:03:15 INFO Executing : wipefs --all /dev/sdd
19/05/2022 11:03:15 INFO Executing : dd if=/dev/zero of=/dev/sdd1 bs=1M count=20 oflag=direct,dsync >/dev/null 2>&1
19/05/2022 11:03:15 INFO Executing : wipefs --all /dev/sdd1
19/05/2022 11:03:11 INFO Start cleaning : sdd
nutt
12 Posts
May 19, 2022, 7:35 pmQuote from nutt on May 19, 2022, 7:35 pmso doing a lsblk -a lists all the disks, however running a fdisk -l only shows 2 of the 18 harddrives, any ideas?
so doing a lsblk -a lists all the disks, however running a fdisk -l only shows 2 of the 18 harddrives, any ideas?
Issues adding OSD on 3rd node
nutt
12 Posts
Quote from nutt on May 19, 2022, 4:06 pmI'm having issues adding OSD's on our 3rd node, getting the following error log below. I've tried a wipe command found on a similar post but not having any luck, any ideas?
19/05/2022 11:03:26 INFO Executing udevadm settle --timeout 30
19/05/2022 11:03:26 INFO Calling udevadm on sdd device
19/05/2022 11:03:26 INFO Executing partprobe /dev/sdd
19/05/2022 11:03:26 INFO Calling partprobe on sdd device
19/05/2022 11:03:25 INFO Starting sgdisk -t 1:103af3d7-a019-4e56-bfe0-4d664b989f40 /dev/sdd
19/05/2022 11:03:25 INFO Start setting partition type for sdd1
19/05/2022 11:03:25 INFO Mark journal partition sdd1 as available.
19/05/2022 11:03:25 ERROR Error executing : ceph-volume --log-path /opt/petasan/log lvm prepare --bluestore --data /dev/sdeNone --block.db /dev/sdd1
ceph-volume lvm prepare: error: Unable to proceed with non-existing device: /dev/sdeNone
[--journal-slots JOURNAL_SLOTS]
[--journal-size JOURNAL_SIZE]
[--filestore] [--journal JOURNAL]
[--block.wal-slots BLOCK_WAL_SLOTS]
[--block.wal-size BLOCK_WAL_SIZE]
[--block.wal BLOCK_WAL]
[--block.db-slots BLOCK_DB_SLOTS]
[--block.db-size BLOCK_DB_SIZE]
[--block.db BLOCK_DB]
[--dmcrypt] [--no-systemd] [--bluestore]
[--crush-device-class CRUSH_DEVICE_CLASS]
[--cluster-fsid CLUSTER_FSID]
[--osd-fsid OSD_FSID]
[--data-slots DATA_SLOTS] [--osd-id OSD_ID]
usage: ceph-volume lvm prepare [-h] --data DATA [--data-size DATA_SIZE]
stderr: Unknown device "/dev/sdeNone": No such file or directory
stderr: blkid: error: /dev/sdeNone: No such file or directory
19/05/2022 11:03:25 ERROR stderr: lsblk: /dev/sdeNone: not a block device
19/05/2022 11:03:25 INFO Starting : ceph-volume --log-path /opt/petasan/log lvm prepare --bluestore --data /dev/sdeNone --block.db /dev/sdd1
19/05/2022 11:03:22 INFO Executing udevadm settle --timeout 30
19/05/2022 11:03:22 INFO Calling udevadm on sdd device
19/05/2022 11:03:22 INFO Executing partprobe /dev/sdd
19/05/2022 11:03:22 INFO Calling partprobe on sdd device
19/05/2022 11:03:21 INFO Creating journal-db-2-e09794d9 partition num 1 size 61440MB on /dev/sdd
19/05/2022 11:03:20 INFO creating new journal partition.
19/05/2022 11:03:20 INFO osd.2 is removed from crush map
19/05/2022 11:03:18 INFO Start remove osd.2 from crush map
19/05/2022 11:03:18 INFO Creating data partition num 1 size 858483MB on /dev/sde
19/05/2022 11:03:18 INFO Start prepare bluestore OSD : sde
19/05/2022 11:03:18 INFO User didn't select a cache for disk sde.
19/05/2022 11:03:18 INFO User selected Auto journal, selected device is sdd disk for disk sde.
19/05/2022 11:03:15 INFO Executing : partprobe /dev/sdd
19/05/2022 11:03:15 INFO Executing : parted -s /dev/sdd mklabel gpt
19/05/2022 11:03:15 INFO Executing : dd if=/dev/zero of=/dev/sdd bs=1M count=20 oflag=direct,dsync >/dev/null 2>&1
19/05/2022 11:03:15 INFO Executing : wipefs --all /dev/sdd
19/05/2022 11:03:15 INFO Executing : dd if=/dev/zero of=/dev/sdd1 bs=1M count=20 oflag=direct,dsync >/dev/null 2>&1
19/05/2022 11:03:15 INFO Executing : wipefs --all /dev/sdd1
19/05/2022 11:03:11 INFO Start cleaning : sdd
I'm having issues adding OSD's on our 3rd node, getting the following error log below. I've tried a wipe command found on a similar post but not having any luck, any ideas?
19/05/2022 11:03:26 INFO Executing udevadm settle --timeout 30
19/05/2022 11:03:26 INFO Calling udevadm on sdd device
19/05/2022 11:03:26 INFO Executing partprobe /dev/sdd
19/05/2022 11:03:26 INFO Calling partprobe on sdd device
19/05/2022 11:03:25 INFO Starting sgdisk -t 1:103af3d7-a019-4e56-bfe0-4d664b989f40 /dev/sdd
19/05/2022 11:03:25 INFO Start setting partition type for sdd1
19/05/2022 11:03:25 INFO Mark journal partition sdd1 as available.
19/05/2022 11:03:25 ERROR Error executing : ceph-volume --log-path /opt/petasan/log lvm prepare --bluestore --data /dev/sdeNone --block.db /dev/sdd1
ceph-volume lvm prepare: error: Unable to proceed with non-existing device: /dev/sdeNone
[--journal-slots JOURNAL_SLOTS]
[--journal-size JOURNAL_SIZE]
[--filestore] [--journal JOURNAL]
[--block.wal-slots BLOCK_WAL_SLOTS]
[--block.wal-size BLOCK_WAL_SIZE]
[--block.wal BLOCK_WAL]
[--block.db-slots BLOCK_DB_SLOTS]
[--block.db-size BLOCK_DB_SIZE]
[--block.db BLOCK_DB]
[--dmcrypt] [--no-systemd] [--bluestore]
[--crush-device-class CRUSH_DEVICE_CLASS]
[--cluster-fsid CLUSTER_FSID]
[--osd-fsid OSD_FSID]
[--data-slots DATA_SLOTS] [--osd-id OSD_ID]
usage: ceph-volume lvm prepare [-h] --data DATA [--data-size DATA_SIZE]
stderr: Unknown device "/dev/sdeNone": No such file or directory
stderr: blkid: error: /dev/sdeNone: No such file or directory
19/05/2022 11:03:25 ERROR stderr: lsblk: /dev/sdeNone: not a block device
19/05/2022 11:03:25 INFO Starting : ceph-volume --log-path /opt/petasan/log lvm prepare --bluestore --data /dev/sdeNone --block.db /dev/sdd1
19/05/2022 11:03:22 INFO Executing udevadm settle --timeout 30
19/05/2022 11:03:22 INFO Calling udevadm on sdd device
19/05/2022 11:03:22 INFO Executing partprobe /dev/sdd
19/05/2022 11:03:22 INFO Calling partprobe on sdd device
19/05/2022 11:03:21 INFO Creating journal-db-2-e09794d9 partition num 1 size 61440MB on /dev/sdd
19/05/2022 11:03:20 INFO creating new journal partition.
19/05/2022 11:03:20 INFO osd.2 is removed from crush map
19/05/2022 11:03:18 INFO Start remove osd.2 from crush map
19/05/2022 11:03:18 INFO Creating data partition num 1 size 858483MB on /dev/sde
19/05/2022 11:03:18 INFO Start prepare bluestore OSD : sde
19/05/2022 11:03:18 INFO User didn't select a cache for disk sde.
19/05/2022 11:03:18 INFO User selected Auto journal, selected device is sdd disk for disk sde.
19/05/2022 11:03:15 INFO Executing : partprobe /dev/sdd
19/05/2022 11:03:15 INFO Executing : parted -s /dev/sdd mklabel gpt
19/05/2022 11:03:15 INFO Executing : dd if=/dev/zero of=/dev/sdd bs=1M count=20 oflag=direct,dsync >/dev/null 2>&1
19/05/2022 11:03:15 INFO Executing : wipefs --all /dev/sdd
19/05/2022 11:03:15 INFO Executing : dd if=/dev/zero of=/dev/sdd1 bs=1M count=20 oflag=direct,dsync >/dev/null 2>&1
19/05/2022 11:03:15 INFO Executing : wipefs --all /dev/sdd1
19/05/2022 11:03:11 INFO Start cleaning : sdd
nutt
12 Posts
Quote from nutt on May 19, 2022, 7:35 pmso doing a lsblk -a lists all the disks, however running a fdisk -l only shows 2 of the 18 harddrives, any ideas?
so doing a lsblk -a lists all the disks, however running a fdisk -l only shows 2 of the 18 harddrives, any ideas?