Unable to select drives during installation
khopkins
96 Posts
May 18, 2018, 9:16 pmQuote from khopkins on May 18, 2018, 9:16 pmDuring the installation, I was able to select the system disk, but after the reboot and going through the setup (step 7) where you select the 3 boxes "management services, local storage and Iscsi service" there are no disk present, just blank. A note was under the screen shot saying that you can skip adding disks now and do it later after building the cluster..... Well all 3 servers were reloaded and all 3 were talking to each other. Got into the management web on port 5000 and it all looked good. On the dashboard, there were all "0" for the Osd clusters. Tried to add a Iscsi disk and it just looks at me. there is nothing in the disk list. Can go into the "Node list", all 3 servers are there and if you click on "edit", it shows the disks are there, and up state. Physical disk show its there but no status, journal . What did I miss?
During the installation, I was able to select the system disk, but after the reboot and going through the setup (step 7) where you select the 3 boxes "management services, local storage and Iscsi service" there are no disk present, just blank. A note was under the screen shot saying that you can skip adding disks now and do it later after building the cluster..... Well all 3 servers were reloaded and all 3 were talking to each other. Got into the management web on port 5000 and it all looked good. On the dashboard, there were all "0" for the Osd clusters. Tried to add a Iscsi disk and it just looks at me. there is nothing in the disk list. Can go into the "Node list", all 3 servers are there and if you click on "edit", it shows the disks are there, and up state. Physical disk show its there but no status, journal . What did I miss?
admin
2,930 Posts
May 18, 2018, 9:49 pmQuote from admin on May 18, 2018, 9:49 pmin the Node List -> Physical Disks do you see your disks ? do you see a + button to add OSD and +j to add journal ?
in the Node List -> Physical Disks do you see your disks ? do you see a + button to add OSD and +j to add journal ?
khopkins
96 Posts
May 21, 2018, 1:02 pmQuote from khopkins on May 21, 2018, 1:02 pmIn the Node List- it lists the Name, Type, Management IP, Status and Action, all 3 disks are reporting as a 3.64TB size. Under Action, Physical Disk List, View Log and Node Role Setting. Under Physical Disk List its has the disk parameters listed, Used as System but no Status, Journal or Action. Under Roles, management, Local Storage Service and ISCSI Target Service are check (unable to change settings). Under Physical Disks, do not see any (+) button. Using Chrome and IE 11. Thanks
In the Node List- it lists the Name, Type, Management IP, Status and Action, all 3 disks are reporting as a 3.64TB size. Under Action, Physical Disk List, View Log and Node Role Setting. Under Physical Disk List its has the disk parameters listed, Used as System but no Status, Journal or Action. Under Roles, management, Local Storage Service and ISCSI Target Service are check (unable to change settings). Under Physical Disks, do not see any (+) button. Using Chrome and IE 11. Thanks
admin
2,930 Posts
May 21, 2018, 1:36 pmQuote from admin on May 21, 2018, 1:36 pmAre all disks are showing as "System" in their usage ?
Can you show the output of
ceph-disk list
Are all disks are showing as "System" in their usage ?
Can you show the output of
ceph-disk list
khopkins
96 Posts
May 21, 2018, 2:34 pmQuote from khopkins on May 21, 2018, 2:34 pmyes, all disk are showing usage as "system".
root@PS-NODE-1:~# root@PS-NODE-1:~# ceph-disk list
/dev/sda :
/dev/sda1 other, ext4, mounted on /boot
/dev/sda2 other, ext4, mounted on /
/dev/sda3 other, ext4, mounted on /var/lib/ceph
/dev/sda4 other, ext4, mounted on /opt/petasan/config
/dev/sr0 other, unknown
yes, all disk are showing usage as "system".
root@PS-NODE-1:~# root@PS-NODE-1:~# ceph-disk list
/dev/sda :
/dev/sda1 other, ext4, mounted on /boot
/dev/sda2 other, ext4, mounted on /
/dev/sda3 other, ext4, mounted on /var/lib/ceph
/dev/sda4 other, ext4, mounted on /opt/petasan/config
/dev/sr0 other, unknown
admin
2,930 Posts
May 21, 2018, 2:57 pmQuote from admin on May 21, 2018, 2:57 pmI had understood you have 3 disks in each node, but maybe you meant 3 disks in total which seems to be the output of ceph-disk.
In PetaSAN or most storage systems, the system/os disk is not used for storage, this is for performance reasons since you want storage disks to be dedicated for that purpose. So you need more 1 disks per node so you can have storage disks.
I had understood you have 3 disks in each node, but maybe you meant 3 disks in total which seems to be the output of ceph-disk.
In PetaSAN or most storage systems, the system/os disk is not used for storage, this is for performance reasons since you want storage disks to be dedicated for that purpose. So you need more 1 disks per node so you can have storage disks.
khopkins
96 Posts
May 21, 2018, 3:02 pmQuote from khopkins on May 21, 2018, 3:02 pmOk, misunderstood. I'll split the RAID up on the Nodes so two disk will be seen on each node. Thanks for the help
Ok, misunderstood. I'll split the RAID up on the Nodes so two disk will be seen on each node. Thanks for the help
admin
2,930 Posts
May 21, 2018, 3:15 pmQuote from admin on May 21, 2018, 3:15 pmCool, one thing to note in PetaSAN/Ceph : do not use RAID, Ceph does its own redundancy/self healing and prefers to have direct access to disks.
Cool, one thing to note in PetaSAN/Ceph : do not use RAID, Ceph does its own redundancy/self healing and prefers to have direct access to disks.
Unable to select drives during installation
khopkins
96 Posts
Quote from khopkins on May 18, 2018, 9:16 pmDuring the installation, I was able to select the system disk, but after the reboot and going through the setup (step 7) where you select the 3 boxes "management services, local storage and Iscsi service" there are no disk present, just blank. A note was under the screen shot saying that you can skip adding disks now and do it later after building the cluster..... Well all 3 servers were reloaded and all 3 were talking to each other. Got into the management web on port 5000 and it all looked good. On the dashboard, there were all "0" for the Osd clusters. Tried to add a Iscsi disk and it just looks at me. there is nothing in the disk list. Can go into the "Node list", all 3 servers are there and if you click on "edit", it shows the disks are there, and up state. Physical disk show its there but no status, journal . What did I miss?
During the installation, I was able to select the system disk, but after the reboot and going through the setup (step 7) where you select the 3 boxes "management services, local storage and Iscsi service" there are no disk present, just blank. A note was under the screen shot saying that you can skip adding disks now and do it later after building the cluster..... Well all 3 servers were reloaded and all 3 were talking to each other. Got into the management web on port 5000 and it all looked good. On the dashboard, there were all "0" for the Osd clusters. Tried to add a Iscsi disk and it just looks at me. there is nothing in the disk list. Can go into the "Node list", all 3 servers are there and if you click on "edit", it shows the disks are there, and up state. Physical disk show its there but no status, journal . What did I miss?
admin
2,930 Posts
Quote from admin on May 18, 2018, 9:49 pmin the Node List -> Physical Disks do you see your disks ? do you see a + button to add OSD and +j to add journal ?
in the Node List -> Physical Disks do you see your disks ? do you see a + button to add OSD and +j to add journal ?
khopkins
96 Posts
Quote from khopkins on May 21, 2018, 1:02 pmIn the Node List- it lists the Name, Type, Management IP, Status and Action, all 3 disks are reporting as a 3.64TB size. Under Action, Physical Disk List, View Log and Node Role Setting. Under Physical Disk List its has the disk parameters listed, Used as System but no Status, Journal or Action. Under Roles, management, Local Storage Service and ISCSI Target Service are check (unable to change settings). Under Physical Disks, do not see any (+) button. Using Chrome and IE 11. Thanks
In the Node List- it lists the Name, Type, Management IP, Status and Action, all 3 disks are reporting as a 3.64TB size. Under Action, Physical Disk List, View Log and Node Role Setting. Under Physical Disk List its has the disk parameters listed, Used as System but no Status, Journal or Action. Under Roles, management, Local Storage Service and ISCSI Target Service are check (unable to change settings). Under Physical Disks, do not see any (+) button. Using Chrome and IE 11. Thanks
admin
2,930 Posts
Quote from admin on May 21, 2018, 1:36 pmAre all disks are showing as "System" in their usage ?
Can you show the output of
ceph-disk list
Are all disks are showing as "System" in their usage ?
Can you show the output of
ceph-disk list
khopkins
96 Posts
Quote from khopkins on May 21, 2018, 2:34 pmyes, all disk are showing usage as "system".
root@PS-NODE-1:~# root@PS-NODE-1:~# ceph-disk list
/dev/sda :
/dev/sda1 other, ext4, mounted on /boot
/dev/sda2 other, ext4, mounted on /
/dev/sda3 other, ext4, mounted on /var/lib/ceph
/dev/sda4 other, ext4, mounted on /opt/petasan/config
/dev/sr0 other, unknown
yes, all disk are showing usage as "system".
root@PS-NODE-1:~# root@PS-NODE-1:~# ceph-disk list
/dev/sda :
/dev/sda1 other, ext4, mounted on /boot
/dev/sda2 other, ext4, mounted on /
/dev/sda3 other, ext4, mounted on /var/lib/ceph
/dev/sda4 other, ext4, mounted on /opt/petasan/config
/dev/sr0 other, unknown
admin
2,930 Posts
Quote from admin on May 21, 2018, 2:57 pmI had understood you have 3 disks in each node, but maybe you meant 3 disks in total which seems to be the output of ceph-disk.
In PetaSAN or most storage systems, the system/os disk is not used for storage, this is for performance reasons since you want storage disks to be dedicated for that purpose. So you need more 1 disks per node so you can have storage disks.
I had understood you have 3 disks in each node, but maybe you meant 3 disks in total which seems to be the output of ceph-disk.
In PetaSAN or most storage systems, the system/os disk is not used for storage, this is for performance reasons since you want storage disks to be dedicated for that purpose. So you need more 1 disks per node so you can have storage disks.
khopkins
96 Posts
Quote from khopkins on May 21, 2018, 3:02 pmOk, misunderstood. I'll split the RAID up on the Nodes so two disk will be seen on each node. Thanks for the help
Ok, misunderstood. I'll split the RAID up on the Nodes so two disk will be seen on each node. Thanks for the help
admin
2,930 Posts
Quote from admin on May 21, 2018, 3:15 pmCool, one thing to note in PetaSAN/Ceph : do not use RAID, Ceph does its own redundancy/self healing and prefers to have direct access to disks.
Cool, one thing to note in PetaSAN/Ceph : do not use RAID, Ceph does its own redundancy/self healing and prefers to have direct access to disks.