Forums

Home / Forums

You need to log in to create posts and topics. Login · Register

deleting large iscsi disks stuck as DETACHED

Hello:

We deleted 2x iSCSI disks that were part of a POOL. The disks where 64TB each.

We noticed that both disks used space was made available to cluster however, the iscsi disks appear as DETACHED in the GUI.

Petasan.log shows as following.... when trying to delete.

I would like to note that we are one Petasan 2.8.1 and are in the plans to migrate to 3.3.0 but have a few open items as this is a production cluster.

07/07/2024 20:46:51 ERROR Get ceph image size image-00033 error
07/07/2024 20:46:51 ERROR [errno 2] RBD image not found (error opening image b'image-00033' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 1050, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00033' at snapshot None)
07/07/2024 20:46:51 ERROR Get ceph image size image-00032 error
07/07/2024 20:46:51 ERROR [errno 2] RBD image not found (error opening image b'image-00032' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 1050, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00032' at snapshot None)
07/07/2024 20:46:58 ERROR Get ceph image size image-00033 error
07/07/2024 20:46:58 ERROR [errno 2] RBD image not found (error opening image b'image-00033' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 1050, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00033' at snapshot None)
07/07/2024 20:46:58 ERROR Get ceph image size image-00032 error
07/07/2024 20:46:58 ERROR [errno 2] RBD image not found (error opening image b'image-00032' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 1050, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00032' at snapshot None)
07/07/2024 20:46:58 INFO script
07/07/2024 20:46:58 INFO /opt/petasan/scripts/util/delete_iscsi_disk.py
07/07/2024 20:46:58 INFO params
07/07/2024 20:46:58 INFO image-00033 pool-hdd
07/07/2024 20:46:58 INFO Deleting disk: image-00033 has been started as a job
07/07/2024 20:46:58 ERROR General error in Ceph cmd : rbd snap ls pool-hdd/image-00033 --cluster ceph
07/07/2024 20:46:58 ERROR Getting snapshots of image: image-00033
07/07/2024 20:46:58 ERROR Error in getting header object = rbd: error opening image image-00033: (2) No such file or directory

07/07/2024 20:46:58 ERROR Cannot get image meta object from rbd header.
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 842, in __get_header_object
raise MetadataException("Cannot get image meta object from rbd header.")
PetaSAN.core.common.CustomException.MetadataException: Cannot get image meta object from rbd header.
07/07/2024 20:47:01 ERROR Get ceph image size image-00033 error
07/07/2024 20:47:01 ERROR [errno 2] RBD image not found (error opening image b'image-00033' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 1050, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00033' at snapshot None)
07/07/2024 20:47:01 ERROR Get ceph image size image-00032 error
07/07/2024 20:47:01 ERROR [errno 2] RBD image not found (error opening image b'image-00032' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 1050, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00032' at snapshot None)
07/07/2024 20:47:14 ERROR Get ceph image size image-00033 error
07/07/2024 20:47:14 ERROR [errno 2] RBD image not found (error opening image b'image-00033' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 1050, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00033' at snapshot None)
07/07/2024 20:47:15 ERROR Get ceph image size image-00032 error
07/07/2024 20:47:15 ERROR [errno 2] RBD image not found (error opening image b'image-00032' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 1050, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00032' at snapshot None)
^C

 

 

 

 

It is probably due to a previous delete attempt failed. The rbd image is in a half deleted state,some rbd commands can run some give an error.

You can use cli command to delete the rbd.

We did fix delete issues with half deleted images in recent releases. Earlier we had some checking code to retrieve connected rbd clients/watchers before delete attempt, this check would give an error exception for half deleted images.