Forums

Home / Forums

You need to log in to create posts and topics. Login · Register

iscsi disks random stop start and iscsi paths jumping after trying to delete large 100TB iscsi disk


ghbiz
76 Posts
December 23, 2023, 12:52 am
  1. was on petasan 2.8.1 upgrading now to 3.0.0 and then 3.2.2 latest.
  2. tried to delete a iscsi disk with image id 00009
  3. image-00009 now shows detached and gui does NOT allow me to delete with error "Method Not Allowed"
  4. trying to ATTACH disk gives warning "This disk has not been created by PetaSAN. The Ceph rbd image will be renamed to match the PetaSAN naming standard."
  5. iscsi paths appear to be jumping from node to node randomly.
  6. iscsi disks appear to be stopping and starting at random.

 

tail -f PetaSAN.log
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:45:17 ERROR Get ceph image size image-00009 error
22/12/2023 19:45:17 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:45:19 INFO Ignore forced path 00010/3
22/12/2023 19:45:26 ERROR Get ceph image size image-00009 error
22/12/2023 19:45:26 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:45:26 ERROR Get ceph image size image-00009 error
22/12/2023 19:45:26 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:45:28 INFO Ignore forced path 00010/4
22/12/2023 19:45:34 ERROR Get ceph image size image-00009 error
22/12/2023 19:45:34 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:45:34 ERROR Get ceph image size image-00009 error
22/12/2023 19:45:34 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:45:36 INFO Ignore forced path 00010/3
22/12/2023 19:45:37 INFO GlusterFS mount attempt
22/12/2023 19:45:42 ERROR Get ceph image size image-00009 error
22/12/2023 19:45:42 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:45:42 ERROR Get ceph image size image-00009 error
22/12/2023 19:45:42 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:45:44 INFO Ignore forced path 00004/2
22/12/2023 19:45:49 ERROR Get ceph image size image-00009 error
22/12/2023 19:45:49 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:45:49 ERROR Get ceph image size image-00009 error
22/12/2023 19:45:49 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:45:51 INFO Found pool:pool1-hdd for disk:00008 via consul
22/12/2023 19:45:52 INFO Could not lock path 00008/2 with session d5850a91-527a-13e7-e16b-3dfafd7a3df

 

#1

ghbiz
76 Posts
December 23, 2023, 1:03 am

I am starting to think this issue is also related to adding ceph tier caching as it seems to give the same iscsi disk id for the hot and normal pools...

 

tail -f PetaSAN.log
22/12/2023 19:57:41 ERROR Device /dev/rbd/pool1-hdd/image-00004 is not a TYPE_DISK rbd device
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/lio/api.py", line 79, in add_target
storage_obj = RBDStorageObject(ConfigAPI().get_image_name_prefix() + disk_meta.id, rbd_mapped_path,wwn)
File "/usr/lib/python3/dist-packages/rtslib_fb/tcm.py", line 840, in __init__
self._configure(dev, wwn, readonly)
File "/usr/lib/python3/dist-packages/rtslib_fb/tcm.py", line 850, in _configure
raise RTSLibError("Device %s is not a TYPE_DISK rbd device" % dev)
rtslib_fb.utils.RTSLibError: Device /dev/rbd/pool1-hdd/image-00004 is not a TYPE_DISK rbd device
22/12/2023 19:57:41 ERROR Error could not acquire path 00004/3
22/12/2023 19:57:47 ERROR Get ceph image size image-00009 error
22/12/2023 19:57:47 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:57:47 ERROR Get ceph image size image-00009 error
22/12/2023 19:57:47 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:57:47 INFO Unlock path 00004/3
22/12/2023 19:57:47 INFO PetaSAN unlocked any consul locks not configured in this node.
22/12/2023 19:57:51 ERROR Get ceph image size image-00009 error
22/12/2023 19:57:51 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:57:51 ERROR Get ceph image size image-00009 error
22/12/2023 19:57:51 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:57:51 INFO Call "get assignments stats" function.
22/12/2023 19:57:52 ERROR Get ceph image size image-00009 error
22/12/2023 19:57:52 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:57:53 ERROR Get ceph image size image-00009 error
22/12/2023 19:57:53 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:57:53 INFO Image image-00004 unmapped successfully.
22/12/2023 19:57:53 INFO Found pool:pool1-hdd-hot for disk:00004 via consul
22/12/2023 19:57:53 INFO Image image-00004 mapped successfully.
22/12/2023 19:57:56 INFO LIO add_target() disk wwn is 00004
22/12/2023 19:57:56 ERROR LIO error could not create target for disk 00004.
22/12/2023 19:57:56 ERROR Device /dev/rbd/pool1-hdd/image-00004 is not a TYPE_DISK rbd device
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/lio/api.py", line 79, in add_target
storage_obj = RBDStorageObject(ConfigAPI().get_image_name_prefix() + disk_meta.id, rbd_mapped_path,wwn)
File "/usr/lib/python3/dist-packages/rtslib_fb/tcm.py", line 840, in __init__
self._configure(dev, wwn, readonly)
File "/usr/lib/python3/dist-packages/rtslib_fb/tcm.py", line 850, in _configure
raise RTSLibError("Device %s is not a TYPE_DISK rbd device" % dev)
rtslib_fb.utils.RTSLibError: Device /dev/rbd/pool1-hdd/image-00004 is not a TYPE_DISK rbd device
22/12/2023 19:57:56 ERROR Error could not acquire path 00004/1
22/12/2023 19:58:01 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:01 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:01 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:01 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:01 INFO Call "get assignments stats" function.
22/12/2023 19:58:02 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:02 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:02 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:02 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:02 INFO Unlock path 00004/1
22/12/2023 19:58:02 INFO PetaSAN unlocked any consul locks not configured in this node.
22/12/2023 19:58:07 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:07 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:07 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:07 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:07 INFO Image image-00004 unmapped successfully.
22/12/2023 19:58:07 INFO Found pool:pool1-hdd-hot for disk:00010 via consul
22/12/2023 19:58:08 INFO Image image-00010 mapped successfully.
22/12/2023 19:58:10 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:10 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:10 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:10 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:11 INFO Call "get assignments stats" function.
22/12/2023 19:58:11 INFO LIO add_target() disk wwn is 00010
22/12/2023 19:58:11 ERROR LIO error could not create target for disk 00010.
22/12/2023 19:58:11 ERROR Device /dev/rbd/pool1-hdd/image-00010 is not a TYPE_DISK rbd device
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/lio/api.py", line 79, in add_target
storage_obj = RBDStorageObject(ConfigAPI().get_image_name_prefix() + disk_meta.id, rbd_mapped_path,wwn)
File "/usr/lib/python3/dist-packages/rtslib_fb/tcm.py", line 840, in __init__
self._configure(dev, wwn, readonly)
File "/usr/lib/python3/dist-packages/rtslib_fb/tcm.py", line 850, in _configure
raise RTSLibError("Device %s is not a TYPE_DISK rbd device" % dev)
rtslib_fb.utils.RTSLibError: Device /dev/rbd/pool1-hdd/image-00010 is not a TYPE_DISK rbd device
22/12/2023 19:58:11 ERROR Error could not acquire path 00010/3
22/12/2023 19:58:16 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:16 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:16 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:16 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:16 INFO Unlock path 00010/3
22/12/2023 19:58:16 INFO PetaSAN unlocked any consul locks not configured in this node.
22/12/2023 19:58:22 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:22 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:22 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:22 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:23 INFO Call "get assignments stats" function.
22/12/2023 19:58:23 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:23 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:23 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:23 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:24 INFO Image image-00010 unmapped successfully.
22/12/2023 19:58:24 INFO Found pool:pool1-hdd-hot for disk:00004 via consul
22/12/2023 19:58:24 INFO Image image-00004 mapped successfully.
22/12/2023 19:58:27 INFO LIO add_target() disk wwn is 00004
22/12/2023 19:58:27 ERROR LIO error could not create target for disk 00004.
22/12/2023 19:58:27 ERROR Device /dev/rbd/pool1-hdd/image-00004 is not a TYPE_DISK rbd device
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/lio/api.py", line 79, in add_target
storage_obj = RBDStorageObject(ConfigAPI().get_image_name_prefix() + disk_meta.id, rbd_mapped_path,wwn)
File "/usr/lib/python3/dist-packages/rtslib_fb/tcm.py", line 840, in __init__
self._configure(dev, wwn, readonly)
File "/usr/lib/python3/dist-packages/rtslib_fb/tcm.py", line 850, in _configure
raise RTSLibError("Device %s is not a TYPE_DISK rbd device" % dev)
rtslib_fb.utils.RTSLibError: Device /dev/rbd/pool1-hdd/image-00004 is not a TYPE_DISK rbd device
22/12/2023 19:58:27 ERROR Error could not acquire path 00004/2
22/12/2023 19:58:30 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:30 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:30 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:31 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:31 INFO Call "get assignments stats" function.
22/12/2023 19:58:33 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:33 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:33 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:33 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:33 INFO Unlock path 00004/2
22/12/2023 19:58:33 INFO PetaSAN unlocked any consul locks not configured in this node.
22/12/2023 19:58:38 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:38 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:38 ERROR Get ceph image size image-00009 error
22/12/2023 19:58:38 ERROR [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/PetaSAN/core/ceph/api.py", line 998, in __get_image_size
size = int(math.ceil(float(rbd.Image(ioctx, image).size()) / float(1024 ** 3)))
File "rbd.pyx", line 3487, in rbd.Image.__init__
rbd.ImageNotFound: [errno 2] RBD image not found (error opening image b'image-00009' at snapshot None)
22/12/2023 19:58:39 INFO Image image-00004 unmapped successfully.
22/12/2023 19:58:39 INFO Found pool:pool1-hdd-hot for disk:00004 via consul

#2

admin
2,930 Posts
December 23, 2023, 10:27 am

We do not support cache tiering in PetaSAN. It has been deprecated by Red Hat many years ago.

https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/2.0/html/release_notes/deprecated_functionality

 

#3

ghbiz
76 Posts
December 23, 2023, 9:20 pm

yah, we tested the cache tiering but as you said, lack of development.

The issue was caused by a large image that would not delete. Eventually, it got in a stuck state and we manually had to recreate it and then delete it again through the GUI.

 

#4