ISCSI Disk Stop when reboot ISCSI Server
zamasaki158
13 Posts
July 3, 2020, 3:28 amQuote from zamasaki158 on July 3, 2020, 3:28 amHi admin,
I have a cluster with 3 nodes running version 2.5.3, all enable iSCSI Target Service. When I reboot one node, all ISCSI Disks was stopped. I have to start disks again. I tried reboot the node one by one but same error.
The log:
03/07/2020 09:51:24 INFO Start settings IPs
03/07/2020 09:51:27 INFO str_start_command: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> consul agent -raft-protocol 2 -config-dir /opt/petasan/config/etc/consul.d/server -bind 10.3.54.21 -retry-join 10.3.54.22 -retry-join 10.3.54.23
03/07/2020 09:51:27 INFO GlusterFS mount attempt
03/07/2020 09:51:29 INFO Starting cluster file sync service
03/07/2020 09:51:29 INFO Starting iSCSI Service
03/07/2020 09:51:29 INFO Starting Cluster Management application
03/07/2020 09:51:29 INFO Starting Node Stats Service
03/07/2020 09:51:29 INFO Starting activating PetaSAN lvs
03/07/2020 09:51:29 INFO Running command: /sbin/vgs --noheadings --readonly --units=g --separator=";" -o vg_name,pv_count,lv_count,snap_count,vg_attr,vg_size,vg_free,vg_free_count
03/07/2020 09:51:29 INFO stdout ceph-1adde35e-0b4c-4839-8ade-32b2add53f85";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-79508a67-08d9-48ef-a80b-7e0a90d33ac6";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-9545c1ea-bbf7-455e-a5b4-4558415210f8";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-b8d119c9-cc58-4d45-87ba-b4e213a73a2c";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-d714f0d2-ec4a-4bef-86d2-ae32dac42055";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e3fff4fa-023d-4d18-97b5-ef5e7f8d9f72";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e91b5a79-9516-4bac-925e-fec5a907b35a";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO LeaderElectionBase dropping old sessions
03/07/2020 09:51:29 INFO Starting activating PetaSAN lvs
03/07/2020 09:51:29 INFO Running command: /sbin/vgs --noheadings --readonly --units=g --separator=";" -o vg_name,pv_count,lv_count,snap_count,vg_attr,vg_size,vg_free,vg_free_count
03/07/2020 09:51:29 INFO stdout ceph-1adde35e-0b4c-4839-8ade-32b2add53f85";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-79508a67-08d9-48ef-a80b-7e0a90d33ac6";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-9545c1ea-bbf7-455e-a5b4-4558415210f8";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-b8d119c9-cc58-4d45-87ba-b4e213a73a2c";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-d714f0d2-ec4a-4bef-86d2-ae32dac42055";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e3fff4fa-023d-4d18-97b5-ef5e7f8d9f72";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e91b5a79-9516-4bac-925e-fec5a907b35a";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:31 INFO Starting OSDs
03/07/2020 09:51:31 INFO Starting petasan tuning service
03/07/2020 09:51:31 INFO Starting Config Upload service
03/07/2020 09:51:36 INFO Cluster is just starting, system will delete all active disk resources
03/07/2020 09:52:01 INFO GlusterFS mount attempt
03/07/2020 09:52:14 INFO Service is starting.
03/07/2020 09:52:15 INFO LeaderElectionBase successfully dropped old sessions
03/07/2020 09:52:32 INFO GlusterFS mount attempt
03/07/2020 09:52:50 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:52:57 INFO Image image-00004 mapped successfully.
03/07/2020 09:53:00 INFO LIO add_target() disk wwn is 55c7bcf400004
03/07/2020 09:53:01 INFO Path 00004/1 acquired successfully
03/07/2020 09:53:10 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:53:11 INFO Could not lock path 00004/3 with session e785e43f-aaa9-54ed-e6bb-deffd84e9eee.
03/07/2020 09:54:01 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:54:02 INFO Path 00004/3 acquired successfully
03/07/2020 09:54:02 INFO Updating path 10.3.55.22 status to 2
03/07/2020 09:54:02 INFO Path 10.3.55.22 status updated to 2
03/07/2020 09:58:58 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:58:58 INFO Could not lock path 00004/2 with session e785e43f-aaa9-54ed-e6bb-deffd84e9eee.
03/07/2020 09:59:13 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:59:13 INFO The path 00004/4 was locked by dellr620-02-c15.
03/07/2020 09:59:17 INFO Path 00004/4 acquired successfully
03/07/2020 10:03:39 INFO Cleaned disk path 00004/4.
03/07/2020 10:03:39 INFO Cleaned disk path 00004/3.
03/07/2020 10:03:39 INFO Cleaned disk path 00004/1.
03/07/2020 10:03:39 INFO PetaSAN cleaned local paths not locked by this node in consul.
03/07/2020 10:03:39 INFO LIO deleted backstore image image-00004
03/07/2020 10:03:40 INFO LIO deleted Target iqn.2016-05.com.petasan:00004
03/07/2020 10:03:40 INFO Image image-00004 unmapped successfully.
03/07/2020 10:03:40 INFO PetaSAN cleaned iqns.
03/07/2020 10:06:40 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 10:06:41 INFO Image image-00004 mapped successfully.
03/07/2020 10:06:44 INFO LIO add_target() disk wwn is 55c7bcf400004
03/07/2020 10:06:44 INFO Path 00004/3 acquired successfully
03/07/2020 10:06:54 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
Hi admin,
I have a cluster with 3 nodes running version 2.5.3, all enable iSCSI Target Service. When I reboot one node, all ISCSI Disks was stopped. I have to start disks again. I tried reboot the node one by one but same error.
The log:
03/07/2020 09:51:24 INFO Start settings IPs
03/07/2020 09:51:27 INFO str_start_command: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> consul agent -raft-protocol 2 -config-dir /opt/petasan/config/etc/consul.d/server -bind 10.3.54.21 -retry-join 10.3.54.22 -retry-join 10.3.54.23
03/07/2020 09:51:27 INFO GlusterFS mount attempt
03/07/2020 09:51:29 INFO Starting cluster file sync service
03/07/2020 09:51:29 INFO Starting iSCSI Service
03/07/2020 09:51:29 INFO Starting Cluster Management application
03/07/2020 09:51:29 INFO Starting Node Stats Service
03/07/2020 09:51:29 INFO Starting activating PetaSAN lvs
03/07/2020 09:51:29 INFO Running command: /sbin/vgs --noheadings --readonly --units=g --separator=";" -o vg_name,pv_count,lv_count,snap_count,vg_attr,vg_size,vg_free,vg_free_count
03/07/2020 09:51:29 INFO stdout ceph-1adde35e-0b4c-4839-8ade-32b2add53f85";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-79508a67-08d9-48ef-a80b-7e0a90d33ac6";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-9545c1ea-bbf7-455e-a5b4-4558415210f8";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-b8d119c9-cc58-4d45-87ba-b4e213a73a2c";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-d714f0d2-ec4a-4bef-86d2-ae32dac42055";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e3fff4fa-023d-4d18-97b5-ef5e7f8d9f72";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e91b5a79-9516-4bac-925e-fec5a907b35a";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO LeaderElectionBase dropping old sessions
03/07/2020 09:51:29 INFO Starting activating PetaSAN lvs
03/07/2020 09:51:29 INFO Running command: /sbin/vgs --noheadings --readonly --units=g --separator=";" -o vg_name,pv_count,lv_count,snap_count,vg_attr,vg_size,vg_free,vg_free_count
03/07/2020 09:51:29 INFO stdout ceph-1adde35e-0b4c-4839-8ade-32b2add53f85";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-79508a67-08d9-48ef-a80b-7e0a90d33ac6";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-9545c1ea-bbf7-455e-a5b4-4558415210f8";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-b8d119c9-cc58-4d45-87ba-b4e213a73a2c";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-d714f0d2-ec4a-4bef-86d2-ae32dac42055";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e3fff4fa-023d-4d18-97b5-ef5e7f8d9f72";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e91b5a79-9516-4bac-925e-fec5a907b35a";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:31 INFO Starting OSDs
03/07/2020 09:51:31 INFO Starting petasan tuning service
03/07/2020 09:51:31 INFO Starting Config Upload service
03/07/2020 09:51:36 INFO Cluster is just starting, system will delete all active disk resources
03/07/2020 09:52:01 INFO GlusterFS mount attempt
03/07/2020 09:52:14 INFO Service is starting.
03/07/2020 09:52:15 INFO LeaderElectionBase successfully dropped old sessions
03/07/2020 09:52:32 INFO GlusterFS mount attempt
03/07/2020 09:52:50 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:52:57 INFO Image image-00004 mapped successfully.
03/07/2020 09:53:00 INFO LIO add_target() disk wwn is 55c7bcf400004
03/07/2020 09:53:01 INFO Path 00004/1 acquired successfully
03/07/2020 09:53:10 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:53:11 INFO Could not lock path 00004/3 with session e785e43f-aaa9-54ed-e6bb-deffd84e9eee.
03/07/2020 09:54:01 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:54:02 INFO Path 00004/3 acquired successfully
03/07/2020 09:54:02 INFO Updating path 10.3.55.22 status to 2
03/07/2020 09:54:02 INFO Path 10.3.55.22 status updated to 2
03/07/2020 09:58:58 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:58:58 INFO Could not lock path 00004/2 with session e785e43f-aaa9-54ed-e6bb-deffd84e9eee.
03/07/2020 09:59:13 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:59:13 INFO The path 00004/4 was locked by dellr620-02-c15.
03/07/2020 09:59:17 INFO Path 00004/4 acquired successfully
03/07/2020 10:03:39 INFO Cleaned disk path 00004/4.
03/07/2020 10:03:39 INFO Cleaned disk path 00004/3.
03/07/2020 10:03:39 INFO Cleaned disk path 00004/1.
03/07/2020 10:03:39 INFO PetaSAN cleaned local paths not locked by this node in consul.
03/07/2020 10:03:39 INFO LIO deleted backstore image image-00004
03/07/2020 10:03:40 INFO LIO deleted Target iqn.2016-05.com.petasan:00004
03/07/2020 10:03:40 INFO Image image-00004 unmapped successfully.
03/07/2020 10:03:40 INFO PetaSAN cleaned iqns.
03/07/2020 10:06:40 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 10:06:41 INFO Image image-00004 mapped successfully.
03/07/2020 10:06:44 INFO LIO add_target() disk wwn is 55c7bcf400004
03/07/2020 10:06:44 INFO Path 00004/3 acquired successfully
03/07/2020 10:06:54 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
ISCSI Disk Stop when reboot ISCSI Server
zamasaki158
13 Posts
Quote from zamasaki158 on July 3, 2020, 3:28 amHi admin,
I have a cluster with 3 nodes running version 2.5.3, all enable iSCSI Target Service. When I reboot one node, all ISCSI Disks was stopped. I have to start disks again. I tried reboot the node one by one but same error.
The log:
03/07/2020 09:51:24 INFO Start settings IPs
03/07/2020 09:51:27 INFO str_start_command: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> consul agent -raft-protocol 2 -config-dir /opt/petasan/config/etc/consul.d/server -bind 10.3.54.21 -retry-join 10.3.54.22 -retry-join 10.3.54.23
03/07/2020 09:51:27 INFO GlusterFS mount attempt
03/07/2020 09:51:29 INFO Starting cluster file sync service
03/07/2020 09:51:29 INFO Starting iSCSI Service
03/07/2020 09:51:29 INFO Starting Cluster Management application
03/07/2020 09:51:29 INFO Starting Node Stats Service
03/07/2020 09:51:29 INFO Starting activating PetaSAN lvs
03/07/2020 09:51:29 INFO Running command: /sbin/vgs --noheadings --readonly --units=g --separator=";" -o vg_name,pv_count,lv_count,snap_count,vg_attr,vg_size,vg_free,vg_free_count
03/07/2020 09:51:29 INFO stdout ceph-1adde35e-0b4c-4839-8ade-32b2add53f85";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-79508a67-08d9-48ef-a80b-7e0a90d33ac6";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-9545c1ea-bbf7-455e-a5b4-4558415210f8";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-b8d119c9-cc58-4d45-87ba-b4e213a73a2c";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-d714f0d2-ec4a-4bef-86d2-ae32dac42055";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e3fff4fa-023d-4d18-97b5-ef5e7f8d9f72";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e91b5a79-9516-4bac-925e-fec5a907b35a";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO LeaderElectionBase dropping old sessions
03/07/2020 09:51:29 INFO Starting activating PetaSAN lvs
03/07/2020 09:51:29 INFO Running command: /sbin/vgs --noheadings --readonly --units=g --separator=";" -o vg_name,pv_count,lv_count,snap_count,vg_attr,vg_size,vg_free,vg_free_count
03/07/2020 09:51:29 INFO stdout ceph-1adde35e-0b4c-4839-8ade-32b2add53f85";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-79508a67-08d9-48ef-a80b-7e0a90d33ac6";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-9545c1ea-bbf7-455e-a5b4-4558415210f8";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-b8d119c9-cc58-4d45-87ba-b4e213a73a2c";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-d714f0d2-ec4a-4bef-86d2-ae32dac42055";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e3fff4fa-023d-4d18-97b5-ef5e7f8d9f72";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e91b5a79-9516-4bac-925e-fec5a907b35a";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:31 INFO Starting OSDs
03/07/2020 09:51:31 INFO Starting petasan tuning service
03/07/2020 09:51:31 INFO Starting Config Upload service
03/07/2020 09:51:36 INFO Cluster is just starting, system will delete all active disk resources
03/07/2020 09:52:01 INFO GlusterFS mount attempt
03/07/2020 09:52:14 INFO Service is starting.
03/07/2020 09:52:15 INFO LeaderElectionBase successfully dropped old sessions
03/07/2020 09:52:32 INFO GlusterFS mount attempt
03/07/2020 09:52:50 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:52:57 INFO Image image-00004 mapped successfully.
03/07/2020 09:53:00 INFO LIO add_target() disk wwn is 55c7bcf400004
03/07/2020 09:53:01 INFO Path 00004/1 acquired successfully
03/07/2020 09:53:10 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:53:11 INFO Could not lock path 00004/3 with session e785e43f-aaa9-54ed-e6bb-deffd84e9eee.
03/07/2020 09:54:01 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:54:02 INFO Path 00004/3 acquired successfully
03/07/2020 09:54:02 INFO Updating path 10.3.55.22 status to 2
03/07/2020 09:54:02 INFO Path 10.3.55.22 status updated to 2
03/07/2020 09:58:58 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:58:58 INFO Could not lock path 00004/2 with session e785e43f-aaa9-54ed-e6bb-deffd84e9eee.
03/07/2020 09:59:13 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:59:13 INFO The path 00004/4 was locked by dellr620-02-c15.
03/07/2020 09:59:17 INFO Path 00004/4 acquired successfully
03/07/2020 10:03:39 INFO Cleaned disk path 00004/4.
03/07/2020 10:03:39 INFO Cleaned disk path 00004/3.
03/07/2020 10:03:39 INFO Cleaned disk path 00004/1.
03/07/2020 10:03:39 INFO PetaSAN cleaned local paths not locked by this node in consul.
03/07/2020 10:03:39 INFO LIO deleted backstore image image-00004
03/07/2020 10:03:40 INFO LIO deleted Target iqn.2016-05.com.petasan:00004
03/07/2020 10:03:40 INFO Image image-00004 unmapped successfully.
03/07/2020 10:03:40 INFO PetaSAN cleaned iqns.
03/07/2020 10:06:40 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 10:06:41 INFO Image image-00004 mapped successfully.
03/07/2020 10:06:44 INFO LIO add_target() disk wwn is 55c7bcf400004
03/07/2020 10:06:44 INFO Path 00004/3 acquired successfully
03/07/2020 10:06:54 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
Hi admin,
I have a cluster with 3 nodes running version 2.5.3, all enable iSCSI Target Service. When I reboot one node, all ISCSI Disks was stopped. I have to start disks again. I tried reboot the node one by one but same error.
The log:
03/07/2020 09:51:24 INFO Start settings IPs
03/07/2020 09:51:27 INFO str_start_command: >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> consul agent -raft-protocol 2 -config-dir /opt/petasan/config/etc/consul.d/server -bind 10.3.54.21 -retry-join 10.3.54.22 -retry-join 10.3.54.23
03/07/2020 09:51:27 INFO GlusterFS mount attempt
03/07/2020 09:51:29 INFO Starting cluster file sync service
03/07/2020 09:51:29 INFO Starting iSCSI Service
03/07/2020 09:51:29 INFO Starting Cluster Management application
03/07/2020 09:51:29 INFO Starting Node Stats Service
03/07/2020 09:51:29 INFO Starting activating PetaSAN lvs
03/07/2020 09:51:29 INFO Running command: /sbin/vgs --noheadings --readonly --units=g --separator=";" -o vg_name,pv_count,lv_count,snap_count,vg_attr,vg_size,vg_free,vg_free_count
03/07/2020 09:51:29 INFO stdout ceph-1adde35e-0b4c-4839-8ade-32b2add53f85";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-79508a67-08d9-48ef-a80b-7e0a90d33ac6";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-9545c1ea-bbf7-455e-a5b4-4558415210f8";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-b8d119c9-cc58-4d45-87ba-b4e213a73a2c";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-d714f0d2-ec4a-4bef-86d2-ae32dac42055";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e3fff4fa-023d-4d18-97b5-ef5e7f8d9f72";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e91b5a79-9516-4bac-925e-fec5a907b35a";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO LeaderElectionBase dropping old sessions
03/07/2020 09:51:29 INFO Starting activating PetaSAN lvs
03/07/2020 09:51:29 INFO Running command: /sbin/vgs --noheadings --readonly --units=g --separator=";" -o vg_name,pv_count,lv_count,snap_count,vg_attr,vg_size,vg_free,vg_free_count
03/07/2020 09:51:29 INFO stdout ceph-1adde35e-0b4c-4839-8ade-32b2add53f85";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-79508a67-08d9-48ef-a80b-7e0a90d33ac6";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-9545c1ea-bbf7-455e-a5b4-4558415210f8";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-b8d119c9-cc58-4d45-87ba-b4e213a73a2c";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-d714f0d2-ec4a-4bef-86d2-ae32dac42055";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e3fff4fa-023d-4d18-97b5-ef5e7f8d9f72";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:29 INFO stdout ceph-e91b5a79-9516-4bac-925e-fec5a907b35a";"1";"1";"0";"wz--n-";"1788.00g";"0g";"0
03/07/2020 09:51:31 INFO Starting OSDs
03/07/2020 09:51:31 INFO Starting petasan tuning service
03/07/2020 09:51:31 INFO Starting Config Upload service
03/07/2020 09:51:36 INFO Cluster is just starting, system will delete all active disk resources
03/07/2020 09:52:01 INFO GlusterFS mount attempt
03/07/2020 09:52:14 INFO Service is starting.
03/07/2020 09:52:15 INFO LeaderElectionBase successfully dropped old sessions
03/07/2020 09:52:32 INFO GlusterFS mount attempt
03/07/2020 09:52:50 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:52:57 INFO Image image-00004 mapped successfully.
03/07/2020 09:53:00 INFO LIO add_target() disk wwn is 55c7bcf400004
03/07/2020 09:53:01 INFO Path 00004/1 acquired successfully
03/07/2020 09:53:10 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:53:11 INFO Could not lock path 00004/3 with session e785e43f-aaa9-54ed-e6bb-deffd84e9eee.
03/07/2020 09:54:01 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:54:02 INFO Path 00004/3 acquired successfully
03/07/2020 09:54:02 INFO Updating path 10.3.55.22 status to 2
03/07/2020 09:54:02 INFO Path 10.3.55.22 status updated to 2
03/07/2020 09:58:58 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:58:58 INFO Could not lock path 00004/2 with session e785e43f-aaa9-54ed-e6bb-deffd84e9eee.
03/07/2020 09:59:13 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 09:59:13 INFO The path 00004/4 was locked by dellr620-02-c15.
03/07/2020 09:59:17 INFO Path 00004/4 acquired successfully
03/07/2020 10:03:39 INFO Cleaned disk path 00004/4.
03/07/2020 10:03:39 INFO Cleaned disk path 00004/3.
03/07/2020 10:03:39 INFO Cleaned disk path 00004/1.
03/07/2020 10:03:39 INFO PetaSAN cleaned local paths not locked by this node in consul.
03/07/2020 10:03:39 INFO LIO deleted backstore image image-00004
03/07/2020 10:03:40 INFO LIO deleted Target iqn.2016-05.com.petasan:00004
03/07/2020 10:03:40 INFO Image image-00004 unmapped successfully.
03/07/2020 10:03:40 INFO PetaSAN cleaned iqns.
03/07/2020 10:06:40 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul
03/07/2020 10:06:41 INFO Image image-00004 mapped successfully.
03/07/2020 10:06:44 INFO LIO add_target() disk wwn is 55c7bcf400004
03/07/2020 10:06:44 INFO Path 00004/3 acquired successfully
03/07/2020 10:06:54 INFO Found pool:HYBRID-SSD-WRITECACHE for disk:00004 via consul