Forums

Home / Forums

You need to log in to create posts and topics. Login · Register

Bug in move_paths

Pages: 1 2 3

therm
121 Posts
September 18, 2017, 12:19 pm

No server has the 192.168.3.21 enabled, all are disabled.

Or both??

Last edited on September 18, 2017, 12:23 pm by therm · #11

therm
121 Posts
September 18, 2017, 12:22 pm

LIO:

Server1:

| | o- tpg3 ............................................................................................................ [enabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00001 (/dev/rbd/rbd/image-00001)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.3.21:3260 ................................................................................. [OK, iser disabled]

Server2:

| | o- tpg3 ............................................................................................................ [enabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00001 (/dev/rbd/rbd/image-00001)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.3.21:3260 ................................................................................. [OK, iser disabled]

#12

admin
2,930 Posts
September 18, 2017, 12:25 pm

Ok i see what you mean..  same ip should not be on 2 nodes ! but i do not know how this could have occurred..you have not added any ips manually ? if not we will try to think why this could have happened but we have not seen this before.

#13

therm
121 Posts
September 18, 2017, 12:26 pm

No, I assigned no ip manually. What about the LIO config above that is twice enabled?

#14

admin
2,930 Posts
September 18, 2017, 12:27 pm

What does the ui say about  192.168.3.21  is in active ? who is serving it ? the node serving it should have the path enabled in LIO and the ip assigned to its nic.

#15

therm
121 Posts
September 18, 2017, 12:31 pm

It says that it is on server2. But enabled on server1 too. The ip I disabled on server1. Everything ok now? Does the LIO part on server1 needs to be disabled?

#16

admin
2,930 Posts
September 18, 2017, 12:33 pm

There was an error in my posts. To view if LIO has a path enabled

targetcli ls

and check for enabled or disabled in front of the "tpgX"  line (target portal group) not next to the ip as i incorrectly stated.

Sorry

#17

therm
121 Posts
September 18, 2017, 12:39 pm

Server1:

| o- iqn.2016-05.com.petasan:00001 ...................................................................................... [4 TPGs]
| | o- tpg1 ............................................................................................................ [enabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00001 (/dev/rbd/rbd/image-00001)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.3.20:3260 ................................................................................. [OK, iser disabled]
| | o- tpg2 ............................................................................................................ [enabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00001 (/dev/rbd/rbd/image-00001)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.4.20:3260 ................................................................................. [OK, iser disabled]
| | o- tpg3 ............................................................................................................ [enabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00001 (/dev/rbd/rbd/image-00001)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.3.21:3260 ................................................................................. [OK, iser disabled]
| | o- tpg4 ........................................................................................................... [disabled]
| | o- acls ........................................................................................................... [0 ACLs]
| | o- luns ............................................................................................................ [1 LUN]
| | | o- lun0 ..................................................................... [rbd/image-00001 (/dev/rbd/rbd/image-00001)]
| | o- portals ...................................................................................................... [1 Portal]
| | o- 192.168.4.21:3260 ................................................................................. [OK, iser disabled]
| o- iqn.2016-05.com.petasan:00002 ...................................................................................... [4 TPGs]
| | o- tpg1 ........................................................................................................... [disabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00002 (/dev/rbd/rbd/image-00002)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.3.22:3260 ................................................................................. [OK, iser disabled]
| | o- tpg2 ............................................................................................................ [enabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00002 (/dev/rbd/rbd/image-00002)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.4.22:3260 ................................................................................. [OK, iser disabled]
| | o- tpg3 ............................................................................................................ [enabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00002 (/dev/rbd/rbd/image-00002)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.3.23:3260 ................................................................................. [OK, iser disabled]
| | o- tpg4 ............................................................................................................ [enabled]
| | o- acls ........................................................................................................... [0 ACLs]
| | o- luns ............................................................................................................ [1 LUN]
| | | o- lun0 ..................................................................... [rbd/image-00002 (/dev/rbd/rbd/image-00002)]
| | o- portals ...................................................................................................... [1 Portal]
| | o- 192.168.4.23:3260 ................................................................................. [OK, iser disabled]
| o- iqn.2016-05.com.petasan:00003 ...................................................................................... [4 TPGs]
| | o- tpg1 ........................................................................................................... [disabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00003 (/dev/rbd/rbd/image-00003)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.3.24:3260 ................................................................................. [OK, iser disabled]
| | o- tpg2 ........................................................................................................... [disabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00003 (/dev/rbd/rbd/image-00003)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.4.24:3260 ................................................................................. [OK, iser disabled]
| | o- tpg3 ............................................................................................................ [enabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00003 (/dev/rbd/rbd/image-00003)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.3.25:3260 ................................................................................. [OK, iser disabled]
| | o- tpg4 ............................................................................................................ [enabled]
| | o- acls ........................................................................................................... [0 ACLs]
| | o- luns ............................................................................................................ [1 LUN]
| | | o- lun0 ..................................................................... [rbd/image-00003 (/dev/rbd/rbd/image-00003)]
| | o- portals ...................................................................................................... [1 Portal]
| | o- 192.168.4.25:3260 ................................................................................. [OK, iser disabled]
| o- iqn.2016-05.com.petasan:00004 ...................................................................................... [4 TPGs]
| | o- tpg1 ............................................................................................................ [enabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00004 (/dev/rbd/rbd/image-00004)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.3.26:3260 ................................................................................. [OK, iser disabled]
| | o- tpg2 ............................................................................................................ [enabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00004 (/dev/rbd/rbd/image-00004)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.4.26:3260 ................................................................................. [OK, iser disabled]
| | o- tpg3 ........................................................................................................... [disabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00004 (/dev/rbd/rbd/image-00004)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.3.27:3260 ................................................................................. [OK, iser disabled]
| | o- tpg4 ........................................................................................................... [disabled]
| | o- acls ........................................................................................................... [0 ACLs]
| | o- luns ............................................................................................................ [1 LUN]
| | | o- lun0 ..................................................................... [rbd/image-00004 (/dev/rbd/rbd/image-00004)]
| | o- portals ...................................................................................................... [1 Portal]
| | o- 192.168.4.27:3260 ................................................................................. [OK, iser disabled]
| o- iqn.2016-05.com.petasan:00005 ...................................................................................... [4 TPGs]
| o- tpg1 ............................................................................................................ [enabled]
| | o- acls ........................................................................................................... [0 ACLs]
| | o- luns ............................................................................................................ [1 LUN]
| | | o- lun0 ..................................................................... [rbd/image-00005 (/dev/rbd/rbd/image-00005)]
| | o- portals ...................................................................................................... [1 Portal]
| | o- 192.168.3.28:3260 ................................................................................. [OK, iser disabled]
| o- tpg2 ........................................................................................................... [disabled]
| | o- acls ........................................................................................................... [0 ACLs]
| | o- luns ............................................................................................................ [1 LUN]
| | | o- lun0 ..................................................................... [rbd/image-00005 (/dev/rbd/rbd/image-00005)]
| | o- portals ...................................................................................................... [1 Portal]
| | o- 192.168.4.28:3260 ................................................................................. [OK, iser disabled]
| o- tpg3 ............................................................................................................ [enabled]
| | o- acls ........................................................................................................... [0 ACLs]
| | o- luns ............................................................................................................ [1 LUN]
| | | o- lun0 ..................................................................... [rbd/image-00005 (/dev/rbd/rbd/image-00005)]
| | o- portals ...................................................................................................... [1 Portal]
| | o- 192.168.3.29:3260 ................................................................................. [OK, iser disabled]
| o- tpg4 ............................................................................................................ [enabled]
| o- acls ........................................................................................................... [0 ACLs]
| o- luns ............................................................................................................ [1 LUN]
| | o- lun0 ..................................................................... [rbd/image-00005 (/dev/rbd/rbd/image-00005)]
| o- portals ...................................................................................................... [1 Portal]
| o- 192.168.4.29:3260 ................................................................................. [OK, iser disabled]

 

Server2:

o- / ......................................................................................................................... [...]
o- backstores .............................................................................................................. [...]
| o- fileio ................................................................................................... [0 Storage Object]
| o- iblock ................................................................................................... [0 Storage Object]
| o- pscsi .................................................................................................... [0 Storage Object]
| o- rbd ..................................................................................................... [2 Storage Objects]
| | o- image-00001 ..................................................... [LEGACY: SHARED HBA (/dev/rbd/rbd/image-00001 activated)]
| | o- image-00004 ..................................................... [LEGACY: SHARED HBA (/dev/rbd/rbd/image-00004 activated)]
| o- rd_mcp ................................................................................................... [0 Storage Object]
o- ib_srpt ........................................................................................................... [0 Targets]
o- iscsi ............................................................................................................. [2 Targets]
| o- iqn.2016-05.com.petasan:00001 ...................................................................................... [4 TPGs]
| | o- tpg1 ........................................................................................................... [disabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00001 (/dev/rbd/rbd/image-00001)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.3.20:3260 ................................................................................. [OK, iser disabled]
| | o- tpg2 ........................................................................................................... [disabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00001 (/dev/rbd/rbd/image-00001)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.4.20:3260 ................................................................................. [OK, iser disabled]
| | o- tpg3 ............................................................................................................ [enabled]
| | | o- acls ........................................................................................................... [0 ACLs]
| | | o- luns ............................................................................................................ [1 LUN]
| | | | o- lun0 ..................................................................... [rbd/image-00001 (/dev/rbd/rbd/image-00001)]
| | | o- portals ...................................................................................................... [1 Portal]
| | | o- 192.168.3.21:3260 ................................................................................. [OK, iser disabled]
| | o- tpg4 ........................................................................................................... [disabled]
| | o- acls ........................................................................................................... [0 ACLs]
| | o- luns ............................................................................................................ [1 LUN]
| | | o- lun0 ..................................................................... [rbd/image-00001 (/dev/rbd/rbd/image-00001)]
| | o- portals ...................................................................................................... [1 Portal]
| | o- 192.168.4.21:3260 ................................................................................. [OK, iser disabled]
| o- iqn.2016-05.com.petasan:00004 ...................................................................................... [4 TPGs]
| o- tpg1 ........................................................................................................... [disabled]
| | o- acls ........................................................................................................... [0 ACLs]
| | o- luns ............................................................................................................ [1 LUN]
| | | o- lun0 ..................................................................... [rbd/image-00004 (/dev/rbd/rbd/image-00004)]
| | o- portals ...................................................................................................... [1 Portal]
| | o- 192.168.3.26:3260 ................................................................................. [OK, iser disabled]
| o- tpg2 ........................................................................................................... [disabled]
| | o- acls ........................................................................................................... [0 ACLs]
| | o- luns ............................................................................................................ [1 LUN]
| | | o- lun0 ..................................................................... [rbd/image-00004 (/dev/rbd/rbd/image-00004)]
| | o- portals ...................................................................................................... [1 Portal]
| | o- 192.168.4.26:3260 ................................................................................. [OK, iser disabled]
| o- tpg3 ............................................................................................................ [enabled]
| | o- acls ........................................................................................................... [0 ACLs]
| | o- luns ............................................................................................................ [1 LUN]
| | | o- lun0 ..................................................................... [rbd/image-00004 (/dev/rbd/rbd/image-00004)]
| | o- portals ...................................................................................................... [1 Portal]
| | o- 192.168.3.27:3260 ................................................................................. [OK, iser disabled]
| o- tpg4 ........................................................................................................... [disabled]
| o- acls ........................................................................................................... [0 ACLs]
| o- luns ............................................................................................................ [1 LUN]
| | o- lun0 ..................................................................... [rbd/image-00004 (/dev/rbd/rbd/image-00004)]
| o- portals ...................................................................................................... [1 Portal]
| o- 192.168.4.27:3260 ................................................................................. [OK, iser disabled]
o- loopback .......................................................................................................... [0 Targets]
o- qla2xxx ........................................................................................................... [0 Targets]
o- tcm_fc ............................................................................................................ [0 Targets]
o- vhost ............................................................................................................. [0 Targets]

 

#18

therm
121 Posts
September 18, 2017, 1:02 pm

After switching another ip (of LUN1) from server1 to server2 this happens on the esx-server:

[root@bl460-10:~] dmesg -T |tail
2017-09-18T12:47:56.379Z cpu30:2147508)PVSCSI: 769: PVSCSICheckForFirstWrite: CID for target: 1 is not updated yet. Will return BSY.

2017-09-18T12:47:56.379Z cpu30:2147508)PVSCSI: 769: PVSCSICheckForFirstWrite: CID for target: 1 is not updated yet. Will return BSY.

2017-09-18T12:47:56.379Z cpu30:2147508)PVSCSI: 769: PVSCSICheckForFirstWrite: CID for target: 1 is not updated yet. Will return BSY.

2017-09-18T12:47:56.379Z cpu30:2147508)PVSCSI: 769: PVSCSICheckForFirstWrite: CID for target: 1 is not updated yet. Will return BSY.

2017-09-18T12:47:57.636Z cpu34:2819016)Vmxnet3: 15258: Using default queue delivery for vmxnet3 for port 0x20001cd
2017-09-18T12:47:57.637Z cpu34:2819016)NetPort: 1573: enabled port 0x20001cd with mac 00:50:56:81:19:51

Before that all paths were available in ESX as you can see here:

[root@bl460-10:~] esxcfg-mpath -b |grep 'vmhba33\|PETASAN'
naa.60014050000100000000000000000000 : PETASAN iSCSI Disk (naa.60014050000100000000000000000000)
vmhba33:C0:T0:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00001 Alias= Session=00023d000001 PortalTag=1
vmhba33:C3:T0:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00001 Alias= Session=00023d000004 PortalTag=2
vmhba33:C4:T0:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00001 Alias= Session=00023d000005 PortalTag=3
vmhba33:C7:T0:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00001 Alias= Session=00023d000008 PortalTag=4
naa.60014050000500000000000000000000 : PETASAN iSCSI Disk (naa.60014050000500000000000000000000)
vmhba33:C3:T4:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00005 Alias= Session=00023d000004 PortalTag=2
vmhba33:C4:T4:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00005 Alias= Session=00023d000005 PortalTag=3
vmhba33:C7:T4:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00005 Alias= Session=00023d000008 PortalTag=4
vmhba33:C0:T4:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00005 Alias= Session=00023d000001 PortalTag=1
naa.60014050000400000000000000000000 : PETASAN iSCSI Disk (naa.60014050000400000000000000000000)
vmhba33:C4:T3:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00004 Alias= Session=00023d000005 PortalTag=3
vmhba33:C7:T3:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00004 Alias= Session=00023d000008 PortalTag=4
vmhba33:C0:T3:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00004 Alias= Session=00023d000001 PortalTag=1
vmhba33:C3:T3:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00004 Alias= Session=00023d000004 PortalTag=2
naa.60014050000300000000000000000000 : PETASAN iSCSI Disk (naa.60014050000300000000000000000000)
vmhba33:C7:T2:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00003 Alias= Session=00023d000008 PortalTag=4
vmhba33:C0:T2:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00003 Alias= Session=00023d000001 PortalTag=1
vmhba33:C3:T2:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00003 Alias= Session=00023d000004 PortalTag=2
vmhba33:C4:T2:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00003 Alias= Session=00023d000005 PortalTag=3
naa.60014050000200000000000000000000 : PETASAN iSCSI Disk (naa.60014050000200000000000000000000)
vmhba33:C0:T1:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00002 Alias= Session=00023d000001 PortalTag=1
vmhba33:C3:T1:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00002 Alias= Session=00023d000004 PortalTag=2
vmhba33:C4:T1:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00002 Alias= Session=00023d000005 PortalTag=3
vmhba33:C7:T1:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:bl460-10-58cf050b Target: IQN=iqn.2016-05.com.petasan:00002 Alias= Session=00023d000008 PortalTag=4

But the server did not read or write from/to it! Might it be an option to send arp requests in intervalls?

#19

therm
121 Posts
September 18, 2017, 1:16 pm

Moving a third ip, the address was duplicate again. Removed it from by hand.

#20
Pages: 1 2 3