Error setting node ips.
hjallisnorra
19 Posts
November 28, 2019, 2:48 pmQuote from hjallisnorra on November 28, 2019, 2:48 pmhi,
have some problem with setting ip on backend1,2 bond0,
my node config :
cat petasan/config/node_info.json
{
"backend_1_ip": "10.118.64.1",
"backend_2_ip": "10.118.65.1",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.1",
"name": "av-petasan-p-ash1-001"
}
cat petasan/config/cluster_info.json
{
"backend_1_base_ip": "10.118.64.0",
"backend_1_eth_name": "bond0",
"backend_1_mask": "255.255.255.0",
"backend_1_vlan_id": "2064",
"backend_2_base_ip": "10.118.65.0",
"backend_2_eth_name": "bond0",
"backend_2_mask": "255.255.255.0",
"backend_2_vlan_id": "2065",
"bonds": [
{
"interfaces": "eth2,eth3",
"is_jumbo_frames": true,
"mode": "802.3ad",
"name": "bond0",
"primary_interface": ""
},
{
"interfaces": "eth4,eth5",
"is_jumbo_frames": true,
"mode": "802.3ad",
"name": "bond1",
"primary_interface": ""
}
],
"eth_count": 8,
"iscsi_1_eth_name": "bond1",
"iscsi_2_eth_name": "bond1",
"jumbo_frames": [
"eth4",
"eth2",
"eth5",
"eth3"
],
"management_eth_name": "eth1",
"management_nodes": [
{
"backend_1_ip": "10.118.64.1",
"backend_2_ip": "10.118.65.1",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.1",
"name": "av-petasan-p-ash1-001"
},
{
"backend_1_ip": "10.118.64.2",
"backend_2_ip": "10.118.65.2",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.2",
"name": "av-petasan-p-ash1-002"
},
{
"backend_1_ip": "10.118.64.3",
"backend_2_ip": "10.118.65.3",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.3",
"name": "av-petasan-p-ash1-003"
}
],
"name": "av-petasan",
"storage_engine": "bluestore"
}
when starting node backend vlan dont get assigned ip numbers.
ip a:
ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::f603:43ff:fe3e:f6a0/64 scope link
valid_lft forever preferred_lft forever
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::f603:43ff:fe3e:f6a1/64 scope link
valid_lft forever preferred_lft forever
4: eth6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a2 brd ff:ff:ff:ff:ff:ff
inet6 fe80::f603:43ff:fe3e:f6a2/64 scope link
valid_lft forever preferred_lft forever
5: eth7: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
link/ether f4:03:43:3e:f6:a3 brd ff:ff:ff:ff:ff:ff
6: eth4: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
7: eth2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
8: eth5: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
9: eth3: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
11: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
12: bond1: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca0/64 scope link
valid_lft forever preferred_lft forever
13: eth1.1064@eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
inet 10.117.64.1/24 brd 10.117.64.255 scope global eth1.1064
valid_lft forever preferred_lft forever
inet6 fe80::f603:43ff:fe3e:f6a1/64 scope link
valid_lft forever preferred_lft forever
14: bond0.2064@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
15: bond0.2065@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
but if i run after startup:
/opt/petasan/scripts/node_start_ips.py
the node will get the correct ip's
ip a
ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a0 brd ff:ff:ff:ff:ff:ff
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
4: eth6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a2 brd ff:ff:ff:ff:ff:ff
5: eth7: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
link/ether f4:03:43:3e:f6:a3 brd ff:ff:ff:ff:ff:ff
6: eth4: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
7: eth2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
8: eth5: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
9: eth3: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
16: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
17: bond1: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca0/64 scope link
valid_lft forever preferred_lft forever
18: eth1.1064@eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
inet 10.117.64.1/24 scope global eth1.1064
valid_lft forever preferred_lft forever
inet6 fe80::f603:43ff:fe3e:f6a1/64 scope link
valid_lft forever preferred_lft forever
19: bond0.2064@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet 10.118.64.1/24 scope global bond0.2064
valid_lft forever preferred_lft forever
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
20: bond0.2065@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet 10.118.65.1/24 scope global bond0.2065
valid_lft forever preferred_lft forever
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
it looks like the bond0 is not ready for adding ip address or something.
can you help me with this?
hjalli.
hi,
have some problem with setting ip on backend1,2 bond0,
my node config :
cat petasan/config/node_info.json
{
"backend_1_ip": "10.118.64.1",
"backend_2_ip": "10.118.65.1",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.1",
"name": "av-petasan-p-ash1-001"
}
cat petasan/config/cluster_info.json
{
"backend_1_base_ip": "10.118.64.0",
"backend_1_eth_name": "bond0",
"backend_1_mask": "255.255.255.0",
"backend_1_vlan_id": "2064",
"backend_2_base_ip": "10.118.65.0",
"backend_2_eth_name": "bond0",
"backend_2_mask": "255.255.255.0",
"backend_2_vlan_id": "2065",
"bonds": [
{
"interfaces": "eth2,eth3",
"is_jumbo_frames": true,
"mode": "802.3ad",
"name": "bond0",
"primary_interface": ""
},
{
"interfaces": "eth4,eth5",
"is_jumbo_frames": true,
"mode": "802.3ad",
"name": "bond1",
"primary_interface": ""
}
],
"eth_count": 8,
"iscsi_1_eth_name": "bond1",
"iscsi_2_eth_name": "bond1",
"jumbo_frames": [
"eth4",
"eth2",
"eth5",
"eth3"
],
"management_eth_name": "eth1",
"management_nodes": [
{
"backend_1_ip": "10.118.64.1",
"backend_2_ip": "10.118.65.1",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.1",
"name": "av-petasan-p-ash1-001"
},
{
"backend_1_ip": "10.118.64.2",
"backend_2_ip": "10.118.65.2",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.2",
"name": "av-petasan-p-ash1-002"
},
{
"backend_1_ip": "10.118.64.3",
"backend_2_ip": "10.118.65.3",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.3",
"name": "av-petasan-p-ash1-003"
}
],
"name": "av-petasan",
"storage_engine": "bluestore"
}
when starting node backend vlan dont get assigned ip numbers.
ip a:
ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::f603:43ff:fe3e:f6a0/64 scope link
valid_lft forever preferred_lft forever
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::f603:43ff:fe3e:f6a1/64 scope link
valid_lft forever preferred_lft forever
4: eth6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a2 brd ff:ff:ff:ff:ff:ff
inet6 fe80::f603:43ff:fe3e:f6a2/64 scope link
valid_lft forever preferred_lft forever
5: eth7: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
link/ether f4:03:43:3e:f6:a3 brd ff:ff:ff:ff:ff:ff
6: eth4: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
7: eth2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
8: eth5: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
9: eth3: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
11: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
12: bond1: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca0/64 scope link
valid_lft forever preferred_lft forever
13: eth1.1064@eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
inet 10.117.64.1/24 brd 10.117.64.255 scope global eth1.1064
valid_lft forever preferred_lft forever
inet6 fe80::f603:43ff:fe3e:f6a1/64 scope link
valid_lft forever preferred_lft forever
14: bond0.2064@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
15: bond0.2065@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
but if i run after startup:
/opt/petasan/scripts/node_start_ips.py
the node will get the correct ip's
ip a
ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a0 brd ff:ff:ff:ff:ff:ff
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
4: eth6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a2 brd ff:ff:ff:ff:ff:ff
5: eth7: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
link/ether f4:03:43:3e:f6:a3 brd ff:ff:ff:ff:ff:ff
6: eth4: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
7: eth2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
8: eth5: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
9: eth3: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
16: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
17: bond1: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca0/64 scope link
valid_lft forever preferred_lft forever
18: eth1.1064@eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
inet 10.117.64.1/24 scope global eth1.1064
valid_lft forever preferred_lft forever
inet6 fe80::f603:43ff:fe3e:f6a1/64 scope link
valid_lft forever preferred_lft forever
19: bond0.2064@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet 10.118.64.1/24 scope global bond0.2064
valid_lft forever preferred_lft forever
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
20: bond0.2065@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet 10.118.65.1/24 scope global bond0.2065
valid_lft forever preferred_lft forever
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
it looks like the bond0 is not ready for adding ip address or something.
can you help me with this?
hjalli.
hjallisnorra
19 Posts
November 28, 2019, 3:27 pmQuote from hjallisnorra on November 28, 2019, 3:27 pmThis is probably some error on my part, after rebooting node again a few times the problem stopped, i have no idea why....
This is probably some error on my part, after rebooting node again a few times the problem stopped, i have no idea why....
Error setting node ips.
hjallisnorra
19 Posts
Quote from hjallisnorra on November 28, 2019, 2:48 pmhi,
have some problem with setting ip on backend1,2 bond0,
my node config :
cat petasan/config/node_info.json
{
"backend_1_ip": "10.118.64.1",
"backend_2_ip": "10.118.65.1",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.1",
"name": "av-petasan-p-ash1-001"}
cat petasan/config/cluster_info.json
{
"backend_1_base_ip": "10.118.64.0",
"backend_1_eth_name": "bond0",
"backend_1_mask": "255.255.255.0",
"backend_1_vlan_id": "2064",
"backend_2_base_ip": "10.118.65.0",
"backend_2_eth_name": "bond0",
"backend_2_mask": "255.255.255.0",
"backend_2_vlan_id": "2065",
"bonds": [
{
"interfaces": "eth2,eth3",
"is_jumbo_frames": true,
"mode": "802.3ad",
"name": "bond0",
"primary_interface": ""
},
{
"interfaces": "eth4,eth5",
"is_jumbo_frames": true,
"mode": "802.3ad",
"name": "bond1",
"primary_interface": ""
}
],
"eth_count": 8,
"iscsi_1_eth_name": "bond1",
"iscsi_2_eth_name": "bond1",
"jumbo_frames": [
"eth4",
"eth2",
"eth5",
"eth3"
],
"management_eth_name": "eth1",
"management_nodes": [
{
"backend_1_ip": "10.118.64.1",
"backend_2_ip": "10.118.65.1",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.1",
"name": "av-petasan-p-ash1-001"
},
{
"backend_1_ip": "10.118.64.2",
"backend_2_ip": "10.118.65.2",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.2",
"name": "av-petasan-p-ash1-002"
},
{
"backend_1_ip": "10.118.64.3",
"backend_2_ip": "10.118.65.3",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.3",
"name": "av-petasan-p-ash1-003"
}
],
"name": "av-petasan",
"storage_engine": "bluestore"
}
when starting node backend vlan dont get assigned ip numbers.
ip a:
ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::f603:43ff:fe3e:f6a0/64 scope link
valid_lft forever preferred_lft forever
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::f603:43ff:fe3e:f6a1/64 scope link
valid_lft forever preferred_lft forever
4: eth6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a2 brd ff:ff:ff:ff:ff:ff
inet6 fe80::f603:43ff:fe3e:f6a2/64 scope link
valid_lft forever preferred_lft forever
5: eth7: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
link/ether f4:03:43:3e:f6:a3 brd ff:ff:ff:ff:ff:ff
6: eth4: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
7: eth2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
8: eth5: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
9: eth3: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
11: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
12: bond1: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca0/64 scope link
valid_lft forever preferred_lft forever
13: eth1.1064@eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
inet 10.117.64.1/24 brd 10.117.64.255 scope global eth1.1064
valid_lft forever preferred_lft forever
inet6 fe80::f603:43ff:fe3e:f6a1/64 scope link
valid_lft forever preferred_lft forever
14: bond0.2064@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
15: bond0.2065@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
but if i run after startup:
/opt/petasan/scripts/node_start_ips.py
the node will get the correct ip's
ip a
ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a0 brd ff:ff:ff:ff:ff:ff
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
4: eth6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a2 brd ff:ff:ff:ff:ff:ff
5: eth7: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
link/ether f4:03:43:3e:f6:a3 brd ff:ff:ff:ff:ff:ff
6: eth4: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
7: eth2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
8: eth5: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
9: eth3: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
16: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
17: bond1: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca0/64 scope link
valid_lft forever preferred_lft forever
18: eth1.1064@eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
inet 10.117.64.1/24 scope global eth1.1064
valid_lft forever preferred_lft forever
inet6 fe80::f603:43ff:fe3e:f6a1/64 scope link
valid_lft forever preferred_lft forever
19: bond0.2064@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet 10.118.64.1/24 scope global bond0.2064
valid_lft forever preferred_lft forever
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
20: bond0.2065@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet 10.118.65.1/24 scope global bond0.2065
valid_lft forever preferred_lft forever
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft foreverit looks like the bond0 is not ready for adding ip address or something.
can you help me with this?
hjalli.
hi,
have some problem with setting ip on backend1,2 bond0,
my node config :
cat petasan/config/node_info.json
{
"backend_1_ip": "10.118.64.1",
"backend_2_ip": "10.118.65.1",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.1",
"name": "av-petasan-p-ash1-001"
}
cat petasan/config/cluster_info.json
{
"backend_1_base_ip": "10.118.64.0",
"backend_1_eth_name": "bond0",
"backend_1_mask": "255.255.255.0",
"backend_1_vlan_id": "2064",
"backend_2_base_ip": "10.118.65.0",
"backend_2_eth_name": "bond0",
"backend_2_mask": "255.255.255.0",
"backend_2_vlan_id": "2065",
"bonds": [
{
"interfaces": "eth2,eth3",
"is_jumbo_frames": true,
"mode": "802.3ad",
"name": "bond0",
"primary_interface": ""
},
{
"interfaces": "eth4,eth5",
"is_jumbo_frames": true,
"mode": "802.3ad",
"name": "bond1",
"primary_interface": ""
}
],
"eth_count": 8,
"iscsi_1_eth_name": "bond1",
"iscsi_2_eth_name": "bond1",
"jumbo_frames": [
"eth4",
"eth2",
"eth5",
"eth3"
],
"management_eth_name": "eth1",
"management_nodes": [
{
"backend_1_ip": "10.118.64.1",
"backend_2_ip": "10.118.65.1",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.1",
"name": "av-petasan-p-ash1-001"
},
{
"backend_1_ip": "10.118.64.2",
"backend_2_ip": "10.118.65.2",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.2",
"name": "av-petasan-p-ash1-002"
},
{
"backend_1_ip": "10.118.64.3",
"backend_2_ip": "10.118.65.3",
"is_backup": false,
"is_iscsi": true,
"is_management": true,
"is_storage": true,
"management_ip": "10.117.64.3",
"name": "av-petasan-p-ash1-003"
}
],
"name": "av-petasan",
"storage_engine": "bluestore"
}
when starting node backend vlan dont get assigned ip numbers.
ip a:
ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::f603:43ff:fe3e:f6a0/64 scope link
valid_lft forever preferred_lft forever
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::f603:43ff:fe3e:f6a1/64 scope link
valid_lft forever preferred_lft forever
4: eth6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a2 brd ff:ff:ff:ff:ff:ff
inet6 fe80::f603:43ff:fe3e:f6a2/64 scope link
valid_lft forever preferred_lft forever
5: eth7: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
link/ether f4:03:43:3e:f6:a3 brd ff:ff:ff:ff:ff:ff
6: eth4: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
7: eth2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
8: eth5: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
9: eth3: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
11: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
12: bond1: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca0/64 scope link
valid_lft forever preferred_lft forever
13: eth1.1064@eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
inet 10.117.64.1/24 brd 10.117.64.255 scope global eth1.1064
valid_lft forever preferred_lft forever
inet6 fe80::f603:43ff:fe3e:f6a1/64 scope link
valid_lft forever preferred_lft forever
14: bond0.2064@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
15: bond0.2065@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
but if i run after startup:
/opt/petasan/scripts/node_start_ips.py
the node will get the correct ip's
ip a
ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a0 brd ff:ff:ff:ff:ff:ff
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
4: eth6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a2 brd ff:ff:ff:ff:ff:ff
5: eth7: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
link/ether f4:03:43:3e:f6:a3 brd ff:ff:ff:ff:ff:ff
6: eth4: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
7: eth2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
8: eth5: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond1 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
9: eth3: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
16: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
17: bond1: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a0 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ba83:3ff:fe5f:7ca0/64 scope link
valid_lft forever preferred_lft forever
18: eth1.1064@eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether f4:03:43:3e:f6:a1 brd ff:ff:ff:ff:ff:ff
inet 10.117.64.1/24 scope global eth1.1064
valid_lft forever preferred_lft forever
inet6 fe80::f603:43ff:fe3e:f6a1/64 scope link
valid_lft forever preferred_lft forever
19: bond0.2064@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet 10.118.64.1/24 scope global bond0.2064
valid_lft forever preferred_lft forever
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
20: bond0.2065@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether b8:83:03:5f:7c:a1 brd ff:ff:ff:ff:ff:ff
inet 10.118.65.1/24 scope global bond0.2065
valid_lft forever preferred_lft forever
inet6 fe80::ba83:3ff:fe5f:7ca1/64 scope link
valid_lft forever preferred_lft forever
it looks like the bond0 is not ready for adding ip address or something.
can you help me with this?
hjalli.
hjallisnorra
19 Posts
Quote from hjallisnorra on November 28, 2019, 3:27 pmThis is probably some error on my part, after rebooting node again a few times the problem stopped, i have no idea why....
This is probably some error on my part, after rebooting node again a few times the problem stopped, i have no idea why....