1/3 mons down
apcart
2 Posts
August 26, 2024, 1:58 pmQuote from apcart on August 26, 2024, 1:58 pmHi, we got a 3 node cluster, after one of the nodes goes down for few days due hardware problems, when we puted up again, after completed backfill the Cluster shows this STATUS, and the CPU of the PETANODE01 its higher than the others. how can we solve this?
root@PETANODE01:~# ceph -s
cluster:
id: 0262f991-4442-4431-92ba-5cae1bbb1db7
health: HEALTH_WARN
1/3 mons down, quorum PETANODE3,PETANODE2
3 slow ops, oldest one blocked for 284 sec, mon.PETANODE01 has slow ops
services:
mon: 3 daemons, quorum PETANODE3,PETANODE2 (age 9s), out of quorum: PETANODE 01
mgr: PETANODE3(active, since 19M), standbys: PETANODE2, PETANODE01
mds: cephfs:1 {0=PETANODE3=up:active} 2 up:standby
osd: 24 osds: 24 up (since 4d), 24 in (since 4d)
data:
pools: 10 pools, 673 pgs
objects: 3.10M objects, 10 TiB
usage: 17 TiB used, 18 TiB / 35 TiB avail
pgs: 673 active+clean
io:
client: 1.5 MiB/s rd, 4.8 MiB/s wr, 147 op/s rd, 586 op/s wr
Hi, we got a 3 node cluster, after one of the nodes goes down for few days due hardware problems, when we puted up again, after completed backfill the Cluster shows this STATUS, and the CPU of the PETANODE01 its higher than the others. how can we solve this?
root@PETANODE01:~# ceph -s
cluster:
id: 0262f991-4442-4431-92ba-5cae1bbb1db7
health: HEALTH_WARN
1/3 mons down, quorum PETANODE3,PETANODE2
3 slow ops, oldest one blocked for 284 sec, mon.PETANODE01 has slow ops
services:
mon: 3 daemons, quorum PETANODE3,PETANODE2 (age 9s), out of quorum: PETANODE 01
mgr: PETANODE3(active, since 19M), standbys: PETANODE2, PETANODE01
mds: cephfs:1 {0=PETANODE3=up:active} 2 up:standby
osd: 24 osds: 24 up (since 4d), 24 in (since 4d)
data:
pools: 10 pools, 673 pgs
objects: 3.10M objects, 10 TiB
usage: 17 TiB used, 18 TiB / 35 TiB avail
pgs: 673 active+clean
io:
client: 1.5 MiB/s rd, 4.8 MiB/s wr, 147 op/s rd, 586 op/s wr
apcart
2 Posts
September 17, 2024, 9:04 amQuote from apcart on September 17, 2024, 9:04 amHi,
can anyone help me?
thanks!
Hi,
can anyone help me?
thanks!
1/3 mons down
apcart
2 Posts
Quote from apcart on August 26, 2024, 1:58 pmHi, we got a 3 node cluster, after one of the nodes goes down for few days due hardware problems, when we puted up again, after completed backfill the Cluster shows this STATUS, and the CPU of the PETANODE01 its higher than the others. how can we solve this?
root@PETANODE01:~# ceph -s
cluster:
id: 0262f991-4442-4431-92ba-5cae1bbb1db7
health: HEALTH_WARN
1/3 mons down, quorum PETANODE3,PETANODE2
3 slow ops, oldest one blocked for 284 sec, mon.PETANODE01 has slow opsservices:
mon: 3 daemons, quorum PETANODE3,PETANODE2 (age 9s), out of quorum: PETANODE 01
mgr: PETANODE3(active, since 19M), standbys: PETANODE2, PETANODE01
mds: cephfs:1 {0=PETANODE3=up:active} 2 up:standby
osd: 24 osds: 24 up (since 4d), 24 in (since 4d)data:
pools: 10 pools, 673 pgs
objects: 3.10M objects, 10 TiB
usage: 17 TiB used, 18 TiB / 35 TiB avail
pgs: 673 active+cleanio:
client: 1.5 MiB/s rd, 4.8 MiB/s wr, 147 op/s rd, 586 op/s wr
Hi, we got a 3 node cluster, after one of the nodes goes down for few days due hardware problems, when we puted up again, after completed backfill the Cluster shows this STATUS, and the CPU of the PETANODE01 its higher than the others. how can we solve this?
root@PETANODE01:~# ceph -s
cluster:
id: 0262f991-4442-4431-92ba-5cae1bbb1db7
health: HEALTH_WARN
1/3 mons down, quorum PETANODE3,PETANODE2
3 slow ops, oldest one blocked for 284 sec, mon.PETANODE01 has slow ops
services:
mon: 3 daemons, quorum PETANODE3,PETANODE2 (age 9s), out of quorum: PETANODE 01
mgr: PETANODE3(active, since 19M), standbys: PETANODE2, PETANODE01
mds: cephfs:1 {0=PETANODE3=up:active} 2 up:standby
osd: 24 osds: 24 up (since 4d), 24 in (since 4d)
data:
pools: 10 pools, 673 pgs
objects: 3.10M objects, 10 TiB
usage: 17 TiB used, 18 TiB / 35 TiB avail
pgs: 673 active+clean
io:
client: 1.5 MiB/s rd, 4.8 MiB/s wr, 147 op/s rd, 586 op/s wr
apcart
2 Posts
Quote from apcart on September 17, 2024, 9:04 amHi,
can anyone help me?
thanks!
Hi,
can anyone help me?
thanks!