Bucket Tree & Rules Help
the.only.chaos.lucifer
31 Posts
May 28, 2024, 6:29 amQuote from the.only.chaos.lucifer on May 28, 2024, 6:29 amI am having problem creating anything beside the default replicated_rule. I am not sure what i am doing wrong but the pool kept on showing INACTIVE so i cannot create the "CephFS File Systems" and therefore cannot create cifs storage. But when i switch back to default replicated_rule it suddenly work even without changing the tree below back its original format.
For example when i use this rule:
replicated-chassis-and-all-below
{
id 5
type replicated
step take default
step chooseleaf firstn 0 type chassis
step chooseleaf firstn 0 type host
step emit
}
with bucket tree or ceph osd tree:
default
-
chassis-A
-
storage-pool00000-node00001
-
osd.1 (ssd)
-
osd.3 (ssd)
-
storage-pool00000-node00002
-
osd.2 (ssd)
-
osd.4 (ssd)
-
chassis-B
-
storage-pool00000-node00003
-
osd.0 (ssd)
-
osd.5 (ssd)
Pools:
Name
Type
Usage
PGs Autoscale
PGs
Size
Min Size
Rule Name
Used Space
Available Space
Active OSDs
Status
Action
.mgr
replicated
mgr
off
1
3
2
replicated_rule
2.65 MB
474.34 GB
3
Active
cephfs_all_lv_data
replicated
cephfs
on
177
2
1
replicated-chassis-and-all-below
0 Bytes
711.51 GB
6
Active
cephfs_all_lv_metadata
replicated
cephfs
on
192
2
1
replicated-chassis-and-all-below
0 Bytes
711.51 GB
6
Inactive
Showing 1 to 3 of 3 entries
I am having problem creating anything beside the default replicated_rule. I am not sure what i am doing wrong but the pool kept on showing INACTIVE so i cannot create the "CephFS File Systems" and therefore cannot create cifs storage. But when i switch back to default replicated_rule it suddenly work even without changing the tree below back its original format.
For example when i use this rule:
replicated-chassis-and-all-below
{
id 5
type replicated
step take default
step chooseleaf firstn 0 type chassis
step chooseleaf firstn 0 type host
step emit
}
with bucket tree or ceph osd tree:
default
-
chassis-A
-
storage-pool00000-node00001
-
osd.1 (ssd)
-
osd.3 (ssd)
-
storage-pool00000-node00002
-
osd.2 (ssd)
-
osd.4 (ssd)
-
chassis-B
-
storage-pool00000-node00003
-
osd.0 (ssd)
-
osd.5 (ssd)
Pools:
Name
Type
Usage
PGs Autoscale
PGs
Size
Min Size
Rule Name
Used Space
Available Space
Active OSDs
Status
Action
.mgr
replicated
mgr
off
1
3
2
replicated_rule
2.65 MB
474.34 GB
3
Active
cephfs_all_lv_data
replicated
cephfs
on
177
2
1
replicated-chassis-and-all-below
0 Bytes
711.51 GB
6
Active
cephfs_all_lv_metadata
replicated
cephfs
on
192
2
1
replicated-chassis-and-all-below
0 Bytes
711.51 GB
6
Inactive
Showing 1 to 3 of 3 entries
Last edited on May 28, 2024, 6:31 am by the.only.chaos.lucifer · #1
admin
2,930 Posts
May 28, 2024, 10:51 amQuote from admin on May 28, 2024, 10:51 amthe crush rule looks incorrect, try
step take default class ssd
step chooseleaf firstn 0 type chassis
step emit
the crush rule looks incorrect, try
step take default class ssd
step chooseleaf firstn 0 type chassis
step emit
the.only.chaos.lucifer
31 Posts
May 31, 2024, 7:06 amQuote from the.only.chaos.lucifer on May 31, 2024, 7:06 amThis it turn out like you said a issue with my script. Thanks I went and look at more example and barely scratching the surface in understanding the usage of it. But i at least figure how to to change the failure domain now thanks!
This it turn out like you said a issue with my script. Thanks I went and look at more example and barely scratching the surface in understanding the usage of it. But i at least figure how to to change the failure domain now thanks!
Bucket Tree & Rules Help
the.only.chaos.lucifer
31 Posts
Quote from the.only.chaos.lucifer on May 28, 2024, 6:29 amI am having problem creating anything beside the default replicated_rule. I am not sure what i am doing wrong but the pool kept on showing INACTIVE so i cannot create the "CephFS File Systems" and therefore cannot create cifs storage. But when i switch back to default replicated_rule it suddenly work even without changing the tree below back its original format.
For example when i use this rule:
replicated-chassis-and-all-below
{ id 5 type replicated step take default step chooseleaf firstn 0 type chassis step chooseleaf firstn 0 type host step emit }with bucket tree or ceph osd tree:
default
Pools:
Name Type Usage PGs Autoscale PGs Size Min Size Rule Name Used Space Available Space Active OSDs Status Action .mgr replicated mgr off 1 3 2 replicated_rule 2.65 MB 474.34 GB 3 Active cephfs_all_lv_data replicated cephfs on 177 2 1 replicated-chassis-and-all-below 0 Bytes 711.51 GB 6 Active cephfs_all_lv_metadata replicated cephfs on 192 2 1 replicated-chassis-and-all-below 0 Bytes 711.51 GB 6 Inactive
I am having problem creating anything beside the default replicated_rule. I am not sure what i am doing wrong but the pool kept on showing INACTIVE so i cannot create the "CephFS File Systems" and therefore cannot create cifs storage. But when i switch back to default replicated_rule it suddenly work even without changing the tree below back its original format.
For example when i use this rule:
replicated-chassis-and-all-below
{
id 5
type replicated
step take default
step chooseleaf firstn 0 type chassis
step chooseleaf firstn 0 type host
step emit
}
with bucket tree or ceph osd tree:
default
Pools:
Name Type Usage PGs Autoscale PGs Size Min Size Rule Name Used Space Available Space Active OSDs Status Action .mgr replicated mgr off 1 3 2 replicated_rule 2.65 MB 474.34 GB 3 Active cephfs_all_lv_data replicated cephfs on 177 2 1 replicated-chassis-and-all-below 0 Bytes 711.51 GB 6 Active cephfs_all_lv_metadata replicated cephfs on 192 2 1 replicated-chassis-and-all-below 0 Bytes 711.51 GB 6 Inactive
admin
2,930 Posts
Quote from admin on May 28, 2024, 10:51 amthe crush rule looks incorrect, try
step take default class ssd
step chooseleaf firstn 0 type chassis
step emit
the crush rule looks incorrect, try
step take default class ssd
step chooseleaf firstn 0 type chassis
step emit
the.only.chaos.lucifer
31 Posts
Quote from the.only.chaos.lucifer on May 31, 2024, 7:06 amThis it turn out like you said a issue with my script. Thanks I went and look at more example and barely scratching the surface in understanding the usage of it. But i at least figure how to to change the failure domain now thanks!
This it turn out like you said a issue with my script. Thanks I went and look at more example and barely scratching the surface in understanding the usage of it. But i at least figure how to to change the failure domain now thanks!