Forums

Home / Forums

You need to log in to create posts and topics. Login · Register

Multiple Pools ( Only 10x SSD // Only 10x SAS HDD + 2 SSD journal) each nodes

I Have

3 Nodes with each

2x E52620 V3 - 64GB DDR4

2x Dual 40GBE MLX 354A Cards

10x SAS SSDs & 10x SAS HDDs 10x + 2 SSD journal

 

How can i configure 2 Sepperate Pools 1x for fast VM & 1x slow Data pool

 

Best Regards

use the built in by-host-ssd and by-host-hdd rule templates and create the fast pool using the first and the slow pool the second. use default size of 3 and assign 2048 pgs per pool, delete the default pool if not used.

THX it works 🙂

the ssd pool is 10k iops write slower than the default pool with 1024 PGs

Best Regards

If you give more detail i will try to help:

What model of ssd do you use ?

What are the read/write iops for both the default and ssd pools ?

How many PG for both pools ?

Can you test with 2 client nodes, 64 threads each for 5 min.

What are the resource load ? if possible post screen shots of benchmark page as well as node stats for cpu% and disk%

per node:   SSD: 4x PM1633a  960GB

SSD: 2x PM1633a  960GB Journal

SSD: 8x Toshiba THNSN81Q92CSE

HDD: 10x HGST HUC101212CSS600 600GB 10K
Ceph total
Pool 1 -- SSDs  PM1633a & THNSN81Q92CSE
Pool 2 --  SAS HDDs + SSD journal PM1633a

 

As soon as I have time again I will benchmark with client nodes

 

best regards

Also if you can run the raw disk test from the blue node console, they write data on raw devices so they need to run on disks before adding as OSDs. or you can delete an OSD to run the tests.

For the SSD pool, typically you would not add another SSD as a journal, you would normally not add a journal or use a faster nvme device. unless the SSD for the OSD is very slow. The raw tests will help to know.

yes ssd pool = 4x pm1633a + 8x THNSN81Q92CSE witout journal