Space calculation and expected performance
rbetancor
1 Post
October 31, 2018, 7:59 pmQuote from rbetancor on October 31, 2018, 7:59 pmHi all, I'm new to PetaSAN and by now just doing some researching and lab-testing, but I'm unable to find a way to calculate the total storage that will be available after a creation of a new disc to be exported throught the iSCSI to a VMWare cluster of ESXi nodes
I suppose there will be lot of small things that change that number, but for a lab of 3 PetaSAN nodes with:
- 2x Xeon E5-2620 v1 6 Core CPU running at 2Ghz
- 32Gb of RAM
- 1x 120GB SSD for system
- 1x 1Tb NVMe for journals
- 12x WD 6TB Purple discs
- 1x LSI 9211-8i
- 2x x520-da2 Dual 10Gb SFP+ nics
- 2x 1Gb nics
- Server chasis have space for 36 3.5" SAS/SATA HDDs
Per PetaSAN node, with the standar/default PetaSAN install values, how much space could I expect to be seen by the ESXi nodes (3 nodes) ?
Apart from using all SSD or NVMe discs, which is out of scope for this lab escenario, is there any other hardware component that should be improved? ... the VMWare Cluster runs 30 VM's, most of then low IOPS demanding, but high space demanding ones (ony two of the VM's are high IOPS, an Oracle VM and a Documentum one)
Thanks in advace and best regards.
Hi all, I'm new to PetaSAN and by now just doing some researching and lab-testing, but I'm unable to find a way to calculate the total storage that will be available after a creation of a new disc to be exported throught the iSCSI to a VMWare cluster of ESXi nodes
I suppose there will be lot of small things that change that number, but for a lab of 3 PetaSAN nodes with:
- 2x Xeon E5-2620 v1 6 Core CPU running at 2Ghz
- 32Gb of RAM
- 1x 120GB SSD for system
- 1x 1Tb NVMe for journals
- 12x WD 6TB Purple discs
- 1x LSI 9211-8i
- 2x x520-da2 Dual 10Gb SFP+ nics
- 2x 1Gb nics
- Server chasis have space for 36 3.5" SAS/SATA HDDs
Per PetaSAN node, with the standar/default PetaSAN install values, how much space could I expect to be seen by the ESXi nodes (3 nodes) ?
Apart from using all SSD or NVMe discs, which is out of scope for this lab escenario, is there any other hardware component that should be improved? ... the VMWare Cluster runs 30 VM's, most of then low IOPS demanding, but high space demanding ones (ony two of the VM's are high IOPS, an Oracle VM and a Documentum one)
Thanks in advace and best regards.
admin
2,930 Posts
October 31, 2018, 10:35 pmQuote from admin on October 31, 2018, 10:35 pmYour raw storage is = 12 x 6TB x 3 servers = 216 TB
If you create pool(s) with 2x replicas, this will give you 108 TB client/ESXi storage. if you create pools with 3x replicas you get 72 TB. You can also enable inline compression which will give you higher storage capacity.
PetaSAN v 2.2 due in 1 week, will support erasure coded pools giving you better storage efficiency than replicated pools, but is slower in small block sizes (it is ideal for backups) + requires a min of 5 nodes.
Note: when calculating available storage, we use the total physical disks. iSCSI disks are thin provisioned, so it is possible to create iSCSI disks whose total capacity exceeds physical storage available, and keep adding physical storage as your iSCSI disks fill up.
The configuration looks good as is. If you can beef up the LSI 9211 to a controller with write cache, it will speed write iops by 3-4x. Also you may get better performance by bumping the drive count to 16 or 20 per node.
Your raw storage is = 12 x 6TB x 3 servers = 216 TB
If you create pool(s) with 2x replicas, this will give you 108 TB client/ESXi storage. if you create pools with 3x replicas you get 72 TB. You can also enable inline compression which will give you higher storage capacity.
PetaSAN v 2.2 due in 1 week, will support erasure coded pools giving you better storage efficiency than replicated pools, but is slower in small block sizes (it is ideal for backups) + requires a min of 5 nodes.
Note: when calculating available storage, we use the total physical disks. iSCSI disks are thin provisioned, so it is possible to create iSCSI disks whose total capacity exceeds physical storage available, and keep adding physical storage as your iSCSI disks fill up.
The configuration looks good as is. If you can beef up the LSI 9211 to a controller with write cache, it will speed write iops by 3-4x. Also you may get better performance by bumping the drive count to 16 or 20 per node.
Last edited on October 31, 2018, 10:40 pm by admin · #2
Ste
125 Posts
November 6, 2018, 4:50 pmQuote from Ste on November 6, 2018, 4:50 pm
Quote from rbetancor on October 31, 2018, 7:59 pm
2x Xeon E5-2620 v1 6 Core CPU running at 2Ghz
Server chasis have space for 36 3.5" SAS/SATA HDDs
Hi rbetancor,
please can you tell me which server chassis will you use ? Could it fit ATX moterboard (I mean the commercial ones, like an ASUS X370 for example) ? And what motherboard do you have in mind for your nodes ?
Thanks.
Quote from rbetancor on October 31, 2018, 7:59 pm
2x Xeon E5-2620 v1 6 Core CPU running at 2Ghz
Server chasis have space for 36 3.5" SAS/SATA HDDs
Hi rbetancor,
please can you tell me which server chassis will you use ? Could it fit ATX moterboard (I mean the commercial ones, like an ASUS X370 for example) ? And what motherboard do you have in mind for your nodes ?
Thanks.
Space calculation and expected performance
rbetancor
1 Post
Quote from rbetancor on October 31, 2018, 7:59 pmHi all, I'm new to PetaSAN and by now just doing some researching and lab-testing, but I'm unable to find a way to calculate the total storage that will be available after a creation of a new disc to be exported throught the iSCSI to a VMWare cluster of ESXi nodes
I suppose there will be lot of small things that change that number, but for a lab of 3 PetaSAN nodes with:
- 2x Xeon E5-2620 v1 6 Core CPU running at 2Ghz
- 32Gb of RAM
- 1x 120GB SSD for system
- 1x 1Tb NVMe for journals
- 12x WD 6TB Purple discs
- 1x LSI 9211-8i
- 2x x520-da2 Dual 10Gb SFP+ nics
- 2x 1Gb nics
- Server chasis have space for 36 3.5" SAS/SATA HDDs
Per PetaSAN node, with the standar/default PetaSAN install values, how much space could I expect to be seen by the ESXi nodes (3 nodes) ?
Apart from using all SSD or NVMe discs, which is out of scope for this lab escenario, is there any other hardware component that should be improved? ... the VMWare Cluster runs 30 VM's, most of then low IOPS demanding, but high space demanding ones (ony two of the VM's are high IOPS, an Oracle VM and a Documentum one)
Thanks in advace and best regards.
Hi all, I'm new to PetaSAN and by now just doing some researching and lab-testing, but I'm unable to find a way to calculate the total storage that will be available after a creation of a new disc to be exported throught the iSCSI to a VMWare cluster of ESXi nodes
I suppose there will be lot of small things that change that number, but for a lab of 3 PetaSAN nodes with:
- 2x Xeon E5-2620 v1 6 Core CPU running at 2Ghz
- 32Gb of RAM
- 1x 120GB SSD for system
- 1x 1Tb NVMe for journals
- 12x WD 6TB Purple discs
- 1x LSI 9211-8i
- 2x x520-da2 Dual 10Gb SFP+ nics
- 2x 1Gb nics
- Server chasis have space for 36 3.5" SAS/SATA HDDs
Per PetaSAN node, with the standar/default PetaSAN install values, how much space could I expect to be seen by the ESXi nodes (3 nodes) ?
Apart from using all SSD or NVMe discs, which is out of scope for this lab escenario, is there any other hardware component that should be improved? ... the VMWare Cluster runs 30 VM's, most of then low IOPS demanding, but high space demanding ones (ony two of the VM's are high IOPS, an Oracle VM and a Documentum one)
Thanks in advace and best regards.
admin
2,930 Posts
Quote from admin on October 31, 2018, 10:35 pmYour raw storage is = 12 x 6TB x 3 servers = 216 TB
If you create pool(s) with 2x replicas, this will give you 108 TB client/ESXi storage. if you create pools with 3x replicas you get 72 TB. You can also enable inline compression which will give you higher storage capacity.
PetaSAN v 2.2 due in 1 week, will support erasure coded pools giving you better storage efficiency than replicated pools, but is slower in small block sizes (it is ideal for backups) + requires a min of 5 nodes.
Note: when calculating available storage, we use the total physical disks. iSCSI disks are thin provisioned, so it is possible to create iSCSI disks whose total capacity exceeds physical storage available, and keep adding physical storage as your iSCSI disks fill up.
The configuration looks good as is. If you can beef up the LSI 9211 to a controller with write cache, it will speed write iops by 3-4x. Also you may get better performance by bumping the drive count to 16 or 20 per node.
Your raw storage is = 12 x 6TB x 3 servers = 216 TB
If you create pool(s) with 2x replicas, this will give you 108 TB client/ESXi storage. if you create pools with 3x replicas you get 72 TB. You can also enable inline compression which will give you higher storage capacity.
PetaSAN v 2.2 due in 1 week, will support erasure coded pools giving you better storage efficiency than replicated pools, but is slower in small block sizes (it is ideal for backups) + requires a min of 5 nodes.
Note: when calculating available storage, we use the total physical disks. iSCSI disks are thin provisioned, so it is possible to create iSCSI disks whose total capacity exceeds physical storage available, and keep adding physical storage as your iSCSI disks fill up.
The configuration looks good as is. If you can beef up the LSI 9211 to a controller with write cache, it will speed write iops by 3-4x. Also you may get better performance by bumping the drive count to 16 or 20 per node.
Ste
125 Posts
Quote from Ste on November 6, 2018, 4:50 pmQuote from rbetancor on October 31, 2018, 7:59 pm2x Xeon E5-2620 v1 6 Core CPU running at 2Ghz
Server chasis have space for 36 3.5" SAS/SATA HDDs
Hi rbetancor,
please can you tell me which server chassis will you use ? Could it fit ATX moterboard (I mean the commercial ones, like an ASUS X370 for example) ? And what motherboard do you have in mind for your nodes ?
Thanks.
Quote from rbetancor on October 31, 2018, 7:59 pm2x Xeon E5-2620 v1 6 Core CPU running at 2Ghz
Server chasis have space for 36 3.5" SAS/SATA HDDs
Hi rbetancor,
please can you tell me which server chassis will you use ? Could it fit ATX moterboard (I mean the commercial ones, like an ASUS X370 for example) ? And what motherboard do you have in mind for your nodes ?
Thanks.