Forums

Home / Forums

You need to log in to create posts and topics. Login · Register

Speed drops for large file transfers


maurice.itc
3 Posts
July 26, 2022, 12:56 pm

Hi,

I currently have a 3 node storage cluster running each with the following specs:

HPE ProLiant DL360 Gen9
2x Intel Xeon E5-2640 v4
64GB DDR4 2133MHz
HP 10Gb 560FLR-SFP+ 10Gbit
Smart HBA H241 in HBA Mode
HPE D3700 Drive Enclosure
12x HPE 1.2TB SAS HDD 10k 12g (All OSD)
4x HPE 800GB SATA SSD 6g (2x Journal, 2x Cache)
2x 128GB SATA SSD in RAID1 for System installation

Eth4 (10Gbit) for backend
Eth5 (10Gbit) for ISCSI1 and ISCSI2 on seperate VLAN

Speed in general is around 600/700 mbps, which is okay but on large files the speed drops after some time to around 30/70 mbps. It seems like a cache is being maxed out but i cannot find exactly where.
Installation is out of the box PetaSAN with ISCSI configured, also shows 'too few PGs per OSD (8 < min 10)' after a certain amount of time in the web interface while auto balancing is on and after that it drops even to lower PGs per OSD.

Image of the filetransfer: https://pasteboard.co/IKjTVxFW5Lir.png

Last edited on July 26, 2022, 1:14 pm by maurice.itc · #1