100% VM reported cpu (cause is default idle state disable?)
samcan
2 Posts
August 24, 2023, 6:52 pmQuote from samcan on August 24, 2023, 6:52 pmhi, trying to use petasan alongside other genral VMs in my home lab systems but its causing problems with esxi i believe the cause of this can be seen during petasans boot up where it mentions disabling idle states. is this behaviour expected?( as its causing unresonable high power draw) SSH into the system and running htop shows no cpu usage at all.
edit: system info:
dual socket E5 2690 V4s
128GB ram
hi, trying to use petasan alongside other genral VMs in my home lab systems but its causing problems with esxi i believe the cause of this can be seen during petasans boot up where it mentions disabling idle states. is this behaviour expected?( as its causing unresonable high power draw) SSH into the system and running htop shows no cpu usage at all.
edit: system info:
dual socket E5 2690 V4s
128GB ram
Last edited on August 24, 2023, 6:54 pm by samcan · #1
admin
2,930 Posts
August 25, 2023, 7:40 pmQuote from admin on August 25, 2023, 7:40 pmWe do several performance tweaks such as cpu idle states, max frequency and set cpu governor to performance. these do make a difference and enhance total performance.
we do not recommend running PetaSAN in vms (this is true for any Ceph system). it is also possible the hypervisor has issue with the cpu settings, you may edit these if you need to run vms and feel the settings give you a problem.
We do several performance tweaks such as cpu idle states, max frequency and set cpu governor to performance. these do make a difference and enhance total performance.
we do not recommend running PetaSAN in vms (this is true for any Ceph system). it is also possible the hypervisor has issue with the cpu settings, you may edit these if you need to run vms and feel the settings give you a problem.
samcan
2 Posts
August 27, 2023, 1:09 amQuote from samcan on August 27, 2023, 1:09 am
Quote from admin on August 25, 2023, 7:40 pm
We do several performance tweaks such as cpu idle states, max frequency and set cpu governor to performance. these do make a difference and enhance total performance.
we do not recommend running PetaSAN in vms (this is true for any Ceph system). it is also possible the hypervisor has issue with the cpu settings, you may edit these if you need to run vms and feel the settings give you a problem.
i tried polling power draws from dells idrac and that was giving me around a 230w power draw increase
i cant currently run this on bare metal as its in a home environment and i would be killed for the cost of running 3 additional servers nevermind noise.
if theres any specfic parts that are changed i could get pointers too for reading up on that would be greatly appreciated as i am more of the networking guy that deals with broken windows computers. i just found this to be a really cool filesystem that i wanted to slowly dip into playing with
Quote from admin on August 25, 2023, 7:40 pm
We do several performance tweaks such as cpu idle states, max frequency and set cpu governor to performance. these do make a difference and enhance total performance.
we do not recommend running PetaSAN in vms (this is true for any Ceph system). it is also possible the hypervisor has issue with the cpu settings, you may edit these if you need to run vms and feel the settings give you a problem.
i tried polling power draws from dells idrac and that was giving me around a 230w power draw increase
i cant currently run this on bare metal as its in a home environment and i would be killed for the cost of running 3 additional servers nevermind noise.
if theres any specfic parts that are changed i could get pointers too for reading up on that would be greatly appreciated as i am more of the networking guy that deals with broken windows computers. i just found this to be a really cool filesystem that i wanted to slowly dip into playing with
fredohouse
13 Posts
September 15, 2023, 1:51 pmQuote from fredohouse on September 15, 2023, 1:51 pmhello teams,
I have 3 nodes cluster on vmware 7.0.3. The product working very fine before I decide to update to 3.2.1. I have the same problem : the cpu is working to 100%. I understand that is not the best to run petasan in vm, but before it's working fine.
It seeams that you would tell us than the petasan product is not compatible to do like vsan ???
Best regards,
Frédéric MASSON.
hello teams,
I have 3 nodes cluster on vmware 7.0.3. The product working very fine before I decide to update to 3.2.1. I have the same problem : the cpu is working to 100%. I understand that is not the best to run petasan in vm, but before it's working fine.
It seeams that you would tell us than the petasan product is not compatible to do like vsan ???
Best regards,
Frédéric MASSON.
admin
2,930 Posts
September 19, 2023, 7:27 pmQuote from admin on September 19, 2023, 7:27 pmExcuse the late response, things have been very busy.
We do performance tuning to get max cpu performance and disable wait states, maybe this is causing issues in your vmware setup. You can try to delete the peformance tunings:
rm /opt/petasan/scripts/tuning/tuning.sh
rm /etc/rc.local
and reboot and see if it helps. Some things worth mentioning:
These cpu settings are the number 1 peformance recommendation for ceph
To label things correctly, if vmware cannot handle these then it is a vmware bug. Our devs use VirtualBox and we do not see this issue.
Further note: version 3.3 will include adjustable tuning profiles, so this would be done from ui
Excuse the late response, things have been very busy.
We do performance tuning to get max cpu performance and disable wait states, maybe this is causing issues in your vmware setup. You can try to delete the peformance tunings:
rm /opt/petasan/scripts/tuning/tuning.sh
rm /etc/rc.local
and reboot and see if it helps. Some things worth mentioning:
These cpu settings are the number 1 peformance recommendation for ceph
To label things correctly, if vmware cannot handle these then it is a vmware bug. Our devs use VirtualBox and we do not see this issue.
Further note: version 3.3 will include adjustable tuning profiles, so this would be done from ui
Last edited on September 20, 2023, 7:59 am by admin · #5
fredohouse
13 Posts
November 1, 2023, 8:57 amQuote from fredohouse on November 1, 2023, 8:57 amExcuse the late response, things have been very busy, for me too... 🙂
Just settings the cpu number to 1 was sufficient.
Thanks a lot !
Have a nice day,
Excuse the late response, things have been very busy, for me too... 🙂
Just settings the cpu number to 1 was sufficient.
Thanks a lot !
Have a nice day,
the.only.chaos.lucifer
31 Posts
January 4, 2024, 5:13 amQuote from the.only.chaos.lucifer on January 4, 2024, 5:13 amThose code work like a charm now to test it in the VM. Thanks!!!
Those code work like a charm now to test it in the VM. Thanks!!!
100% VM reported cpu (cause is default idle state disable?)
samcan
2 Posts
Quote from samcan on August 24, 2023, 6:52 pmhi, trying to use petasan alongside other genral VMs in my home lab systems but its causing problems with esxi i believe the cause of this can be seen during petasans boot up where it mentions disabling idle states. is this behaviour expected?( as its causing unresonable high power draw) SSH into the system and running htop shows no cpu usage at all.
edit: system info:
dual socket E5 2690 V4s
128GB ram
hi, trying to use petasan alongside other genral VMs in my home lab systems but its causing problems with esxi i believe the cause of this can be seen during petasans boot up where it mentions disabling idle states. is this behaviour expected?( as its causing unresonable high power draw) SSH into the system and running htop shows no cpu usage at all.
edit: system info:
dual socket E5 2690 V4s
128GB ram
admin
2,930 Posts
Quote from admin on August 25, 2023, 7:40 pmWe do several performance tweaks such as cpu idle states, max frequency and set cpu governor to performance. these do make a difference and enhance total performance.
we do not recommend running PetaSAN in vms (this is true for any Ceph system). it is also possible the hypervisor has issue with the cpu settings, you may edit these if you need to run vms and feel the settings give you a problem.
We do several performance tweaks such as cpu idle states, max frequency and set cpu governor to performance. these do make a difference and enhance total performance.
we do not recommend running PetaSAN in vms (this is true for any Ceph system). it is also possible the hypervisor has issue with the cpu settings, you may edit these if you need to run vms and feel the settings give you a problem.
samcan
2 Posts
Quote from samcan on August 27, 2023, 1:09 amQuote from admin on August 25, 2023, 7:40 pmWe do several performance tweaks such as cpu idle states, max frequency and set cpu governor to performance. these do make a difference and enhance total performance.
we do not recommend running PetaSAN in vms (this is true for any Ceph system). it is also possible the hypervisor has issue with the cpu settings, you may edit these if you need to run vms and feel the settings give you a problem.
i tried polling power draws from dells idrac and that was giving me around a 230w power draw increase
i cant currently run this on bare metal as its in a home environment and i would be killed for the cost of running 3 additional servers nevermind noise.
if theres any specfic parts that are changed i could get pointers too for reading up on that would be greatly appreciated as i am more of the networking guy that deals with broken windows computers. i just found this to be a really cool filesystem that i wanted to slowly dip into playing with
Quote from admin on August 25, 2023, 7:40 pmWe do several performance tweaks such as cpu idle states, max frequency and set cpu governor to performance. these do make a difference and enhance total performance.
we do not recommend running PetaSAN in vms (this is true for any Ceph system). it is also possible the hypervisor has issue with the cpu settings, you may edit these if you need to run vms and feel the settings give you a problem.
i tried polling power draws from dells idrac and that was giving me around a 230w power draw increase
i cant currently run this on bare metal as its in a home environment and i would be killed for the cost of running 3 additional servers nevermind noise.
if theres any specfic parts that are changed i could get pointers too for reading up on that would be greatly appreciated as i am more of the networking guy that deals with broken windows computers. i just found this to be a really cool filesystem that i wanted to slowly dip into playing with
fredohouse
13 Posts
Quote from fredohouse on September 15, 2023, 1:51 pmhello teams,
I have 3 nodes cluster on vmware 7.0.3. The product working very fine before I decide to update to 3.2.1. I have the same problem : the cpu is working to 100%. I understand that is not the best to run petasan in vm, but before it's working fine.
It seeams that you would tell us than the petasan product is not compatible to do like vsan ???
Best regards,
Frédéric MASSON.
hello teams,
I have 3 nodes cluster on vmware 7.0.3. The product working very fine before I decide to update to 3.2.1. I have the same problem : the cpu is working to 100%. I understand that is not the best to run petasan in vm, but before it's working fine.
It seeams that you would tell us than the petasan product is not compatible to do like vsan ???
Best regards,
Frédéric MASSON.
admin
2,930 Posts
Quote from admin on September 19, 2023, 7:27 pmExcuse the late response, things have been very busy.
We do performance tuning to get max cpu performance and disable wait states, maybe this is causing issues in your vmware setup. You can try to delete the peformance tunings:
rm /opt/petasan/scripts/tuning/tuning.sh
rm /etc/rc.localand reboot and see if it helps. Some things worth mentioning:
These cpu settings are the number 1 peformance recommendation for ceph
To label things correctly, if vmware cannot handle these then it is a vmware bug. Our devs use VirtualBox and we do not see this issue.
Further note: version 3.3 will include adjustable tuning profiles, so this would be done from ui
Excuse the late response, things have been very busy.
We do performance tuning to get max cpu performance and disable wait states, maybe this is causing issues in your vmware setup. You can try to delete the peformance tunings:
rm /opt/petasan/scripts/tuning/tuning.sh
rm /etc/rc.local
and reboot and see if it helps. Some things worth mentioning:
These cpu settings are the number 1 peformance recommendation for ceph
To label things correctly, if vmware cannot handle these then it is a vmware bug. Our devs use VirtualBox and we do not see this issue.
Further note: version 3.3 will include adjustable tuning profiles, so this would be done from ui
fredohouse
13 Posts
Quote from fredohouse on November 1, 2023, 8:57 amExcuse the late response, things have been very busy, for me too... 🙂
Just settings the cpu number to 1 was sufficient.
Thanks a lot !
Have a nice day,
Excuse the late response, things have been very busy, for me too... 🙂
Just settings the cpu number to 1 was sufficient.
Thanks a lot !
Have a nice day,
the.only.chaos.lucifer
31 Posts
Quote from the.only.chaos.lucifer on January 4, 2024, 5:13 amThose code work like a charm now to test it in the VM. Thanks!!!
Those code work like a charm now to test it in the VM. Thanks!!!