Forums

Home / Forums

You need to log in to create posts and topics. Login · Register

Error adding 3rd node - Error building Consul cluster.


nutt
12 Posts
May 3, 2022, 8:08 pm

Error adding 3rd node and not sure what is wrong. I've reinstalled the 3rd node just to make sure and still same issues joining the cluster. I've downloaded the logs and everything seems to be correct with the IP's and subnets.

The only thing that is strange is the 24drives are not showing up on step 7, however, all drives show up in the Perc controller. Not sure if there is a error building the cluster because of no extra storage being preset? If so does each drive somehow need to be presented or formatted beforehand?

I've read through this post - https://www.petasan.org/forums/?view=thread&id=28&part=3 and alot seems to be related to networking, it seems all of my hosts can ping and talk to each other.

System Specs X3

Dell R720xd
Dual Xeon E5-3667 3.3GHz 8cores
512GB Memory
OS - 2 300GB SSDs Raid 1
6 - 1.6TB SSDs
18 - 900GB 10K HDDs
2 Fusion Cards (Not sure if compatible or usable with PetaSAN but they are installed)
2 - Dual 10GB Nics

Management is on 1GB Nic, Eth0
Backend is on 10GB, Eth4 (Using Fiber with SFPs and mtu set to 9000, also getting warning 'Unqualified SFP+ module detected, Port 0 from JDSU part number')

I'll send the Cluster Status file in an email for your review.

Thanks!

#1

nutt
12 Posts
May 4, 2022, 4:28 pm

So I went ahead and rebuilt nodes 1 and 2 and believe the issue has to do with the cluster password having special characters. Not sure if this has been tested but in the past on different applications within Linux special characters have caused problems. Anyways the cluster is now finished and I was able to login to the dashboard but I'm still having issues with the other drives being detected.

 

So I'm needing some help now trying to figure out how to get the drives to show up within the dashboard? Any type of script I can run to get PetaSAN to see these?

 

Thanks!

#2

admin
2,930 Posts
May 5, 2022, 2:44 pm

i doubt the initial issue was password related, you would have received a ui error specific to incorrect password.

For drives not detected : do you see the drives in

ls /sys/block

Do the drives get seen if you try any other OS such as Windows ?

#3

nutt
12 Posts
May 5, 2022, 7:11 pm

Looks like I needed to reflash the firmware on the Perc Card to be in IT mode. Pretty good article for anyone else wondering - https://fohdeesha.com/docs/perc.html

Anyways they are now showing up, thanks you! @Admin what would your recommendation be for Journal, Cache, OSD? Trying to get the largest volume with the best performance.

Dell R720xd
Dual Xeon E5-3667 3.3GHz 8cores
512GB Memory
OS - 1 300GB SSD
6 - 1.6TB SSDs
18 - 900GB 10K HDDs
2 Fusion Cards (Not sure if compatible or usable with PetaSAN but they are installed)
2 - Dual 10GB Nics

Thanks for the help

Last edited on May 5, 2022, 7:12 pm by nutt · #4