Shulou(Shulou.com)06/01 Report--

This article mainly explains "what problems should be paid attention to in ceph cluster configuration", interested friends may wish to take a look. The method introduced in this paper is simple, fast and practical. Let's let the editor take you to learn what problems you need to pay attention to in ceph cluster configuration.

Ceph deployment environment:

Hardware environment. 4 4U servers. The server configuration information is as follows:

1) CPU is Intel Xeon E5-2650 (32 cores)

2) memory size is 128GB

3) there are 35 HDD in the server, of which one HDD is used to install the operating system and the other 34 HDD are used for ceph storage

4) the network adopts public/cluster type network.

Software environment.

1) operating system: all 4 servers use ubuntu-14.04.1

2) ceph software version: the latest version of Firefly (0.80.11)

Problems that have occurred:

When starting the cluster, there are a large number of non-active+clean PGs in the ceph cluster and the osdmap is unstable, and the state of the osd switches back and forth between up and doan. As a result, the ceph cluster cannot be available for a long time.

The cause of the problem:

Due to the large number of osd started on one host (34 OSDs), the number of threads has far exceeded the system maximum number of threads configured by the linux kernel when the ceph cluster is started and when the ceph cluster is in recovery and rebalance.

Solution:

The default maximum number of threads for the linux kernel is 32768, which can be seen with the command # sysctl kernel.pid_max. The maximum number of threads is for desktop systems, but for servers and clustered systems, this value is not enough. Therefore, it is best to set this value to the maximum, that is: # sysctl-w kernel.pid_max=4194303. Or modify the / etc/sysctl.conf file to fill in kernel.pid_max = 4194303 at the end of the / etc/sysctl.conf file.

At this point, I believe that everyone on the "ceph cluster configuration need to pay attention to what issues" have a deeper understanding, might as well to the actual operation of it! Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.