Shulou(Shulou.com)06/01 Report--

This article mainly shows you "hadoop cdh5.1 on the configuration requirements of the centos system itself is what", the content is easy to understand, clear, hope to help you solve your doubts, the following let the editor lead you to study and learn "what is the configuration requirements of the centos system itself by hadoop cdh5.1" this article.

When running a task, nodemanager may report the following error

Java.lang.OutOfMemoryError: unable to create new native thread

Solution: configure linux itself.

Echo "100000" > / proc/sys/kernel/pid_max

Echo "200000" > / proc/sys/vm/max_map_count

For centos6.5, append the following files

Vi / etc/security/limits.d/90-nproc.conf

* soft nproc unlimited

Root soft nproc unlimited

Add the following

/ etc/security/limits.conf

* soft nofile 65535

* hard nofile 65535

* hard nproc 100000

* soft nproc 100000

Ulimit-a needs to be configured as follows:

For example, open files

Max user processes

/ home/game/.bash_profile the last line

Ulimit-u 65535

[@ sbin] $ulimit-a

Core file size (blocks,-c) 0

Data seg size (kbytes,-d) unlimited

Scheduling priority (- e) 0

File size (blocks,-f) unlimited

Pending signals (- I) 514847

Max locked memory (kbytes,-l) 64

Max memory size (kbytes,-m) unlimited

Open files (- n) 65535

Pipe size (512 bytes,-p) 8

POSIX message queues (bytes,-Q) 819200

Real-time priority (- r) 0

Stack size (kbytes,-s) 10240

Cpu time (seconds,-t) unlimited

Max user processes (- u) 65535

Virtual memory (kbytes,-v) unlimited

File locks (- x) unlimited

These are all the contents of the article "what are the configuration requirements of hadoop cdh5.1 for the centos system itself?" Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.