Shulou(Shulou.com)06/01 Report--

This article mainly shows you "Hadoop error reporting how to do", the content is easy to understand, clear, hope to help you solve doubts, the following let the editor lead you to study and learn "Hadoop error reporting how to do" this article.

JAVA_HOME is not set and could not be found

‍‍ obviously this is caused by not setting the JAVA_HOME environment variable. However, this error is still reported after the JAVA_HOME environment variable is set. The startup script cannot read this environment variable, look it up and solve it by adding export JAVA_HOME=/PATH/TO/JDK to $HADOOP_HOME/libexec/hadoop-config.sh. ‍

‍

Why the script can't read the JAVA_HOME environment variable set by the system, you still need to study the startup script to find out why. ‍

WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... Using builtin-java classes where applicable

Execute. / start-all.sh start hadoop Cluster Times WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... Using builtin-java classes where applicable

This error is reported when the local library does not exist or when the local library is inconsistent with the current operating system version. The hadoop version downloaded from hadoop's official website contains 32-bit native library files. If deployed on a 64bit system, it needs to be recompiled to resolve it. In addition, this error is still reported after recompiling 64-bit native library files. Execute bash-x start-all.sh to track the cause of the error. When you start, look for the native library file in the $HADOOP_HOME/lib directory, while the native library file is stored in the $HADOOP_HOME/lib/native directory by default. Temporarily copy the library file to the lib directory to solve this problem. However, the correct solution should be to define the path of the native library file, and the location of the specific definition has not been found. Make it up when you find it.

Org.apache.hadoop.yarn.exceptions.YarnException: Unauthorized request to start container.

Cause: namenode, datanode node host system time inconsistency

Solution: configure the ntp service and synchronize the clock regularly to keep the server time of each node in the cluster consistent.

The above is all the contents of the article "how to report an error in Hadoop". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.