Shulou(Shulou.com)06/02 Report--

This article introduces the knowledge of "how to specify the output level of Hadoop command line log". In the operation of actual cases, many people will encounter such a dilemma, so let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something!

1. Purpose of document writing

When using the client command of Hadoop, when the command executes the error, you need to use the DEBUG log to analyze the cause of the error. On CM, set the Gateway role log output level of HDFS to DEBUG, but the command hadoop command does not output the DEBUG log.

After the above method is set, the command line executes the hadoop command and cannot output the Debug log

Test environment description

1.CM5.15.0 and CDH5.14.2

two。 Command to set the output log level

Set the log output level of the hadoop command by setting the environment variable of HADOOP_ROOT_LOGGER on the command line, as follows:

[root@cdh03 ~] # export HADOOP_ROOT_LOGGER=DEBUG,console

[root@cdh03 ~] # hadoop fs-ls /

(can slide left and right)

You can see that you have a detailed DEBUG log output.

Note: before Cloudera Manager5.3, you can do this in the following ways

Export HADOOP_CLIENT_OPTS= "- Droot.logger=DEBUG,console"

Hadoop fs-ls /

This is the end of "how to specify the Hadoop command line log output level". Thank you for reading. If you want to know more about the industry, you can follow the website, the editor will output more high-quality practical articles for you!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.