Shulou(Shulou.com)06/01 Report--

This article mainly introduces "what is the difference between the hdfs command line and the client". In the daily operation, I believe that many people have doubts about the difference between the hdfs command line and the client. The editor consulted all kinds of materials and sorted out simple and easy-to-use methods of operation. I hope it will be helpful to answer the questions of "what is the difference between the hdfs command line and the client?" Next, please follow the editor to study!

It has never been found that there is a big difference between the command line of principle hdfs and the use of client api.

Phenomenon:

Set dfs.block.size to 128m

With 28G data available, theoretically speaking, the total number of map should be 224, but the number of map has doubled to 448.

I can't find out why. Use the hdfs command line to check the block size of the file that needs to be mapreduce.

Then the block size of the file you put in with the hdfs fs-put command is 128m.

Finally, it is guessed that the client API did not read the *-site.xml on the server when constructing the Configuration object, and put the *-site.xml on the server under the root directory of the client to experiment, and sure enough, OK

At this point, the study on "what is the difference between the hdfs command line and the client" is over. I hope to be able to solve your doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.