Shulou(Shulou.com)05/31 Report--

This article shows you how to solve the problem of java.io.IOException: Cannot obtain block length for LocatedBlock. The content is concise and easy to understand. It will definitely brighten your eyes. I hope you can get something through the detailed introduction of this article.

In the process of hadoop test cluster running job, it was found that some of them failed, including Cannot obtain block length for LocatedBlock, and this error was also reported when using hdfs dfs-cat ${file}. After reading the code, it was found that the file was not normally closed (flume was transferred to hdfs, it may be due to Namenode gc for a long time or switching or restart will leave a lot of files at the end of .tmp). To this end, use the hadoop command to display the files in the open state Then delete these files:

Hadoop fsck /-openforwrite | egrep-v'^\. + $'| egrep "MISSING | OPENFORWRITE" | grep-o "/ [^] *" | sed-e "s peg /" | xargs-i hadoop fs-rmr {}

Then retransmit these files to hdfs.

The above content is how to solve the problem of java.io.IOException: Cannot obtain block length for LocatedBlock. Have you learned any knowledge or skills? If you want to learn more skills or enrich your knowledge reserve, you are welcome to follow the industry information channel.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.