Shulou(Shulou.com)05/31 Report--

This article mainly shows you "how hadoop solves the problem of copying data between different versions of discp", which is easy to understand and well-organized. I hope it can help you solve your doubts. Let me lead you to study and learn this article "hadoop how to solve the problem of copying data between different versions of discp".

Checksum mismatch problems encountered in hadoop discp

Solution method

Universal solution on the Internet

In hdfs-site.xml

Set the dfs.checksum.type property to CRC32

The above errors are still reported in the course of use.

After inspection, refer to http://blog.sina.com.cn/s/blog_7ed002b30101kk08.html

Use the-update-skipcrccheck option.

Hadoop distcp-update-skipcrccheck h ftp://host:50070/ file / path

The above is all the contents of the article "how hadoop solves the problem of copying data between different versions of discp". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.