Shulou(Shulou.com)06/01 Report--

This article mainly introduces "the method of enabling local mode in hive". In the daily operation, I believe many people have doubts about the method of enabling local mode in hive. The editor has consulted all kinds of materials and sorted out simple and easy-to-use operation methods. I hope it will be helpful to answer the doubts about "how to enable local mode in hive". Next, please follow the editor to study!

Hive enables local mode and is mainly used to deal with situations where the amount of data is relatively small.

Hive.exec.mode.local.auto=true

Hive.exec.mode.local.auto.inputbytes.max=50000000

Hive.exec.mode.local.auto.tasks.max=10

Hive.exec.mode.local.auto.input.files.max=50

Hive.exec.mode.local.auto.tasks.max and hive.exec.mode.local.auto.inputbytes.max, the default values are 4 and 128MB, respectively, that is, local mr mode is enabled when the number of files processed by map does not exceed 4 and the total size is less than 128MB.

At this point, the study on "hive's way to enable local mode" is over. I hope to be able to solve your doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.