Shulou(Shulou.com)06/01 Report--

This article mainly introduces how to choose the input format in Hive, has a certain reference value, interested friends can refer to, I hope you can learn a lot after reading this article, the following let Xiaobian take you to understand.

Input format selection

Hive supports TEXTFILE, SEQUENCEFILE, AVRO, RCFILE, ORC, and PARQUET file formats, which can be specified in two ways:

CREATE TABLE... STORE AS: specify the file format when creating the table. The default is TEXTFILEALTER TABLE. [PARTITION partition_spec] SET FILEFORMAT: modify the file format of a specific table

If the file storage format is not specified, the format set by the parameter hive.default.fileformat is used by default.

If the data is stored in a small file that is smaller than the block size, you can use the SEQUENCE file format. If you want to store data in an optimized way that reduces storage space and improves performance, you can use the ORC file format, which is useful when there is too much data nested in the column. Therefore, you need to determine the input file format based on the data you have.

Thank you for reading this article carefully. I hope the article "how to choose the input format in Hive" shared by the editor will be helpful to everyone. At the same time, I also hope that you will support and pay attention to the industry information channel. More related knowledge is waiting for you to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.