Shulou(Shulou.com)06/01 Report--

Editor to share with you how to create hive partition table, I believe most people do not know much about it, so share this article for your reference, I hope you can learn a lot after reading this article, let's go to know it!

HIVE organizes tables into "partitions", which is a mechanism for roughly dividing tables according to the values of "partition columns". Using partitions can speed up the query of data fragments.

Tables or partitions can be further divided into buckets. It provides an additional structure for the data for more efficient query processing.

Create a partition table

CREATE TABLE bills_detail (msgid STRING,time STRING,spid STRING,opid STRING,spcode STRING,result STRING) PARTITIONED BY (dt STRING,type STRING) ROW FORMAT DELIMITEDFIELDS TERMINATED BY'\ t'

Table structure

Hive > desc bills_detail OKmsgid string time string spid string opid string spcode String result string dt string type string # Partition Information # col_name data_type comment dt string type string

two。 Import data

Load data local inpath'/ home/hive/201601notify.txt' into table bills_detail partition (dt='201601',type='notifySmsDeliveryReceipt'); load data local inpath'/ home/hive/201601sendsms.txt' into table bills_detail partition (dt='201601',type='sendSms')

Actual path of data in hive:

/ apps/hive/warehouse/bills_detail/dt=201601/type=sendSms/201601sendsms.txt

3. Query data

Hive > select * from bills_detail where dt='201601' and type='sendSms' limit 10

These are all the contents of the article "how to create hive Partition tables". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.