Shulou(Shulou.com)06/01 Report--

This article is about how to import and export Hive and es data. The editor thinks it is very practical, so share it with you as a reference and follow the editor to have a look.

1. Add two jar packages to Hive's hive.aux.jars.path directory org.elasticsearch elasticsearch-hadoop 6.6.2 commons-httpclient commons-httpclient 3.1 external tables create external table charge_current_frequency_es (province string, vehicleType string, vin string, chargeType string) that create es indexes in hive ChargeCurrentFrequency array, statis_time string) STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler' location' / warningplatform.db/ads/charge_current_frequency_es' TBLPROPERTIES ('es.resource' =' charge_current_frequency/charge_current_frequency', 'es.mapping.names' =' province:province,vehicleType:vehicleType,vin:vin,chargeType:chargeType,chargeCurrentFrequency:chargeCurrentFrequency,statis_time:time' 'es.nodes' =' 192.168.11.29', 'es.port' =' 9200')

Specify the matching rules for hive and es fields

The string in hive can be written to the date type of es, and the format can be yyyy-MM-dd HH:mm:ss, but when hive reads es data, it cannot receive fields of date type and format yyyy-MM-dd HH:mm:ss in es with string type.

The insertion and query of hive is the insertion and query of es index.

3. Type matching

Thank you for reading! This is the end of this article on "how to import and export Hive and es data". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, you can share it out for more people to see!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.