Shulou(Shulou.com)06/03 Report--

Test: using oozie, execute sqoop action to import the data from DB2 into the hive partition table.

Points to pay attention to:

1, to add the parameter hive.metastore.uris. Otherwise, the data cannot be loaded into the hive table. And, if there is more than one such operation in a xml text, this parameter needs to be configured in each action.

2. Pay attention to the problem of escape characters in XML. Here in my sql, there is a less than sign that needs to be rewritten, otherwise the sql statement will be said to be wrong after execution.

3, because it is a partition table, it is partitioned on a daily basis, so get the system time from the system. No other executable method was found here, so it was troublesome to write it as follows: ${replaceAll (timestamp (), "T. {0,}", "")}.

4. Also pay attention to the version of xmlns. At this time, just try a few more.

Workflow.xml

Hive.metastore.uris

Thrift://192.168.20.39:9083

Import

-- connect

Jdbc:db2://192.168.20.236:50001/sample

-- username

Db2inst1

-- password

Zheshimima

-- query

Select projno,projname,prstdate from project where prstdate

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.