Shulou(Shulou.com)06/01 Report--

The sqoop currently in use imports data from oracle into hbase.

Sqoop import-- connect jdbc:oracle:thin:@192.168.193.37:1521:hispacedb-- username hwmarket-- password hwmarket37-- M1-- query "select g.imei hh34:mi:ss' g.id as sign, to_char (g.logindatetemerenzyyyylivedddMMmuryMody) as crtdate,g.buildNumber,g.modelnumber,g.firmwarever as firmware,g.hispaceNumber,g.cno,to_char (g.updateTimeMMMuyycombe dd hh34:mi:ss') as updateTime, g.netjold g.sourcecoverall 'density '' screen from l_logonlog_egame g where\ $CONDITIONS "--columns IMEI,SIGN,CRTDATE,BUILDNUMBER,MODELNUMBER,FIRMWARE,HISPACENUMBER,CNO,UPDATETIME,NET,SOURCE,DENSITY,SCREEN-- hbase-create-table-- hbase-table h_active_device_info_gamecenter-- hbase-row-key IMEI-- column-family data

For some specific parameters, please see api on sqoop's official website.

The speed of pouring in data is still very fast. 1kw data can be imported in 10 minutes.

In addition, I found that the field in hbase cannot be changed when sqoop is imported from oracle to hbase. It must be consistent with the field name on this side of oracle. I don't know if it is my own problem. If I have anything clear, I can share it.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.