Hi Yan, What hadoop distribution are you using? In addition, can you clarify the issue? Regards, Robert ...
What hadoop distribution are you using? In addition, can you clarify the issue?
i use importtsv like this
hadoop jar /opt/module/hbase-0.94.6-cdh4.3.0/hbase-0.94.6-cdh4.3.0-security.jar importtsv -Dimporttsv.bulk.output=/data_hfile/output -Dimporttsv.columns=HBASE_ROW_KEY,s:STATION,s:YEAR,s:MONTH,s:DAY,s:HOUR,s:MINUTE,s:ODATE,s:LDATE,s:LTIME,s:CCCC,s:LATITUDE,s:LONGITUDE,s:ELEVATION………… -Dimporttsv.separator=, data_rk /data_split/data_rk_2_4bw
data_rk_2_4bw about 600MB
and result make to mang file about 15GB
A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.
Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world