sqoop 1.4.5 导入 hbase 0.94.21

最新推荐文章于 2024-05-15 12:14:33 发布

wind520

最新推荐文章于 2024-05-15 12:14:33 发布

阅读量2.8k

点赞数

CC 4.0 BY-SA版权

分类专栏： HBase 文章标签： sqoop hbase

本文链接：https://blog.youkuaiyun.com/wind520/article/details/39139169

HBase 专栏收录该内容

8 篇文章

订阅专栏

本文介绍如何使用Sqoop将MySQL中的数据导入到HBase表中，并展示了具体的命令行操作过程及验证数据导入成功的方法。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

[jifeng@jifeng02 sqoop]$ bin/sqoop  import  --connect jdbc:mysql://10.x.x.x:3306/lir --username dss --password xxx123 --table bb_month --hbase-table bb_month --hbase-create-table --hbase-row-key ID --column-family diqu
Warning: /home/jifeng/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /home/jifeng/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
Warning: $HADOOP_HOME is deprecated.

14/09/08 21:19:43 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5
14/09/08 21:19:43 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
14/09/08 21:19:43 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
14/09/08 21:19:43 INFO tool.CodeGenTool: Beginning code generation
14/09/08 21:19:44 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `bb_month` AS t LIMIT 1
14/09/08 21:19:44 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `bb_month` AS t LIMIT 1
14/09/08 21:19:44 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /home/jifeng/hadoop/hadoop-1.2.1
注: /tmp/sqoop-jifeng/compile/42f3e8bac7bf9527e884da96d72ed7a9/bb_month.java使用或覆盖了已过时的 API。
注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
14/09/08 21:19:44 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-jifeng/compile/42f3e8bac7bf9527e884da96d72ed7a9/bb_month.jar
14/09/08 21:19:44 WARN manager.MySQLManager: It looks like you are importing from mysql.
14/09/08 21:19:44 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
14/09/08 21:19:44 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
14/09/08 21:19:44 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
14/09/08 21:19:44 INFO mapreduce.ImportJobBase: Beginning import of bb_month
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:host.name=jifeng02
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_65
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.home=/home/jifeng/jdk1.7.0_45/jre
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/home/jifeng/hadoop/hadoop-1.2.1/libexec/../conf:/home/jifeng/jdk1.7.0_45/lib/tools.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/..:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../hadoop-core-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/asm-3.2.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/aspectjrt-1.6.11.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/aspectjtools-1.6.11.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-beanutils-1.7.0.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-beanutils-core-1.8.0.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-cli-1.2.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-codec-1.4.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-collections-3.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-configuration-1.6.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-daemon-1.0.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-digester-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-el-1.0.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-httpclient-3.0.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-io-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-lang-2.4.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-logging-1.1.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-logging-api-1.0.4.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-math-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-net-3.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/core-3.1.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-capacity-scheduler-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-fairscheduler-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-thriftfs-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hsqldb-1.8.0.10.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jackson-core-asl-1.8.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jasper-compiler-5.5.12.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jasper-runtime-5.5.12.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jdeb-0.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jersey-core-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jersey-json-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jersey-server-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jets3t-0.6.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jetty-6.1.26.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jetty-util-6.1.26.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jsch-0.1.42.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/junit-4.5.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/kfs-0.2.2.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/log4j-1.2.15.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/mockito-all-1.8.5.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/oro-2.0.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/servlet-api-2.5-20081211.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/slf4j-api-1.4.3.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/slf4j-log4j12-1.4.3.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/xmlenc-0.52.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jsp-2.1/jsp-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jsp-2.1/jsp-api-2.1.jar:/home/jifeng/sqoop/conf::/home/jifeng/sqoop/lib/ant-contrib-1.0b3.jar:/home/jifeng/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar:/home/jifeng/sqoop/lib/avro-1.7.5.jar:/home/jifeng/sqoop/lib/avro-mapred-1.7.5-hadoop2.jar:/home/jifeng/sqoop/lib/commons-compress-1.4.1.jar:/home/jifeng/sqoop/lib/commons-io-1.4.jar:/home/jifeng/sqoop/lib/hsqldb-1.8.0.10.jar:/home/jifeng/sqoop/lib/jackson-core-asl-1.9.13.jar:/home/jifeng/sqoop/lib/jackson-mapper-asl-1.9.13.jar:/home/jifeng/sqoop/lib/libthrift-0.9.0.jar:/home/jifeng/sqoop/lib/mysql-connector-java-5.1.32-bin.jar:/home/jifeng/sqoop/lib/paranamer-2.3.jar:/home/jifeng/sqoop/lib/snappy-java-1.0.5.jar:/home/jifeng/sqoop/lib/xz-1.0.jar:/home/jifeng/hbase-0.94.21/conf:/home/jifeng/jdk1.7.0_45/lib/tools.jar:/home/jifeng/hbase-0.94.21:/home/jifeng/hbase-0.94.21/hbase-0.94.21.jar:/home/jifeng/hbase-0.94.21/hbase-0.94.21-tests.jar:/home/jifeng/hbase-0.94.21/lib/activation-1.1.jar:/home/jifeng/hbase-0.94.21/lib/asm-3.1.jar:/home/jifeng/hbase-0.94.21/lib/avro-1.5.3.jar:/home/jifeng/hbase-0.94.21/lib/avro-ipc-1.5.3.jar:/home/jifeng/hbase-0.94.21/lib/commons-beanutils-1.7.0.jar:/home/jifeng/hbase-0.94.21/lib/commons-beanutils-core-1.8.0.jar:/home/jifeng/hbase-0.94.21/lib/commons-cli-1.2.jar:/home/jifeng/hbase-0.94.21/lib/commons-codec-1.4.jar:/home/jifeng/hbase-0.94.21/lib/commons-collections-3.2.1.jar:/home/jifeng/hbase-0.94.21/lib/commons-configuration-1.6.jar:/home/jifeng/hbase-0.94.21/lib/commons-digester-1.8.jar:/home/jifeng/hbase-0.94.21/lib/commons-el-1.0.jar:/home/jifeng/hbase-0.94.21/lib/commons-httpclient-3.1.jar:/home/jifeng/hbase-0.94.21/lib/commons-io-2.1.jar:/home/jifeng/hbase-0.94.21/lib/commons-lang-2.5.jar:/home/jifeng/hbase-0.94.21/lib/commons-logging-1.1.1.jar:/home/jifeng/hbase-0.94.21/lib/commons-math-2.1.jar:/home/jifeng/hbase-0.94.21/lib/commons-net-1.4.1.jar:/home/jifeng/hbase-0.94.21/lib/core-3.1.1.jar:/home/jifeng/hbase-0.94.21/lib/guava-11.0.2.jar:/home/jifeng/hbase-0.94.21/lib/hadoop-core-1.2.1.jar:/home/jifeng/hbase-0.94.21/lib/hamcrest-core-1.3.jar:/home/jifeng/hbase-0.94.21/lib/high-scale-lib-1.1.1.jar:/home/jifeng/hbase-0.94.21/lib/httpclient-4.1.2.jar:/home/jifeng/hbase-0.94.21/lib/httpcore-4.1.3.jar:/home/jifeng/hbase-0.94.21/lib/jackson-core-asl-1.8.8.jar:/home/jifeng/hbase-0.94.21/lib/jackson-jaxrs-1.8.8.jar:/home/jifeng/hbase-0.94.21/lib/jackson-mapper-asl-1.8.8.jar:/home/jifeng/hbase-0.94.21/lib/jackson-xc-1.8.8.jar:/home/jifeng/hbase-0.94.21/lib/jamon-runtime-2.3.1.jar:/home/jifeng/hbase-0.94.21/lib/jasper-compiler-5.5.23.jar:/home/jifeng/hbase-0.94.21/lib/jasper-runtime-5.5.23.jar:/home/jifeng/hbase-0.94.21/lib/jaxb-api-2.1.jar:/home/jifeng/hbase-0.94.21/lib/jaxb-impl-2.2.3-1.jar:/home/jifeng/hbase-0.94.21/lib/jersey-core-1.8.jar:/home/jifeng/hbase-0.94.21/lib/jersey-json-1.8.jar:/home/jifeng/hbase-0.94.21/lib/jersey-server-1.8.jar:/home/jifeng/hbase-0.94.21/lib/jettison-1.1.jar:/home/jifeng/hbase-0.94.21/lib/jetty-6.1.26.jar:/home/jifeng/hbase-0.94.21/lib/jetty-util-6.1.26.jar:/home/jifeng/hbase-0.94.21/lib/jruby-complete-1.6.5.jar:/home/jifeng/hbase-0.94.21/lib/jsp-2.1-6.1.14.jar:/home/jifeng/hbase-0.94.21/lib/jsp-api-2.1-6.1.14.jar:/home/jifeng/hbase-0.94.21/lib/jsr305-1.3.9.jar:/home/jifeng/hbase-0.94.21/lib/junit-4.11.jar:/home/jifeng/hbase-0.94.21/lib/libthrift-0.8.0.jar:/home/jifeng/hbase-0.94.21/lib/log4j-1.2.16.jar:/home/jifeng/hbase-0.94.21/lib/metrics-core-2.1.2.jar:/home/jifeng/hbase-0.94.21/lib/netty-3.2.4.Final.jar:/home/jifeng/hbase-0.94.21/lib/protobuf-java-2.4.0a.jar:/home/jifeng/hbase-0.94.21/lib/servlet-api-2.5-6.1.14.jar:/home/jifeng/hbase-0.94.21/lib/slf4j-api-1.4.3.jar:/home/jifeng/hbase-0.94.21/lib/slf4j-log4j12-1.4.3.jar:/home/jifeng/hbase-0.94.21/lib/snappy-java-1.0.3.2.jar:/home/jifeng/hbase-0.94.21/lib/stax-api-1.0.1.jar:/home/jifeng/hbase-0.94.21/lib/velocity-1.7.jar:/home/jifeng/hbase-0.94.21/lib/xmlenc-0.52.jar:/home/jifeng/hbase-0.94.21/lib/zookeeper-3.4.5.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../conf:/home/jifeng/jdk1.7.0_45/lib/tools.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/..:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../hadoop-core-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/asm-3.2.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/aspectjrt-1.6.11.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/aspectjtools-1.6.11.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-beanutils-1.7.0.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-beanutils-core-1.8.0.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-cli-1.2.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-codec-1.4.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-collections-3.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-configuration-1.6.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-daemon-1.0.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-digester-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-el-1.0.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-httpclient-3.0.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-io-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-lang-2.4.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-logging-1.1.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-logging-api-1.0.4.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-math-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/commons-net-3.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/core-3.1.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-capacity-scheduler-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-fairscheduler-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-thriftfs-1.2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/hsqldb-1.8.0.10.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jackson-core-asl-1.8.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jasper-compiler-5.5.12.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jasper-runtime-5.5.12.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jdeb-0.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jersey-core-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jersey-json-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jersey-server-1.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jets3t-0.6.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jetty-6.1.26.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jetty-util-6.1.26.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jsch-0.1.42.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/junit-4.5.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/kfs-0.2.2.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/log4j-1.2.15.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/mockito-all-1.8.5.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/oro-2.0.8.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/servlet-api-2.5-20081211.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/slf4j-api-1.4.3.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/slf4j-log4j12-1.4.3.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/xmlenc-0.52.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jsp-2.1/jsp-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/jsp-2.1/jsp-api-2.1.jar:/home/jifeng/hadoop/hadoop-1.2.1/conf:/home/jifeng/sqoop/sqoop-1.4.5.jar:/home/jifeng/sqoop/sqoop-test-1.4.5.jar:
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/home/jifeng/hadoop/hadoop-1.2.1/libexec/../lib/native/Linux-i386-32
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:os.arch=i386
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-358.el6.i686
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:user.name=jifeng
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/jifeng
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/jifeng/sqoop
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=jifeng02:2181,jifeng01:2181 sessionTimeout=180000 watcher=hconnection
14/09/08 21:19:45 INFO zookeeper.ClientCnxn: Opening socket connection to server jifeng02/10.5.4.55:2181. Will not attempt to authenticate using SASL (unknown error)
14/09/08 21:19:45 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 1516@jifeng02
14/09/08 21:19:45 INFO zookeeper.ClientCnxn: Socket connection established to jifeng02/10.5.4.55:2181, initiating session
14/09/08 21:19:45 INFO zookeeper.ClientCnxn: Session establishment complete on server jifeng02/10.5.4.55:2181, sessionid = 0x1484b8856b20001, negotiated timeout = 180000
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=jifeng02:2181,jifeng01:2181 sessionTimeout=180000 watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@b8acae
14/09/08 21:19:45 INFO zookeeper.ClientCnxn: Opening socket connection to server jifeng02/10.5.4.55:2181. Will not attempt to authenticate using SASL (unknown error)
14/09/08 21:19:45 INFO zookeeper.ClientCnxn: Socket connection established to jifeng02/10.5.4.55:2181, initiating session
14/09/08 21:19:45 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 1516@jifeng02
14/09/08 21:19:45 INFO zookeeper.ClientCnxn: Session establishment complete on server jifeng02/10.5.4.55:2181, sessionid = 0x1484b8856b20002, negotiated timeout = 180000
14/09/08 21:19:45 INFO zookeeper.ZooKeeper: Session: 0x1484b8856b20002 closed
14/09/08 21:19:45 INFO mapreduce.HBaseImportJob: Creating missing HBase table bb_month
14/09/08 21:19:45 INFO zookeeper.ClientCnxn: EventThread shut down
14/09/08 21:19:46 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=jifeng02:2181,jifeng01:2181 sessionTimeout=180000 watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@b8acae
14/09/08 21:19:46 INFO zookeeper.ClientCnxn: Opening socket connection to server jifeng01/10.5.4.54:2181. Will not attempt to authenticate using SASL (unknown error)
14/09/08 21:19:46 INFO zookeeper.ClientCnxn: Socket connection established to jifeng01/10.5.4.54:2181, initiating session
14/09/08 21:19:46 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 1516@jifeng02
14/09/08 21:19:46 INFO zookeeper.ClientCnxn: Session establishment complete on server jifeng01/10.5.4.54:2181, sessionid = 0x484b88593f0006, negotiated timeout = 180000
14/09/08 21:19:46 INFO zookeeper.ZooKeeper: Session: 0x484b88593f0006 closed
14/09/08 21:19:46 INFO zookeeper.ClientCnxn: EventThread shut down
14/09/08 21:19:46 INFO db.DBInputFormat: Using read commited transaction isolation
14/09/08 21:19:46 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(`ID`), MAX(`ID`) FROM `bb_month`
14/09/08 21:19:47 INFO mapred.JobClient: Running job: job_201409072150_0018
14/09/08 21:19:48 INFO mapred.JobClient:  map 0% reduce 0%
14/09/08 21:20:02 INFO mapred.JobClient:  map 25% reduce 0%
14/09/08 21:20:03 INFO mapred.JobClient:  map 75% reduce 0%
14/09/08 21:20:04 INFO mapred.JobClient:  map 100% reduce 0%
14/09/08 21:20:04 INFO mapred.JobClient: Job complete: job_201409072150_0018
14/09/08 21:20:04 INFO mapred.JobClient: Counters: 17
14/09/08 21:20:04 INFO mapred.JobClient:   Job Counters 
14/09/08 21:20:04 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=26361
14/09/08 21:20:04 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
14/09/08 21:20:04 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
14/09/08 21:20:04 INFO mapred.JobClient:     Launched map tasks=4
14/09/08 21:20:04 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
14/09/08 21:20:04 INFO mapred.JobClient:   File Output Format Counters 
14/09/08 21:20:04 INFO mapred.JobClient:     Bytes Written=0
14/09/08 21:20:04 INFO mapred.JobClient:   FileSystemCounters
14/09/08 21:20:04 INFO mapred.JobClient:     HDFS_BYTES_READ=409
14/09/08 21:20:04 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=379763
14/09/08 21:20:04 INFO mapred.JobClient:   File Input Format Counters 
14/09/08 21:20:04 INFO mapred.JobClient:     Bytes Read=0
14/09/08 21:20:04 INFO mapred.JobClient:   Map-Reduce Framework
14/09/08 21:20:04 INFO mapred.JobClient:     Map input records=43
14/09/08 21:20:04 INFO mapred.JobClient:     Physical memory (bytes) snapshot=280817664
14/09/08 21:20:04 INFO mapred.JobClient:     Spilled Records=0
14/09/08 21:20:04 INFO mapred.JobClient:     CPU time spent (ms)=4370
14/09/08 21:20:04 INFO mapred.JobClient:     Total committed heap usage (bytes)=96337920
14/09/08 21:20:04 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=1756061696
14/09/08 21:20:04 INFO mapred.JobClient:     Map output records=43
14/09/08 21:20:04 INFO mapred.JobClient:     SPLIT_RAW_BYTES=409
14/09/08 21:20:04 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 18.5066 seconds (0 bytes/sec)
14/09/08 21:20:04 INFO mapreduce.ImportJobBase: Retrieved 43 records.
[jifeng@jifeng02 sqoop]$

Hbase查看

[jifeng@jifeng01 ~]$ hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.94.21, r83b4a1ee9b9a2fa4c7ae1739259e041cabe8edc2, Fri Jun 27 16:14:16 UTC 2014

hbase(main):001:0> list
TABLE                                                                                                       
bb_month                                                                                                    
testtable                                                                                                   
2 row(s) in 0.6190 seconds

hbase(main):002:0> count bb_month;
hbase(main):003:0* 
hbase(main):004:0* [jifeng@jifeng01 ~]$ 
[jifeng@jifeng01 ~]$ hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.94.21, r83b4a1ee9b9a2fa4c7ae1739259e041cabe8edc2, Fri Jun 27 16:14:16 UTC 2014

hbase(main):001:0> list
TABLE                                                                                                       
bb_month                                                                                                    
testtable                                                                                                   
2 row(s) in 0.5700 seconds


hbase(main):009:0> describe 'bb_month'
DESCRIPTION                                                            ENABLED                              
 'bb_month', {NAME => 'diqu', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILT true                                 
 ER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION                                       
 => 'NONE', MIN_VERSIONS => '0', TTL => '2147483647', KEEP_DELETED_CEL                                      
 LS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_                                      
 DISK => 'true', BLOCKCACHE => 'true'}                                                                      
1 row(s) in 0.0920 seconds

hbase(main):010:0> get 'bb_month','174'
COLUMN                       CELL                                                                           
0 row(s) in 0.0670 seconds

hbase(main):011:0> get 'bb_month','175'
COLUMN                       CELL                                                                           
0 row(s) in 0.0130 seconds


hbase(main):013:0> scan 'bb_month'
ROW                          COLUMN+CELL                                                                    
 295                         column=diqu:FactPrice, timestamp=1410182401784, value=172499.0000              
 295                         column=diqu:Fcom, timestamp=1410182401784, value=CRO                           
 295                         column=diqu:HospPrice, timestamp=1410182401784, value=172499.0000              
 295                         column=diqu:Inputdate, timestamp=1410182401784, value=2014-02                  
 295                         column=diqu:RatePrice, timestamp=1410182401784, value=172499.0000              
 295                         column=diqu:Requestid, timestamp=1410182401784, value=986.0000                 
 295                         column=diqu:StandPrice, timestamp=1410182401784, value=149946.0000             
 295                         column=diqu:month, timestamp=1410182401784, value=2                            
 295                         column=diqu:quarter, timestamp=1410182401784, value=1                          
 295                         column=diqu:year, timestamp=1410182401784, value=2014                          
......                       
 715                         column=diqu:FactPrice, timestamp=1410182402013, value=22.0000                  
 715                         column=diqu:Fcom, timestamp=1410182402013, value=\xE5\xB9\xBF\xE5\xB7\x9E      
 715                         column=diqu:HospPrice, timestamp=1410182402013, value=22.0000                  
 715                         column=diqu:Inputdate, timestamp=1410182402013, value=2014-04                  
 715                         column=diqu:RatePrice, timestamp=1410182402013, value=22.0000                  
 715                         column=diqu:Requestid, timestamp=1410182402013, value=22.0000                  
 715                         column=diqu:StandPrice, timestamp=1410182402013, value=22.0000                 
 715                         column=diqu:month, timestamp=1410182402013, value=3                            
 715                         column=diqu:quarter, timestamp=1410182402013, value=1                          
 715                         column=diqu:year, timestamp=1410182402013, value=2014                          
43 row(s) in 0.7130 seconds

hbase(main):014:0> get 'bb_month','295'
COLUMN                       CELL                                                                           
 diqu:FactPrice              timestamp=1410182401784, value=172499.0000                                     
 diqu:Fcom                   timestamp=1410182401784, value=CRO                                             
 diqu:HospPrice              timestamp=1410182401784, value=172499.0000                                     
 diqu:Inputdate              timestamp=1410182401784, value=2014-02                                         
 diqu:RatePrice              timestamp=1410182401784, value=172499.0000                                     
 diqu:Requestid              timestamp=1410182401784, value=986.0000                                        
 diqu:StandPrice             timestamp=1410182401784, value=149946.0000                                     
 diqu:month                  timestamp=1410182401784, value=2                                               
 diqu:quarter                timestamp=1410182401784, value=1                                               
 diqu:year                   timestamp=1410182401784, value=2014                                            
10 row(s) in 0.0270 seconds

hbase(main):015:0>