环境:ubuntu 13.04 ,hadoop-1.2.1+hbase-0.94.11
ubuntu 的/etc/hosts的文档修改如下,避免某些域名被映射成,127.0.1.1。
127.0.0.1 localhost
127.0.0.1 shallon-ThinkPad-X230
127.0.0.1 ubuntu.ubuntu-domain ubuntu
127.0.0.1 shallon-ThinkPad-X230
127.0.0.1 ubuntu.ubuntu-domain ubuntu
1、hadoop的配置
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more core-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.default.name</name>
<value> hdfs://shallon-ThinkPad-X230:9000/hbase</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/hadoop/hadoop-${user.name}</value>
<description>A base for other temporary directories.</description>
</property>
</configuration>
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.default.name</name>
<value> hdfs://shallon-ThinkPad-X230:9000/hbase</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/hadoop/hadoop-${user.name}</value>
<description>A base for other temporary directories.</description>
</property>
</configuration>
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more masters
shallon-ThinkPad-X230
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more slaves
shallon-ThinkPad-X230
shallon-ThinkPad-X230
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more slaves
shallon-ThinkPad-X230
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/conf$ more hdfs-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
启动hadoop的文件HDFS:
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/bin$ ./start-dfs.sh
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1/bin$ jps
1493 NameNode
1780 DataNode
2226 SecondaryNameNode
1493 NameNode
1780 DataNode
2226 SecondaryNameNode
尝试访问dfs。
hadoop@shallon-ThinkPad-X230:~/hadoop-1.2.1$ bin/hadoop dfs -ls /
Found 3 items
drwxr-xr-x - hadoop supergroup 0 2013-09-22 22:05 /hbase
drwxr-xr-x - hadoop supergroup 0 2013-09-22 15:54 /home
drwxr-xr-x - hadoop supergroup 0 2013-08-30 15:18 /user
Found 3 items
drwxr-xr-x - hadoop supergroup 0 2013-09-22 22:05 /hbase
drwxr-xr-x - hadoop supergroup 0 2013-09-22 15:54 /home
drwxr-xr-x - hadoop supergroup 0 2013-08-30 15:18 /user
2、Hbase 配置
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/conf$ vi hbase-site.xml
<configuration>
<property>
<name>hbase.rootdir</name>
<value> hdfs://shallon-ThinkPad-X230:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
</configuration>
<property>
<name>hbase.rootdir</name>
<value> hdfs://shallon-ThinkPad-X230:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
</configuration>
黑体部分与上面配置的HDFS根路径匹配。指向本地配置的HDFS
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/bin$ ./start-hbase.sh
hadoop@localhost's password:
localhost: starting zookeeper, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-zookeeper-shallon-ThinkPad-X230.out
starting master, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-master-shallon-ThinkPad-X230.out
hadoop@shallon-thinkpad-x230's password:
shallon-ThinkPad-X230: starting regionserver, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-regionserver-shallon-ThinkPad-X230.out
hadoop@localhost's password:
localhost: starting zookeeper, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-zookeeper-shallon-ThinkPad-X230.out
starting master, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-master-shallon-ThinkPad-X230.out
hadoop@shallon-thinkpad-x230's password:
shallon-ThinkPad-X230: starting regionserver, logging to /home/hadoop/hbase-0.94.11/bin/../logs/hbase-hadoop-regionserver-shallon-ThinkPad-X230.out
查看HBase的启动进程
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11$ jps
1493 NameNode
1780 DataNode
2226 SecondaryNameNode
20273 Jps
14163 HMaster
14081 HQuorumPeer
14655 HRegionServer
1493 NameNode
1780 DataNode
2226 SecondaryNameNode
20273 Jps
14163 HMaster
14081 HQuorumPeer
14655 HRegionServer
查看hbase的master的状态
Master: localhost:60000
Local logs, Thread Dump, Log Level, Debug dump,
Attributes
Attribute Name | Value | Description |
---|---|---|
HBase Version | 0.94.11, r1513697 | HBase version and revision |
HBase Compiled | Wed Aug 14 04:54:46 UTC 2013, jenkins | When HBase version was compiled and by whom |
Hadoop Version | 1.0.4, r1393290 | Hadoop version and revision |
Hadoop Compiled | Thu Oct 4 20:40:32 UTC 2012, hortonfo | When Hadoop version was compiled and by whom |
HBase Root Directory | hdfs://shallon-ThinkPad-X230:9000/hbase | Location of HBase home directory |
Zookeeper Quorum | localhost:2181 | Addresses of all registered ZK servers. For more, see zk dump. |
HMaster Start Time | Mon Sep 23 10:06:53 CST 2013 | Date stamp of when this HMaster was started |
HMaster Active Time | Mon Sep 23 10:06:53 CST 2013 | Date stamp of when this HMaster became active |
Load average | 3 | Average number of regions per regionserver. Naive computation. |
HBase Cluster ID | 4d409e24-108f-41bb-ad32-a49977445601 | Unique identifier generated for each HBase cluster |
Coprocessors | [] | Coprocessors currently loaded loaded by the master |
使用HBase的创建表和查询数据
hadoop@shallon-ThinkPad-X230:~/hbase-0.94.11/bin$ ./hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.94.11, r1513697, Wed Aug 14 04:54:46 UTC 2013
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.94.11, r1513697, Wed Aug 14 04:54:46 UTC 2013
hbase(main):003:0> create 'test', 'cf' 0 row(s) in 1.2200 seconds hbase(main):003:0> list 'test' .. 1 row(s) in 0.0550 seconds hbase(main):004:0> put 'test', 'row1', 'cf:a', 'value1' 0 row(s) in 0.0560 seconds hbase(main):005:0> put 'test', 'row2', 'cf:b', 'value2' 0 row(s) in 0.0370 seconds hbase(main):006:0> put 'test', 'row3', 'cf:c', 'value3' 0 row(s) in 0.0450 seconds
hbase(main):001:0> scan 'test'
ROW COLUMN+CELL
row1 column=cf:a, timestamp=1379858801692, value=value1
row2 column=cf:b, timestamp=1379858810975, value=value2
row3 column=cf:c, timestamp=1379858822233, value=value3
3 row(s) in 1.3100 seconds
ROW COLUMN+CELL
row1 column=cf:a, timestamp=1379858801692, value=value1
row2 column=cf:b, timestamp=1379858810975, value=value2
row3 column=cf:c, timestamp=1379858822233, value=value3
3 row(s) in 1.3100 seconds
查看HBase Root Directory的文件内容
Contents of directory /hbase
Goto :
Go to parent directory
Name | Type | Size | Replication | Block Size | Modification Time | Permission | Owner | Group |
-ROOT- | dir | 2013-09-22 22:02 | rwxr-xr-x | hadoop | supergroup | |||
.META. | dir | 2013-09-22 16:32 | rwxr-xr-x | hadoop | supergroup | |||
.corrupt | dir | 2013-09-22 22:02 | rwxr-xr-x | hadoop | supergroup | |||
.logs | dir | 2013-09-23 10:06 | rwxr-xr-x | hadoop | supergroup | |||
.oldlogs | dir | 2013-09-23 10:07 | rwxr-xr-x | hadoop | supergroup | |||
.tmp | dir | 2013-09-23 10:06 | rwxr-xr-x | hadoop | supergroup | |||
hbase.id | file | 0.04 KB | 3 | 64 MB | 2013-09-22 16:32 | rw-r--r-- | hadoop | supergroup |
hbase.version | file | 0 KB | 3 | 64 MB | 2013-09-22 16:32 | rw-r--r-- | hadoop | supergroup |
test | dir | 2013-09-22 22:05 | rwxr-xr-x | hadoop |