伪分布式Hbase安装与java API连接

最新推荐文章于 2024-12-03 13:00:47 发布

JgyXyyxy

最新推荐文章于 2024-12-03 13:00:47 发布

阅读量1.4k

点赞数 1

CC 4.0 BY-SA版权

分类专栏：大数据Hadoop 文章标签： hbase centos

本文链接：https://blog.youkuaiyun.com/JgyXyyxy/article/details/76618380

大数据Hadoop 专栏收录该内容

1 篇文章

订阅专栏

本文介绍了如何在CentOS系统中进行伪分布式Hbase的安装配置，包括修改core-site.xml、hdfs-site.xml、hosts文件和bashrc文件。同时，详细阐述了Hbase的环境变量设置，如在hbase-env.sh中配置JAVA_HOME，并在hbase-site.xml中设置相关配置。此外，还提及了通过Java API连接Hbase的相关步骤。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

伪分布式Hadoop配置文件如下

core-site.xml

<configuration>
    <property>
        <name>hadoop.tmp.dir</name>
        <value>file:/usr/hadoop/tmp</value>
        <description>Abase for other temporary directories.</description>
    </property>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://192.168.11.16:9000</value>
    </property>
</configuration>

hdfs-site.xml

<configuration>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
    <property>
        <name>dfs.namenode.name.dir</name>
        <value>file:/usr/hadoop/tmp/dfs/name</value>
    </property>
    <property>
        <name>dfs.datanode.data.dir</name>
        <value>file:/usr/hadoop/tmp/dfs/data</value>
    </property>
</configuration>

/etc/hosts 增加

192.168.11.16 hbase

~/.bashrc 增加

# Hadoop Environment Variables

export HADOOP_HOME=/usr/hadoop
export HADOOP_INSTALL=$HADOOP_HOME
export HADOOP_MAPRED_HOME=$HADOOP_HOME
export HADOOP_COMMON_HOME=$HADOOP_HOME
export HADOOP_HDFS_HOME=$HADOOP_HOME
export YARN_HOME=$HADOOP_HOME
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export PATH=$PATH:$HADOOP_HOME/sbin:$HADOOP_HOME/bin

伪分布式Hbase配置文件如下

~/.bashrc 增加

# Hbase Environment Variables
export HBASE_HOME=/usr/hbase
export PATH=$PATH:$HBASE_HOME/bin
export CLASSPATH=.${JAVA_HOME}/lib:${JRE_HOME}/lib:${HADOOP_HOME}/share/hadoop/common/lib:${HBASE_HOME}/lib

hbase-env.sh

export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk

export HBASE_MANAGES_ZK=true

hbase-site.xml

<configuration>
  <property>
    <name>hbase.rootdir</name>
    <value>hdfs://192.168.11.16:9000/hbase</value>
  </property>
  <property>
    <name>hbase.zookeeper.property.dataDir</name>
    <value>/usr/hbase/data/zookeeper</value>
  </property>
  <property>
    <name>hbase.cluster.distributed</name>
    <value>true</value>
  </property>
  <property>
    <name>hbase.zookeeper.quorum</name>
    <value>192.168.11.16</value>
  </property>
  <property>
    <name>hbase.master.info.port</name>
    <value>60010</value>
  </property>
</configuration>

Java API连接

public static void init(){
    System.setProperty("hadoop.home.dir", "E:\\hadoop");
    configuration = HBaseConfiguration.create();
    configuration.set("hbase.zookeeper.quorum","192.168.11.16");
    configuration.set("hbase.zookeeper.property.clientPort", "2181");
    configuration.set("hbase.rootdir","hdfs://192.168.11.16:9000/hbase");
    try {
        connection = ConnectionFactory.createConnection(configuration);
        admin = connection.getAdmin();
        System.out.println("connection success");
    } catch (IOException e) {
        System.out.println("connection failed");
        e.printStackTrace();
    }
}