首頁>技術>

基於上一篇Hadoop叢集已經搭建完成基礎上(需要的朋友可以翻看我的上一篇博文),我們來完成Hbase的搭建工作。

一、節點規劃二、Zookeeper叢集安裝

由於Hbase叢集master的高可用需要依賴Zookeeper叢集,所以需要安裝Zookeeper叢集。

zooker安裝:

1、修改配置檔案

注意要下載bin的版本才能帶可執行檔案

cd /opt/mkdir zookeepercd zookeeperwget https://mirrors.tuna.tsinghua.edu.cn/apache/zookeeper/zookeeper-3.5.9/apache-zookeeper-3.5.9-bin.tar.gztar -zxvf zookeeper-3.4.14.tar.gzcd zookeeper-3.4.14/confcp zoo_sample.cfg zoo.cfgvim zoo.cfg

新增如下內容:

# The number of milliseconds of each ticktickTime=2000# The number of ticks that the initial # synchronization phase can takeinitLimit=10# The number of ticks that can pass between # sending a request and getting an acknowledgementsyncLimit=5# the directory where the snapshot is stored.# do not use /tmp for storage, /tmp here is just # example sakes.dataDir=/var/zookeeper# the port at which the clients will connectclientPort=2181# the maximum number of client connections.# increase this if you need to handle more clients#maxClientCnxns=60## Be sure to read the maintenance section of the # administrator guide before turning on autopurge.## http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance## The number of snapshots to retain in dataDir#autopurge.snapRetainCount=3# Purge task interval in hours# Set to "0" to disable auto purge feature#autopurge.purgeInterval=1server.1=node21:2888:3888server.2=node245:2888:3888server.3=node255:2888:3888

設定node21上的zookeeper的id為1

mkdir -p /var/zookeepercd /var/zookeeperecho "1" >> ./myid
2、將zookeeper所有配置copy到node245和node255上
scp -r zookeeper/ root@node245:/optscp -r zookeeper/ root@node255:/opt

設定node245上的zookeeper的id為2

mkdir -p /var/zookeepercd /var/zookeeperecho "2" >> ./myid

設定node255上的zookeeper的id為3

mkdir -p /var/zookeepercd /var/zookeeperecho "3" >> ./myid
3、分別在3臺機器配置環境變數
vim /etc/profile#新增如下配置export ZOOKEEPER_HOME=/opt/zookeeper/apache-zookeeper-3.5.9export PATH=$ZOOKEEPER_HOME/bin:$PATH#配置生效source /etc/profile
4、3臺機器分別執行如下命令,啟動服務:
zkServer.sh
5、檢查叢集狀態:

可以看到zookeeper叢集有一臺機器node245是leader, 另外兩臺是 follower , 叢集工作狀態正常!

[root@node21 bin]# ./zkServer.sh statusZooKeeper JMX enabled by defaultUsing config: /opt/zookeeper/apache-zookeeper-3.5.9/bin/../conf/zoo.cfgClient port found: 2181. Client address: localhost. Client SSL: false.Mode: follower
[root@node245 zookeeper]# zkServer.sh statusZooKeeper JMX enabled by defaultUsing config: /opt/zookeeper/apache-zookeeper-3.5.9/bin/../conf/zoo.cfgClient port found: 2181. Client address: localhost. Client SSL: false.Mode: leader
[root@node255 zookeeper]# zkServer.sh statusZooKeeper JMX enabled by defaultUsing config: /opt/zookeeper/apache-zookeeper-3.5.9/bin/../conf/zoo.cfgClient port found: 2181. Client address: localhost. Client SSL: false.Mode: follower
三、Hbase安裝:1、下載解壓hbase
mkdir -p /opt/hbasecd /opt/hbasewget http://mirror.bit.edu.cn/apache/hbase/2.2.6/hbase-2.2.6-bin.tar.gztar -zxvf hbase-2.2.6-bin.tar.gz
2、修改hbase-site.xml
vim /opt/hbase/hbase-2.2.6/conf/hbase-site.xml #新增內容如下   <property>        <name>hbase.rootdir</name>        <value>hdfs://node21:8020/hbase</value>    </property>    <property>        <name>hbase.cluster.distributed</name>        <value>true</value>    </property>    <property>        <name>hbase.zookeeper.property.clientPort</name>        <value>2181</value>    </property>    <property>        <name>hbase.zookeeper.quorum</name>        <value>node21,node245,node255</value>    </property>    <property>        <name>hbase.master.info.port</name>        <value>9084</value>    </property>    <property>       <name>hbase.unsafe.stream.capability.enforce</name>       <value>false</value>    </property>    

注意 hbase.rootdir要跟hadoop中的配置一致(即和 /opt/hadoop/hadoop-3.2.1/etc/hadoop/core-site.xml 中的fs.defaultFS 配置的IP和埠是一致的!

3、修改hbase-env.sh
vim /opt/hbase/hbase-2.2.6/conf/hbase-env.sh #jdk 路徑export JAVA_HOME=/opt/jdk1.8# 不要用hbase 自帶的zookeeperexport HBASE_MANAGES_ZK=false
4、修改regionservers
vim /opt/hbase/hbase-2.2.6/conf/regionservers#新增如下內容,注意刪除自帶的localhostnode21node245node255
5、將所有配置copy到node245和node255上
scp -r hbase/ root@node245:/optscp -r hbase/ root@node255:/opt
6、分別在3臺機器配置環境變數
vim /etc/profile#新增如下配置export HBASE_HOME=/opt/hbase/hbase-2.2.6export PATH=$HBASE_HOME/bin:$PATH#配置生效source /etc/profile
7、在node21上執行服務啟動命令:
[root@node21 ~]# start-hbase.sh
8、檢查叢集服務啟動情況檢查node21節點:
[root@node21 conf]# jps -l2768 sun.tools.jps.Jps18470 org.apache.hadoop.hdfs.server.datanode.DataNode1943 org.apache.hadoop.hbase.regionserver.HRegionServer19144 org.apache.hadoop.yarn.server.nodemanager.NodeManager18940 org.apache.hadoop.yarn.server.resourcemanager.ResourceManager18269 org.apache.hadoop.hdfs.server.namenode.NameNode26989 org.apache.zookeeper.server.quorum.QuorumPeerMain1757 org.apache.hadoop.hbase.master.HMaster

可以看到hbase的兩個服務,一個是HMster,一個是HregionServer。

檢查node245節點:
[root@node245 ~]# jps -l10689 org.apache.hadoop.hdfs.server.datanode.DataNode15985 sun.tools.jps.Jps10810 org.apache.hadoop.yarn.server.nodemanager.NodeManager14348 org.apache.zookeeper.server.quorum.QuorumPeerMain15628 org.apache.hadoop.hbase.regionserver.HRegionServer

可以看到hbase的服務一個是HregionServer已經成功啟動。

檢查node255節點:
[root@node255 ~]# jps -l19768 org.apache.hadoop.hdfs.server.datanode.DataNode19976 org.apache.hadoop.yarn.server.nodemanager.NodeManager19886 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode25758 org.apache.zookeeper.server.quorum.QuorumPeerMain28014 sun.tools.jps.Jps27567 org.apache.hadoop.hbase.regionserver.HRegionServer

同樣,可以看到hbase的服務一個是HregionServer已經成功啟動。

9、訪問Hbase的頁面:

可以看到Hbase的3個節點資訊。

以上就完成了整個Hbase叢集的搭建工作!

—————END—————

11
最新評論
  • BSA-TRITC(10mg/ml) TRITC-BSA 牛血清白蛋白改性標記羅丹明
  • 如何判斷模板類中是否存在函式f?