Hbase的安裝和基本使用-創(chuàng)新互聯(lián)
Hbase介紹
HBase是一個(gè)開源的非關(guān)系型分布式數(shù)據(jù)庫（NoSQL），它參考了谷歌的BigTable建模，實(shí)現(xiàn)的編程語言為?Java。它是Apache軟件基金會的Hadoop項(xiàng)目的一部分，運(yùn)行于HDFS文件系統(tǒng)之上，為?Hadoop?提供類似于BigTable 規(guī)模的服務(wù)。因此，它可以容錯(cuò)地存儲海量稀疏的數(shù)據(jù)。
十余年的東昌網(wǎng)站建設(shè)經(jīng)驗(yàn)，針對設(shè)計(jì)、前端、開發(fā)、售后、文案、推廣等六對一服務(wù)，響應(yīng)快，48小時(shí)及時(shí)工作處理。全網(wǎng)營銷推廣的優(yōu)勢是能夠根據(jù)用戶設(shè)備顯示端的尺寸不同，自動調(diào)整東昌建站的顯示方式，使網(wǎng)站能夠適用不同顯示終端，在瀏覽器中調(diào)整網(wǎng)站的寬度，無論在任何一種瀏覽器上瀏覽網(wǎng)站，都能展現(xiàn)優(yōu)雅布局與設(shè)計(jì)，從而大程度地提升瀏覽體驗(yàn)。創(chuàng)新互聯(lián)公司從事“東昌網(wǎng)站設(shè)計(jì)”,“東昌網(wǎng)站推廣”以來，每個(gè)客戶項(xiàng)目都認(rèn)真落實(shí)執(zhí)行。
Hbase安裝
安裝環(huán)境
三臺虛擬機(jī)：master、slave1、slave2，
已經(jīng)安裝好Hadoop環(huán)境和zookeeper
下載Hbase安裝包，根據(jù)你自己的需求下載對應(yīng)的安裝包
wget http://archive.apache.org/dist/hbase/0.98.24/hbase-0.98.24-hadoop2-bin.tar.gz也可以直接去鏡像網(wǎng)站下載，地址：http://archive.apache.org/dist/
下載好后，解壓安裝包
tar -zxvf hbase-0.98.24-hadoop2-bin.tar.gz添加Hbase的環(huán)境變量
//打開~/.bashrc文件
vim ~/.bashrc
//然后在里邊追加兩行
export HBASE_HOME=/usr/local/src/hbase-0.98.24-hadoop2
export PATH=$PATH:$HBASE_HOME/bin
//然后保存退出，source一下
source ~/.bashrc配置Hbase
打開Hbase目錄下conf/hbase-env.sh（如果沒有新建一個(gè)）
vim conf/hbase-env.sh
//添加下邊兩個(gè)配置
export JAVA_HOME=/usr/local/src/jdk1.8.0_171 //java home
export HBASE_MANAGES_ZK=false //是否使用自帶的zookeeper，自己有安裝的話就用自己的，沒有就用自帶的配置hbase-site.xml文件
vim conf/hbase-site.xml
//添加如下配置
<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://master:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>master,slave1,slave2</value>
</property>
<property>
<name>dfs.replication</name>
<value>2</value>
</property>
</configuration>修改regionservers文件
vim conf/regionservers
//添加需要安裝regionserver的機(jī)器節(jié)點(diǎn)
slave1
slave2到這里Hbase簡單的環(huán)境就搭建好了
Hbase的啟動
啟動Hbase需要首先啟動Hadoop和zookeeper
啟動Hadoop
master機(jī)器節(jié)點(diǎn)
//進(jìn)入到Hadoop目錄的sbin下
./start-all.sh查看Hadoop是不是啟動成功
master機(jī)器節(jié)點(diǎn)，jps查看進(jìn)程看到圖中進(jìn)程說明成功啟動
slave機(jī)器節(jié)點(diǎn)，jps查看
Zookeeper啟動
master和slave節(jié)點(diǎn)都執(zhí)行，進(jìn)入zookeeper安裝目錄bin目錄下
zkServer.sh start然后jps查看進(jìn)程，能看到QuorumPeerMain說明Zookeeper啟動成功
####啟動Hbase
在Hadoop和Zookeeper都啟動之后就可以啟動Hbase了，進(jìn)入Hbase的安裝目錄的bin目錄下
./start-hbase.shjps查看進(jìn)程，在master能看到Hmaster進(jìn)程，在slave節(jié)點(diǎn)能看到HRegionServer進(jìn)程，說明Hbase啟動成功
也可以通過網(wǎng)址來檢查，http://master:60010/master-status
Hbase簡單的shell命令操作
進(jìn)入shell命令模式，在bin目錄下執(zhí)行
./hbase shell
hbase(main):001:0>- 查看當(dāng)前所有表
hbase(main):003:0> list
table
0 row(s) in 0.1510 seconds
=> []- 創(chuàng)建表
hbase(main):006:0> create 'test_table' , 'mate_data', 'action'
0 row(s) in 2.4390 seconds
=> Hbase::Table - test_table- 查看表詳情
hbase(main):009:0> desc 'test_table'
Table test_table is ENABLED
test_table
COLUMN FAMILIES DESCRIPTION
{NAME => 'action', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_EN
CODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536',
REPLICATION_SCOPE => '0'}
{NAME => 'mate_data', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK
_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536
', REPLICATION_SCOPE => '0'}
2 row(s) in 0.0520 seconds- 增加列簇
hbase(main):010:0> alter 'test_table', {NAME => 'new', VERSIONS => '2', IN_MEMORY => 'true'}
Updating all regions with the new schema...
0/1 regions updated.
1/1 regions updated.
Done.
0 row(s) in 2.2790 seconds
hbase(main):011:0> desc 'test_table'
Table test_table is ENABLED
test_table
COLUMN FAMILIES DESCRIPTION
{NAME => 'action', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_EN
CODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536',
REPLICATION_SCOPE => '0'}
{NAME => 'mate_data', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK
_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536
', REPLICATION_SCOPE => '0'}
{NAME => 'new', BLOOMFILTER => 'ROW', VERSIONS => '2', IN_MEMORY => 'true', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODI
NG => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPL
ICATION_SCOPE => '0'}
3 row(s) in 0.0570 seconds- 刪除列簇
hbase(main):013:0> alter 'test_table', {NAME => 'new', METHOD => 'delete'}
Updating all regions with the new schema...
0/1 regions updated.
1/1 regions updated.
Done.
0 row(s) in 2.2390 seconds
hbase(main):014:0> desc 'test_table'
Table test_table is ENABLED
test_table
COLUMN FAMILIES DESCRIPTION
{NAME => 'action', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_EN
CODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536',
REPLICATION_SCOPE => '0'}
{NAME => 'mate_data', BLOOMFILTER => 'ROW', VERSIONS => '1', IN_MEMORY => 'false', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK
_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536
', REPLICATION_SCOPE => '0'}
2 row(s) in 0.0430 seconds- 刪除表
//首先disable
hbase(main):016:0> disable 'test_table'
0 row(s) in 1.2980 seconds
//然后再刪除
hbase(main):017:0> drop 'test_table'
0 row(s) in 0.2020 seconds
//查看是否刪除
hbase(main):018:0> list
table
0 row(s) in 0.0070 seconds
=> []- 往表里寫數(shù)據(jù)并查看
hbase(main):021:0> put 'test_table', '1001', 'mate_data:name', 'zhangsan'
0 row(s) in 0.1400 seconds
hbase(main):022:0> put 'test_table', '1002', 'mate_data:name', 'lisi'
0 row(s) in 0.0110 seconds
hbase(main):023:0> put 'test_table', '1001', 'mate_data:gender', 'woman'
0 row(s) in 0.0170 seconds
hbase(main):024:0> put 'test_table', '1002', 'mate_data:age', '25'
0 row(s) in 0.0140 seconds
hbase(main):025:0> scan 'test_table'
ROW COLUMN+CELL
1001 column=mate_data:gender, timestamp=1540034584363, value=woman
1001 column=mate_data:name, timestamp=1540034497293, value=zhangsan
1002 column=mate_data:age, timestamp=1540034603800, value=25
1002 column=mate_data:name, timestamp=1540034519659, value=lisi
2 row(s) in 0.0410 seconds
- 讀取數(shù)據(jù)
hbase(main):026:0> get 'test_table', '1001'
COLUMN CELL
mate_data:gender timestamp=1540034584363, value=woman
mate_data:name timestamp=1540034497293, value=zhangsan
2 row(s) in 0.0340 seconds
hbase(main):027:0> get 'test_table', '1001', 'mate_data:name'
COLUMN CELL
mate_data:name timestamp=1540034497293, value=zhangsan
1 row(s) in 0.0320 seconds- 查看行數(shù)
hbase(main):028:0> count 'test_table'
2 row(s) in 0.0390 seconds
=> 2- 清空表數(shù)據(jù)
hbase(main):029:0> truncate 'test_table'
Truncating 'test_table' table (it may take a while):
- Disabling table...
- Truncating table...
0 row(s) in 1.5220 seconds通過Python腳本來操作Hbase
不能通過Python腳本來直接操作Hbase，必須要借助thrift服務(wù)作為中間層，所以需要兩個(gè)Python模塊：hbase模塊和thrift模塊，和安裝thrift來實(shí)現(xiàn)Python對Hbase的操作
####安裝thrift并獲得thrift模塊
- 下載安裝thrift
wget http://archive.apache.org/dist/thrift/0.11.0/thrift-0.11.0.tar.gz
tar -zxvf thrift-0.11.0.tar.gz
cd thrift-0.11.0/
./configure
make
make install
cd lib/py/build/lib.linux-x86_64-2.7然后就能看到thrift模塊
獲得hbase模塊
- 下載Hbase源碼包
wget http://archive.apache.org/dist/hbase/0.98.24/hbase-0.98.24-src.tar.gz
tar -zxvf hbase-0.98.24-src.tar.gz- 產(chǎn)生hbase模塊
//進(jìn)入該目錄
cd /usr/local/src/hbase-0.98.24/hbase-thrift/src/main/resources/org/apache/hadoop/hbase/thrift
//執(zhí)行如下命令，產(chǎn)生gen-py目錄
thrift --gen py Hbase.thrift
//進(jìn)入該目錄就能得到生成的hbase模塊
cd gen-py使用Python寫數(shù)據(jù)
- 創(chuàng)建表
from thrift.transport import TSocket
from thrift.protocol import TBinaryProtocol
from hbase import Hbase
from hbase.ttypes import *
transport = TSocket.TSocket('master', 9090)
transport = TTransport.TBufferedTransport(transport)
protocol = TBinaryProtocol.TBinaryProtocol(transport)
client = Hbase.Client(protocol)
transport.open()
base_info_contents = ColumnDescriptor(name='columnName1', maxVersions=1)
other_info_contents = ColumnDescriptor(name='columnName2', maxVersions=1)
client.createTable('tableName', [base_info_contents,other_info_contents])- 插入數(shù)據(jù)
from thrift.transport import TSocket
from thrift.protocol import TBinaryProtocol
from hbase import Hbase
from hbase.ttypes import *
transport = TSocket.TSocket('master', 9090)
transport = TTransport.TBufferedTransport(transport)
protocol = TBinaryProtocol.TBinaryProtocol(transport)
client = Hbase.Client(protocol)
transport.open()
table_name = 'tableName'
rowKey = 'rowKeyName'
mutations = [Mutation(column="columnName:columnPro", value="valueName")]
client.mutateRow(table_name,rowKey,mutations,None)
- 查看數(shù)據(jù)
from thrift.transport import TSocket
from thrift.protocol import TBinaryProtocol
from hbase import Hbase
from hbase.ttypes import *
transport = TSocket.TSocket('master', 9090)
transport = TTransport.TBufferedTransport(transport)
protocol = TBinaryProtocol.TBinaryProtocol(transport)
client = Hbase.Client(protocol)
transport.open()
table_name = 'tableName'
rowKey = 'rowKeyName'
result = client.getRow(table_name,rowKey,None)
for l in result:
print "the row is "+ l.row
for k,v in l.columns.items():
print '\t'.join([k,v.value])from thrift.transport import TSocket
from thrift.protocol import TBinaryProtocol
from hbase import Hbase
from hbase.ttypes import *
transport = TSocket.TSocket('master', 9090)
transport = TTransport.TBufferedTransport(transport)
protocol = TBinaryProtocol.TBinaryProtocol(transport)
client = Hbase.Client(protocol)
transport.open()
table_name = 'tableName'
scan = TScan()
id = client.scannerOpenWithScan(table_name,scan,None)
result = client.scannerGetList(id,10)
for l in result:
print "========="
print "the row is "+ l.row
for k,v in l.columns.items():
print '\t'.join([k,v.value])另外有需要云服務(wù)器可以了解下創(chuàng)新互聯(lián)scvps.cn，海內(nèi)外云服務(wù)器15元起步，三天無理由+7*72小時(shí)售后在線，公司持有idc許可證，提供“云服務(wù)器、裸金屬服務(wù)器、高防服務(wù)器、香港服務(wù)器、美國服務(wù)器、虛擬主機(jī)、免備案服務(wù)器”等云主機(jī)租用服務(wù)以及企業(yè)上云的綜合解決方案，具有“安全穩(wěn)定、簡單易用、服務(wù)可用性高、性價(jià)比高”等特點(diǎn)與優(yōu)勢，專為企業(yè)上云打造定制，能夠滿足用戶豐富、多元化的應(yīng)用場景需求。
網(wǎng)頁標(biāo)題：Hbase的安裝和基本使用-創(chuàng)新互聯(lián)
當(dāng)前地址：http://muchs.cn/article24/dsjjce.html
成都網(wǎng)站建設(shè)公司_創(chuàng)新互聯(lián)，為您提供動態(tài)網(wǎng)站、網(wǎng)站內(nèi)鏈、外貿(mào)建站、品牌網(wǎng)站設(shè)計(jì)、網(wǎng)頁設(shè)計(jì)公司、云服務(wù)器
聲明：本網(wǎng)站發(fā)布的內(nèi)容（圖片、視頻和文字）以用戶投稿、用戶轉(zhuǎn)載內(nèi)容為主，如果涉及侵權(quán)請盡快告知，我們將會在第一時(shí)間刪除。文章觀點(diǎn)不代表本網(wǎng)站立場，如需處理請聯(lián)系客服。電話：028-86922220；郵箱：631063699@qq.com。內(nèi)容未經(jīng)允許不得轉(zhuǎn)載，或轉(zhuǎn)載時(shí)需注明來源： 創(chuàng)新互聯(lián)
猜你還喜歡下面的內(nèi)容
- Tornado學(xué)習(xí)筆記(四)-創(chuàng)新互聯(lián)
- 批處理bat如何判斷是否特殊字符-創(chuàng)新互聯(lián)
- jQuery圖片加載失敗替換默認(rèn)圖片的示例分析-創(chuàng)新互聯(lián)
- in_array()函數(shù)怎么在PHP項(xiàng)目中使用-創(chuàng)新互聯(lián)
- android使用kotlin怎么實(shí)現(xiàn)點(diǎn)擊更換全局語言-創(chuàng)新互聯(lián)
- 虛擬主機(jī)根目錄如何查找-創(chuàng)新互聯(lián)
- C語言中基本的數(shù)據(jù)類型有哪些-創(chuàng)新互聯(lián)
- 導(dǎo)致網(wǎng)站排名下降的因素 2021-03-21
- 【SEO優(yōu)化】分析競爭網(wǎng)站更利于超越競爭對手的網(wǎng)站排名 2021-08-07
- 如何才能穩(wěn)定網(wǎng)站排名 2013-06-03
- 網(wǎng)站排名上不去的原因? 2015-12-22
- 網(wǎng)站排名與網(wǎng)站建設(shè)的哪些因素有關(guān) 2014-06-30
- 白帽百度優(yōu)化為什么網(wǎng)站排名見效時(shí)間長？ 2020-12-26
- 德州百度快照推薦實(shí)用的要害詞拓展東西補(bǔ)充網(wǎng)站排名少的缺憾 2023-01-24
- 成都百度排名網(wǎng)站排名 2022-07-07
- 網(wǎng)站排名上不去怎么辦？熟練掌握七招網(wǎng)站排名技巧 2023-04-14
- 網(wǎng)站排名優(yōu)化要注意什么方面 2013-12-26
- 仿站下來，網(wǎng)站排名怎么差這么多呢? 2022-12-12
- 網(wǎng)站排名公司：頂級域名和二級域名的區(qū)別？ 2016-11-14