cdh5beta2集群配置文件的示例分析

這篇文章給大家分享的是有關(guān)cdh5 beta2集群配置文件的示例分析的內(nèi)容。小編覺得挺實(shí)用的，因此分享給大家做個(gè)參考，一起跟隨小編過來看看吧。

目前創(chuàng)新互聯(lián)建站已為超過千家的企業(yè)提供了網(wǎng)站建設(shè)、域名、網(wǎng)頁空間、網(wǎng)站改版維護(hù)、企業(yè)網(wǎng)站設(shè)計(jì)、建甌網(wǎng)站維護(hù)等服務(wù)，公司將堅(jiān)持客戶導(dǎo)向、應(yīng)用為本的策略，正道將秉承"和諧、參與、激情"的文化，與客戶和合作伙伴齊心協(xié)力一起成長，共同發(fā)展。

注意：需要自己配置java環(huán)境，ssh通信
版本：hadoop:hadoop-2.2.0-cdh6.0.0-beta-2.tar.gz
      zookeeper:zookeeper-3.4.5-cdh6.0.0-beta-2.tar.gz
      hbase:hbase-0.96.1.1-cdh6.0.0-beta-2.tar.gz
下載地址：http://archive.cloudera.com/cdh6/cdh/5/
Hadoop：
core-site.xml
===========================================
<configuration>
        <property>
                <name>fs.default.name</name>
                <value>hdfs://master:8020</value>
                <final>true</final>
        </property>
         <property>
                <name>dfs.namenode.name.dir</name>
                <value>/usr/local/hd/dfs/name</value>
         </property>
        <property>
                 <name>hadoop.tmp.dir</name>
                 <value>/usr/local/hd/tmp</value>
                 <description>A base for other temporary directories.</description>
        </property>
        <property>
                 <name>hadoop.proxyuser.hadoop.hosts</name>
                 <value>*</value>
        </property>
        <property>
                 <name>hadoop.proxyuser.hadoop.groups</name>
                 <value>*</value>
        </property>
</configuration>
==================================================
hdfs-site.xml
==================================================
<configuration>
        <property>
                <name>dfs.datanode.data.dir</name>
                <value>/usr/local/hd/dfs/data</value>
        </property>
        <property>
                <name>dfs.replication</name>
                <value>2</value>
        </property>
        <property>
                <name>dfs.permissions</name>
                <value>false</value>
        </property>
        <property>
               <name>dfs.namenode.secondary.http-address</name>
               <value>master:8021</value>
         </property>
         <property>
               <name>dfs.webhdfs.enabled</name>
               <value>true</value>
         </property>
         <property>
                 <name>dfs.web.ugi</name>
                 <value>hadoop,supergroup,zzg</value>
         </property>
</configuration>
===============================================================
maped-site.xml
===============================================================
<configuration>
        <property>
                <name>mapreduce.framework.name</name>
                <value>yarn</value>
        </property>
        <property>
                <name>mapreduce.jobhistory.address</name>
                <value>master:10020</value>
        </property>
        <property>
                <name>mapreduce.jobhistory.webapp.address</name>
                <value>master:19888</value>
        </property>?
</configuration>
=================================================================
yarn-site.xml
===============================================================
<configuration>

<!-- Site specific YARN configuration properties -->
                <property>
                　　<name>yarn.resourcemanager.address</name>
                　　<value>master:8032</value>
                </property>
         
                <property>
                　　<name>yarn.resourcemanager.scheduler.address</name>
                　　<value>master:8030</value>
                </property>      
                <property>
                　　<name>yarn.resourcemanager.resource-tracker.address</name>
                　　<value>master:8031</value>
                </property>
                 
                <property>
                　　<name>yarn.resourcemanager.admin.address</name>
                　　<value>master:8033</value>
                </property>
                 
                <property>
                　　<name>yarn.resourcemanager.webapp.address</name>
                　　<value>master:8088</value>
                </property>
        <property>
                <name>yarn.nodemanager.aux-services</name>
                <value>mapreduce_shuffle</value>
        </property>
        <property>
                <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
                <value>org.apache.hadoop.mapred.ShuffleHandler</value>
        </property>
</configuration>
============================================================
zookeeper
zoo.cfg
==========================================================

# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial 
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between 
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just 
# example sakes.
dataDir=/usr/local/hd/zookeeper/data
# the port at which the clients will connect
clientPort=2181
server.1=master:2888:3888  
server.2=slave1:2888:3888  
server.3=slave2:2888:3888  
#
# Be sure to read the maintenance section of the 
# administrator guide before turning on autopurge.
#
# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
#
# The number of snapshots to retain in dataDir
#autopurge.snapRetainCount=3
# Purge task interval in hours
# Set to "0" to disable auto purge feature
#autopurge.purgeInterval=1
==========================================================
hbase
hbase-site.xml
========================================================
<configuration>
        <property> 
                <name>hbase.rootdir</name> 
                <value>hdfs://master:8020/hbase</value> 
        </property> 
        <property> 
                <name>hbase.cluster.distributed</name> 
                <value>true</value> 
        </property> 
        <property> 
                <name>hbase.zookeeper.quorum</name> 
                <value>master,slave1,slave2</value>
       </property>
        <property>
                <name>hbase.zookeeper.property.clientPort</name>
                 <value>2181</value>
       </property>
       <property>
                <name>hbase.zookeeper.property.dataDir</name>
                <value>/usr/local/hd/zookeeper/data</value>
       </property>
</configuration>
===========================================================

感謝各位的閱讀！關(guān)于“cdh5 beta2集群配置文件的示例分析”這篇文章就分享到這里了，希望以上內(nèi)容可以對大家有一定的幫助，讓大家可以學(xué)到更多知識，如果覺得文章不錯，可以把它分享出去讓更多的人看到吧！

網(wǎng)頁名稱：cdh5beta2集群配置文件的示例分析
文章出自：http://muchs.cn/article20/ihcdjo.html

成都網(wǎng)站建設(shè)公司_創(chuàng)新互聯(lián)，為您提供網(wǎng)站排名、服務(wù)器托管、營銷型網(wǎng)站建設(shè)、Google、網(wǎng)站建設(shè)、建站公司

廣告

聲明：本網(wǎng)站發(fā)布的內(nèi)容（圖片、視頻和文字）以用戶投稿、用戶轉(zhuǎn)載內(nèi)容為主，如果涉及侵權(quán)請盡快告知，我們將會在第一時(shí)間刪除。文章觀點(diǎn)不代表本網(wǎng)站立場，如需處理請聯(lián)系客服。電話：028-86922220；郵箱：631063699@qq.com。內(nèi)容未經(jīng)允許不得轉(zhuǎn)載，或轉(zhuǎn)載時(shí)需注明來源： 創(chuàng)新互聯(lián)

網(wǎng)站建設(shè)網(wǎng)站維護(hù)公司