在centos系统中，hbase的资源调度主要依赖于yarn（yet another Resource negotiator）来实现。以下是hbase在centos中进行资源调度的基本步骤：
1. 安装和配置YARN
首先，确保你的CentOS系统上已经安装了hadoop和YARN。如果没有安装，可以参考Hadoop官方文档进行安装和配置。
安装Hadoop
wget https://archive.apache.org/dist/hadoop/common/hadoop-3.3.1/hadoop-3.3.1.tar.gz tar -xzvf hadoop-3.3.1.tar.gz -C /usr/local/
配置Hadoop
编辑/usr/local/hadoop/etc/hadoop/core-site.xml：
<<span>configuration></span> <<span>property></span> <<span>name></span>fs.defaultFS</<span>name></span> <<span>value></span>hdfs://localhost:9000</<span>value></span> </<span>property></span> </<span>configuration></span>
编辑/usr/local/hadoop/etc/hadoop/hdfs-site.xml：
<<span>configuration></span> <<span>property></span> <<span>name></span>dfs.replication</<span>name></span> <<span>value></span>1</<span>value></span> </<span>property></span> </<span>configuration></span>
编辑/usr/local/hadoop/etc/hadoop/yarn-site.xml：
<<span>configuration></span> <<span>property></span> <<span>name></span>yarn.nodemanager.aux-services</<span>name></span> <<span>value></span>mapreduce_shuffle</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>yarn.nodemanager.resource.memory-mb</<span>name></span> <<span>value></span>4096</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>yarn.nodemanager.resource.cpu-vcores</<span>name></span> <<span>value></span>4</<span>value></span> </<span>property></span> </<span>configuration></span>
2. 启动Hadoop集群
启动HDFS和YARN：
start-dfs.sh start-yarn.sh
3. 配置HBase使用YARN
编辑HBase的配置文件/usr/local/hbase/conf/hbase-site.xml，添加以下配置：
<<span>configuration></span> <<span>property></span> <<span>name></span>hbase.rootdir</<span>name></span> <<span>value></span>hdfs://localhost:9000/hbase</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.cluster.distributed</<span>name></span> <<span>value></span>true</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.zookeeper.quorum</<span>name></span> <<span>value></span>localhost</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.zookeeper.property.dataDir</<span>name></span> <<span>value></span>/usr/local/hbase/zookeeper</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.master.info.port</<span>name></span> <<span>value></span>16000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.info.port</<span>name></span> <<span>value></span>16020</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.handler.count</<span>name></span> <<span>value></span>100</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.global.memstore.size</<span>name></span> <<span>value></span>0.4</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.wal.codec</<span>name></span> <<span>value></span>org.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.blocksize</<span>name></span> <<span>value></span>64M</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.writer.impl</<span>name></span> <<span>value></span>org.apache.hadoop.hbase.regionserver.wal.HLogWriterFactory</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.count</<span>name></span> <<span>value></span>1</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.impl</<span>name></span> <<span>value></span>org.apache.hadoop.hbase.regionserver.wal.Syncer</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint</<span>name></span> <<span>value></span>100</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.interval</<span>name></span> <<span>value></span>300000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>60000</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.size</<span>name></span> <<span>value></span>104857600</<span>value></span> </<span>property></span> <<span>property></span> <<span>name></span>hbase.regionserver.hlog.syncer.checkpoint.timeout</<span>name></span> <<span>value></span>6000
© 版权声明
文章版权归作者所有，未经允许请勿转载。
THE END
