Shulou(Shulou.com)06/03 Report--

Timeline Service v2 default integration embed HBase(HMaster, HRegionServer), process start User: yarn-ats

Embedded HBase configuration file path: [yarn-ats@master1 embedded-yarn-ats-hbase]$ pwd/usr/hdp/3.1.0.0-78/hadoop-yarn/conf/embedded-yarn-ats-hbase[yarn-ats@master1 embedded-yarn-ats-hbase]$ ls -latotal 40drwxr-xr-x 2 yarn-ats hadoop 4096 March 9 10:32 .drwxr-xr-x 4 root root 4096 April 23 19:32.. - rw-r--r-- 1 yarn-ats hadoop 1462 March 7 09:22 hadoop-metrics2-hbase.properties-rw-r--r-- 1 yarn-ats hadoop 3374 April 23 20:41 hbase-env.sh-rw-r--r-- 1 yarn-ats hadoop 818 March 7 09:22 hbase_grant_permissions.sh-rw-r--r-- 1 yarn-ats hadoop 411 March 7 09:22 hbase-policy.xml-rw-r--r-- 1 yarn-ats hadoop 5394 March 7 09:22 hbase-site.xml-rw-r--r-- 1 yarn-ats hadoop 5315 March 7 09:22 log4j.properties

hbase-site.xml file

dfs.domain.socket.path /var/lib/hadoop-hdfs/dn_socket hbase.bucketcache.ioengine hbase.bucketcache.percentage.in.combinedcache hbase.bucketcache.size hbase.client.keyvalue.maxsize 1048576 hbase.client.retries.number 7 hbase.client.scanner.caching 100 hbase.cluster.distributed true hbase.coprocessor.master.classes hbase.coprocessor.region.classes hbase.coprocessor.regionserver.classes hbase.defaults.for.version.skip true hbase.hregion.majorcompaction 604800000 hbase.hregion.majorcompaction.jitter 0.50 hbase.hregion.max.filesize 10737418240 hbase.hregion.memstore.block.multiplier 4 hbase.hregion.memstore.flush.size 134217728 hbase.hregion.memstore.mslab.enabled true hbase.hstore.blockingStoreFiles 10 hbase.hstore.compaction.max 10 hbase.hstore.compactionThreshold 3 hbase.local.dir ${hbase.tmp.dir}/local hbase.master.info.bindAddress 0.0.0.0 hbase.master.info.port 17010 hbase.master.namespace.init.timeout 2400000 hbase.master.port 17000 hbase.master.ui.readonly false hbase.master.wait.on.regionservers.timeout 30000 hbase.regionserver.executor.openregion.threads 20 hbase.regionserver.global.memstore.size 0.4 hbase.regionserver.handler.count 30 hbase.regionserver.info.port 17030 hbase.regionserver.port 17020 hbase.rootdir /atsv2/hbase/data hbase.rpc.protection authentication hbase.rpc.timeout 90000 hbase.security.authentication simple hbase.security.authorization false hbase.superuser yarn hbase.tmp.dir /tmp/hbase-${user.name} hbase.zookeeper.property.clientPort 2181 hbase.zookeeper.quorum manager.bigdata.com,master2.bigdata.com,master1.bigdata.com hbase.zookeeper.useMulti true hfile.block.cache.size 0.4 zookeeper.recovery.retry 6 zookeeper.session.timeout 90000 zookeeper.znode.parent /atsv2-hbase-unsecure

Zookeeper Cluster znode information

[zookeeper@master1 zookeeper-client]$ bin/zkCli.sh -server master1.bigdata.com:2181[zk: master1.bigdata.com:2181(CONNECTED) 1] ls /atsv2-hbase-unsecure[replication, meta-region-server, rs, splitWAL, backup-masters, table-lock, flush-table-proc, master-maintenance, online-snapshot, switch, master, running, draining, namespace, hbaseid, table][zk: master1.bigdata.com:2181(CONNECTED) 2] ls /atsv2-hbase-unsecure/rsUI Interfacehttp://master1.bigdata.com:17010/Table listprod.timelineservice.app_flowprod.timelineservice.applicationprod.timelineservice.entity prod.timelineservice.flowactivityprod.timelineservice.flowrunprod.timelineservice.subapplication

TTL: Default 30 days

Hbase shell execute hbase --config /usr/hdp/3.1.0.0-78/hadoop-yarn/conf/embedded-yarn-ats-hbase shellhbase(main):004:0* status1 active master, 0 backup masters, 1 servers, 0 dead, 124.0000 average loadTook 1.2255 seconds hbase(main):005:0> listTABLE prod.timelineservice.app_flow prod.timelineservice.application prod.timelineservice.entity prod.timelineservice.flowactivity prod.timelineservice.flowrun prod.timelineservice.subapplication 6 row(s)Took 0.0862 seconds => ["prod.timelineservice.app_flow", "prod.timelineservice.application", "prod.timelineservice.entity", "prod. timelineservice.flowactivity", "prod. timelineservice.flowrun", "prod.timelineservice.subapplication"]hbase(main):018:0> scan 'prod.timelineservice.app_flow', { COLUMNS => ['m'], LIMIT => 10 }HDFS Storage Path

/atsv2/hbase

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.