Shulou(Shulou.com)06/01 Report--

Hbase.client.scanner.caching

Defines the number of rows retrieved when the next method is called in the scanner. The higher the number, the fewer remote calls the client needs to make to the RegionServer during the scan. The higher the value, the more memory the client consumes.

Hbase.balancer.period

The region equalizer runs periodically in HBase Master. This attribute defines the time interval for the equalizer to run, which defaults to 5 minutes in milliseconds.

Hbase.client.write.buffer

Client HTable instance write cache (in Byte). The larger the RPC, the fewer calls it makes and the more memory it takes up.

Hbase.hregion.majorcompaction

Big mergers, periodic mergers. Milliseconds are units, and the default is one day. (it is usually not recommended to turn it on)

Hbase.hregion.max

The maximum value of the underlying storage file HStoreFile. The region size is defined by this parameter. If the storage file of the column family exceeds this value, the region is split.

Hbase.hregion.memstore.flush.size

The maximum value of MemStore, in Byte. When MemStore exceeds this value, it will be written to disk. A thread that runs periodically checks the size of the MemStore. The thread running frequency can be defined by the hbase.server.thread.wakefrequency.

Hbase.server.thread.wakefrequency

Hbase.hregion.memstore.mslab.enabled

MemStore-Local Allocation Buffer is a feature of HBase to prevent heap fragmentation in the event of intensive writes. Enabling it will generally solve the problem that the garbage collection pause is too long due to the large heap. The default is true.

Hbase.hstore.blockingStoreFiles

If the number of files stored in a column family in the region exceeds this value, the write will block until the merge is complete or the blocking timeout. Timeout is set with hbase.hstore.blockingWaitTime (in milliseconds).

Hbase.hstore.blockingWaitTime

Hbase.hstore.compaction.max

Configure the maximum number of files to merge in a single small merge. The default is 7.

Hbase.hstore.compactionThreshold

When the number of stored files for a column family reaches this value, HBase performs a merge on that region. The higher the value set to this parameter, the lower the frequency of the merge, but the longer it takes.

Hbase.mapreduce.hfileoutputformat.blocksize

The HFile block size is set at each column family level of each table, and this parameter determines the granularity of HFile indexing. The smaller the block, the better the random read performance, and the more space the block index takes up, the more memory is consumed. When you use HFileOutputFormat to write data directly to HFile in a MapReduce job, you must use this attribute to define the block size.

Hbase.master.info.port

Define user access port

Http://master:port, default is 60010

Hbase.master.port

Is the Master process listener port. The default value is 60000.

Hbase.regionserver.port

Listening port of RegionServer

Hbase.regionserver.global.memstore.lowerLimithbase.regionserver.global.memstore.upperLimit

UpperLimit defines the total percentage of heap that MemStore can use on a RegionServer. When upperLimit is encountered, MemStore is written to the hard drive until it stops when it encounters lowerLimit.

Hbase.regionserver.handler.count

Number of RPC snooping that can be started on RegionServer and Master processes

Hbase.regionserver.optionallogflushinterval

No matter how much edits there is in the HLog file, how often Hlog must overwrite the file system. This is the time interval for forced writing, in milliseconds. The default is 1000ms.

Hbase.regionserver.regionSplitLimit

The maximum number of region a system has. The default is MAX_INT (2147483647).

Hbase.tmp.dir

Local HBase uses temporary directories

Hfile.block.cache.size

The maximum number of heaps that can be used by the block cache. The block caching algorithm is LRU.

Zookeeper.session.timeout

Both the HBase daemon and the client are Zookeeper clients. This parameter is the session timeout between them and Zookeeper, in milliseconds.

Zookeeper.znode.parent

In ZooKeeper, the HBase and znode root directories, the default is / hbase. All HBase ZooKeeper files are configured to use this directory as the parent directory.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.