Shulou(Shulou.com)05/31 Report--

This article introduces the knowledge of "how to configure the timeout of hbase client access". In the operation of actual cases, many people will encounter such a dilemma, so let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something!

You can configure the following parameters:

1. The timeout of hbase.rpc.timeout:rpc is 60s by default. Modification is not recommended to avoid affecting normal business. The online environment was initially configured for 3 seconds, and a large number of timeout error was found after running for half a day. The reason is that a region has the following problems blocking the write operation: "Blocking updates … memstore size 434.3m is > = than blocking 256.0m size" cannot be too low.

2. The timeout for ipc.socket.timeout:socket to establish a link should be less than or equal to the timeout for rpc. The default is 20s.

3. Hbase.client.retries.number: number of retries. Default is 14 and can be configured to 3.

4. Hbase.client.pause: the sleep time of retry is 1 second by default, which can be reduced, such as 100ms

5. The number of retries of zookeeper.recovery.retry:zk can be adjusted to 3. Zk does not hang up easily, and if there is a problem with the hbase cluster, each retry will retry zk. The total number of retries of zk is: hbase.client.retries.number * zookeeper.recovery.retry, and the sleep time of each retry will increase exponentially by 2. Every visit to hbase will retry. If multiple zk accesses are involved in a hbase operation. If zk is not available, there will be many zk retries, which is a waste of time.

6. The sleep time of zookeeper.recovery.retry.intervalmill:zk retry is 1s by default, which can be reduced, such as 200ms

7. The timeout for each interaction with server in hbase.regionserver.lease.period:scan query is 60s by default, but can not be adjusted.

This is the end of the content of "how to configure the timeout for hbase client access". Thank you for reading. If you want to know more about the industry, you can follow the website, the editor will output more high-quality practical articles for you!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.