Shulou(Shulou.com)06/03 Report--

In the previous phase, it took almost two weeks to introduce the operation of setting up and installing DKhadoop. The download of the DKhadoop installation package is only said by the way, but it seems that the fast search server is being updated, and the new download page is not easy to use! Many friends left messages saying that the search site could not be downloaded. I have uploaded the previously downloaded version to the network disk, and friends who need the DKhadoop installation package can download it directly through the network disk!

Download the DKHadoop installation package:

About the DKhadoop version, it was mentioned when writing the Hadoop environment to build and deploy. The major versions are DKHadoop standard version, DKH- distributed SQL version, and DKHadoop commercial version. What we can download by ourselves, including the version of the installation package I downloaded before, is a three-node learning version. The DKhadoop standard version has a stand-alone version for testing, a 3-node learning version, and a 5-node standard server version for personal research and development. 3 nodes were previously provided for free download, 5 nodes may need to submit an application, but fortunately, it is also free!

Download address of DKHadoop installation package:

Https://pan.baidu.com/s/1-427Sh7lTLrLAPh7KMOYVg

Password: vg2w

DKM platform monitoring parameters description:

The content of platform monitoring parameters is mainly for friends who download and install DKHadoop. Here are some simple monitoring parameters.

1. Home page monitoring interface

(1) average cluster load

Monitoring cluster CUP load

The vertical axis represents the number of tasks, in units

The horizontal axis represents time, in minutes.

Indicates the number of tasks waiting in the cluster. For example, the red line of 1 minute represents the number of tasks that need to be executed within 1 minute, and the line of 5 minutes represents the number of tasks that need to be executed within 5 minutes.

(2) Cluster disk IO

Monitoring cluster disk IO

The vertical axis represents the reading and writing speed, in KB/S

The horizontal axis represents time, in minutes.

The disk byte write speed indicates the speed at which the disk is written. The number of disk bytes read indicates the speed at which the disk is read. The unit is KB/S

(3) Cluster disk usage

Monitor cluster disk usage

The vertical axis represents disk space in GB

The horizontal axis represents time, in minutes.

Total: represents the total space of the cluster disk

Free: represents free space

Used: indicates the space already used

2. HDFS monitoring interface (1) HDFS capacity monitoring

Monitor the capacity of HDFS in the cluster

The vertical axis represents the capacity of the HDFS, in GB

The horizontal axis represents time, in minutes.

(2) number of bytes read by DataNode

Monitor the amount of DataNode read in the cluster

The vertical axis represents the number of DataNode bytes in B

The horizontal axis represents time, in minutes.

(3) number of bytes written by DataNode

Monitor the amount of DataNode writes in the cluster

The vertical axis represents the number of DataNode bytes in B

The horizontal axis represents time, in minutes.

3. Hbase monitoring interface

(1) Total number of RegionServer

Monitor the total number of RegionServer

The vertical axis represents the quantity, in units

The horizontal axis represents time, in minutes.

(2) the number of memstoresize in RegionServer

Monitor the number of memstoresize in RegionServer

The vertical axis represents the quantity, in units

The horizontal axis represents time, in minutes.

(3) number of RegionServer read and write requests

Monitor the number of RegionServer read and write requests

The vertical axis represents times per second, in seconds

The horizontal axis represents time, in minutes.

(4) Total number of store in RegionServer

Monitor the total number of store in RegionServer

The vertical axis represents the number of store, per unit

The horizontal axis represents time, in minutes.

(5) Total number of storFile in RegionServer

Monitor the total number of storeFile in RegionServer

The vertical axis represents the number of storeFile, per unit

The horizontal axis represents time, in minutes.

DKH platform monitoring parameters are too many, this article will briefly introduce these, otherwise the length of the code is too long, looking tired! Next time, we will explain the parameters of the monitoring platform. I'll try to finish what I know. The focus of this article is still the top part of the installation package download, the extraction code is also given above. Download and play!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.