Shulou(Shulou.com)06/03 Report--

Cdh version: 5.14

Mainly refer to the official document: https://www.cloudera.com/documentation/enterprise/5-14-x/topics/sentry.html

one。 Deploy sentry services

1. Configuration: it is officially recommended that the heap size of hive metastore be set to at least 10GB:

Set the HMS heap size to at least 10 GB. This is required because by default, Sentry uses 12 connections to communicate with HMS. To verify the HMS heap size, open the Hive service, click the Configuration tab, and search for the Java Heap Size of Hive Meatstore Server in Bytes property.

For every million objects in hive (including servers, databases, tables, partitions, columns, URIs, and views), the Heap Size of sentry requires 2.25GB accordingly:

Cloudera recommends that for each Sentry host, you have 2.25 GB memory per million objects in the Hive database. Hive objects include servers, databases, tables, partitions, columns, URIs, and views.

Make sure that the JVM heap size is set to a value that is appropriate for the memory requirements. You can check the heap size in Cloudera Manager. Open the Sentry service, click the Configuration tab, and search for the Java Heap Size of Sentry Server in Bytes property. Set that property to the maximum size for the Java process heap memory.

two。 Install sentry

Add a sentry service to CDH

3. Preparation before starting the sentry service

Using the default Hive warehouse directory-Permissions on the warehouse directory must be set as follows (see following Note for caveats):

771 on the directory itself (by default, / user/hive/warehouse)

771 on all subdirectories (for example, / user/hive/warehouse/mysubdir)

All files and subdirectories should be owned by hive:hive

For example:

$sudo-u hdfs hdfs dfs-chmod-R 771 / user/hive/warehouse

$sudo-u hdfs hdfs dfs-chown-R hive:hive / user/hive/warehouse

Check to enable senrty authentication in the hive service

Remove hiveserver2 configuration items: HiveServer2 Enable Impersonation

Add yarn nodemanager option-Allowed System Users: add hive

Configure hadoop.proxyuser.hive.groups in hive and add hive,hue,sentry

two。 Integration

1.hive configuration item Sentry service, select sentry

2.impala configuration item Sentry Service Select sentry

3.hue configuration item Sentry Service Select sentry

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.