Shulou(Shulou.com)05/31 Report--

This article will explain in detail how to compile Atlas. The editor thinks it is very practical, so I share it with you as a reference. I hope you can get something after reading this article.

Atlas is a tool for turning metadata into a graph.

Http://atlas.apache.org/

Atlas is a set of scalable and scalable core underlying governance services that enable enterprises to effectively meet compliance requirements in Hadoop and allow integration with the entire enterprise data ecosystem.

Apache Atlas provides organizations with open metadata management and governance capabilities to establish a catalogue of their data assets, classify and govern those assets, and provide collaborative capabilities around these data assets for data scientists, analysts, and data governance teams.

So how do you install and use Altas?

There are many installation holes in Atlas. This tutorial will introduce the whole installation process of Atlas2.1.0 in detail. If you have any questions, you are welcome to pay attention to real-time streaming computing.

Backstage message ~

download

Please go to the official website https://atlas.apache.org/#/Downloads

Download the corresponding version of the source code package this article uses the latest version 2.1.0

The speed of domestic sites is faster.

Https://mirrors.tuna.tsinghua.edu.cn/apache/atlas/2.1.0/apache-atlas-2.1.0-sources.tar.gz

Compile

What is more difficult is that Atlas does not provide the installation package to download, but the source package needs to be compiled and packaged by itself.

Note that you need to install maven first, because this is a java web project developed using maven. The maven3.6.3 version is fine.

Install maven

Some download addresses

Http://maven.apache.org/download.cgi

Https://mirrors.tuna.tsinghua.edu.cn/apache/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz

Upload to the / usr/local directory of linux

Cd / usr/local

Extract the file

Tar-zxvf apache-maven-3.6.3-bin.tar.gz

Configure environment variables

Vi / etc/profile

Export MAVEN_HOME=/usr/local/apache-maven-3.6.3

Export PATH=MAVEN_HOME/bin:PATH

Refresh environment variables

Source / etc/profile

Check the version

Mvn-v

Configure the environment variables of maven. Note that domestic images of maven need to be configured. Generally, Ali, Huawei, Tsinghua and other images such as vi / usr/local/apache-maven-3.6.3/conf/settings.xml are used.

Alimaven

Aliyun maven

Http://maven.aliyun.com/nexus/content/groups/public/

Central

Copy this setting.xml to ~ / .m2/

Cp settings.xml .m2 /

Compile Atlas

Decompress the source package

Tar-zxvf apache-atlas-2.1.0-sources.tar.gz

1. Modify the pom.xml of the atlas source project

Modify dependent versions such as hbase zookeeper hive to a consistent version (or a compatible version) in your own environment

Parent project pom file

3.4.14

2.2.3

7.7.2

two。 Perform maven compilation and packaging

Atlas can use embedded hbase-solr as the underlying index storage and search component, or external hbase and solr. If you want to use embedded hbase-solr, use the following command to compile and package cd apache-atlas-sources-2.1.0/ export MAVEN_OPTS= "- Xms2g-Xmx2g" mvn clean-DskipTests package-Pdist,embedded-hbase-solr

No need to build in. Just mvn clean-DskipTests package-Pdist.

After changing the path, we will wait very quickly and patiently.

The webui submodule of atlas relies on nodejs, which downloads the dependent libraries from the central repository of nodejs.

After the compilation is completed, the packaging result will be generated in the new distro/target directory in the source directory.

Note that there are both compressed and decompressed packages produced here. In the hook package, you can see that there are hook packages for various platforms.

As the name implies, this is the hook package, that is, each big data framework will provide a variety of lifecycle callback functions and provide the relevant information in the form of data. These hooks can listen and receive data.

If there are no errors and see a row of success, it is a success.

This is the end of the article on "how to compile Atlas". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, please share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.