Shulou(Shulou.com)05/31 Report--

This article mainly explains "what is the principle of Apache Atlas architecture". Interested friends may wish to have a look at it. The method introduced in this paper is simple, fast and practical. Let's let the editor take you to learn "what is the principle of Apache Atlas architecture"?

What is Atlas?

Nowadays, with the more and more extensive application of big data, data governance has always been a huge problem for enterprises.

Most companies simply deal with the data, but the consanguinity and classification of the data are difficult to achieve, and there is an urgent need for a technical framework focused on data governance in the market, when Atlas arises at the historic moment.

Atlas official website address: https://atlas.apache.org/

Atlas is the data governance and metadata framework of Hadoop.

Atlas is a set of scalable and scalable core underlying governance services that enable enterprises to effectively and efficiently meet compliance requirements in Hadoop and allow integration with the entire enterprise data ecosystem.

Apache Atlas provides organizations with open metadata management and governance capabilities to establish a catalogue of their data assets, classify and govern those assets, and provide collaborative capabilities around these data assets for data scientists, analysts, and data governance teams.

Atlas supports various Hadoop and non-Hadoop metadata types

Provides rich REST API for integration

The traceability of data consanguinity has reached the field level, and this technology does not have a similar framework that can be implemented.

There is also a good control over the authority.

Second, the principle of architecture

Atlas includes the following components:

Using Hbase to store metadata

Using Solr to realize Index

Ingest/Export acquisition and export components Type System type system Graph Engine graphics engine together constitute the core mechanism of Atlas

All functions are provided to users through API or can be integrated through Kafka messaging system.

Atlas supports various sources to obtain metadata: Hive,Sqoop,Storm.

And excellent UI support.

Third, effect picture

At this point, I believe you have a deeper understanding of "what is the principle of Apache Atlas architecture?" you might as well do it in practice. Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.