Shulou(Shulou.com)06/02 Report--

It is believed that many inexperienced people have no idea about how to realize the data consanguinity function in Amundsen. Therefore, this paper summarizes the causes and solutions of the problem. Through this article, I hope you can solve this problem.

New concept

Lineage: this is a term that represents the transfer of a data stream from one entity to another. In particular, the ETL process focuses on the data flow process from table to table and column to column.

Upstream: data flows from upstream to downstream, and Upstream represents the current data source.

Downstream: represents the relevant entity that uses the current data.

Table level

The page is divided into two tabs: Upstream and Downstream.

Each tab will contain a list of tables from which data is inherited or used. This allows the user to view it in a very simple way.

Column level

Similar to the table level, it can be viewed by extending the metadata of the column.

Of course, this is only a preliminary design, there may be more changes in the future, we will continue to pay attention to.

An implementation diagram of this function of Apache Atlas is attached.

After reading the above, have you mastered the method of how to realize the data consanguinity function in Amundsen? If you want to learn more skills or want to know more about it, you are welcome to follow the industry information channel, thank you for reading!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.