Shulou(Shulou.com)06/01 Report--

In this issue, the editor will bring you about why you use oozie coordinator. The article is rich in content and analyzes and narrates it from a professional point of view. I hope you can get something after reading this article.

Workflow supported by Oozie, workflow definition is defined by organizing multiple Hadoop Job definitions in a certain order, and then running as a whole according to a given path. A workflow has been defined, and by launching the workflow Job, multiple Hadoop Job contained in the workflow will be executed until it is completed, which is the life cycle of the workflow Job.

So, now that we have a workflow Job that we want to start and run at 00:00 every morning, all we can think of is to write a scheduled script to schedule the program to run. If we have multiple workflow Job, using crontab to call may need to write a large number of scripts, but also through scripts to control the execution timing of each workflow Job, not only the script is not easy to maintain, but also monitoring is not convenient. Based on this background, Oozie put forward the concept of Coordinator. They can run each workflow Job as an action (Action), which is equivalent to an execution node in the workflow definition (we can understand it as the workflow of workflow). In this way, multiple workflow Job can be organized, called Coordinator Job, and trigger time and frequency can be specified. Data sets, concurrency and so on can be configured. A Coordinator Job contains the semantics of setting the execution cycle and frequency outside the Job, similar to adding a coordinator outside the workflow to manage the operation of the workflow Job of these workflows.

The above is why the editor shared the use of oozie coordinator, if you happen to have similar doubts, you might as well refer to the above analysis to understand. If you want to know more about it, you are welcome to follow the industry information channel.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.