Shulou(Shulou.com)06/03 Report--

It took a long time to install oozie, first the source package, but gave up.

Then there is the installed version of CDH, which has been working for a long time and often reports all kinds of errors.

Finally sorted out this article.

This installation process also applies to other CDH versions of oozie4.1.0.

Download the file first:

The CDH version is used here, no compilation, just watch the compilation process is enough. Download address:

Http://archive.cloudera.com/cdh6/cdh/5/oozie-4.1.0-cdh6.5.2.tar.gz

The file is large, 1.6G

You also need to download ExjJS, the UI desktop framework for the extended JavaScript.

It must be version 2.2, which is specified on the official website and has been written in oozied.sh. Download address:

Http://download.csdn.net/download/feature_09/10015730

Installation environment:

Redhat5.5,64 bit virtual machine

Hadoop2.6.0-cdh6.5.2

Jdk1.8.0_11

1. Decompress and install oozie

[hadoop@fa01 ~] $tar-zxvf oozie-4.1.0-cdh6.5.2.tar.gz

[hadoop@fa01 ~] $cd oozie-4.1.0-cdh6.5.2

Second, configure environment variables

[hadoop@fa01 ~] $vim .bash _ profile

Export OOZIE_HOME=/home/hadoop/oozie-4.1.0-cdh6.5.2

[hadoop@fa01 ~] $source .bash _ profile

Third, you also need to configure the core-site file of hadoop.

I have not made any changes here because I have modified this content once before when I installed hive.

If you modify it, you need to restart the hadoop cluster.

[hadoop@fa01 hadoop] $vim core-site.xml

Hadoop.proxyuser.hadoop.hosts

*

Hadoop.proxyuser.hadoop.groups

*

Create a libext directory

[hadoop@fa01 oozie-4.1.0-cdh6.5.2] $mkdir libext

Extract the tar package of hadooplibs in the package and copy the contents of the hadooplibs directory to the directory you just created

[hadoop@fa01 oozie-4.1.0-cdh6.5.2] $tar-zxvf oozie-hadooplibs-4.1.0-cdh6.5.2.tar.gz

After decompression, an oozie-4.1.0-cdh6.5.2 is added. This name is the same as the name of oozie itself, and it is easy to be confused.

[hadoop@fa01 oozie-4.1.0-cdh6.5.2] $cd oozie-4.1.0-cdh6.5.2/hadooplibs/

[hadoop@fa01 hadooplibs] $cp hadooplib-2.6.0-cdh6.5.2.oozie-4.1.0-cdh6.5.2/* / home/hadoop/oozie-4.1.0-cdh6.5.2/libext/

[hadoop@fa01 hadooplibs] $cp hadooplib-2.6.0-mr1-cdh6.5.2.oozie-4.1.0-cdh6.5.2/* / home/hadoop/oozie-4.1.0-cdh6.5.2/libext/

According to the official website, if you are using a different version of hadoop, you need to copy the jar file of hadoop to libext/.

6. Decompress the previously downloaded ext2.2.zip to the libext/ directory

[hadoop@fa01] $unzip ExtJS-2.2.zip-d / home/hadoop/oozie-4.1.0-cdh6.5.2/libext

Go to the unzipped directory and see if it is available.

[hadoop@fa01 ~] $cd oozie-4.1.0-cdh6.5.2/libext/

[hadoop@fa01 libext] $ls

7. Generate war package

[hadoop@fa01 oozie-4.1.0-cdh6.5.2] $bin/addtowar.sh-inputwar $OOZIE_HOME/oozie.war-outputwar $OOZIE_HOME/oozie-server/webapps/oozie.war-hadoop 2.6.0 $HADOOP_HOME-extjs / home/hadoop/ExtJS-2.2.zip

Show below and this is a success.

8. Place the JDBC driver in three places + a HDFS directory

Put the JDBC driver of mysql into the libext/ directory you created earlier, and under the lib/ directory

Download this version of: mysql-connector-java-5.1.43-bin.jar

Link: http://download.csdn.net/download/feature_09/10018454

At the same time, the following permissions should be modified:

[hadoop@fa01 libext] $chmod 777 / home/hadoop/oozie-4.1.0-cdh6.5.2/lib/mysql-connector-java-5.1.43-bin.jar

[hadoop@fa01 libext] $chmod 777 / home/hadoop/oozie-4.1.0-cdh6.5.2/libext/mysql-connector-java-5.1.43-bin.jar

Last! We have to configure another place!

This is the directory / home/hadoop/oozie-4.1.0-cdh6.5.2/oozie-server/webapps/oozie/WEB-INF/lib

This directory is not available for the time being. Add it after opening the instance. (step 13)

[hadoop@fa01 lib] $cd / home/hadoop/oozie-4.1.0-cdh6.5.2/lib

[hadoop@fa01 lib] $cp mysql-connector-java-5.1.43-bin.jar / home/hadoop/oozie-4.1.0-cdh6.5.2/oozie-server/webapps/oozie/WEB-INF/lib

[hadoop@fa01 lib] $ls | grep mysql

Mysql-connector-java-5.1.43-bin.jar

With regard to the jar package for the mysql driver, in fact, after oozie generates the share/lib directory on hdfs, you have to place a mysql driver under the share/lib/lib_timestamp/sqoop of hdfs (in the sharelib path generated by hdfs in step 10).

After the placement is successful, update the sharelib

[hadoop@fa01 lib] $oozie admin-oozie http://fa01:11000/oozie-sharelibupdate

IX. Configure conf/oozie-site.xml file

The main thing is to configure the database to save the source file.

[hadoop@fa01 conf] $vim oozie-site.xml

Add the following at the bottom of the file:

Oozie.db.schema.name

Oozie

Oozie DataBase Name

Oozie.service.JPAService.create.db.schema

False

Creates Oozie DB.

If set to true, it creates the DB schema if it does not exist. If the DB schema exists is a NOP.

If set to false, it does not create the DB schema. If the DB schema does not exist it fails start up.

Oozie.service.JPAService.jdbc.driver

Com.mysql.jdbc.Driver

JDBC driver class.

Oozie.service.JPAService.jdbc.url

Jdbc:mysql://192.168.20.32:3306/oozie?createDatabaseIfNotExist=true

JDBC URL.

Oozie.service.JPAService.jdbc.username

Oozie

DB user name.

Oozie.service.JPAService.jdbc.password

Mysql

DB user password.

IMPORTANT: if password is emtpy leave a 1 space string, the service trims the value

If empty Configuration assumes it is NULL.

Oozie.service.HadoopAccessorService.hadoop.configurations

* = / home/hadoop/hadoop-2.6.0-cdh6.5.2/etc/hadoop

Comma separated AUTHORITY=HADOOP_CONF_DIR, where AUTHORITY is the HOST:PORT of

The Hadoop service (JobTracker, HDFS). The wildcard'* 'configuration is

Used when there is no exact match for an authority. The HADOOP_CONF_DIR contains

The relevant Hadoop *-site.xml files. If the path is relative is looked within

The Oozie configuration directory; though the path can be absolute (i.e. To point

To Hadoop client conf/ directories in the local filesystem.

At the same time, create a user name and password in MySQL.

Mysql > create user 'oozie' identified by' mysql'

Mysql > grant all privileges on *. * to 'oozie'@'%' with grant option

Since version 5 does not recognize%, you need to redeclare the address of the host

Mysql > grant all privileges on *. * to oozie@fa01 identified by 'mysql'

Mysql > flush privileges

Create a package on hdfs

[hadoop@fa01 oozie-4.1.0-cdh6.5.2] $pwd

/ home/hadoop/oozie-4.1.0-cdh6.5.2

[hadoop@fa01 oozie-4.1.0-cdh6.5.2] $bin/oozie-setup.sh sharelib create-fs hdfs://192.168.20.32:9000-locallib oozie-sharelib-4.1.0-cdh6.5.2-yarn.tar.gz

Give authority to oozie-server

[hadoop@fa01 oozie-4.1.0-cdh6.5.2] $chmod 777 oozie-server-R

[hadoop@fa01 libext] $chmod 777 ext-2.2-R

Create a database script and initialize the database

[hadoop@fa01 oozie-4.1.0-cdh6.5.2] $bin/ooziedb.sh create-sqlfile oozie.sql-run DB Connection

The following display:

13. Enable the instance of oozie

[hadoop@fa01 oozie-4.1.0-cdh6.5.2] $bin/oozied.sh start

14. Run oozie

[hadoop@fa01 oozie-4.1.0-cdh6.5.2] $bin/oozied.sh run &

15. Testing, viewing

Jps, the appearance of Bootstrap is 1/3.

Continue: the appearance of NORMAL is 2/3 correct.

[hadoop@fa01 oozie-4.1.0-cdh6.5.2] $bin/oozie admin-oozie http://192.168.20.32:11000/oozie-status

System mode: NORMAL

Then go on:

Login page http://192.168.20.32:11000/oozie/, you can normally display the following page, 100%.

Reference:

Http://www.cnblogs.com/zlslch/p/6118431.html

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.