Shulou(Shulou.com)06/01 Report--

What are the common problems and solutions of DKhadoop installation and configuration? in view of this problem, this article introduces the corresponding analysis and solutions in detail, hoping to help more partners who want to solve this problem to find a more simple and easy way.

Today, I will give you a summary of the common problems and solutions in the installation of dkhadoop development environment.

Collation of DKHadoop installation problems

1. System installation

If you are not connected to the Internet, please synchronize the time manually

If you are connected to the Internet, please synchronize to the Chinese time zone.

2. Cluster secret-free login problem

1): hostnames must be case-sensitive, otherwise encryption will not succeed

2): when running sshpass.sh, it must be under / root/ and the parameter is the cluster password (if not 123456, please enter your own password! To avoid typing errors

3. MySQL installation problem

1): if something like: bash "MySQL" command not found needs to be run:

Source / etc/profile

2): you must enter another IP when you execute. / sync

4. DKH starts the installation

1): if you can't log in, remember if there was a typing error when running changeMaster. If you enter an error, you must modify the file manually:

Vi / root/DKHInstall/webapps/DKH/WEB-INF/classes/dbconfig.properties

Vi / root/DKHInstall/webapps/DKH/WEB-INF/classes/wsconfig.properties

Change the wrong IP

2): follow the steps, enter the host name and IP (do not refresh the page during installation! )

3): Firefox browser is required for installation

4): the test platform only provides installation of three or more than five machines and less than five machines.

5. Impala installation

1): if there is no networking impala to skip installation (LAN is not networked! )

2): if you need impala and are not connected to the Internet, please see the local yum source building.

6. Slave node namenode exception

Because the synchronization metadata forgot to start, it is executed on the slave node (where IP is the slave node IP):

Ssh root@10.1.56.09

/ opt/dkh/Hadoop-2.6.0/sbin/Hadoop-daemon.sh start namenode

7. Install the system to report an error without JAVA_HOME

1) each machine executes vi / etc/profile

Put export JAVA_HOME= / opt/dkh/jdk1.7.0_79

Export PATH=$JAVA_HOME/bin:$PATH

Export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar

Add three commands to the bottom and execute the command line after saving:

Source / etc/profile

2) execute the command line:

Cd / root/install

. / installJDK.sh hostname 1 hostname 2 hostname 3

Then start the tomcat command line:

Cd / root/DKHInstall/bin/

. / startup.sh

3) execute vi / opt/dkh/DKM/bin/catalina.sh

Export JAVA_HOME= / opt/dkh/jdk1.7.0_79

Export JRE_HOME= / opt/dkh/jdk1.7.0_79/jre

Add the above two lines of commands to the second line to save

Note that every machine has to be changed.

4) execute vi / opt/dkh/DkSou/bin/catalina.sh

Export JAVA_HOME= / opt/dkh/jdk1.7.0_79

Export JRE_HOME= / opt/dkh/jdk1.7.0_79/jre

Add the above two lines of commands to the second line to save

Note that every machine has to be changed.

8. Start kafka

/ opt/dkh/kafka*/bin/kafka-server-start.sh / usr/local/kafka*/config/server.properties > > / opt/dkh/kafka*/config/kafka-server.log 2 > & 1 &

Note: this is a command that should be run on every machine

9. Start dkm dksou

/ opt/dkh/DKM/bin/startup.sh

/ opt/dkh/DkSou/bin/startup.sh

Every machine has to execute

10. Cluster privacy issues

After performing cluster secret-free, you need to SSH to see if the cluster-secret-free operation is successful. Failure means that the correspondence is not well written.

This is the answer to the frequently asked questions and solutions to the installation and configuration of DKhadoop. I hope the above content can be of some help to you. If you still have a lot of doubts to be solved, you can follow the industry information channel for more related knowledge.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.