Shulou(Shulou.com)06/01 Report--

Xiaobian to share with you how centos7.0 compiles hadoop 2.6, I believe most people still do not know how, so share this article for your reference, I hope you have a lot of harvest after reading this article, let's go to understand it together!

Hadoop Compilation & Clustering

centos7.0

Copy all required software to/usr/local/softs directory

All software is installed in/usr/lib

1. Install jdk1.7 and configure environment variables

2. Install maven, configure environment variables

Found at conf/setting.xml

/path/to/local/repo

Delete comment read

/usr/lib/apache-maven-3.3.3/repo

Create repo/setting.xml in maven directory

mkdir repocp /usr/lib/apache-maven-3.3.3/conf/setting.xml setting.xml

Delete/usr/lib/apache-maven-3.3.3/repo

Responsive places to add content

was added

nexus-osc * Nexusosc http://maven.oschina.net/content/groups/public/ join jdk-1.7 1.7 nexus local private nexus http://maven.oschina.net/content/groups/public/ true false nexus local private nexus http://maven.oschina.net/content/groups/public/ true false

3. Install ant, configure environment variables

4. Install protobuf

Extract protobuf-2.5.0.tar.gz in softs directory

tar -zxvf protobuf-2.5.0.tar.gz

cd protobuf-2.5.0

./ configure --prefix=/usr/lib/protobuf

When installing protobuf, there will be dependencies that need to be installed manually

yum -y install gcc-c++ glibc-headers glibc-develyum -y install gccmake &&make installldconfig

Check the installation directory (that is, the directory configured above)

whereis protobuf

Configure protobuf environment variables

vim /etc/profileexport JAVA_HOME=/usr/lib/jdk1.7.0_79export MAVEN_HOME=/usr/lib/apache-maven-3.3.3export LD_LIBRARY_PATH=/usr/lib/protobufexport ANT_HOME=/usr/lib/apache-ant-1.9.4export PATH=$JAVA_HOME/bin:$MAVEN_HOME/bin:$LD_LIBRARY_PATH/bin:$ANT_HOME/bin:$PATHexport CLASSPATH=.:$ JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar

Check whether protoc installation is successful

[root@hadoop1 protobuf-2.5.0]# protoc --versionlibprotoc 2.5.0

5. install OpenSSL

yum install libssl-dev

6. Install cmake

yum install cmakeyum install openssl-develyum install zlib1g-devyum install libssl-dev

7. Start compiling

Go to src directory

cd hadoop-2.6.0-src

mvn package -Pdist,native -DskipTests -Dtar

Just wait.

hadoop-2.6.0-src/hadoop-dist/target directory has hadoop-2.6.0.tar.gz

If the compilation fails, it means that the dependency library has not been Google

The above is "centos 7.0 how to compile hadoop 2.6" all the content of this article, thank you for reading! I believe that everyone has a certain understanding, hope to share the content to help everyone, if you still want to learn more knowledge, welcome to pay attention to the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.