Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

Compile 64-bit haoop2.5.2

2025-01-18 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Internet Technology >

Share

Shulou(Shulou.com)06/03 Report--

As linux now uses 64bit, but the official website of haoop.apche only provides 32 compiled hadoop2.5.2, so I have to compile it myself.

Before (complaining), consider using something compiled by others on the Internet and use it directly, only to be cheated decisively.

So I have a little trouble again, finally I will put my compiled connection at the back, definitely not a pit, the next blog I will use it to build a highly available distributed hadoop cluster (Hadoop HA). It takes about 1 hour to compile.

Prepare materials:

Yum install gccyum install gcc-c++yum install cmakeyum install openssh-develyum install ncurses-devel

Jdk 1.7 extract the tar package and add the configuration file to / etc/profile

Maven3.39 unzips the tar package and adds a profile / etc/profile

Protobuf2.5 decompression;. / configure; make & & make install (if you are not familiar with compilation, please install it by Baidu)

Hadoop-2.5.2-src source code package, official website down

Ant-1.9.4 unzips the tar package and adds a configuration file to / etc/profile

Package link: http://pan.baidu.com/s/1eSdQm4q here I only provide ant, protobuf, maven

Please download the rest from the official website, especially the protobuf, please use the one provided by me. I have tried version 2.6, and the compilation will report an error.

The configured environment is as follows (my host)

Check whether the software is installed successfully

[root@node0 bin] # java-versionjava version "1.7.0,79" Java (TM) SE Runtime Environment (build 1.7.0_79-b15) Java HotSpot (TM) 64-Bit Server VM (build 24.79-b02, mixed mode) [root@node0 bin] # mvn-versionApache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5 2015-11-11T00:41:47+08:00) Maven home: / home/mavenJava version: 1.7.0: 79, vendor: Oracle CorporationJava home: / usr/java/jdk1.7.0_79/jreDefault locale: zh_CN, platform encoding: UTF-8OS name: "linux", version: "3.10.0-229.el7.x86_64", arch: "amd64" Family: "unix" [root@node0 bin] # protoc-- versionlibprotoc 2.5.0 [root@node0 bin] # ant-versionApache Ant (TM) version 1.9.4 compiled on April 29 2014

Decompress the hadoop-2.5.2-src. At this point, the preparation work is basically completed.

Enter the source code unzipped package directory, execute the following command, and you can go to sleep (good luck! ):

Mvn clean package-Pdist-Pnative-DskipTests-Dtar

After the compilation is completed, if there are no errors, build success will appear in the last few lines. I forgot to take a screenshot, so I can't show it.

Then, you go to your source code decompression directory and go to the directory shown below.

The full path is:

/ home/tmp/hadoop-2.5.2-src/hadoop-dist/target/ hadoop-2.5.2.tar.gz

This is the compiled package. Change its name to distinguish

All right, it's done!

The following is to send the compiled package to the lazy: http://pan.baidu.com/s/1skTuzN3

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Internet Technology

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report