Shulou(Shulou.com)06/03 Report--

Idea+Centos7+hadoop-2.7.3 source code reading environment build

1. Environmental preparation

Install maven 3.5.4 Download Address: http://mirrors.shu.edu.cn/apache/maven/maven-3/3.5.4/binaries/

Install Protocol Buffers 2.5.0

1)Download protobuf-2.5.0.tar.gz, download address: http://pan.baidu.com/s/1pJlZubT (provided by netizens)

2)Extract:

tar -zxvf protobuf-2.5.0.tar.gz

3)Compile and install, assuming that the output directory after successful compilation is: /usr/local/protobuf

./ configure --prefix=/usr/local/protobufmake && make install

4)Add export PATH=/usr/local/protobuf/bin:$PATH to the environment variable after successful compilation

Use protoc --version to verify whether the compilation and installation is successful

Install JDK 1.80

2. Compile hadoop source code

1)Unzip:tar -zxvf hadoop-2.7.3-src.tar.gz

2) cd hadoop-2.7.3-src

3)Use the following command to compile the source code

mvn package -Pdist -DskipTests -Dtar

4)Waiting for a long compilation process, the compilation success message is as follows:

3. Use idea to import hadoop source code

Select the compiled source directory

Then click Next.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.