Shulou(Shulou.com)06/01 Report--

This article mainly explains "CDH 5.13.0 how to install Spark 2.2", the content of the article is simple and clear, easy to learn and understand, now please follow the editor's ideas slowly in depth, together to study and learn "CDH 5.13.0 how to install Spark 2.2" bar!

1. Install the CDH environment

two。 Create directories on the primary and standby nodes of the CDH

[root@yp-test-3 /] # mkdir / opt/cloudera/csd/

3. Download the Spark 2.2 package

Download csd address: http://archive.cloudera.com/spark2/csd/-corresponding system version (SPARK2_ON_YARN-2.2.0.cloudera4.jar)

Download parcel library address: http://archive.cloudera.com/spark2/parcels/2.2.0.cloudera4/ has a total of four files:

[root@yp-test-3 csd] # ll

Total 176904

-rw-r--r-- 1 root root 5171 Oct 30 17:44 manifest.json

-rw-r--r-- 1 root root 181104738 Oct 30 17:48 SPARK2-2.2.0.cloudera4-1.cdh6.13.3.p0.603055-el7.parcel

-rw-r--r-- 1 root root 41 Oct 30 17:42 SPARK2-2.2.0.cloudera4-1.cdh6.13.3.p0.603055-el7.parcel.sha

-rw-r--r-- 1 root root 17493 Oct 30 17:42 SPARK2_ON_YARN-2.2.0.cloudera4.jar

[root@yp-test-3 csd] #

4. Add parcel libraries to the CDH interface

5. Add apsrk 2.2 service

Thank you for reading, the above is "CDH 5.13.0 how to install Spark 2.2" content, after the study of this article, I believe you on CDH 5.13.0 how to install Spark 2.2 this problem has a deeper understanding, the specific use of the situation also needs to be verified in practice. Here is, the editor will push for you more related knowledge points of the article, welcome to follow!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.