Shulou(Shulou.com)06/01 Report--

This article mainly introduces how to build a Spark development environment under mac, which has a certain reference value, interested friends can refer to, I hope you can learn a lot after reading this article, let the editor take you to understand it.

one。 Download the scale installation package

Wget https://downloads.lightbend.com/scala/2.12.2/scala-2.12.2.tgz

two。 Download the spark installation package

Wget http://mirrors.tuna.tsinghua.edu.cn/apache/spark/spark-2.1.1/spark-2.1.1-bin-hadoop2.7.tgz

three。 Extract it to / usr/local. The example is as follows:

four。 Configure environment variables

five。 Configure spark

Configure the following environment parameters to spark-env.sh

Export SCALA_HOME=/usr/local/scala-2.12.2

Export SPARK_MASTER_IP=localhost

Export SPARK_WORKER_MEMORY=4g

six。 Start spark

Go to the / usr/local/spark-2.1.1-bin-hadoop2.7/sbin directory

Startup script: start-all.sh

seven。 Start spark-shell

Thank you for reading this article carefully. I hope the article "how to build a Spark Development Environment under mac" shared by the editor will be helpful to you. At the same time, I also hope you will support us and pay attention to the industry information channel. More related knowledge is waiting for you to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.