Shulou(Shulou.com)05/31 Report--

This article introduces the knowledge of "how to start a Spark cluster". In the operation of practical cases, many people will encounter such a dilemma, so let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something!

When you use jps on SparkWorker1 and SparkWorker2, you will see the following process information:

Start the Spark cluster

On the basis of the successful startup of the Hadoop cluster, you need to use "start-all.sh" under Spark's sbin directory to start the Spark cluster:

At this point, a new process "Worker" appears in SparkWorker1 and SparkWorker2:

At this point, we can go to the Web page of the Spark cluster and visit "http://SparkMaster:8080": as follows:"

We can see from the page that we have two Worker nodes and their information.

At this point, we go to the bin directory of Spark and use the "spark-shell" console:

This is the end of how to start a Spark Cluster. Thank you for your reading. If you want to know more about the industry, you can follow the website, the editor will output more high-quality practical articles for you!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.