Shulou(Shulou.com)05/31 Report--

What is the spark1.3.1 configuration template? in view of this problem, this article introduces the corresponding analysis and solution in detail, hoping to help more partners who want to solve this problem to find a more simple and feasible way.

Spark1.3.1 is paired with hadoop2.6.0 and supports both standalone and yarn

Spark-env.sh

Export SCALA_HOME=/home/hadoop/scala-2.11.6 # standaloneSPARK_WORKER_CORES=8SPARK_WORKER_MEMORY=16384M # yarnexport HADOOP_HOME=/home/hadoop/hadoop-2.6.0export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoopSPARK_EXECUTOR_INSTANCES=24SPARK_EXECUTOR_CORES=8SPARK_EXECUTOR_MEMORY=16384MSPARK_DRIVER_MEMORY=16384MSPARK_YARN_APP_NAME= "Spark 1.3.1" this is the answer to the question about what the spark1.3.1 configuration template is. I hope the above content can be of some help to you. If you still have a lot of questions to solve, you can follow the industry information channel to learn more about it.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.