Shulou(Shulou.com)06/03 Report--

This article mainly explains "how to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem". The content in the article is simple and clear, and it is easy to learn and understand. Please follow the editor's train of thought to study and learn "how to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem".

Spark YARN Cluster mode get this error "Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster"

Spark.yarn.jars

Spark.yarn.archive

Misconfiguration may cause this problem

/ tmp/spark-80645695-04d9-4801-b119-bf526e903334/__spark_libs__5482901671928622840.zip-> hdfs:

Correct configuration:

Spark.yarn.jar hdfs://udp02:8020/user//spark-lib/*.jar

Thank you for your reading, the above is the content of "how to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem", after the study of this article, I believe you have a deeper understanding of how to solve the Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster problem, and the specific use needs to be verified in practice. Here is, the editor will push for you more related knowledge points of the article, welcome to follow!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.