Shulou(Shulou.com)06/02 Report--

This article focuses on "maven based on spark-2.3.1 commonly used dependencies and plug-ins collation", interested friends may wish to take a look. The method introduced in this paper is simple, fast and practical. Let's let the editor take you to learn the common dependencies and plug-ins based on spark-2.3.1 in maven.

4.0.0 com.baidukt spark 1.0-SNAPSHOT jar 1.8 2.11.12 2.3.1 2.7.6 2.0.1 2.0.1 UTF-8 org.scala-lang scala-library ${scala.version} Org.apache.spark spark-core_2.11 ${spark.version} org.apache.spark spark-sql_2.11 ${spark.version} org.apache.spark Spark-graphx_2.11 ${spark.version} org.apache.spark spark-streaming_2.11 ${spark.version} org.apache.spark spark-streaming-kafka-0-102.11 ${spark.version} Org.apache.kafka kafka-clients ${kafka-clients.version} org.apache.kafka kafka-streams ${kafka-streams.version} org.apache.spark Spark-hive_2.11 ${spark.version} org.apache.hbase hbase-common 2.0.1 org.apache.hbase hbase-client 2.0.1 org.apache.hbase hbase-server 1.2.3 org.apache.hbase hbase 2.0.1 pom org.apache.hadoop hadoop-client ${hadoop.version} org.apache.hadoop hadoop-hdfs ${hadoop.version} org.apache.zookeeper zookeeper 3.4.10 redis.clients jedis 2.9.0 log4j log4j 1.2.17 Com.typesafe config 1.3.0 commons-httpclient commons-httpclient 3.1 com.alibaba fastjson 1.2.35 ch.hsr geohash 1. 3.0 mysql mysql-connector-java 5.1.47 Org.apache.maven.plugins maven-compiler-plugin 3.8.0 1.8 1.8 Org.apache.maven.plugins maven-compiler-plugin 3.8.0 compile compile Org.apache.maven.plugins maven-shade-plugin 3.2.1 package Shade *: * META-INF/* .SF META-INF/*.DSA META-INF/*.RSA To this point I believe you have a deeper understanding of the "spark-2.3.1-based dependency and plug-in collation in maven", so you might as well do it in practice. Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.