Shulou(Shulou.com)06/02 Report--

This article introduces the knowledge of "how to write wordcount programs with scala". In the operation of actual cases, many people will encounter such a dilemma, so let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something!

Go straight to the program.

I. Public category

4.0.0

TestScala

TestScala

1.0

2008

2.11.8

2.6.0-cdh6.7.0

2.2.1

5.1.25

Scala-tools.org

Scala-Tools Maven2 Repository

Http://scala-tools.org/repo-releases

Cloudera

Cloudera

Https://repository.cloudera.com/artifactory/cloudera-repos/

Scala-tools.org

Scala-Tools Maven2 Repository

Http://scala-tools.org/repo-releases

Org.apache.spark

Spark-core_2.11

${spark.version}

Org.scala-lang

Scala-library

${scala.version}

Junit

Junit

4.4

Test

Org.specs

Specs

1.2.5

Test

Org.apache.hadoop

Hadoop-client

${hadoop.version}

Mysql

Mysql-connector-java

${mysql.version}

Src/main/scala

Src/test/scala

Org.scala-tools

Maven-scala-plugin

Compile

TestCompile

${scala.version}

-target:jvm-1.5

Org.apache.maven.plugins

Maven-eclipse-plugin

True

Ch.epfl.lamp.sdt.core.scalabuilder

Ch.epfl.lamp.sdt.core.scalanature

Org.eclipse.jdt.launching.JRE_CONTAINER

Ch.epfl.lamp.sdt.launching.SCALA_CONTAINER

Org.scala-tools

Maven-scala-plugin

${scala.version}

VI. Test data

Hdfs dfs-ls / ruozedata/scala

Found 3 items

-rw-r--r-- 3 hadoop supergroup 24 2018-02-1214: 48 / ruozedata/scala/201802121449-1.txt

-rw-r--r-- 3 hadoop supergroup 12 2018-02-1214: 48 / ruozedata/scala/201802121449-2.txt

-rw-r--r-- 3 hadoop supergroup 12 2018-02-1214: 48 / ruozedata/scala/201802121449-3.txt

-

Hdfs dfs-cat / ruozedata/scala/201802121449-1.txt

Hello world

Hello worls

Hdfs dfs-cat / ruozedata/scala/201802121449-2.txt

Hello ruoze

Hdfs dfs-cat / ruozedata/scala/201802121449-3.txt

Ruoze hello

7. Test results

This is the end of "how to write wordcount programs with scala". Thank you for reading. If you want to know more about the industry, you can follow the website, the editor will output more high-quality practical articles for you!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.