Shulou(Shulou.com)05/31 Report--

In this issue, the editor will bring you about how to analyze the implementation process of spark wordcount. The article is rich in content and analyzes and narrates it from a professional point of view. I hope you can get something after reading this article.

Summary

WordCount program example import org.apache.spark.SparkContextimport org.apache.spark.SparkConfimport org.apache.spark.SparkConfobject WordCount {def main (args: Array [String]) {val conf = new SparkConf val sc = new SparkContext (conf) val lines = sc.parallelize (List ("hello spark", "hi spark", "wow scala")); val words = lines.flatMap {x = > x.split ("")}; val word = words.map {x = > (x, 1)} Val wordCount = word.reduceByKey (_ + _); wordCount.collect (). Foreach (println)}} the above is the analysis of how to perform spark wordcount execution. If you happen to have similar doubts, please refer to the above analysis to understand. If you want to know more about it, you are welcome to follow the industry information channel.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.