Shulou(Shulou.com)05/31 Report--

How to compare mr and spark, I believe that many inexperienced people do not know what to do. Therefore, this paper summarizes the causes and solutions of the problem. Through this article, I hope you can solve this problem.

Mr currently does not support the DAG computing model, and Tez tries to do this optimization, but it is not yet mature.

In versions prior to spark 1.2.0, shuffle was problematic and unstable. 1.2.0 used netty4, which is said to have solved the problem and has not yet been tried.

Spark biosphere has more advantages. Spark sql, spark streaming, spark graphx and spark mllib are all based on spark core and can be connected seamlessly.

Spark is more convenient, and spark-shell can do some prototype checking calculation quickly.

Hadoop is more heavy and more stable.

After reading the above, have you mastered the method of comparing mr with spark? If you want to learn more skills or want to know more about it, you are welcome to follow the industry information channel, thank you for reading!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.