Shulou(Shulou.com)06/02 Report--

Editor to share with you what apache spark means, I believe most people do not know much about it, so share this article for your reference, I hope you can learn a lot after reading this article, let's go to understand it!

What does apache spark mean?

Apache Spark is an open source cluster computing system based on memory computing, which aims to make data analysis faster. Spark is very small and developed by a small team based on Matei at the AMP Lab at the University of California, Berkeley. The language used is Scala, and the code in the core part of the project has only 63 Scala files, which is very short and concise.

5 advantages of Apache Spark:

1. Higher performance because the data is loaded into the distributed memory of the cluster host. Data can be quickly transformed and iterated and cached for subsequent frequent access requirements. Many people who are interested in Spark may also have heard the saying that Spark can be 100 times faster than Hadoop when all the data is loaded into memory, and Hadoop 10 times faster when there is not enough memory to store all the data.

two。 Through the establishment of standard API in Java, Scala, Python, SQL (response to interactive query) to facilitate the use of various industries, but also contains a large number of out-of-the-box machine learning libraries.

3. Ecologically compatible with existing Hadoop v1 (SIMR) and 2.x (YARN), so institutions can migrate seamlessly.

4. Easy to download and install. Convenient shell (REPL: Read-Eval-Print-Loop) can learn API interactively.

5. Increase productivity with a high-level architecture so that you can focus on computing.

At the same time, Apache Spark is implemented by Scala and the code is very concise.

The above is what apache spark means all the content, thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.