Shulou(Shulou.com)06/03 Report--

"what basics do you need to learn hadoop" is no longer a new topic. You can find hundreds of articles about the basics of learning hadoop by casually searching the Internet. A more direct question is-is it difficult to learn Hadoop? In a particularly speechless sentence, the answer is: is it difficult? is it difficult?

During the school holiday, I wrote some articles about hadoop learning and sharing. The first few articles I wrote were a little messy, and one of them was about what kind of foundation it takes to learn hadoop. The so-called difficult, will not be difficult, must also be based on your present foundation. Assuming that you don't even have a basic computer foundation, it may really be "difficult". If you have a good computer foundation, for example, you can configure a virtual machine, have JAVA foundation and Linux operation foundation, then learning hadoop may not be difficult for you.

When you read a lot of articles about the basics of learning hadoop, you will surely come to the conclusion that there are three basic skills necessary for learning hadoop: basic JAVA, basic Linux, and basic virtual machine (as mentioned above). After talking about these three basics, all the articles seem to tell us that as long as you have these three basics, you will certainly be able to learn hadoop well, and then you will reach the peak of your life. In fact, it is not always the case. Only when you really come into contact with hadoop will you find the real problem.

Anyone who has been in contact with hadoop knows that building each build in a separate hadoo requires a process of running environment, modifying configuration files, testing, and so on. If you just install the running environment, you are making a big mistake. Almost every component is a pit, which is almost impossible for beginners to have a pleasant learning process. Although Hadoop originated abroad, there are many domestic distributions, but none of them solve the problem of environmental construction. If they do not pay attention to the tedious construction of the operating environment, I certainly do not believe it. Really do not know whether their current technology can not solve this problem, or do not want to take the time to solve it?

In early March this year, a friend who was doing program development gave a domestic distribution DKHadoop, which is a big fast search open source release hadoop. This version of hadoop finally solves the tedious problem of building a running environment, and it integrates many commonly used components in the open source community, including HDFS,Hbase,Storm,Spark,Flume,Kafka,Mahout,ES, into one platform, which can be installed with a simple button and called directly when needed, and finally makes me feel that I don't have to install and debug it like I did before.

Therefore, I think learning hadoop requires not only the foundation of JAVA, virtual machine and Linux, but also the choice of hadoop version. The point of learning hadoop is to develop something, not to learn the installation of the running environment, which makes people feel like putting the cart before the horse!

For those who are learning hadoop or preparing to learn hadoop, they personally recommend DKHadoop, which is very friendly for beginners after all. I am using the standard three-node dkhadoop version (rest assured, it is free), although it is free, but the permissions are open. So, it's enough for beginners or personal research. Need dkhadoop installation package, you can leave a message to me, can be packaged and sent to you!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.