Shulou(Shulou.com)06/01 Report--

This article mainly introduces "what knowledge Hadoop beginners should know". In daily operation, I believe many people have doubts about what knowledge Hadoop beginners should know. The editor consulted all kinds of materials and sorted out simple and easy-to-use methods of operation. I hope it will be helpful to answer the doubts of "what knowledge Hadoop beginners should know". Next, please follow the editor to study!

First of all, we need to understand what hadoop is? what can Hadoop do? what is the usage scenario of Hadoop? what is the relationship between Hadoop and big data and cloud computing? How to use hadoop?

When you have a basic understanding of these issues, we will learn hadoop systematically. I personally suggest that you should not blindly learn theoretical knowledge. * is a combination of theory and practice. You can first operate with videos and documents, first set up a pseudo-distributed cluster and run wordcount instances, and have a general understanding and understanding of the construction process and operating mechanism of hadoop clusters, and then find out which aspects of weakness you are in the process of operation, and make up for it. In this way, learning will be more targeted and purposeful, and the learning effect will be relatively better, otherwise learning will be very blind and painful.

We know that hadoop has stand-alone mode, pseudo-distributed mode and distributed mode. At the same time, the environment of hadoop is Linux, so we also need to install Linux system. Because our habit is to use windows, it will be very difficult for Linux to install software and so on. And if we want to build a cluster, we need more than one piece of hardware. it is impossible to buy three computers in order to build a cluster. So we also need to know about virtualization from the point of view of cost and use. The virtualization here is that we need to understand the use of virtual machines. Because hadoop is installed in Linux, it really works. So we won't use windows either.

Based on the above. So we need to understand

Virtualization

Linux

Java Foundation

Let's introduce it in detail:

Virtualization: we chose VMware Workstation, which requires us to build virtual machines and install linux (such as centos) operating systems, which should be very simple as long as we operate according to video. The difficulty lies in the configuration of virtual machine networks, especially nat mode and bridge mode, because hadoop requires hosts and virtual machines and external networks (can access the Internet), these three are connected and can be connected to the network. Only in this way, there will be no trouble during the installation process.

Linux: learning about Linux is also a process, because you may not even know the simplest boot and shutdown commands, let alone configure the network. There are only more than 20 commonly used linux commands, and what we need to do is to constantly strengthen the practice in the process of building the cluster and memorize it in practice. But we will encounter all kinds of orders that we can't, and even if we can find them, we can't use them. Why this is so, because there are some commands that require the use of installation packages. So we also need to learn how to download the installation package.

We need to use some commands to configure the network, but in the network configuration, we must understand some knowledge of the virtual machine, so the previous knowledge of the virtual machine needs to be more solid.

Students with linux foundation can also choose hadoop operation and maintenance engineer as their career choice.

Remind everyone not to be impetuous, we can't finish all of the above in a day or two, we need to spend at least a week to train and strengthen. As long as we are familiar with the Linux command, familiar with the network knowledge. Later, our study will be very easy, very fast.

Through the above study, we have been able to install the cluster, so then we need to enter the development phase. What should we do if we develop a zero foundation?

Hadoop programming is not only a Java framework, but also a revolution in programming, which makes the traditional development and running programs from a single client (a single computer) to run by multiple clients (multiple machines), so that the task can be divided, which greatly improves the efficiency.

Since Hadoop is a Java framework, it requires us to understand Java. There are a lot of materials on the Internet, so it is not difficult to learn Java. But the extent to which we learn may be what our zero-foundation students care about.

Java: we need to have basic knowledge of javaSE, but we don't need knowledge of java Web and various frameworks for the time being. If there is no javaSE foundation, it is recommended to strengthen the study and training in this area before or in the process of learning hadoop. Of course, students with java foundation and development experience will learn hadoop faster and easier.

At this point, the study of "what knowledge Hadoop beginners should know" is over. I hope to be able to solve your doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.