Shulou(Shulou.com)06/01 Report--

This article mainly introduces "the summary of commands commonly used in Hadoop". In the daily operation, I believe that many people have doubts about the collection of commands commonly used in Hadoop. The editor consulted all kinds of data and sorted out simple and easy-to-use methods of operation. I hope it will be helpful for you to answer the doubts of "summary of commands commonly used in Hadoop". Next, please follow the editor to study!

HDFS has a default working directory / user/$USER, where $USER is your login user name.

Create and view the catalog

View all subdirectories

Copy local files to HDFS

Download a file

View Fil

Delete a file

List the job that is running

End job hadoop job-kill

Check the status of the hdfs block for damage

Check the hdfs block status and delete the bad block hadoop fsck /-delete

Check hdfs status

Check to see if it is safe mode and enter and exit safe mode

Hadoop dfsadmin-sademode get

Hadoop dfsadmin-sademode enter

Hadoop dfsadmin-sademode leve

Parallel copy

Hadoop distcp hdfs://a:8020/xxx hdfs://b:8020/

Add a new node

1. Install hadoop on the new node

two。 Copy the namenode configuration file to this node

3. Modify the masters and slaves files to add the node

4. Set ssh password-free login

5. Start datanode and tasktracker (hadoop-daemon.sh start datanode/tasktracker) on this node separately

6. Run start-blancer.sh for data load balancing

At this point, the study of "summary of commands commonly used in Hadoop" is over. I hope to be able to solve your doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.