Shulou(Shulou.com)06/01 Report--

This article mainly introduces "what are the methods of operating the file system by Hadoop API". In the daily operation, I believe that many people have doubts about the methods of operating the file system with Hadoop API. The editor has consulted all kinds of materials and sorted out simple and easy-to-use methods of operation. I hope it will be helpful to answer the doubts of "what are the methods of operating the file system by Hadoop API?" Next, please follow the editor to study!

# # Maven configuration

Org.apache.hadoop hadoop-client 2.7.3

Create a folder

Configuration config = new Configuration (); try {FileSystem fs = FileSystem.get (new URI ("hdfs://localhost:9000"), config); boolean result = fs.mkdirs (new Path ("/ api/test")); System.out.println (result);} catch (Exception e) {e.printStackTrace ();}

# read files

FSDataInputStream in = fileSystem.open (new Path ("/ hadoop.txt")); IOUtils.copyBytes (in,System.out,1024)

# create a file

FSDataOutputStream out = fileSystem.create (new Path ("/ hello.txt")); out.writeUTF ("hello world"); out.flush (); out.close ()

# rename the file

FileSystem.rename (new Path ("/ hello.txt"), new Path ("/ new.txt"))

# copy local files to hdfs

FileSystem.copyFromLocalFile (new Path (". / pom.xml"), new Path ("/ pom.xml"))

# download hdfs file locally

FileSystem.copyToLocalFile (new Path ("/ hadoop.txt"), new Path ("hadoop.txt"); at this point, the study of "what are the methods of operating the file system by Hadoop API" is over. I hope to be able to solve your doubts. The collocation of theory and practice can better help you learn, go and try it! If you want to continue to learn more related knowledge, please continue to follow the website, the editor will continue to work hard to bring you more practical articles!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.