Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

How to read and write HDFS by JAVA API

2025-04-06 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >

Share

Shulou(Shulou.com)06/01 Report--

This article shows you how JAVA API reads and writes HDFS. The content is concise and easy to understand. It will definitely brighten your eyes. I hope you can get something through the detailed introduction of this article.

Package demo;import java.io.IOException;import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.fs.FSDataInputStream;import org.apache.hadoop.fs.FSDataOutputStream;import org.apache.hadoop.fs.FileStatus;import org.apache.hadoop.fs.FileSystem;import org.apache.hadoop.fs.Path;public class PutMerge {public static void main (String [] args) throws IOException {Configuration conf=new Configuration (); FileSystem hdfs=FileSystem.get (conf) FileSystem local=FileSystem.getLocal (conf); / / set the input directory to the output file Path inputDir=new Path (args [0]); Path hdfsFile=new Path (args [1]); / / get a list of local files FileStatus [] inputFiles=local.listStatus (inputDir) / / generate the HDFS output stream FSDataOutputStream out=hdfs.create (hdfsFile); for (int iS0X i0) {out.write (buffer,0,bytesRead);} in.close ();} out.close () }} the above is how JAVA API reads and writes HDFS. Have you learned any knowledge or skills? If you want to learn more skills or enrich your knowledge reserve, you are welcome to follow the industry information channel.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Servers

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report