In addition to Weibo, there is also WeChat
Please pay attention
WeChat public account
Shulou
2025-02-23 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >
Share
Shulou(Shulou.com)06/01 Report--
This article will explain in detail how to read large TXT files in JAVA. The content of the article is of high quality, so the editor shares it for you as a reference. I hope you will have a certain understanding of the relevant knowledge after reading this article.
When the file is too large, if we still read it in the traditional way, it is easy to cause the memory to be full, we should take it apart and read it:
Use NIO to divide large files into small files of fixed size (less than 2G, comprehensively analyze how big each file is, too large is easy to waste space, and too small to waste time), and then recycle program 1 to read each small file.
Public static void readLargeTextWithNIO () {
Try {
Long startTime = System.currentTimeMillis ()
/ / Files to be read
FileInputStream fin = new FileInputStream ("/ Applications/demo/aaaa.txt")
FileChannel fcin = fin.getChannel ()
/ / the file is too large and split into a 128m txt file
ByteBuffer buffer = ByteBuffer.allocate (128 * 1024 * 1024)
While (true) {
Buffer.clear ()
Int flag = fcin.read (buffer)
If (flag =-1) {
Break
}
Buffer.flip ()
/ / output to the specified location
FileOutputStream fileInputStream = new FileOutputStream ("/ Applications/demo/" + UUID.randomUUID () .toString () + ".txt")
FileChannel channel = fileInputStream.getChannel ()
Channel.write (buffer)
}
Long endTime = System.currentTimeMillis ()
System.out.println ("Total consumption: + (endTime-startTime) / 1000 +" seconds ")
/ / the size of each file is 128m, and then you can read it using the traditional method.
} catch (Exception e) {
}
}
On how to read large TXT files in JAVA to share here, I hope the above content can be of some help to you, can learn more knowledge. If you think the article is good, you can share it for more people to see.
Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.
Views: 0
*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.
Continue with the installation of the previous hadoop.First, install zookooper1. Decompress zookoope
"Every 5-10 years, there's a rare product, a really special, very unusual product that's the most un
© 2024 shulou.com SLNews company. All rights reserved.