Shulou(Shulou.com)06/01 Report--

Xiaobian to share with you Nutch on the reading of resource data commands, I hope you have something to gain after reading this article, let's discuss it together!

1. View crawdb database: bin/nutch readdb url/crawdb/ -stats This command will view the total number of url addresses and their status and rating.

View details of each url address, export data: bin/nutch readdb url/crawldb/ -dump crawldb(exported address)

For example, bin/nutch readdb url/crawldb/ -url http://www.163.com/

2. View linkdb database links: bin/nutch readlinkdb url/linkdb/ -url http://www.163.com/

Export linkdb database file: bin/nutch readlinkdb url/linkdb/ -dump linkdb(exported address)

3. View segments: bin/nutch readseg -list -dir url/segments/You can see the name of each segment, the number of pages generated, the start and end times of the grab, the number of fetches and the number of parses.

Export segments: bin/nutch readseg -dump url/segments/20090309103156 segdb

After reading this article, I believe you have a certain understanding of "Nutch commands about reading resource data." If you want to know more about relevant knowledge, please pay attention to the industry information channel. Thank you for reading!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.