Shulou(Shulou.com)06/01 Report--

Editor to share with you how to add a custom dictionary to pyhanlp, I believe most people do not know much about it, so share this article for your reference, I hope you can learn a lot after reading this article, let's go to know it!

Take python 2.7.9 as an example:

1. Install pyhanlp:pip install pyhanlp

two。 Add a custom dictionary under the dictionary path: the CustomDictionary main dictionary text path is data/dictionary/custom/CustomDictionary.txt, where users can add their own words (not recommended), or you can create a new text file through the configuration file; CustomDictionaryPath=data/dictionary/custom/CustomDictionary.txt; my dictionary .txt; to append the dictionary (recommended).

The specific absolute path can be obtained from hanlp-- version:

# hanlp-version

Jar 1.6.3: / usr/local/lib/python2.7/site-packages/pyhanlp/static/hanlp-1.6.3.jar

Data 1.6.2: / usr/local/lib/python2.7/site-packages/pyhanlp/static/data

Config: / usr/local/lib/python2.7/site-packages/pyhanlp/static/hanlp.properties

# cat / usr/local/lib/python2.7/site-packages/pyhanlp/static/hanlp.properties | grep "CustomDictionaryPath"

3. It is recommended to add your own dictionary file under this path, such as my dictionary .txt, and add it to the above properties file under CustomDictionaryPath.

# cat my dictionary .txt

Codis Cluster nz 1000

Jinri Toutiao nz 1000

The first entry, the second part of speech (the default is n), and the third word frequency

4. Then you need to delete the cache file so that python will reload the new file:

# rm-f CustomDictionary.txt.bin

5. Test the new dictionary:

Python-c "from pyhanlp import *; print (HanLP.segment ('codis Cluster, Jinri Toutiao')"

May 16, 2018 4:43:14 afternoon com.hankcs.hanlp.corpus.io.IOUtil readBytes

Warning: an exception occurred while reading / usr/local/lib/python2.7/site-packages/pyhanlp/static/data/dictionary/custom/CustomDictionary.txt.bin java.io.FileNotFoundException: / usr/local/lib/python2.7/site-packages/pyhanlp/static/data/dictionary/custom/CustomDictionary.txt.bin (there is no file or directory)

It's okay to report this error, it's just a warning, reload the cache file.

The above is all the content of the article "how to add a Custom Dictionary to pyhanlp". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.