lindera-ko-dic-builder

Crates.iolindera-ko-dic-builder
lib.rslindera-ko-dic-builder
version0.32.2
sourcesrc
created_at2020-02-20 06:23:29.187317
updated_at2024-06-29 15:54:22.424593
descriptionA Korean morphological dictionary builder for ko-dic.
homepagehttps://github.com/lindera-morphology/lindera
repositoryhttps://github.com/lindera-morphology/lindera
max_upload_size
id210839
size22,590
Takuya Asano (takuyaa)

documentation

https://docs.rs/lindera-ko-dic-builder

README

Lindera ko-dic Builder

License: MIT Join the chat at https://gitter.im/lindera-morphology/lindera Crates.io

ko-dic dictionary builder for Lindera.

Dictionary version

This repository contains mecab-ko-dic.

Dictionary format

Information about the dictionary format and part-of-speech tags used by mecab-ko-dic id documented in this Google Spreadsheet, linked to from mecab-ko-dic's repository readme.

Note how ko-dic has one less feature column than NAIST JDIC, and has an altogether different set of information (e.g. doesn't provide the "original form" of the word).

The tags are a slight modification of those specified by 세종 (Sejong), whatever that is. The mappings from Sejong to mecab-ko-dic's tag names are given in tab 태그 v2.0 on the above-linked spreadsheet.

The dictionary format is specified fully (in Korean) in tab 사전 형식 v2.0 of the spreadsheet. Any blank values default to *.

Index Name (Korean) Name (English) Notes
0 표면 Surface
1 왼쪽 문맥 ID Left context ID
2 오른쪽 문맥 ID Right context ID
3 비용 Cost
4 품사 태그 part-of-speech tag See 태그 v2.0 tab on spreadsheet
5 의미 부류 meaning (too few examples for me to be sure)
6 종성 유무 presence or absence T for true; F for false; else *
7 읽기 reading usually matches surface, but may differ for foreign words e.g. Chinese character words
8 타입 type One of: Inflect (활용); Compound (복합명사); or Preanalysis (기분석)
9 첫번째 품사 first part-of-speech e.g. given a part-of-speech tag of "VV+EM+VX+EP", would return VV
10 마지막 품사 last part-of-speech e.g. given a part-of-speech tag of "VV+EM+VX+EP", would return EP
11 표현 expression 활용, 복합명사, 기분석이 어떻게 구성되는지 알려주는 필드 – Fields that tell how usage, compound nouns, and key analysis are organized

User dictionary format (CSV)

Simple version

Index Name (Japanese) Name (English) Notes
0 표면 Surface
1 품사 태그 part-of-speech tag See 태그 v2.0 tab on spreadsheet
2 읽기 reading usually matches surface, but may differ for foreign words e.g. Chinese character words

Detailed version

Index Name (Korean) Name (English) Notes
0 표면 Surface
1 왼쪽 문맥 ID Left context ID
2 오른쪽 문맥 ID Right context ID
3 비용 Cost
4 품사 태그 part-of-speech tag See 태그 v2.0 tab on spreadsheet
5 의미 부류 meaning (too few examples for me to be sure)
6 종성 유무 presence or absence T for true; F for false; else *
7 읽기 reading usually matches surface, but may differ for foreign words e.g. Chinese character words
8 타입 type One of: Inflect (활용); Compound (복합명사); or Preanalysis (기분석)
9 첫번째 품사 first part-of-speech e.g. given a part-of-speech tag of "VV+EM+VX+EP", would return VV
10 마지막 품사 last part-of-speech e.g. given a part-of-speech tag of "VV+EM+VX+EP", would return EP
11 표현 expression 활용, 복합명사, 기분석이 어떻게 구성되는지 알려주는 필드 – Fields that tell how usage, compound nouns, and key analysis are organized
12 - - After 12, it can be freely expanded.

How to use ko-dic dictionary

For more details about lindera command, please refer to the following URL:

API reference

The API reference is available. Please see following URL:

Commit count: 505

cargo fmt