Extending the library with analizers for new languages

#
Extending the library with analizers for new languages

It is possible to extend the library with capability to deal with a new language. In some cases, this may be done without reprogramming, but for accurate results, some modules would require entering into the code.

Since the text input language is an configuration option of the system, a new configuration file must be created for the language to be added (e.g. copying and modifying an existing one, such as the example presented in section 2.2.2).

Subsections

- Tokenizer
- Morphological analyzer
  - Multiword detection
  - Nummerical expression detection
  - Date/time expression detection
  - Currency/ratio expression detection
  - Dictionary search
  - Suffixed forms search
  - Probability assignment
- HMM PoS Tagger
- Relaxation Labelling PoS Tagger
- Sense annotation
- Chart Parser
- Dependency Parser