Input: Text data (encoding: UTF8 without BOM), one lowercase token per line This tool is a lemmatiser for Afrikaans developed during the NCHLT Text project (Barnard et al. The tagset used by the tool was especially designed for Afrikaans and consists of 139 PoS-tags. This tool is based on the TnT tagger (Brants 2000). Part-of-speech taggers and lemmatisers in the CLARIN infrastructure For a single language Tool Half of the tools provide additional functionalities such as syntactic parsing or named entity recognition.įor comments, changes of the existing content or inclusion of new tools, send us an email. Most of the tools work for a single language (2 Afrikaans, 1 Assamese, 10 Bantu languages, 1 Belarusian, 1 Bulgarian, 1 Czech, 3 Dutch, 4 English, 2 Estonian, 1 Finnish, 5 German, 1 Greek, 1 Hungarian, 3 Icelandic, 1 Latvian, 1 Maltese, 1 Norwegian, 7 Polish, 4 Portuguese, 2 Slovenian), while the rest have a multilingual scope. The CLARIN infrastructure offers 68 tools for part-of-speech tagging or lemmatisation. On this website, the acronym PoS is used for part- of- speech tagging, while MSD stands for morpho syntactic descriptors. MSD tags denote fine-grained feature-structure based PoS tags which are used to account for rich inflectional paradigms like those in Slavic languages. Part-of-speech tagging and lemmatisation are crucial steps of linguistic pre-processing. Lemmatisation is the process by which inflected forms of a lexeme are grouped together under a base dictionary form. Part-of-speech tagging is the automatic text annotation process in which words or tokens are assigned part of speech tags, which typically correspond to the main syntactic categories in a language (e.g., noun, verb) and often to subtypes of a particular syntactic category which are distinguished by morphosyntactic features (e.g., number, tense).
0 kommentar(er)
