|
Size: 689
Comment:
|
Size: 2808
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 2: | Line 2: |
| * [[http://nkjp.pl/index.php?page=0&lang=1|National Corpus of Polish]] (NKJP), | The National Corpus of Polish is a shared initiative of four institutions: Institute of Computer Science at the Polish Academy of Sciences (coordinator), Institute of Polish Language at the Polish Academy of Sciences, Polish Scientific Publishers PWN, and the Department of Computational and Corpus Linguistics at the University of Łódź. It has been carried out as a research-development project of the Ministry of Science and Higher Education. |
| Line 4: | Line 4: |
| * [[attachment:NKJP-PodkorpusMilionowy-1.1.tgz]], the manually annotated 1-million word subcorpus of the NJKP, available on GNU GPL v.3, * [[http://zil.ipipan.waw.pl/DistrNKJP|Distributable version of NKJP]], * [[http://zil.ipipan.waw.pl/NKJPNGrams|N-grams extracted from balanced National Corpus of Polish]], * [[http://zil.ipipan.waw.pl/NKJP1mEcono|Economy-related subcorpus of the National Corpus of Polish, with manually created sense annotation layer]], * [[http://zil.ipipan.waw.pl/TeiAPI|A java library for parsing NKJP-compatible TEI P5 files]]. |
These four institutions have started cooperation to build a reference corpus of Polish language containing over fifteen hundred millions of words. The list of sources for the corpora contains classic literature, daily newspapers, specialist periodicals and journals, transcripts of conversations, and a variety of short-lived and internet texts. For a corpus to be reliable, not only it is necessary to contain a high number of words, but it also needs a diversity of texts with respect to the subject and genre. The conversations ought to represent both male and female speakers, in various age groups, coming from various regions in Poland. [[http://nkjp.pl/index.php?page=0&lang=1|Official project website]] == Manually annotated subcorpus == The manually annotated 1-million word subcorpus of the National Corpus of Polish, available on GNU GPL v.3: * [[attachment:NKJP-PodkorpusMilionowy-1.2.tar.gz]] -- GZip compressed tar archive, * [[attachment:NKJP-PodkorpusMilionowy-1.2.tar.bz2]] -- BZip2 compressed tar archive. ==== Tagger models, trained on the latest version of the subcorpus ==== * [[attachment:concraft-model-nkjp1m-1.2.gz]] -- model for Concraft 0.7.1 tagger * [[attachment:pantera-model-nkjp1m-1.2.bz2]] -- model for PANTERA 0.9.1 tagger * [[attachment:wcrft-model-nkjp1m-1.2.tar.gz]] -- model for WCRFT1 and WCRFT2 taggers * [[attachment:wmbt-model-nkjp1m-1.2.tar.bz2]] -- model for WMBT tagger == Additional resources == * [[http://zil.ipipan.waw.pl/DistrNKJP|Distributable versions of NKJP]], * [[http://zil.ipipan.waw.pl/NKJPNGrams|N-grams extracted from balanced National Corpus of Polish]], * [[http://zil.ipipan.waw.pl/NKJP1mEcono|Economy-related subcorpus of the National Corpus of Polish, with manually created sense annotation layer]], * [[http://zil.ipipan.waw.pl/TeiAPI|A java library for parsing NKJP-compatible TEI P5 files]]. == Reporting errors == Please use the [[https://docs.google.com/spreadsheet/viewform?hl=pl&formkey=dERoLWhzYWNveXlvS09ZMDlRNmcydVE6MQ#gid=0|linked form]] to report any errors found in the corpus. == Older files == For reference and comparison purposes, older versions of the manually annotated subcorpus are available: * [[attachment:NKJP-PodkorpusMilionowy-1.1.tgz]], * [[attachment:NKJP-PodkorpusMilionowy-1.0.tgz]]. |
National Corpus of Polish
The National Corpus of Polish is a shared initiative of four institutions: Institute of Computer Science at the Polish Academy of Sciences (coordinator), Institute of Polish Language at the Polish Academy of Sciences, Polish Scientific Publishers PWN, and the Department of Computational and Corpus Linguistics at the University of Łódź. It has been carried out as a research-development project of the Ministry of Science and Higher Education.
These four institutions have started cooperation to build a reference corpus of Polish language containing over fifteen hundred millions of words. The list of sources for the corpora contains classic literature, daily newspapers, specialist periodicals and journals, transcripts of conversations, and a variety of short-lived and internet texts. For a corpus to be reliable, not only it is necessary to contain a high number of words, but it also needs a diversity of texts with respect to the subject and genre. The conversations ought to represent both male and female speakers, in various age groups, coming from various regions in Poland.
Manually annotated subcorpus
The manually annotated 1-million word subcorpus of the National Corpus of Polish, available on GNU GPL v.3:
NKJP-PodkorpusMilionowy-1.2.tar.gz -- GZip compressed tar archive,
NKJP-PodkorpusMilionowy-1.2.tar.bz2 -- BZip2 compressed tar archive.
Tagger models, trained on the latest version of the subcorpus
concraft-model-nkjp1m-1.2.gz -- model for Concraft 0.7.1 tagger
pantera-model-nkjp1m-1.2.bz2 -- model for PANTERA 0.9.1 tagger
wcrft-model-nkjp1m-1.2.tar.gz -- model for WCRFT1 and WCRFT2 taggers
wmbt-model-nkjp1m-1.2.tar.bz2 -- model for WMBT tagger
Additional resources
Reporting errors
Please use the linked form to report any errors found in the corpus.
Older files
For reference and comparison purposes, older versions of the manually annotated subcorpus are available: