Polish language of the 1960s

This page is dedicated to the corpus of frequency dictionary of contemporary Polish. The original purpose of the corpus was to create a general frequency dictionary of contemporary Polish. The work started in 1967. Partial results were published between 1972 and 1977, the completed dictionary in 1990. The corpus was later augmented in various respects, both by manual editing and automated procedures.

Corpus data contain 10,000 samples divided into 5 parts: essays, news, scientific texts, fiction and plays. Every sample is approximately 50 words long, they all come from texts published between 1963 and 1967 and contain bibliographic description of its source. Each word is tagged with its base form and some morphological properties. Sentence boundaries are also marked.

In 2001 corpus authors agreed to publish the data in the Internet under GNU licence. This site presents corpus data in base and extended (enhanced) version as well as additional materials and corpus documentation.

The corpus was manually annotated using the IPI PAN tagset — each sentence by one annotator, there was no superannotation stage.

In 2012, under ICT-PSP project CESAR, the corpus with IPI PAN tagset annotation was automatically converted to annotation adhering to the NKJP tagset. The data from the automatic conversion into the NKJP tagset was used when simulating the manual annotation of NKJP – it served as data from one of the two annotators. The second annotator was a human annotator, who annotated the sentence from scratch. As in NKJP manual annotation, the human annotator inspected interpretations of segments in a given sentence generated automatically by the morphological analyser – the human annotator could either choose one of these interpretations, or enter a different interpretation manually. If the human annotator selected a different annotation than the one resulting from automatic conversion, the sentence was returned to the human annotator for inspection. Without knowing the result of automatic conversion, the human annotator could either change their earlier annotation or keep it. After this stage, if there were still conflicting interpretations, the superannotator would decide about the correct interpretation.

NOTE: If you are looking for a more fresh frequency data, please take a look at NKJP ngrams.

Citing the electronic version of the corpus

• Ogrodniczuk, Maciej. Nowa edycja wzbogaconego korpusu słownika frekwencyjnego. (In Polish, EN: New edition of the Enhanced corpus of the Frequency dictionary). [In:] Językoznawstwo w Polsce. Stan i perspektywy. Stanisław Gajda (ed.) Institute of Polish Philology, Polish Academy of Sciences – Linguistics Committee, Opole University. Opole 2003, pp. 181–190. ISBN 83-86881-36-4.

Corpus documentation

• Bień, Janusz S.; Woliński, Marcin. Wzbogacony korpus Słownika frekwencyjnego polszczyzny współczesnej. (In Polish, EN: Enhanced corpus of the frequency dictionary of contemporary Polish). December 17th, 2001.

• Bień, Janusz S.; Woliński, Marcin. Numeryczne kody gramatyczne we wzbogaconym korpusie Słownika frekwencyjnego polszczyzny współczesnej. (In Polish, EN: Numerical grammatical codes in enhanced corpus of the frequency dictionary). December 17th, 2001.

• Głowińska, Katarzyna. Taksonomia morfologiczna dla Słownika frekwencyjnego. (In Polish, EN: Morphological taxonomy for the frequency dictionary).

• Kurcz, Ida; Lewicki, Andrzej; Sambor, Jadwiga; Szafran, Krzysztof; Woronczak, Jerzy. Polish language in the sixties (introduction to the printed edition of the frequency dictionary, available also in Polish).

• Ogrodniczuk, Maciej. Wzbogacenie korpusu słownika frekwencyjnego o nowe kody gramatyczne. (In Polish, EN: Enhancing the corpus of the frequency dictionary with new grammatical codes).

Selected bibliography

• Awramiuk Elżbieta. Wpływ odstępstw od segmentacji ortograficznej na wyniki statystyczne Słownika frekwencyjnego polszczyzny współczesnej. (In Polish, EN: Influence of deviations from orthographic segmentation on the statistical results in the frequency dictionary of contemporary Polish). Roczniki Humanistyczne Uniwersytetu w Białymstoku 2001–2002, t. 49–50, z. 6, s. 31–43. Białystok 2001.

• Bień, Janusz S.; Woliński, Marcin. Wzbogacony korpus Słownika frekwencyjnego polszczyzny współczesnej. (In Polish, EN: Enhanced corpus of the Frequency dictionary of contemporary Polish). [In:] Prace lingwistyczne dedykowane prof. Jadwidze Sambor. Jadwiga Linde-Usiekniewicz (ed.), pp. 6-10, Warszawa 2003, Faculty of Polish Philology, Warsaw University.

• Czerepowicka, Monika; Saloni, Zygmunt. Co skreślano i co dopisywano w korpusie Słownika frekwencyjnego polszczyzny współczesnej. (In Polish, EN: What was deleted and what was added in the frequency dictionary of contemporary Polish), pp. 381–391.

• Kurcz, Ida; Lewicki, Andrzej; Sambor, Jadwiga; Woronczak, Jerzy. Słownictwo współczesnego języka polskiego. Listy frekwencyjne. Tom I. Teksty popularnonaukowe – część I i II. (In Polish, EN: Vocabulary of contemporary Polish. Frequency lists. Volume I. Scientific texts). Warszawa, 1974. Warsaw University.

• Kurcz, Ida; Lewicki, Andrzej; Sambor, Jadwiga; Woronczak, Jerzy. Słownictwo współczesnego języka polskiego. Listy frekwencyjne. Tom II. Drobne wiadomości prasowe – część I. (In Polish, EN: Vocabulary of contemporary Polish. Frequency lists. Volume II. News). Warszawa, 1974. Warsaw University.

• Lewicki, Andrzej; Masłowski, Władysław; Sambor, Jadwiga; Woronczak, Jerzy. Słownictwo współczesnego języka polskiego. Listy frekwencyjne. Tom III. Publicystyka – część I i II. (In Polish, EN: Vocabulary of contemporary Polish. Frequency lists. Volume III. Essays). Warszawa, 1975. Warsaw University.

• Kurcz, Ida; Lewicki, Andrzej; Sambor, Jadwiga; Woronczak, Jerzy. Słownictwo współczesnego języka polskiego. Listy frekwencyjne. Tom IV. Proza artystyczna – część I, II i III. (In Polish, EN: Vocabulary of contemporary Polish. Frequency lists. Volume IV. Fiction). Warszawa, 1976. Warsaw University.

• Kurcz, Ida; Lewicki, Andrzej; Sambor, Jadwiga; Woronczak, Jerzy. Słownictwo współczesnego języka polskiego. Listy frekwencyjne. Tom V. Dramat artystyczny. (In Polish, EN: Vocabulary of contemporary Polish. Frequency lists. Volume V. Plays). Warszawa, 1977. Warsaw University.

• Kurcz, Ida; Lewicki, Andrzej; Sambor, Jadwiga; Szafran, Krzysztof; Woronczak, Jerzy. Słownik frekwencyjny polszczyzny współczesnej – tom I i II. (In Polish, EN: Frequency dictionary of contemporary Polish). Kraków, 1990. Institute of Polish Philology, Polish Academy of Sciences.

• Nazarczuk, Marta. Wstepne przygotowanie korpusu «Słownika frekwencyjnego polszczyzny współczesnej» do dystrybucji na CD-ROM. (In Polish, EN: Initial preparation of the corpus of Frequency dictionary of contemporary Polish for CD-ROM distribution). Master thesis prepared under supervision of prof. Janusz S. Bień. Warsaw, 1997. Institute of Polish Philology, Warsaw University. 59 pages, CD-ROM.

• Ogrodniczuk, Maciej. Rozszerzenie opisów morfologicznych w tekstach korpusu słownika frekwencyjnego polszczyzny współczesnej. (In Polish, EN: Augmenting the morphological description in the corpus of Frequency dictionary of contemporary Polish). [In:] Prace lingwistyczne dedykowane prof. Jadwidze Sambor. Jadwiga Linde-Usiekniewicz (ed.), pp. 164–168, Warszawa 2003, Faculty of Polish Philology, Warsaw University.

• Ogrodniczuk, Maciej. Wykorzystanie SGML i TEI do zapisu polskich danych lingwistycznych. (In Polish, EN: Encoding of Polish linguistic data with SGML and TEI). Master thesis prepared under supervision of prof. Janusz S. Bień. Warsaw, 2000. Institute of Informatics, Warsaw University. 83 pages, CD-ROM.

• Saloni, Zygmunt. Słownik frekwencyjny polszczyzny współczesnej (In Polish, EN: Frequency dictionary of contemporary Polish). ComputerWorld, November 4th 1991, pp. 16–17.

Corpus licence

• GNU Free Documentation Licence for corpus documentation.

• GNU GPL / CC-BY for corpus data.

Corpus data

Current version

The current version of the corpus features:

• manually updated annotation
• TEI P5 data format
• both annotation and data format are compatible with NKJP corpus

Downloads:

• TEI P5 XML corpus files

• Poliqarp files

Original version

Auxilliary files for the TEI P4-encoded XML version:

• Master file with TEI header for the corpus

• Feature library (assembles library of feature elements)

• Feature structure library (assembles library of feature structure elements)

• Writing system declaration

• Feature structures representing morphological descriptions for Polish

• TEI P4 DTD

ISO image of the CD-ROM with most of the materials.

Concordances

• Concordances with location [17.9 MB]

• Concordances without location [24 MB]