Locked History Actions

Diff for "Gazetteer"

Differences between revisions 1 and 25 (spanning 24 versions)
Revision 1 as of 2011-09-29 00:23:57
Size: 1549
Comment:
Revision 25 as of 2012-07-11 16:02:07
Size: 2633
Editor: AgataSavary
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
= Polish Gazetteer = = Gazetteer for Polish Named Entities =
Line 3: Line 3:
The Polish Gazetteer is the textual source used within the SProUT (http://sprout.dfki.de/) platform for the automatic pre-annotation of the National Corpus of Polish (NKJP) on the level of named entities. Its construction, contents and use have been described in: The Gazetteer for Polish Named Entities was used within the ''[[http://sprout.dfki.de/|SProUT]]'' platform, initially for information extraction from Polish texts, and then for the automatic pre-annotation of the ''[[http://nkjp.pl/index.php?page=0&lang=1 |National Corpus of Polish]]'' (NKJP) on the level of named entities. Its construction, contents and use have been described in:
Line 7: Line 7:
 * PISKORSKI, J. (2005). ''Named-Entity Recognition for Polish with SProUT'', in LNCS Vol 3490: Proceedings of IMTCI 2004, Warsaw, Poland.
Line 9: Line 10:
 * forenames and surnames
 * city, country, mountain, region and river names
 * institution names

 * named entity triggers (months, days, positions, etc.)
 * forenames and surnames,
 * city, country, mountain, region and river names,
 * institution names,
 * relational adjectives and inhabitant names stemming from country names,

 * named entity triggers (months, days, positions, etc.).
Line 16: Line 18:
== Authors ==
 * Jakub Piskorski - earlier version of the gazetteer used for information extraction from Polish texts
 * Agata Savary - completed version of the gazetteer used for NKJP pre-annotation; LMF format definition
 * Michał Lenart - LMF conversion and validation
Line 18: Line 25:
The data is available under [[http://en.wikipedia.org/wiki/BSD_licenses#2-clause_license_.28.22Simplified_BSD_License.22_or_.22FreeBSD_License.22.29|2-clause BSD licence]]. The data are available under the [[http://en.wikipedia.org/wiki/BSD_licenses#2-clause_license_.28.22Simplified_BSD_License.22_or_.22FreeBSD_License.22.29|2-clause BSD licence]].
Line 22: Line 29:
[[attachment:gazetteer-nkjp-no-pwn.zip]]  * [[attachment:gazetteer-nkjp-no-pwn.zip|Text version]] as used with Sprout for NKJP pre-annotation

 * [[attachment:PNEG-LMF-v1.tar.gz|LMF-compliant version]] containing:
   * LMF format definition and conversion guidelines,
   * Relax NG schema, morphosyntax configuration file and validation scrypts,
   * grammatically complete gazetteer entries (9,060 lemmas and 95,359 word forms),
   * gramatically incomplete gazetteer entries (35,884 lemmas and 40,612 word forms).

Gazetteer for Polish Named Entities

The Gazetteer for Polish Named Entities was used within the SProUT platform, initially for information extraction from Polish texts, and then for the automatic pre-annotation of the National Corpus of Polish (NKJP) on the level of named entities. Its construction, contents and use have been described in:

  • SAVARY, A., PISKORSKI, J. (2011). Language Resources for Named Entity Annotation in the National Corpus of Polish, to appear in Control and Cybernetics.

  • SAVARY, A., PISKORSKI, J. (2010). Lexicons and Grammars for Named Entity Annotation in the National Corpus of Polish, in Proceedings of the 18th International Conference Intelligent Information Systems (IIS'10), Siedlce, Poland.

  • PISKORSKI, J. (2005). Named-Entity Recognition for Polish with SProUT, in LNCS Vol 3490: Proceedings of IMTCI 2004, Warsaw, Poland.

The file contains 153,477 inflected entries of Polish (and some foreign) proper names and named entity components:

  • forenames and surnames,
  • city, country, mountain, region and river names,
  • institution names,
  • relational adjectives and inhabitant names stemming from country names,
  • named entity triggers (months, days, positions, etc.).

The file DOES NOT contain inhabitant names and relational adjectives stemming from Polish settlements. These data, owned by the PWN publisher, were used within the NKJP project under a particular licence and are concerned by the copyright.

Authors

  • Jakub Piskorski - earlier version of the gazetteer used for information extraction from Polish texts
  • Agata Savary - completed version of the gazetteer used for NKJP pre-annotation; LMF format definition
  • Michał Lenart - LMF conversion and validation

The data are available under the 2-clause BSD licence.

Available resources

  • Text version as used with Sprout for NKJP pre-annotation

  • LMF-compliant version containing:

    • LMF format definition and conversion guidelines,
    • Relax NG schema, morphosyntax configuration file and validation scrypts,
    • grammatically complete gazetteer entries (9,060 lemmas and 95,359 word forms),
    • gramatically incomplete gazetteer entries (35,884 lemmas and 40,612 word forms).