Locked History Actions

Diff for "benchmarks"

Differences between revisions 7 and 10 (spanning 3 versions)
Revision 7 as of 2016-10-19 22:47:19
Size: 1927
Comment:
Revision 10 as of 2016-10-19 22:51:46
Size: 1960
Comment:
Deletions are marked like this. Additions are marked like this.
Line 30: Line 30:
[[Polish Coreference Corpus]] [[http://clip.ipipan.waw.pl/PCC|Polish Coreference Corpus]]
Line 34: Line 34:
|| '''System name''' || '''Short description''' || '''Main publication''' || '''P''' || '''R''' || '''F''' || '''License''' ||
|| [[http://zil.ipipan.waw.pl/MentionDetector|Mention Detector]] || Rule-based ||
Ogrodniczuk M., Głowińska K., Kopeć M., Savary A., Zawisławska M. 'Coreference in Polish: Annotation, Resolution and Evaluation'. Walter De Gruyter, 2015. || || || || CC BY 3 ||
Line 38: Line 35:
|| '''System name''' || '''Short description''' || '''Main publication''' || '''License''' || '''P''' || '''R''' || '''F''' ||
|| [[http://zil.ipipan.waw.pl/MentionDetector|Mention Detector]] || Rule-based || Ogrodniczuk M., Głowińska K., Kopeć M., Savary A., Zawisławska M. 'Coreference in Polish: Annotation, Resolution and Evaluation'. Walter De Gruyter, 2015. || CC BY 3 || || || ||
Line 43: Line 42:
[[Polish Coreference Corpus]] [[http://clip.ipipan.waw.pl/PCC|Polish Coreference Corpus]]
Line 47: Line 46:
|| '''System name''' || '''Short description''' || '''Main publication''' || '''P''' || '''R''' || '''F''' || '''License''' ||
|| [[http://zil.ipipan.waw.pl/Ruler|Ruler]] || Rule-based || Ogrodniczuk M., Kopeć M. 'End-to-end coreference resolution baseline system for Polish'. In Z. Vetulani (ed.), Proceedings of the 5th Language & Technology Conference: Human Language Technologies as a Challenge for Computer Science and Linguistics, pp. 167–171, Poznań, Poland, 2011. || || || || CC BY 3 ||
|| [[http://zil.ipipan.waw.pl/Bartek|Bartek]] || Statistical || Kopeć M., Ogrodniczuk M. 'Creating a Coreference Resolution System for Polish'. In Proceedings of the 8th International Conference on Language Resources and Evaluation, LREC 2012, pp. 192–195, ELRA. || || || || CC BY 3 ||
Line 51: Line 47:
=== References ===
|| '''System name''' || '''Short description''' || '''Main publication''' || '''License''' || '''P''' || '''R''' || '''F''' ||
|| [[http://zil.ipipan.waw.pl/Ruler|Ruler]] || Rule-based || Ogrodniczuk M., Kopeć M. 'End-to-end coreference resolution baseline system for Polish'. In Z. Vetulani (ed.), Proceedings of the 5th Language & Technology Conference: Human Language Technologies as a Challenge for Computer Science and Linguistics, pp. 167–171, Poznań, Poland, 2011. || CC BY 3 || || || ||
|| [[http://zil.ipipan.waw.pl/Bartek|Bartek]] || Statistical || Kopeć M., Ogrodniczuk M. 'Creating a Coreference Resolution System for Polish'. In Proceedings of the 8th International Conference on Language Resources and Evaluation, LREC 2012, pp. 192–195, ELRA. || CC BY 3 || || || ||

Benchmarks

This page documents performance of various NLP systems for Polish.

Lemmatization

POS tagging

Shallow parsing

Dependency parsing

Deep parsing

Word sense disambiguation

Named entity recognition

Sentiment analysis

Mention detection

Test set

Polish Coreference Corpus

Results

System name

Short description

Main publication

License

P

R

F

|| Mention Detector || Rule-based || Ogrodniczuk M., Głowińska K., Kopeć M., Savary A., Zawisławska M. 'Coreference in Polish: Annotation, Resolution and Evaluation'. Walter De Gruyter, 2015. || CC BY 3 || || || ||

Coreference resolution

Test set

Polish Coreference Corpus

Results

System name

Short description

Main publication

License

P

R

F

Ruler

Rule-based

Ogrodniczuk M., Kopeć M. 'End-to-end coreference resolution baseline system for Polish'. In Z. Vetulani (ed.), Proceedings of the 5th Language & Technology Conference: Human Language Technologies as a Challenge for Computer Science and Linguistics, pp. 167–171, Poznań, Poland, 2011.

CC BY 3

Bartek

Statistical

Kopeć M., Ogrodniczuk M. 'Creating a Coreference Resolution System for Polish'. In Proceedings of the 8th International Conference on Language Resources and Evaluation, LREC 2012, pp. 192–195, ELRA.

CC BY 3

Summarization