dc.contributor.author | Karaoglan, B. | |
dc.contributor.author | Dinçer, B.T. | |
dc.contributor.author | Kisla, T. | |
dc.contributor.author | Metin, S.K. | |
dc.date.accessioned | 2020-11-20T16:45:43Z | |
dc.date.available | 2020-11-20T16:45:43Z | |
dc.date.issued | 2013 | |
dc.identifier.isbn | 9781467355629 | |
dc.identifier.uri | https://doi.org/10.1109/SIU.2013.6531217 | |
dc.identifier.uri | https://hdl.handle.net/20.500.12809/5504 | |
dc.description | 2013 21st Signal Processing and Communications Applications Conference, SIU 2013, 24 April 2013 through 26 April 2013, Haspolat, 98109 | en_US |
dc.description.abstract | In order to compare work done under natural language processing, the corpora involved in different studies should be standardized/normalized. Entropy, used as language model performance metric, totally depends on signal information. Whereas, when language is considered semantic information should also be considered. Here we propose a metric that exploits Zipf's and Heaps' power laws to respresent semantic information in terms of signal information and estimates the amount of information anticipated from a corpus of given length in words. The proposed metric is tested on 20 different lengths of sub-corpora drawn from major corpus in Turkish (METU). While the entropy changed depending on the length of the corpus, the value of our proposed metric stayed almost constant which supports our claim about normalizing the corpus. © 2013 IEEE. | en_US |
dc.item-language.iso | tur | en_US |
dc.item-rights | info:eu-repo/semantics/closedAccess | en_US |
dc.subject | Corpus Comparison | en_US |
dc.subject | Cross Entropy | en_US |
dc.subject | Language Model Performance | en_US |
dc.title | Derlem normalizasyonu için bir öneri | en_US |
dc.item-title.alternative | A proposal for corpus normalization [Derlem normalizasyonu için bir öneri] | en_US |
dc.item-type | conferenceObject | en_US |
dc.contributor.department | MÜ | en_US |
dc.contributor.departmentTemp | Karaoglan, B., Uluslararasi Bilgisayar Enstitüsü, Ege Üniversitesi, Izmir, Turkey -- [Dinçer, B.T., Enformatik Bölümü, Mugla Üniversitesi, Mugla, Turkey -- [Kisla, T., Bilgisayar Ve ÖgRetim Teknolojileri Egitimi Bölümü, Ege Üniversitesi, Izmir, Turkey -- [Metin, S.K., Yazilim Mühendisligi Bölümü, IZmir Ekonomi Üniversitesi, Izmir, Turkey | en_US |
dc.identifier.doi | 10.1109/SIU.2013.6531217 | |
dc.relation.journal | 2013 21st Signal Processing and Communications Applications Conference, SIU 2013 | en_US |
dc.relation.publicationcategory | Konferans Öğesi - Uluslararası - Kurum Öğretim Elemanı | en_US |