RIS ID
27712
Abstract
Language modeling is one of the most powerful methods in information retrieval. Many language modeling based retrieval systems have been developed and tested on English collections. Hence, the evaluation of language modeling on collections of other languages is an interesting research issue. In this study, four different language modeling methods proposed by Hiemstra [1] have been evaluated on a large Persian collection of a news archive. Furthermore, we study two different approaches that are proposed for tuning the Lambda parameter in the method. Experimental results show that the performance of language models on Persian text improves after Lambda Tuning. More specifically Witten Bell method provides the best results.
Publication Details
This conference paper was originally published as Amiri, H., Zarnani, A., Tavallaee, M., Abedinzadeh, S., Rahgozar, M. & Oroumchian, F. 2008, 'Investigation of the lambda parameter for language modeling based Persian retrieval', in Proceedings of the 6th International Conference on Information and Systems, Faculty of Computers and Information, Cairo University, pp. NLP39-NLP44.