Fatemeh Momenipour Moghadam, MohammadReza Keyvanpour, Journal of Information Processing Systems Vol. 11, No. 3, pp. 450-464, Sep. 2015  

10.3745/JIPS.04.0020
Keywords: Lookup Table Stemmer, stemmer, Statistical Stemmer, Structural Stemmer
Fulltext: PDF Full Text PubReader

Abstract

In linguistics, stemming is the operation of reducing words to their more general form, which is called the ‘stem’. Stemming is an important step in information retrieval systems, natural language processing, and text mining. Information retrieval systems are evaluated by metrics like precision and recall and the fundamental superiority of an information retrieval system over another one is measured by them. Stemmers decrease the indexed file, increase the speed of information retrieval systems, and improve the performance of these sys- tems by boosting precision and recall. There are few Persian stemmers and most of them work based on mor- phological rules. In this paper we carefully study Persian stemmers, which are classified into three main clas- ses: structural stemmers, lookup table stemmers, and statistical stemmers. We describe the algorithms of each class carefully and present the weaknesses and strengths of each Persian stemmer. We also propose some metrics to compare and evaluate each stemmer by them.

Statistics
Cite this article