An Empirical Study of Good-Turing Smoothing for Language Models on Different Size Corpora of Chinese

• 作 者: Feng-Long Huang Ming-Shing Yu
• 机 构: DepartmentofComputerScienceandInformationEngineering,DepartmentofComputerScience
• 出 处: 电脑和通信(英文)
• 发表日期: 2013年5期
• 关键词: Good-Turing Methods SMOOTHING LANGUAGE Models PERPLEXITY Good-Turing Methods Smo

Data sparseness has been an inherited issue of statistical language models and smoothing method is usually used to resolve the zero count problems. In this paper, we studied empirically and analyzed the well-known smoothing methods of Good-Turing and adva