论文部分内容阅读
在数字图书馆系统集成应用的框架下,提出基于Nutch的专题网页资源采集服务系统设计方案。该方案引入信息过滤模块、基于计算机通信领域专业词典的中文分词模块、GUI信息定制模块、词典和关键词管理模块等,保证采集和获取过程中资源的专题性和系统的可管理性以及易用性。重点对文本解析过滤、Plugin插件开发以及搜索结果的层次化自动聚类等相关技术进行深入研究。通过基于Webservice的服务接口,实现其在数字图书馆资源层的集成应用。
Under the framework of the integrated application of digital library system, this paper proposes a design scheme based on Nutch for webpage collection service system. The scheme introduces the information filtering module, which is based on Chinese word segmentation module, GUI information customization module, dictionary and key word management module of the specialized dictionary in the field of computer communication to ensure the thematic and systematic manageability of the resources in the process of collection and acquisition as well as the ease of use Sex. Focus on text analytic filtering, Plugin plug-in development and search results of the hierarchical automatic clustering and other related technologies in-depth study. Through the Webservice-based service interface to achieve its integration in the digital library resource layer.