Few-shot text classification by leveraging bi-directional attention and cross-class knowledge

来源 :中国科学:信息科学(英文版) | 被引量 : 0次 | 上传用户:mvcexq
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Few-shot text classification targets at the situation where a model is developed to classify newly incoming query instances after acquiring knowledge from a few support instances.In this paper,we investigate few-shot text classification under a metric-based meta-learning framework.While the representations of the query and support instances are the key to the classification,existing study handles them independently in the text encoding stage.To better describe the classification features,we propose to exploit their interaction with adapted bi-directional attention mechanism.Moreover,distinct from previous approaches that encode different classes individually,we leverage the underlying cross-class knowledge for classification.To this end,we conceive the learning target by incorporating the large margin loss,which is expected to shorten the intra-class distances while enlarging the inter-class distances.To validate the design,we conduct extensive experiments on three datasets,and the experimental results demonstrate that our solution outperforms its state-of-the-art competitors.Detailed analyses also reveal that the bi-directional attention and the cross-class knowledge both contribute to the overall performance.
其他文献
近年来,青岛西海岸新区的招才引智工作注重从“单一要素”转向“双轮驱动”,通过要素聚合裂变,实现优势资源叠加效应,集聚了一批各领域高层次人才,为新区高质量发展夯实了人
期刊
在宁夏,面朝黄土背朝天的农民,种植养殖过程中最怕的,除了天灾人祸,应该就是市场滞销了.或顶风冒雪赶到农贸市场,或心怀忐忑与收购商砍价,为的就是能让操劳一年得到的收获卖
期刊
近年来,河北省张家口市崇礼区充分发挥人才在冬奥会筹办和本地发展中的助力引领作用,为冬奥会筹办和本地发展提供了有力的人才智力支撑.rn打造良好环境,吸引高层次人才集聚.
期刊
This paper investigates the three-dimensional(3-D)path following control problem for an under-actuated robotic dolphin.With a comprehensive consideration of the
Deep neural networks often come with a huge number of parameters,even larger than the number of training exam-ples,but it seems that these over-parameterized mo
期刊
2020年,鸡西大力吸引各类优秀人才“筑梦鸡西、共创未来”,实现引才规模、素质的跨越式发展.rn广泛对接,八方引才rn线上线下宣传“五进”吸才,积极推动鸡西人才需求、扶持政
期刊
近年来,广州市白云区坚持人才强区战略,传承工匠精神,通过平台搭建、技能培训、校企合作、举办竞赛、强化服务等举措,建设了一支规模宏大、结构合理、素质优良的知识型、技能
期刊
Aiming at the complex and restrictive characteristics of human resource allocation in multiple scientific university research projects,an improved pigeon-inspir
近年来,南京市江宁区着力构建“引才、育才、留才”一体化机制,全区人才工作扎实推进、亮点纷呈,为南京创新名城建设注入了强劲动能.rn突出高端引领,构筑现代化人才治理体系r
期刊
全面推进乡村振兴,人才是关键.近年来,广东省清远市委市政府紧紧围绕打造全国破解城乡二元结构试验区、粤东西北“入珠融湾”先行市、全省乡村振兴排头兵的工作目标,由市委组
期刊