A Facial Expression Emotion Recognition Based Human-robot Interaction System

来源 :IEEE/CAA Journal of Automatica Sinica | 被引量 : 0次 | 上传用户:kernel_gdi_user
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
A facial expression emotion recognition based human-robot interaction(FEER-HRI) system is proposed, for which a four-layer system framework is designed. The FEERHRI system enables the robots not only to recognize human emotions, but also to generate facial expression for adapting to human emotions. A facial emotion recognition method based on2D-Gabor, uniform local binary pattern(LBP) operator, and multiclass extreme learning machine(ELM) classifier is presented,which is applied to real-time facial expression recognition for robots. Facial expressions of robots are represented by simple cartoon symbols and displayed by a LED screen equipped in the robots, which can be easily understood by human. Four scenarios,i.e., guiding, entertainment, home service and scene simulation are performed in the human-robot interaction experiment, in which smooth communication is realized by facial expression recognition of humans and facial expression generation of robots within 2 seconds. As a few prospective applications, the FEERHRI system can be applied in home service, smart home, safe driving, and so on. The FEERHRI system enables the robots not only recognize human emotions, but also to generate facial expression for adapting to human emotions. A facial emotion recognition method based on 2D-Gabor, uniform local binary pattern (LBP) operator, and multiclass extreme learning machine (ELM) classifier is presented, which is applied to real-time facial expression recognition for robots. expressions of robots are represented by simple cartoon symbols and displayed by a LED screen equipped in the robots, which can be readily understood by human. Four scenarios, ie, guiding, entertainment, home service and scene simulation are performed in the human-robot interaction experiment, in which smooth communication is realized by facial expression recognition of humans and facial expression generation of robots within 2 seconds. As a few pros pective applications, the FEERHRI system can be applied in home service, smart home, safe driving, and so on.
其他文献
The paper introduces an electroencephalography(EEG) driven online position control scheme for a robot arm by utilizing motor imagery to activate and error relat
Magnetic resonance imaging (MRI) reconstruction from undersampled data has always been a challenging and fascinating task due to its implicit ill-posed nature a
由于免疫学的不断进展,表皮内郎格罕氏细胞(Langerhan’s cell)的重要性已逐渐受到重视。在显示郎格罕氏细胞的方法上也有了改进,但在麻风病变中研究甚少,特别是其超微结构
The robust H∞ consensus control problem of highorder discrete-time multi-agent systems with parameter uncertainties and external disturbances is studied,and a
武汉医学院于1977年10月~1981年9月,共施行34例36次同种肾移植,其中有9例除常用的免疫抑制剂(强的松、硫唑嘌呤)外,加用了抗人胸腺淋巴细胞球蛋白(AHTG)。用药次数最少5次,最
时代进步随着遥感技术发展,国家对生态保护愈加重视,植被覆盖引起我们的重视.采用归一化植被指数法,得到泾县各等级植被所占比例和面积.结果表明:泾县地域的高植被类型所占总
Based on the regularity nature of lower-limb motion,an intent pattern recognition approach for above-knee prosthesis is proposed in this paper. To remedy the defects of recognizer based on electromyog
Most target grabbing problems have been dealt with by computer vision system, however, computer vision method is not always enough when it comes to the precisio
党的十七大报告创造性地提出反腐倡廉建设的概念,并把完善惩治和预防腐败体系为重点的反腐倡廉建设放在更加突出的位置,旗帜鲜明地反对腐败。如何贯彻落实这一精神,笔者认为
本文就非致死性心肌梗塞和心脏性死亡分析1,214例有症状冠心病患者的内科治疗转归,并通过多变量分析探讨各项基础参数的预测价值。方法:1,214例因胸痛作冠状动脉造影而证实