This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Vision Based Face Expression Recognition
Technical Paper
2015-01-0218
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
Facial expression, a significant way of nonverbal communication, effectively conveys humans' mental state, emotions and intentions. Understanding of emotions through these expressions is an easy task for human beings. However, when it comes to Human Computer Interface (HCI), it is a developing research field that enables humans' to interact with computers through touch, voice, and gestures. Communication through expression in HCI is still a challenge. In addition, there are a variety of fields such as automotive, biometric, surveillance, teleconferencing etc. in which expression recognition system can be applied. In recent years, several different approaches have been proposed fr facial expression recognition, but most of them work only under definite environmental conditions.
The proposed framework aims to recognize expressions (by analyzing the facial features extracted) based on the Active Shape Model (ASM). Four different expressions namely happy, disgust, surprise and neutral are handled in our approach. The proposed system first identifies the face region from the input image. Thereafter, a model based approach called ASM is applied to identify the major landmarks on the face that has been detected. Based on the position of these landmarks, expression of the detected face is identified.
The recognition of expression is beneficial in multiple ways. Firstly, the expressions captured along with additional features which are used in existing systems such as gaze direction, speed of eye blinking, rotation of the head etc are useful inputs towards building safety systems for the vehicle. Such a system would use these inputs and generate appropriate warnings to the driver as and when necessary. Secondly, the expression recognition will serve the purpose of providing a customized entertainment unit that can adapt itself based on the mood of the driver. For e.g. there is a possibility to change the song that played by music system in the vehicle. If the expression of the driver is detected as happy, the music player can play a happy song.
Recommended Content
Citation
Sreelakshmi, C. and Kutty, K., "Vision Based Face Expression Recognition," SAE Technical Paper 2015-01-0218, 2015, https://doi.org/10.4271/2015-01-0218.Also In
References
- Albert , Mehrabian Nonverbal communication Transaction Publishers 1977
- Zolidah , Kasiran , and Yahya Saadiah Facial Expression as an Implicit Customers' Feedback and the Challenges Computer Graphics, Imaging and Visualisation, 2007. CGIV'07 IEEE 2007
- Esra , Vural et al. Drowsy driver detection through facial movement analysis Human-Computer Interaction Springer Berlin Heidelberg 2007 6 18
- Cohn , Jeffrey F. , Ambadar Zara , and Ekman Paul Observer-based measurement of facial expression with the Facial Action Coding System The handbook of emotion elicitation and assessment 2007 203 221
- Paul , Viola , and Jones Michael Rapid object detection using a boosted cascade of simple features Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on 1 IEEE 2001
- Tim , Cootes , Baldock E. R. , and Graham J. An introduction to active shape models Image Processing and Analysis 2000 223 248
- Hervé Abdi , and Williams Lynne J. Principal component analysis Wiley Interdisciplinary Reviews: Computational Statistics 2 4 2010 433 459
- Dhavalikar , Anagha S. , and Kulkarni R. K. Feature Extraction in Facial Expression Recognition System.
- Danijela , Vukadinovic , and MajaPantic Fully automatic facial feature point detection using Gabor feature based boosted classifiers Systems, Man and Cybernetics, 2005 IEEE International Conference on 2 IEEE 2005
- Caifeng , Shan , Gong Shaogang , and McOwan Peter W. Robust facial expression recognition using local binary patterns Image Processing, 2005. ICIP 2005. IEEE International Conference on 2 IEEE 2005
- Ming-Hsuan Yang , Kriegman David , and Ahuja Narendra Detecting faces in images: A survey IEEE Transactions Pattern Analysis and Machine Intelligence 2002 34 58
- Amy , Ross Procrustes analysis Course report, Department of Computer Science and Engineering University of South Carolina 2004
- Ming-Hsuan Yang , Kriegman David , and Ahuja Narendra Detecting faces in images: A survey Pattern Analysis and Machine Intelligence, IEEE Transactions on 24 1 2002 34 58
- Papageorgiou , Constantine P. , Oren Michael , and Poggio Tomaso A general framework for object detection Computer vision, 1998. sixth international conference on IEEE 1998
- Kah-Kay , Sung Learning and example selection for object and pattern detection. 1996
- Rowley , Henry A. , Baluja Shumeet , and Kanade Takeo Neural network-based face detection Pattern Analysis and Machine Intelligence, IEEE Transactions on 20 1 1998 23 38
- Ying-li Tian , Kanade Takeo , and Cohn Jeffrey F. Recognizing action units for facial expression analysis Pattern Analysis and Machine Intelligence, IEEE Transactions on 23 2 2001 97 115
- YingLi Tian , Kanade Takeo , and Cohn Jeffrey F. Recognizing lower face action units for facial expression analysis Automatic Face and Gesture Recognition, 2000. Proceedings. Fourth IEEE International Conference on IEEE 2000
- Peng Yang , Liu Qingshan , and Metaxas Dimitris N. Boosting coded dynamic features for facial action units and facial expression recognition Computer Vision and Pattern Recognition, 2007. CVPR'07. IEEE Conference on IEEE 2007
- BouchraAbboud Mo Dang , Davoine Frank Facial expression recognition and synthesis based on an appearance model Signal Processing: Image Communication 2004
- Michael , Lyons et al. Coding facial expressions with gabor wavelets Automatic Face and Gesture Recognition, 1998. Proceedings. Third IEEE International Conference on IEEE 1998
- Zhengyou , Zhang et al. Comparison between geometry-based and gabor-wavelets-based facial expression recognition using multi-layer perceptron Automatic Face and Gesture Recognition, 1998. Proceedings. Third IEEE International Conference on IEEE 1998
- Danijela , Vukadinovic , and Pantic Maja Fully automatic facial feature point detection using Gabor feature based boosted classifiers Systems, Man and Cybernetics, 2005 IEEE International Conference on 2 IEEE 2005
- Caifeng , Shan , Gong Shaogang , and McOwan Peter W. Robust facial expression recognition using local binary patterns Image Processing, 2005. ICIP 2005. IEEE International Conference on 2 IEEE 2005
- Ashirbani , Saha , and Wu QM Jonathan Facial expression recognition using curvelet based local binary patterns Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on IEEE 2010
- Jyh-Yeong Chang , and Chen Jia-Lin Automated facial expression recognition system using neural networks Journal of the Chinese Institute of Engineers 24 3 2001 345 356
- Manal , Abdullah , Wazzan Majda , and Bo-saeed Sahar Optimizing face recognition using PCA International Journal of Artificial Intelligence & Applications 3 2 2012
- Robert , Berwick An Idiot's guide to Support vector machines (SVMs). October 21 2003 2011
- Amy , Ross Procrustes analysis Course report Department of Computer Science and Engineering, University of South Carolina 2004