Home   >   CSC-OpenAccess Library   >    Manuscript Information
Full Text Available

This is an Open Access publication published under CSC-OpenAccess Policy.
A Comprehensive Survey on Human Facial Expression Detection
Archana Verma, Lokesh Kumar Sharma
Pages - 171 - 182     |    Revised - 05-04-2013     |    Published - 30-04-2013
Volume - 7   Issue - 2    |    Publication Date - April 2013  Table of Contents
Facial Expression, FACS, Fuzzy Inference System, Feature Extraction, HCI.
In the recent years recognition of Human's Facial Expression has been very active research area in computer vision. There have been several advances in the past few years in terms of face detection and tracking, feature extraction mechanisms and the techniques used for expression classification. This paper surveys some of the published work since 2001. The paper gives a time-line view of the advances made in this field, the applications of automatic face expression recognizers, the characteristics of an ideal system, the databases that have been used and the advances made in terms of their standardization and a detailed summary of the state of the art. The paper also discusses facial parameterization using FACS Action Units (AUs) and advances in face detection, tracking and feature extraction methods. It has the important role in the humancomputer interaction (HCI) systems. There are multiple methods devised for facial feature extraction which helps in identifying face and facial expressions.
CITED BY (7)  
1 Mohammed, S. N., George, L. E., & Dawood, H. A. The Effect of Classification Methods on Facial Emotion Recognition Accuracy.
2 Perikos, I., Ziakopoulos, E., & Hatzilygeroudis, I. (2015). Recognize Emotions from Facial Expressions Using a SVM and Neural Network Schema. In Engineering Applications of Neural Networks (pp. 265-274). Springer International Publishing.
3 Casaburi, L., Colace, F., De Santo, M., & Greco, L. (2015). “Magic mirror in my hand, what is the sentiment in the lens?”: An action unit based approach for mining sentiments from multimedia contents. Journal of Visual Languages & Computing, 27, 19-28.
4 Erna, A., Yu, L., Zhao, K., Chen, W., & Suzuki, E. (2014). Facial Expression Data Constructed with Kinect and Their Clustering Stability. In Active Media Technology (pp. 421-431). Springer International Publishing.
5 Kondo, R., Deguchi, Y., & Suzuki, E. (2014). Developing a Face Monitoring Robot for a Desk Worker. In Ambient Intelligence (pp. 226-241). Springer International Publishing.
6 Perikos, I., Ziakopoulos, E., & Hatzilygeroudis, I. (2014). Recognizing Emotions from Facial Expressions Using Neural Network. In Artificial Intelligence Applications and Innovations (pp. 236-245). Springer Berlin Heidelberg.
7 Barbas, H. (2013). Avatars and the «Imitation Game»–can machines smile.
1 Google Scholar
2 CiteSeerX
3 refSeek
4 Scribd
5 SlideShare
6 PdfSR
1 P. Ekman and W. V. Friesen. “Facial Action Coding System”, Consulting Psychologists Press Inc., 577 College Avenue, Palo Alto, California 94306, 1978.
2 Mehrabian, A., “Silent Messages”, Wadsworth, Belmont, California, 1971.
3 M. S. Barlett et al. "Recognizing facial expression: machine learning and application to spontaneous behavior", IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 2005, pp. 568-573.
4 G. Littlewort et al. "Dynamics of facial expression extracted automatically from video", Image and Vision Computing Vol. 24, pp. 615-625, 2006.
5 Sirakaya E. and Sonmez S., “Gender Images in State Tourism Brouchures: An Overlooked Area in Socially Responsible Tourism Marketing”, Journal of Travel Research, Vol. 38 (May):353-362, 2000.
6 Derbaix, C. M. “The Impact of Affective Reactions on Attitudes toward the Advertisement and the Brand: A Step toward Ecological Validity”, Journal of Marketing Research, Vol. 32(November): 470-479, 1995.
7 Yuasa, M., Yasumura, Y. and Nitta, K., “A Negotiation Support Tool Using Emotional Factors”, IEEE, Vol. 5: 2906-2911, 2001.
8 Lee, R.S.T., “iJADE Authenticator- An Intelligent Multiagent based Facial Authentication System”, International Journal of Pattern Recognition and Artificial Intelligence, Vol.16, No.4: 481-500, 2002.
9 Rowley, H., Baluja, S., and Kanade, T. 1998. Neural network-based face detection. IEEE Patt. Anal. Mach. Intell., 20:22–38.
10 L. Wiskott, J. M. Fellous, N. Kruger and C. von der Malsburg, Face recognition by elastic bunch graph matching, IEEE Trans. Patt. Anal. Mach. Intell. 19 (1997) 775{779.April 29,2004 13:49 WSPC/115-IJPRAI 00322.
11 J. Xiao, S. Baker, I. Matthews, and T. Kanade. Real-time combined 2d+3d active appearance models. In CVPR, volume 2, pages 535 – 542, June 2004.
12 Yunfeng Zhu, Fernando De la Torre, Jeffrey F. Cohn, Associate Member, IEEE,and Yu-Jin Zhang, Senior Member, IEEE”Dynamic Cascades with Bidirectional Bootstrapping for Action Unit Detection in Spontaneous Facial Behavior”, Journal of LATEX Class Files, October 2010
13 H. Deng, L. Jin, L. Zhen, and J. Huang. “A New Facial Expression Recognition Method based on Local Gabor Filter Bank and PCA plus LDA”, International Journal of Information Technology, Vol. 11, No. 11, pp. 86-96, 2005.
14 P. Aleksic and A. Katsaggelos. “Automatic Facial Expression Recognition using Facial Animation Parameters and Multi-Stream HMMs”, IEEE Tran. on Information Forensics and Security, Vol. 1, Issue 1, pp. 3-11, Mar. 2006.
15 A. C. Koutlas and D. I. Fotiadis. “A Region Based Methodology for facial expression recognition”, IEEE Int. Conf. on Systems, Man and Cybernetics, 2008, pp. 662 - 666.
16 M. Bartlett, G. C. Littlewort , M. Frank, C Lainscsek, I. Fasel, J Movellan. “Automatic Recognition of facial actions in spontaneous expressions”, Journal of Multimedia, Vol. 1,No.6, Sept. 2006.
17 L. Thai, N. Nguyen and T. Son. “A Facial Expression Classification System Integrating Canny, Principal Component Analysis and Artificial Neural Network” International Journal of Machine Learning and Computing, Vol. 1, No. 4, pp. 388-393, Oct. 2011.
18 M. Yeasin, B. Bullot, and R. Sharma. “Recognition of Facial Expressions and Measurement of Levels of Interest from video”, IEEE Transactions on Multimedia, Vol.8, No.3, pp. 500-508 Jun 2006.
19 P Yang, Q. Liu, D. Metaxas. “Boosting Encoded dynamic features for facial Expression recognition”, Pattern Recognition Letters, Vol. 30, pp. 132-139, Jan 2009.
20 M. S. Barlett et al. "Recognizing facial expression: machine learning and application to spontaneous behavior", IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 2005, pp. 568-573.
21 Y. Tong, Y. Wang, Z. Zhu, J. Qiang. “Robust Facial Feature Tracking under varying face pose and facial expression”, Pattern Recognition, Vol. 40, pp. 3195-3208, 2007.
22 I. Kotsia and I. Patras. “Facial Expression Recognition in Image Sequences using Geometric Deformation Features and SVM”, IEEE Transactions on Image Processing Vol. 16, No.1, pp.172-187, Jan 2007.
23 A. Jamshidnezhad, J. Nordin. “A Classifier Model based on the Features Quantitative Analysis for Facial Expression Recognition”, Proceeding of the International Conference on Advanced Science, Engineering and Information Technology, 2011.
24 S. Lucey, A. Ashraf, and J. Cohn. “Investigating Spontaneous Facial Action Recognition through AAM Representations of the Face,” Face Recognition, K. Delac and M. Grgic, eds.,I-Tech Education and Publishing, 2007, pp. 275-286.
25 G. Fanelli, A. Yao, P. Noel, J. Gall, and L. Gool. “Hough Forest-based Facial Expression Recognition from Video Sequences”, International Workshop on Sign, Gesture and Activity (SGA’10), Springer LNCS 6553, 2012, pp. 195-206.
26 P. Sharma, “Feature Based Method for Human Facial Emotion Detection using optical Flow Based Analysis”, International Journal of Research in Computer Science, Vol. 1, Issue 1, pp.31-38, 2011.
27 S. Koelstra, M. Pantic and I. Patras. “A Dynamic Texture-Based Approach to Recognition of Facial Actions and Their Temporal Models”, IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 32, No. 11, pp. 1940-1954, Nov. 2010.
28 D. Arumugam and S. Purushothaman. “Emotion Classification using Facial Expression”International Journal of Advanced Computer Science and Applications, Vol. 2, No.7, pp. 92-,98, 2011.
29 S. Bashyal and G. Venayagamoorthy. “Recognizing facial expressions using gabor wavelets and vector quantization”, Engineering Application of Artificial Intelligence, Vol. 21, 2008.
30 R. S. Smith, T. Windeatt.“ Facial Expression Detection using Filtered Local Binary Pattern Features with ECOC Classifiers and Platt Scaling“, JMLR: Workshop and Conference Proceedings 11, 2010, pp.111-118.
31 J.Q. Liu, Q. Z. Fan. “Research of feature extraction method on Facial Expression change”,Advanced Materials Research, Vol. 211-12, pp. 813-817, Feb. 2011.
32 M. Leon, J. Rothkrantz. “Facial Action Recognition for Facial Expression Analysis from static face Images”, IEEE Transactions on System and Cybernetics, Vol. 34, No. 3, pp. 1449-1461, Jun. 2004.
33 C. Shan, S. Gong and P. W. McOwan. “Facial expression recognition based on Local Binary Patterns: A comprehensive study” Image and Vision Computing, Vol. 27, pp. 803-816. May 2009.
Mr. Archana Verma
C.C.E.T. Bhilai - India
Mr. Lokesh Kumar Sharma
National Institute of Occupational Health Ahmedabad, 380016, India - India