Performance Analysis of Classification Models in Multiclass Facial Expression Recognition Based on Eigenface Features

Syefrida Yulina; Heni Rachmawati

doi:10.32736/sisfokom.v12i3.1742

Authors

Syefrida Yulina Program Studi Sistem Informasi, Jurusan Teknologi Informasi, Politeknik Caltex Riau
Heni Rachmawati Program Studi Sistem Informasi, Jurusan Teknologi Informasi, Politeknik Caltex Riau

DOI:

https://doi.org/10.32736/sisfokom.v12i3.1742

Keywords:

Facial expression, FER dataset, Method comparison, Performance analysis

Abstract

Facial Expression Recognition (FER) is currently widely explored by researchers in the field of Computer Vision. The application of Machine Learning and Deep Learning methods is useful in developing an intelligent system that is accurate in recognizing facial expressions such as emotions. This is inseparable from the type of dataset and classification method used which certainly affects the desired results. To choose the right method, it is necessary to compare the performance of these methods. This study focuses on comparing the performance results of four classification methods namely, Convolutional Neural Network (CNN), Support Vector Machine (SVM), K-Nearest Neighbor (KNN), Naïve Bayes Classifier (NBC) on a multiclass dataset for seven classes of facial emotion labels based on Eigenface feature selection uses the Personal Component Analysis (PCA) algorithm. The test parameters used to perform method comparisons are accuracy, recall, precision, f1-score, as well as the Receiving Operating Characteristic (ROC) and Area Under Curve (AUC) curves. The results of the analysis state that the SVM method has the highest accuracy value, while other methods show varying performance based on recall, precision, f1-score, and ROC and AUC analysis. This research was conducted on the FER 2013 dataset which showed that the classification method tested had quite good performance according to the test parameters.

References

D. Canedo and A. J. R. Neves, “Facial Expression Recognition Using Computer Vision: A Systematic Review,” Appl. Sci., vol. 9, no. 21, p. 4678, Nov. 2019, doi: 10.3390/app9214678.

H. Y. Cao and C. Qi, “Facial Expression Study Based on 3D Facial Emotion Recognition,” in 2021 20th International Conference on Ubiquitous Computing and Communications (IUCC/CIT/DSCI/SmartCNS), Dec. 2021, pp. 375–381. doi: 10.1109/IUCC-CIT-DSCI-SmartCNS55181.2021.00067.

Y. Huang, F. Chen, S. Lv, and X. Wang, “Facial Expression Recognition: A Survey,” Symmetry (Basel)., vol. 11, no. 10, p. 1189, Sep. 2019, doi: 10.3390/sym11101189.

H. Azis, F. Tangguh Admojo, and E. Susanti, “Analisis Perbandingan Performa Metode Klasifikasi pada Dataset Multiclass Citra Busur Panah,” Techno.Com, vol. 19, no. 3, pp. 286–294, 2020, doi: 10.33633/tc.v19i3.3646.

V. Cherepanova, S. Reich, S. Dooley, H. Souri, M. Goldblum, and T. Goldstein, “A Deep Dive into Dataset Imbalance and Bias in Face Identification,” Mar. 2022, [Online]. Available: http://arxiv.org/abs/2203.08235

Z. Song, “Facial Expression Emotion Recognition Model Integrating Philosophy and Machine Learning Theory,” Front. Psychol., vol. 12, no. September, Sep. 2021, doi: 10.3389/fpsyg.2021.759485.

P. Tarnowski, M. Kołodziej, A. Majkowski, and R. J. Rak, “Emotion recognition using facial expressions Emotion recognition using facial expressions,” Procedia Comput. Sci., vol. 108, pp. 1175–1184, 2017, doi: 10.1016/j.procs.2017.05.025.

P. Utami, R. Hartanto, and I. Soesanti, “A Study on Facial Expression Recognition in Assessing Teaching Skills: Datasets and Methods,” Procedia Comput. Sci., vol. 161, pp. 544–552, 2019, doi: 10.1016/j.procs.2019.11.154.

J. Erik Solem, Programming Computer Vision with Python. O’Reilly, 2012.

J. Wira Gotama Putra, “Pengenalan Konsep Pembelajaran Mesin dan Deep Learning,” 2020.

I. M. Revina and W. R. S. Emmanuel, “A Survey on Human Face Expression Recognition Techniques,” J. King Saud Univ. - Comput. Inf. Sci., vol. 33, no. 6, pp. 619–628, Jul. 2021, doi: 10.1016/j.jksuci.2018.09.002.

S. Bayrakdar, D. Akgün, and İ. Yücedağ, “A Survey on Automatic Analysis of Facial Expressions,” Res. Artic., vol. 20, no. 2, p. 383, Dec. 2016, doi: 10.16984/saufenbilder.92940.

F. Fadlisyah, Computer Vision dan Pengolahan Citra. ANDI Yogjakarta, 2007.

Y.-L. Tian, T. Kanade, and J. F. Cohn, “Facial Expression Analysis,” in Handbook of Face Recognition, New York: Springer-Verlag, 2005, pp. 247–275. doi: 10.1007/0-387-27257-7_12.

B. K. Durga and D. V Rajesh, “Review of Facial Emotion Recognition System,” Int. J. Pharm. Res., vol. 10, no. 03, Jul. 2018, doi: 10.31838/ijpr/2018.10.03.056.

“Introduction to OpenCV.”

https://docs.opencv.org/4.x/da/df6/tutorial_py_table_of_contents_setup.html