Performance Analysis of Classification Models in Multiclass Facial Expression Recognition Based on Eigenface Features

Syefrida Yulina(1*), Heni Rachmawati(2)

(1) Program Studi Sistem Informasi, Jurusan Teknologi Informasi, Politeknik Caltex Riau
(2) Program Studi Sistem Informasi, Jurusan Teknologi Informasi, Politeknik Caltex Riau
(*) Corresponding Author

Abstract


Facial Expression Recognition (FER) is currently widely explored by researchers in the field of Computer Vision. The application of Machine Learning and Deep Learning methods is useful in developing an intelligent system that is accurate in recognizing facial expressions such as emotions. This is inseparable from the type of dataset and classification method used which certainly affects the desired results. To choose the right method, it is necessary to compare the performance of these methods. This study focuses on comparing the performance results of four classification methods namely, Convolutional Neural Network (CNN), Support Vector Machine (SVM), K-Nearest Neighbor (KNN), Naïve Bayes Classifier (NBC) on a multiclass dataset for seven classes of facial emotion labels based on Eigenface feature selection uses the Personal Component Analysis (PCA) algorithm. The test parameters used to perform method comparisons are accuracy, recall, precision, f1-score, as well as the Receiving Operating Characteristic (ROC) and Area Under Curve (AUC) curves. The results of the analysis state that the SVM method has the highest accuracy value, while other methods show varying performance based on recall, precision, f1-score, and ROC and AUC analysis. This research was conducted on the FER 2013 dataset which showed that the classification method tested had quite good performance according to the test parameters.


Keywords


Facial expression; FER dataset; Method comparison; Performance analysis

Full Text:

PDF

References


D. Canedo and A. J. R. Neves, “Facial Expression Recognition Using Computer Vision: A Systematic Review,” Appl. Sci., vol. 9, no. 21, p. 4678, Nov. 2019, doi: 10.3390/app9214678.

H. Y. Cao and C. Qi, “Facial Expression Study Based on 3D Facial Emotion Recognition,” in 2021 20th International Conference on Ubiquitous Computing and Communications (IUCC/CIT/DSCI/SmartCNS), Dec. 2021, pp. 375–381. doi: 10.1109/IUCC-CIT-DSCI-SmartCNS55181.2021.00067.

Y. Huang, F. Chen, S. Lv, and X. Wang, “Facial Expression Recognition: A Survey,” Symmetry (Basel)., vol. 11, no. 10, p. 1189, Sep. 2019, doi: 10.3390/sym11101189.

H. Azis, F. Tangguh Admojo, and E. Susanti, “Analisis Perbandingan Performa Metode Klasifikasi pada Dataset Multiclass Citra Busur Panah,” Techno.Com, vol. 19, no. 3, pp. 286–294, 2020, doi: 10.33633/tc.v19i3.3646.

V. Cherepanova, S. Reich, S. Dooley, H. Souri, M. Goldblum, and T. Goldstein, “A Deep Dive into Dataset Imbalance and Bias in Face Identification,” Mar. 2022, [Online]. Available: http://arxiv.org/abs/2203.08235

Z. Song, “Facial Expression Emotion Recognition Model Integrating Philosophy and Machine Learning Theory,” Front. Psychol., vol. 12, no. September, Sep. 2021, doi: 10.3389/fpsyg.2021.759485.

P. Tarnowski, M. Kołodziej, A. Majkowski, and R. J. Rak, “Emotion recognition using facial expressions Emotion recognition using facial expressions,” Procedia Comput. Sci., vol. 108, pp. 1175–1184, 2017, doi: 10.1016/j.procs.2017.05.025.

P. Utami, R. Hartanto, and I. Soesanti, “A Study on Facial Expression Recognition in Assessing Teaching Skills: Datasets and Methods,” Procedia Comput. Sci., vol. 161, pp. 544–552, 2019, doi: 10.1016/j.procs.2019.11.154.

J. Erik Solem, Programming Computer Vision with Python. O’Reilly, 2012.

J. Wira Gotama Putra, “Pengenalan Konsep Pembelajaran Mesin dan Deep Learning,” 2020.

I. M. Revina and W. R. S. Emmanuel, “A Survey on Human Face Expression Recognition Techniques,” J. King Saud Univ. - Comput. Inf. Sci., vol. 33, no. 6, pp. 619–628, Jul. 2021, doi: 10.1016/j.jksuci.2018.09.002.

S. Bayrakdar, D. Akgün, and İ. Yücedağ, “A Survey on Automatic Analysis of Facial Expressions,” Res. Artic., vol. 20, no. 2, p. 383, Dec. 2016, doi: 10.16984/saufenbilder.92940.

F. Fadlisyah, Computer Vision dan Pengolahan Citra. ANDI Yogjakarta, 2007.

Y.-L. Tian, T. Kanade, and J. F. Cohn, “Facial Expression Analysis,” in Handbook of Face Recognition, New York: Springer-Verlag, 2005, pp. 247–275. doi: 10.1007/0-387-27257-7_12.

B. K. Durga and D. V Rajesh, “Review of Facial Emotion Recognition System,” Int. J. Pharm. Res., vol. 10, no. 03, Jul. 2018, doi: 10.31838/ijpr/2018.10.03.056.

“Introduction to OpenCV.”

https://docs.opencv.org/4.x/da/df6/tutorial_py_table_of_contents_setup.html




DOI: https://doi.org/10.32736/sisfokom.v12i3.1742

Refbacks

  • There are currently no refbacks.



Indexed By:

 



Creative Commons License
Jurnal Sisfokom (Sistem Informasi dan Komputer) has ISSN 2301-7988 and e-ISSN 2581-0588 which is published by Lembaga Penelitian dan Pengabdian Masyarakat (LPPM) ISB Atma Luhur under a Creative Commons Attribution-ShareAlike 4.0 International License.
Web Analytics Made Easy - StatCounter