Finding Facial Emotions From the Clutter Scenes Using Zernike Moments-Based Convolutional Neural Networks

Finding Facial Emotions From the Clutter Scenes Using Zernike Moments-Based Convolutional Neural Networks

Wencan Zhong, Vijayalakshmi G. V. Mahesh, Alex Noel Joseph Raj, Nersisson Ruban
DOI: 10.4018/978-1-7998-6690-9.ch013
OnDemand:
(Individual Chapters)
Available
$37.50
No Current Special Offers
TOTAL SAVINGS: $37.50

Abstract

Finding faces in the clutter scenes is a challenging task in automatic face recognition systems as facial images are subjected to changes in the illumination, facial expression, orientation, and occlusions. Also, in the cluttered scenes, faces are not completely visible and detecting them is essential as it is significant in surveillance applications to study the mood of the crowd. This chapter utilizes the deep learning methods to understand the cluttered scenes to find the faces and discriminate them into partial and full faces. The work proves that MTCNN used for detecting the faces and Zernike moments-based kernels employed in CNN for classifying the faces into partial and full takes advantage in delivering a notable performance as compared to the other techniques. Considering the limitation of recognition on partial face emotions, only the full faces are preserved, and further, the KDEF dataset is modified by MTCNN to detect only faces and classify them into four emotions. PatternNet is utilized to train and test the modified dataset to improve the accuracy of the results.
Chapter Preview
Top

Face Detection

Finding human face in a cluttered scene is difficult and is also of prime importance in face-related applications. Face detection could be considered as a specific case of object detection. Object detection aims at finding the locations and dimensions of all the objects present in an image and categorize them into different classes. Cluttered images contain not only human faces but also other objects and background as displayed in Fig.1. Thus given a cluttered image, the task of the face detection system is to detect, locate the facial regions and separate or segment them in the cluttered images ignoring the other objects.

Figure 1.

Cluttered image with human faces and background

978-1-7998-6690-9.ch013.f01

It is an undeniable fact that human faces appear with a different orientation, head poses and scales, making face detection a demanding task.

Additionally, the illumination conditions, facial expressions variation, the nonrigidity of faces, and the occlusions of objects such as glasses, beards, mustache scarves, hats and one person hiding the other add considerably to the variations in appearance of faces in an image. These added conditions increase the variability of the face patterns that face detection system should handle. Accordingly, these parameters should be taken into consideration while designing a face detection system. To get the best results it requires good algorithms and design. In recent years, there is a large increase in the number and variety of methods attributed to face detection.

A review of the related works find several methods proposed and presented on face detection using appearance-based, template matching and structural methods. The basic face detection algorithms focused on the detection of frontal faces whereas newer algorithms attempt to solve the more general and difficult problem of multiview face detection.

Complete Chapter List

Search this Book:
Reset