Article Preview
TopIntroduction
Human lives involve social judgment and bring us to elicit reliable judgment of emotion and personality from human raters (Andrea et al., 2004). Emotion and personality depend on a series of processes including the perception of the stimuli, observable behavior to prior knowledge and inferring the state or trait that relatively automatic component towards of a body (Bodenhausen & Hugenberg, 2011; Adolphs, 2002). Hans Eysenck (1916) classifies personality into three categories of super traits (extraversion–introversion), neuroticism and psychoticism stability. The problem with thoughts and behavior of humans comes from uncontrolled emotion that can lead to personality disorders such as borderline, antisocial, narcissistic and others (Zuckerman, 1991)
An article from Pacer Centre has explicated that the childhood of teenager who experiences an emotional disorder will most likely have difficulties in growing up. In addition from DSM-IVR diagnostic criteria, there are several types of emotional disorder that affect a child and youth. In psychosocial aspects, emotional disorders are quite complex. Many psychologists will normally investigate the patient emotional states through questionnaires and counseling and this technique are more subjective. In order to develop objective method to understand the emotional state of an individual, several studies using physiological signal, facial expressions, acoustic analysis of speech, gesture and body motion were investigated (Hassan et al., 2010; Reddy et al., 2011; Russo et al., 2009; Yamada & Watanabe, 2007; Asha et al., 2005; Friberg, 2004; Kobayashi, 2007; Kleinsmith et al., 2011; Omlor et al., 2006; Karg et al., 2010; Roether et al., 2009; Janssen et al., 2008; Venture, 2010). Although several studies are available in the literature, there is still some limitation. Physiological signal is hard to deal with since it can be affected by internal factors of a user. External factor on the other hand deals with the different physiological or acoustic signal characteristic where they are easily exposed to the environmental noise during experimental session. In order to improve the performance to develop the removable method, the researchers used motion capture based marker techniques. The data obtained is considered more accurate since it could represent the orientations of the joints and bone structure as presented in previous works.
Developing machine learning models for recognizing human emotion is far more challenging and it is an active research field which generally referred to as affective computing. Table 1 depicts some of the significant research works that was conducted in the human emotions for various types of motion.
Table 1. A summary of some research works on emotion recognition, detailing the number of subjects, the emotion involved, the features used and the classifiers employed
First Author | Target Group | Emotion | Motion | Features | Classifier | Best Result |
Karg, M. (2009) | 30 Nonprofessional actors | Sad, happy, angry, neutral | Walking, knocking, lifting, throwing | Position, Joint angle | Naïve Bayes, 1- Nearest Neighbor, SVM | 72% |
Asha, K. (2005) | 3 nonprofessional dancers 2 professional dancers | Sadness, joy, anger, fear | Dancing | Position, velocity, acceleration | Logistic Regression, Naïve Bayes, Decision Tree, ANN, SVM | 93% |
Karg, M. (2010) | 13 nonprofessional actors | Neutral, sad, happy, angry | Walking | Joint angle, velocity, stride length, cadence | Nearest Neighbor, Naïve Bayes, SVM | 95% |
Bernhardt, D. (2007) | 30 individuals | Neutral, happy, angry and sad | Knocking, throwing, lifting and walking | Maximum distance, velocity, acceleration, jerk | SVM | 81% |
Castellano, G. (2007) | 10 participants | Anger, joy, pleasure, sadness | Body movement and gesture expressivity | amplitude, speed and 〉uidity of movement | 1-nearest-neighbor, Decision-tree, Bayesian Network | 68% |