Facial Expression and emotion Recognition through Serious game and Kinect device

The human face is considered to be a social stimulus that provides crucial information about a person. Knowing how to read and interpret micro-expressions is an essential part of understanding non-verbal behaviour and reading people. In this study, facial expression features are captured by Kinect Xbox and EMG (electromyography). That are interfaced with the game engine (Unity3D) to read the pose and expressions. Artificial intelligence algorithms are utilized to develop the serious game (SG) that is capable of tracking facial features in a real-time. Procedural Content Generation (PCG) is employed to generate elements of the game’s level to alleviate the work of designing each part of the level with different difficulty.