Facial expression capturing method and device and storage device

Abstract

The invention provides a facial expression capturing method and device and a storage device. The method comprises the steps: obtaining an RGBD image sequence comprising a human face, wherein the RGBD image comprises an RGB image and a depth image, and the pixels of the RGB image and the pixels of the depth image are corresponding in a one-to-one manner; carrying out the human face detection of the RGBD image, so as to extract an RGBD image of a human face region; obtaining a human face feature point from the RGBD image of the human face region; marking the positioning of the human face feature point on the RGBD image of the human face region; tracking the movement track of the human face feature point in the RGBD image sequence, and recording the information of the movement track. The device comprises a processor and an RGBD camera. The storage device stores program data, and the program data can be executed so as to implement the above method. The method can enable the human face feature point and the information of the movement track to be completely reflected through pixel information and depth information, and enables the captured expression information to be more complete and accurate.

Description

technical field [0001] The invention relates to the technical field of RGBD image processing, in particular to a method, device and storage device for capturing human facial expressions. Background technique [0002] An RGBD image is obtained by shooting a scene with an RGBD camera. It refers to an image in which depth information and color information are fused. Each image element has an associated color value and an associated depth value. The depth value represents the distance from the image sensor to the scene. distance from the surface of the object. [0003] Expressions are the external manifestations of emotions and emotions. According to the basic emotion model, expressions can be divided into six categories: anger, disgust, fear, happiness, sadness, and surprise. Facial expression recognition has always been of great research significance, and has huge market value in many fields such as human-computer interaction, public safety, and intelligent film and televisio...

AI Technical Summary

Problems solved by technology

[0005] The invention provides a method, device and storage device for capturing human facial expressions, which can solve the problem that the existing technology cannot comprehensively and accurately reflect the real facial expressions

Images