Augmented reality-based human face interaction entertainment method

Abstract

The invention discloses an augmented reality-based human face interaction entertainment method. The method comprises the following steps of 1, pre-building / pre-making a standard human face three-dimensional model and a face three-dimensional material; 2, inputting a human face video and detecting 2D human face feature points at each frame in the input human face video; 3, estimating 3D position and posture of a human face in video frames in combination with the standard human face three-dimensional model and the 2D human face feature points; 4, converting the pre-made face three-dimensional material to be in the same posture of the human face in the video according to the 3D position and posture, obtained in the step 3, of the human face, and performing rendering and superposition in the human face video to achieve an augmented reality effect; and 5, recording and storing an augmented reality effect video of the human face, and sharing the augmented reality effect video with friends for interaction. According to the method, the human face video can be shot only by a mobile phone camera without external devices such as a special sensor and the like; and the method is not limited in application range, is convenient for popularization, and has very good following performance and natural effects.

Description

technical field [0001] The invention belongs to the technical fields of computer vision and computer graphics, and in particular relates to an augmented reality face interactive entertainment method. Background technique [0002] Augmented reality face interactive entertainment technology mainly shoots face videos through mobile phones, and further estimates the 3D position and posture of the face by tracking the feature points of the face online in real time, so that the preset 3D face material is superimposed on the face video and Follow the rotation and movement of the face to get a novel augmented reality interactive effect. Further, it can also realize interaction by recording a video and sharing it with friends. Since facial movements are an important way to convey human emotions, the above technologies are widely used in human-computer interaction, film and television advertisements, game production, video conferencing, etc. [0003] The current augmented reality sol...

AI Technical Summary

Problems solved by technology

Estimating the 3D position and posture of the face generally requires knowing the 3D model structure information of the face. Currently, the 3D information of the face can be obtained in real time through an RGB-D camera (such as Microsoft’s Kinect sensor), but this type of technology requires a special sensor, so greatly limited its scope of use

Images