Face-changing system and method based on real-time depth somatosensory interaction and augmented reality technology
An augmented reality and body-sensing technology, applied in indoor games, video games, sports accessories, etc., can solve the problems of large impact on face recognition rate, large amount of motion-sensing interaction calculations, single face changing method, etc., and achieve high system redundancy , The system is easy to use and the model is clear
Active Publication Date: 2018-09-25
JINAN ZHONGJING ELECTRONICS TECH
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The augmented reality Sichuan opera face-changing system implemented by ordinary cameras can only superimpose Sichuan opera facial makeup on the user's face on a two-dimensional plane, and the recognition rate for face recognition is greatly affected by the angle of the face. Realizing somatosensory interaction on the image requires a large amount of calculation
In addition, since ordinary cameras can only collect two-dimensional plane images, the Sichuan opera face-changing system that only uses two-dimensional plane images has a single face-changing method, and the user experience is not good
[0003] In order to solve the problems and deficiencies in the above-mentioned "Sichuan opera face changing" system implemented by ordinary cameras, a Sichuan opera face changing system and method based on real-time depth somatosensory interaction is proposed
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0040] In order to make the technical problems, technical solutions and advantages to be solved by the present invention clearer, a detailed description will be given below in conjunction with the accompanying drawings and specific embodiments. What needs to be stated is that although the embodiment takes Sichuan Opera face change as an example, the system and method are explained, but the technology is applicable to any face change field.
[0041] The present invention provides a face-changing system based on real-time depth somatosensory interaction and augmented reality technology: the system is composed of an optical depth sensor and a PC computer. The optical depth sensor is placed on the top of the PC computer display and connected to the PC host for real-time acquisition. The color image and depth image in the three-dimensional space are transmitted to the software processing part of the PC. The software processing part includes a Sichuan Opera facial makeup overlay module...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present invention establishes a face-changing system and method based on real-time depth somatosensory interaction and augmented reality technology to solve the problem that the face recognition rate of the face-changing system realized by ordinary optical cameras is easily affected by light occlusion and the calculation is relatively large, and the user experience is not good. Good and other deficiencies. This method uses the optical depth sensor to collect color images, depth images, and human bone point coordinate images in the environment in real time. Aiming at the fact that ordinary cameras recognize faces that are easily affected by factors such as light occlusion, the method adopts human bone point coordinates and human body bone point coordinates based on Haar features. The face recognition algorithm calculates the three-dimensional coordinates of the face and the size of the face. After obtaining the face coordinates and the size of the face, the augmented reality technology is used to superimpose the Sichuan opera facial make-up on the face. The invention is ingenious in design and convenient in use, and well solves the defect of using an ordinary camera to realize face changing.
Description
Technical field [0001] The invention relates to the fields of augmented reality technology, human-computer interaction and the like. Specifically, it relates to a somatosensory interaction system and method for "Sichuan Opera Changing Face" based on real-time depth somatosensory sensors, in particular to a face changing system and method based on real-time depth somatosensory interaction and augmented reality technology. Background technique [0002] Augmened Reality (AR) is a new technology developed on the basis of virtual reality technology. It is a technology that increases users' perception of the real world through information provided by computer systems. In recent years, with the development of science and technology, especially depth sensors represented by Kinect have greatly promoted the somatosensory interaction technology with depth technology as the core, and a number of applications that combine Kinect technology and AR technology have been produced. The traditiona...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): A63F13/213A63F13/52A63F13/55
Inventor 陈东义
Owner JINAN ZHONGJING ELECTRONICS TECH