Monocular RGB-D camera real-time face reconstruction method and device

A camera, single-purpose technology, applied in the field of 3D reconstruction, can solve the problems of inaccurate rigid motion estimation and reconstruction failure, and achieve the effect of removing the influence of non-rigid motion and improving accuracy

Active Publication Date: 2019-03-15
TSINGHUA UNIV
View PDF7 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method has great limitations when the camera is moving fast or the reconstruction object is moving fast, and reconstruction failures often occur due to inaccurate rigid motion estimation.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Monocular RGB-D camera real-time face reconstruction method and device
  • Monocular RGB-D camera real-time face reconstruction method and device
  • Monocular RGB-D camera real-time face reconstruction method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0034] The method and device for real-time face reconstruction with a monocular RGB-D camera according to an embodiment of the present invention will be described below with reference to the accompanying drawings. First, the method for real-time face reconstruction with a monocular RGB-D camera according to an embodiment of the present invention will be described with reference to the accompanying drawings .

[0035] figure 1 It is a flowchart of a real-time face reconstruction method with a monocular RGB-D camera according to a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a monocular RGB-D camera real-time face reconstruction method and device, wherein, that method comprise: detecting the position of the face feature point on the input face RGBimage through an advanced face feature point detection algorithm; Obtaining three-dimensional coordinates of each feature point of the current frame according to the position of the feature points ofthe face; Acquiring the current three-dimensional coordinates of each facial feature point on the key frame; The global rigid motion from the key frame to each frame is obtained according to the three-dimensional coordinates and the current three-dimensional coordinates, so as to obtain the rigid motion result; The result of rigid motion is used as the initialization of ICP to fine-tune the rigidmotion of human face. The rigid motion results are applied to the key frame model to update the TSDF representation of the model. This method effectively removes the depth of non-face region, eliminates the influence of rigid motion, and improves the accuracy of rigid motion estimation by using facial feature points.

Description

technical field [0001] The invention relates to the technical field of three-dimensional reconstruction, in particular to a method and device for real-time face reconstruction with a monocular RGB-D camera. Background technique [0002] Among related technologies, 3D reconstruction technology is a research hotspot in the fields of computer vision and computer graphics, and is one of the core technologies in the fields of virtual reality / augmented reality, automatic driving, robotics, etc., and has a wide range of applications. In recent years, there have been many works using consumer-level depth cameras (such as Microsoft Kinect, Intel RealSense, etc.) to perform real-time 3D reconstruction of general scenes and objects. [0003] Most of this kind of work is based on the ICP algorithm to rigidly register the reconstructed geometric part and the input point cloud of the current frame, and estimate the rigid motion (global rotation and translation) of the current frame relati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/55G06T15/00
CPCG06T15/005G06T2207/10016G06T2207/10024G06T2207/30201G06T7/55
Inventor 徐枫冯铖锃
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap