Human body 3D reconstruction method and device for complex dynamic scene under multi-view camera

A dynamic scene, three-dimensional reconstruction technology, applied in the field of computer vision, can solve the problems of inaccurate and comprehensive use of two-dimensional information, rough results, etc., to achieve the effect of improving accuracy and reliability, and accurate segmentation of people and objects

Inactive Publication Date: 2018-05-18
TSINGHUA UNIV
View PDF6 Cites 51 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, most of the current 3D reconstruction algorithms do not use 2D information accurately and comprehensively, and the calculation process relies too much on information provided by externa

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human body 3D reconstruction method and device for complex dynamic scene under multi-view camera
  • Human body 3D reconstruction method and device for complex dynamic scene under multi-view camera
  • Human body 3D reconstruction method and device for complex dynamic scene under multi-view camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0036] The method and device for 3D human body reconstruction of complex dynamic scenes under multi-view cameras according to the embodiments of the present invention will be described below with reference to the accompanying drawings. First, the 3D human body reconstruction of complex dynamic scenes under multi-view cameras according to the embodiments of the present invention will be described with reference to the accompanying drawings. rebuild method.

[0037] figure 1 It is a flow chart of a method for three-dimensional rec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a human body 3D reconstruction method and device for a complex dynamic scene under a multi-view camera. The method comprises the following steps: photographing a target human body object at multiple views to obtain 2D images at multiple views under the same moment; predicting all the parts of the human body in the video sequence through a model after deep network learning to obtain the human body skeleton information of the human body; matching the movement and rough contour of the character in the images through a virtual 3D human body model according to the skeleton information to obtain the human body contour information of the human body; and carrying out human body 3D modeling through a Virtual Hull method according to the calibrated internal and external parameter information of the camera at multiple views as well as the human body skeleton information and the human body contour information. Through the method, 3D reconstruction of a human body object ina video sequence can be realized through camera calibration and other processes, and therefore, accurate character object segmentation is realized, and the accuracy and reliability of reconstruction are improved.

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to a method and device for three-dimensional reconstruction of a human body in complex dynamic scenes under multi-view cameras. Background technique [0002] In computer vision, 3D reconstruction is the process of reconstructing 3D information from single-view or multi-view images. Since the information of a single video is incomplete, 3D reconstruction needs to use prior knowledge, while multi-view 3D reconstruction can use more The information of the two-dimensional image of the viewpoint is used to reconstruct the three-dimensional model. However, most of the current 3D reconstruction algorithms do not use 2D information accurately and comprehensively enough, and the calculation process relies too much on information provided by external devices, such as depth information provided by depth cameras, or on the segmentation results of objects and backgrounds, etc. , resulti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00
CPCG06T17/00
Inventor 刘烨斌王金宝戴琼海
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap