Method for recovering real-time three-dimensional body posture based on multimodal fusion

A 3D posture and multi-modal technology, applied in the field of real-time human body 3D posture restoration, can solve the problems of difficulty in realization, achieve the effects of improving stability, simplifying the capture process, and reducing the cost of use

Inactive Publication Date: 2012-11-28
ZHEJIANG UNIV
View PDF3 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] However, the above method still has a certain gap with traditiona

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for recovering real-time three-dimensional body posture based on multimodal fusion
  • Method for recovering real-time three-dimensional body posture based on multimodal fusion
  • Method for recovering real-time three-dimensional body posture based on multimodal fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] combined with figure 1 , a method for real-time human body three-dimensional posture recovery based on multi-modal fusion, its steps are as follows:

[0048] 1) Obtain scene depth image and scene color image

[0049] This method obtains a sequence of scene depth images and scene color images with a length of 640 pixels and a width of 480 pixels at a frame rate of not less than 25 frames per second, and each frame of the scene depth map in the sequence of scene depth maps (such as figure 2 shown) consists of a pixel matrix, and the value of each pixel in the pixel matrix represents the distance from the position in the scene corresponding to the pixel to the reference position, that is, the depth value of the pixel; the scene depth map and the scene color map Synchronized at every moment, every pixel of the scene depth image and the scene color image are also aligned.

[0050] 2) Background clipping on the depth image

[0051] The background and foreground pixels of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for recovering a real-time three-dimensional body posture based on multimodal fusion. The method can be used for recovering three-dimensional framework information of a human body by utilizing multiple technologies of depth map analysis, color identification, face detection and the like to obtain coordinates of main joint points of the human body in a real world. According to the method, on the basis of scene depth images and scene color images synchronously acquired at different moments, position information of the head of the human body can be acquired by a face detection method; position information of the four-limb end points with color marks of the human body are acquired by a color identification method; position information of the elbows and the knees of the human body is figured out by virtue of the position information of the four-limb end points and a mapping relation between the color maps and the depth maps; and an acquired framework is subjected to smooth processing by time domain information to reconstruct movement information of the human body in real time. Compared with the conventional technology for recovering the three-dimensional body posture by near-infrared equipment, the method provided by the invention can improve the recovery stability, and allows a human body movement capture process to be more convenient.

Description

technical field [0001] The invention relates to a method for restoring a real-time three-dimensional pose of a human body, in particular to a method for real-time restoring a three-dimensional pose of a human body by using a depth map and a color code. Background technique [0002] Human body 3D posture recovery refers to obtaining real human body motion data through equipment, including 3D space coordinate information of major joint points, etc.; and then calculating and rendering these motion data to establish the motion posture of the character in the virtual scene. Through such a technology, the movement of the human body in reality can be bound to the movement of the character in the virtual world, thereby driving the movement of the virtual character. At present, the three-dimensional posture restoration technology of the human body is widely used in the fields of film, animation shooting and game production. Compared with the traditional computer animation modeling te...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00G06T15/00
Inventor 肖俊刘彬庄越挺
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap