Real-time whole body motion capture system and method based on camera and IMU data mixing

A camera and data technology, applied in character and pattern recognition, measuring devices, instruments, etc., can solve problems such as poor attitude movement response, data drift, poor reliability and stability of motion capture drives, etc., to ensure reliability and stability , to ensure the accuracy of acquisition and the effect that is not easily affected by the environment

Inactive Publication Date: 2020-10-16
北京中科深智科技有限公司
View PDF5 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method has the advantages of low application cost and good real-time performance. However, when the body parts are occluded, the method cannot accurately identify the human body movement posture, which leads to the interruption of the movement of the human skeleton model. Therefore, this method has the reliability and stability of the motion capture drive. poor disadvantage
[0003] In order to solve the problem of poor reliability and stability of motion capture data captured by visual sensors, a method of capturing motion capture data and driving the human ske

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time whole body motion capture system and method based on camera and IMU data mixing
  • Real-time whole body motion capture system and method based on camera and IMU data mixing
  • Real-time whole body motion capture system and method based on camera and IMU data mixing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] The technical solutions of the present invention will be further described below in conjunction with the accompanying drawings and through specific implementation methods.

[0059] Wherein, the accompanying drawings are only for illustrative purposes, showing only schematic diagrams, rather than physical drawings, and should not be construed as limitations on this patent; in order to better illustrate the embodiments of the present invention, some parts of the accompanying drawings will be omitted, Enlargement or reduction does not represent the size of the actual product; for those skilled in the art, it is understandable that certain known structures and their descriptions in the drawings may be omitted.

[0060] In the drawings of the embodiments of the present invention, the same or similar symbols correspond to the same or similar components; , "inner", "outer" and other indicated orientations or positional relationships are based on the orientations or positional ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time whole body motion capture system and method based on camera and IMU data mixing. The method comprises the steps of collecting video frame images of a human body; predicting the joint position of the 3D skeleton according to the color information and the depth information of the video frame image; constructing a human skeleton model according to the predicted coordinate position of each human joint in the three-dimensional space; acquiring motion posture information of a human body in real time through camera equipment; acquiring the motion postures of the corresponding joints in real time by utilizing IMU nodes bound at the joints on the human body; fusing the joint motion postures acquired by the camera equipment and the IMU node to correct the motion posture of the human body joint; and driving the human skeleton model to move according to the corrected joint motion posture. The advantages of a visual motion capture technology and an IMU inertial measurement technology are integrated, the acquisition precision of motion capture data can be effectively ensured, and the reliability and stability of driving a human skeleton model to move are ensured.

Description

technical field [0001] The invention relates to the technical field of motion simulation, in particular to a real-time whole-body motion capture system and method based on the mixing of camera and IMU data. Background technique [0002] In recent years, low-power full-body motion capture has gained widespread attention in the fields of computer vision and automation. At present, the commonly used motion capture method is to capture the human body movement posture data in real time through the visual sensor, and then drive the human skeleton model to move according to the captured human body movement posture data. This method has the advantages of low application cost and good real-time performance. However, when the body parts are occluded, the method cannot accurately identify the human body motion posture, which leads to interruption of the motion of the human skeleton model. Therefore, this method has the reliability and stability of the motion capture drive. Poor disadv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G01C9/00
CPCG01C9/00G06V40/20G06V20/40
Inventor 不公告发明人
Owner 北京中科深智科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap