Integrated Motion Capture Using Multi-Resolution Video Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional motion capture technologies require separate equipment and processes for capturing body, face, and hand movements, leading to increased costs, reduced efficiency, and limited precision, especially in capturing detailed movements and non-human subjects in controlled environments.
Innovation Solution
A full-body integrated motion capture method that extracts body joints from low-resolution multiview video, detects face and hand regions, and precisely extracts detailed joints from high-resolution video, using a combination of neural networks and image processing techniques to generate integrated motion data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If separate equipment and processes are used to capture body, face, and hand movements, then detailed movement capture is possible, but costs increase and work efficiency decreases
Solution Approach 1:
The patent combines multiple motion capture functions (body, face, hand) into a single integrated system using one type of camera. The camera simultaneously captures full-body motion and detailed facial/hand expressions, eliminating the need for separate capture equipment and post-production integration, thus improving work efficiency while maintaining detailed movement capture precision
Solution Approach 2:
The patent employs a universal camera system that performs multiple capture functions. A single camera setup can capture full-body skeletal motion, facial expressions, and hand gestures, making the system versatile and eliminating the need for specialized equipment for each body part, thereby reducing costs and improving productivity
2Measurement precision
If separate equipment and processes are used to capture body, face, and hand movements, then detailed movement capture is possible, but costs increase
Solution Approach 1:
The patent merges multiple capture functions into a single camera system, reducing the number of expensive specialized devices needed. By using one camera to capture body, face, and hand movements simultaneously, the system eliminates redundant equipment costs while maintaining detailed movement capture precision
Solution Approach 2:
The patent creates a universal capture system that replaces multiple specialized devices with a single multi-functional camera. This universal approach reduces equipment complexity and cost while maintaining the ability to capture detailed movements across different body parts
3Measurement precision
If conventional motion capture equipment is used, then accurate motion data can be obtained, but the system is limited to controlled studio environments
Solution Approach 1:
The patent replaces traditional mechanical motion capture systems (requiring controlled environments) with an image-based capture system using standard cameras. This substitution allows the system to operate in general environments while maintaining motion data accuracy through image processing and neural network-based joint extraction
4Productivity
If image-based motion capture is used, then integrated capture is possible, but the degree of precision is low
Solution Approach 1:
The patent segments the image processing into different resolution levels. A low-resolution video is used for full-body skeletal extraction, while high-resolution videos are used specifically for facial and hand joint extraction. This segmentation allows integrated capture while maintaining high precision for detailed body parts
Solution Approach 2:
The patent applies different quality levels to different body parts based on their importance. High-resolution capture is applied locally to face and hands where detailed precision is critical, while standard resolution is sufficient for the body. This local quality approach maintains overall precision while enabling integrated capture
Data Source
AI summary
Proposed is a full-body integrated motion capture method capable of integrally detecting joints for full-body motion capture by extracting body joints of a body from a low-resolution multiview video, detecting face and hand regions through the body joints, and precisely extracting detailed joints for a face and a hand from a high-resolution video of the face and hand regions. The full-body integrated motion capture method includes: (a) receiving a multiview color-depth video and a high-resolution video; (b) extracting a body skeleton from the low-resolution video; (c) detecting face and hand regions by using joints of a neck and a wrist of the body skeleton; (d) extracting a detailed joint from a region of the high-resolution video corresponding to the face and hand regions; and (e) generating motion data by integrating a body joint and the detailed joint.