3D Avatar Pose Guidance From Monocular Images for Exercise Technique
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing exercise therapy and physical activity systems fail to monitor and guide users in performing physical activities correctly, leading to improper technique and reduced effectiveness in achieving therapeutic goals or improving performance in activities such as dance, sports, and cooking.
Innovation Solution
A computer-implemented pose monitoring platform that uses computer vision and image analysis to assess user performance, providing personalized feedback and guiding users through physical activities to ensure proper technique, with integration of personalized three-dimensional avatars for real-time guidance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If existing exercise therapy systems are used, then users can access exercise programs, but the systems cannot monitor or guide users in performing physical activities correctly
Solution Approach 1:
The system creates a three-dimensional avatar copy of the user based on monocular images. This virtual replica allows the system to monitor and analyze physical activity performance without requiring complex sensor arrays or multiple cameras. The avatar serves as a simplified representation that captures pose information while reducing system complexity.
Solution Approach 2:
The patent replaces complex mechanical sensing systems with computer vision technology. Instead of using multiple sensors or cameras to track body movements, the system uses a single camera to capture images and processes them through image analysis algorithms to generate three-dimensional pose information, thereby reducing hardware complexity while maintaining monitoring precision.
2Loss of information
If users perform physical activities without monitoring feedback, then users can complete exercises independently, but users cannot know when their technique is improper
Solution Approach 1:
The system provides real-time feedback to users by comparing their actual pose against the target pose using the three-dimensional avatar. The avatar visually displays the user's current position and the system can provide guidance information when deviations from the correct technique are detected, ensuring users receive necessary feedback without complicating the exercise routine.
Solution Approach 2:
The three-dimensional avatar serves as a visual copy that mirrors the user's movements in real-time. This virtual replica provides intuitive feedback by showing users exactly how their body is positioned relative to the correct form, making it easy for users to understand and correct their technique without complex instructions.
3Measurement precision
If multiple cameras or sensors are used to monitor physical activities, then measurement precision improves, but device complexity and cost increase
Solution Approach 1:
The system replaces multiple physical sensors or cameras with a single camera and computer vision processing. The monocular image is processed through algorithms that reconstruct three-dimensional pose information, achieving measurement precision comparable to multi-sensor systems while using significantly simpler hardware.
Solution Approach 2:
The three-dimensional avatar acts as a computational copy that encodes pose information derived from a single image. This virtual representation allows the system to extract precise spatial and orientational data without requiring multiple physical measurement devices, thereby reducing hardware complexity while maintaining accuracy.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances adherence to exercise therapy programs and improves performance in physical activities by ensuring proper technique, thereby promoting long-term success and effectiveness in achieving therapeutic goals or improving skills in various domains.
Implementation Method 1
an image sensor that captures a digital image of a user in a predetermined pose
Data Source
AI summary
Introduced here are computer-implemented platforms (also referred to as “pose monitoring platforms”) that are designed to improve adherence to, and success of, physical activity programs. As part of a physical activity therapy program, a user may be requested to engage with a pose monitoring platform to follow a program of physical activities. The pose monitoring platform can create an avatar of a user and estimate poses being performed by the user in the real world. The pose monitoring platform can render instances of the avatar in the estimated poses and display the instances of the avatar to guide the user through the program, such as by comparing the instances to rendered instances of the avatar performing poses associated with the physical activities.