Exercise Feedback System Using AR Graphics and Image Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for providing exercise feedback on musculoskeletal form lack customization and real-time guidance outside of in-person physical therapy sessions, making it difficult for individuals to maintain proper form and adhere to exercise programs effectively.
Innovation Solution
An exercise feedback system that uses user interfaces to track and provide feedback on musculoskeletal form through 2D or 3D images, augmented reality graphics, and machine learning models to rank users based on their performance, adherence, and pain levels, offering personalized guidance and surveys to improve exercise form and adherence.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a physical therapist provides personalized feedback during in-person sessions, then the quality and customization of exercise feedback is improved, but the accessibility and convenience for users exercising at home or work deteriorates
Solution Approach 1:
The system captures images of users performing exercises and creates digital copies that can be analyzed and shared with physical therapists remotely. This allows the feedback quality of in-person sessions to be replicated for home exercise users through image analysis and automated evaluation systems.
Solution Approach 2:
The patent introduces an automated exercise feedback system with image analysis capabilities and AI evaluation as an intermediary between users and physical therapists. This mediator enables remote monitoring and feedback provision, making personalized therapy accessible without requiring in-person sessions.
2Productivity
If the system tracks and monitors multiple users continuously, then the productivity and effectiveness of physical therapy delivery is improved, but the device complexity and system resources required deteriorates
Solution Approach 1:
The system segments user monitoring into discrete image capture events rather than continuous video streaming. By analyzing static images at key moments during exercise performance, the system reduces computational load and resource requirements while maintaining effective tracking of multiple users.
Solution Approach 2:
The patent implements selective monitoring where the system captures and analyzes only the necessary portions of exercise performance data. Rather than processing all possible metrics continuously, it focuses on key pose points and critical form indicators, reducing system complexity while maintaining therapeutic effectiveness.
3Reliability
If the system provides real-time feedback during exercise, then the ability to correct form and prevent injury is improved, but the response time and processing delay deteriorates
Solution Approach 1:
The system pre-processes and analyzes images as they are captured during exercise, rather than waiting for completion. By performing real-time image analysis and providing feedback during the exercise set, the system enables immediate form correction while maintaining a natural exercise rhythm without significant delays.
Data Source
AI summary
An exercise feedback system receives exercise data captured by client devices of users performing musculoskeletal exercises. The exercise feedback system may provide captured images to a client device of a physical trainer (PT) who remotely provides feedback on the users' exercise performances, for example, by labeling images as indicative of proper or improper musculoskeletal form. A PT may track multiple users using a central feed, which includes content displayed in an order based on ranking of users by a model. Additionally, the exercise feedback system may provide an augmented reality (AR) environment. For instance, an AR graphic indicating a target musculoskeletal form for an exercise is overlaid on a video feed displayed by a client device. Responsive to detecting that a user's form is aligned to the AR graphic, the exercise feedback system may notify the user and trigger the start of the exercise.