Exercise Feedback System Using AR Overlay and Remote Trainer Matching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for providing musculoskeletal exercise feedback do not offer customized evaluations outside of in-person physical therapy sessions, making it difficult for individuals to maintain proper exercise form and identify reliable physical therapists tailored to their health goals or conditions.
Innovation Solution
An exercise feedback system that captures and transmits data from user devices to physical trainers for remote feedback, using image, video, and depth information to classify proper musculoskeletal form, generate scores, and recommend trainers based on user preferences, while also performing A/B tests for clinical evaluations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If in-person physical therapy sessions are used to provide exercise feedback, then customized evaluations and reliable feedback can be provided, but loss of time and reduced accessibility occur for users who cannot attend in-person sessions
Solution Approach 1:
The patent introduces a camera-based feedback system as an intermediary between the physical therapist and the user. The camera captures exercise performance data, and automated analysis provides feedback without requiring the physical therapist's direct presence, thus maintaining feedback reliability while eliminating time loss and geographical barriers.
Solution Approach 2:
The system creates a visual copy of the user's exercise performance through camera imaging. This copy is then analyzed to provide feedback, replacing the need for direct in-person observation by the physical therapist while preserving the essence of customized evaluation.
2Ease of operation
If generic online exercise guides are used, then accessibility and convenience are improved, but customization and reliability of feedback are lost
Solution Approach 1:
The system enables users to independently capture and analyze their own exercise performance using their device's camera. The automated analysis provides customized feedback without requiring interaction with a physical therapist, thus maintaining accessibility while restoring feedback customization and reliability.
Solution Approach 2:
The system implements an automated feedback loop where user exercise performance is captured, analyzed, and evaluated against personalized targets. This feedback mechanism provides customized guidance similar to in-person therapy while maintaining the accessibility of remote usage.
3Reliability
If multiple physical therapists are evaluated to find the best match, then customized feedback quality improves, but time and complexity increase
Solution Approach 1:
The patent replaces the manual process of evaluating multiple physical therapists with an automated camera-based assessment system. The system objectively measures exercise performance and matches users with therapists based on quantitative data, reducing system complexity while improving feedback quality through data-driven matching.
Data Source
AI summary
An exercise feedback system receives exercise data captured by client devices of users performing musculoskeletal exercises. The exercise feedback system may provide captured images to a client device of a physical trainer (PT) who remotely provides feedback on the users' exercise performances, for example, by labeling images as indicative of proper or improper musculoskeletal form. A PT may track multiple users using a central feed, which includes content displayed in an order based on ranking of users by a model. Additionally, the exercise feedback system may provide an augmented reality (AR) environment. For instance, an AR graphic indicating a target musculoskeletal form for an exercise is overlaid on a video feed displayed by a client device. Responsive to detecting that a user's form is aligned to the AR graphic, the exercise feedback system may notify the user and trigger the start of the exercise.