AR Exercise Feedback System for Musculoskeletal Form Guidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems for providing exercise feedback on musculoskeletal form lack customization and real-time guidance outside of in-person physical therapy sessions, making it difficult for individuals to maintain proper form and adhere to exercise programs effectively.

Innovation Solution

An augmented reality (AR) exercise feedback system that uses client devices with cameras to capture and analyze user exercises, providing 2D or 3D AR graphics for proper form guidance and allowing users to capture and store images or videos for personalized feedback, enabling remote customization and real-time guidance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If online guides, applications, or videos are used for exercise feedback, then accessibility is improved, but customization and reliability of feedback are worsened

Engineering Contradiction:
ImproveaccessibilityVSAvoidcustomization and reliability of feedback
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system implements automated feedback by capturing images or video of the user performing exercises, analyzing the musculoskeletal form using image processing techniques, and providing real-time feedback on form correctness. This automated feedback loop resolves the contradiction by delivering customized, reliable feedback through technology rather than relying on generic online resources.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system enables users to perform self-assessment of their exercise form by capturing their own images or video and receiving automated analysis. This self-service approach maintains accessibility while providing customized feedback, as the system adapts to each user's specific movements and provides personalized guidance without requiring in-person therapist intervention.

Inventive Principle:
Principle #25Self-service

2Reliability

If in-person physical therapy sessions are used, then customization and reliability of feedback are improved, but accessibility and convenience are worsened

Engineering Contradiction:
Improvecustomization and reliability of feedbackVSAvoidaccessibility
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system introduces an automated image analysis intermediary that bridges the gap between in-person therapy and remote exercise. The intermediary captures and analyzes exercise form remotely, providing the customization and reliability previously only available through in-person sessions, while eliminating the need for physical presence and improving accessibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system replaces the mechanical system of in-person physical therapy with an automated digital system that uses cameras and image processing algorithms. This substitution maintains the customization and reliability of feedback while removing the geographical and scheduling constraints of in-person sessions, thereby improving accessibility.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Speed

If AR graphics are used for exercise guidance, then real-time feedback is improved, but device complexity is worsened

Engineering Contradiction:
Improvereal-time feedbackVSAvoiddevice complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The system leverages the multi-functionality of smartphone devices, which already possess cameras, processors, and display capabilities. By utilizing these existing components for AR visualization and image analysis, the system achieves real-time feedback without requiring specialized equipment, thereby minimizing the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system creates simplified 2D or 3D AR graphics that copy and represent the target musculoskeletal form. These graphical representations provide real-time visual guidance without requiring complex hardware, as they are rendered software-based overlays that leverage the device's existing display and processing capabilities.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11183079B2Augmented reality guided musculoskeletal exercises
Publication Date: 2021.11.23 OMADA HEALTH
  • US11183079B2 patent drawing
  • US11183079B2 patent drawing
  • US11183079B2 patent drawing

AI summary

An exercise feedback system receives exercise data captured by client devices of users performing musculoskeletal exercises. The exercise feedback system may provide captured images to a client device of a physical trainer (PT) who remotely provides feedback on the users' exercise performances, for example, by labeling images as indicative of proper or improper musculoskeletal form. A PT may track multiple users using a central feed, which includes content displayed in an order based on ranking of users by a model. Additionally, the exercise feedback system may provide an augmented reality (AR) environment. For instance, an AR graphic indicating a target musculoskeletal form for an exercise is overlaid on a video feed displayed by a client device. Responsive to detecting that a user's form is aligned to the AR graphic, the exercise feedback system may notify the user and trigger the start of the exercise.