Virtual Trainer Overlaying User Movement on Instructor Avatar

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual training systems lack real-time feedback on user posture and movement, making it difficult to correct and improve physical exercises, as they rely on video-based environments without interactive correction mechanisms.

Innovation Solution

A virtual training system incorporating 2D and 3D image sensors, biometric data sensors, and a processing device to provide real-time feedback on user movement compared to standard forms, displayed as graphical, textual, or audible information, with an adaptable instructor avatar based on user profiles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If video-based virtual training environment is used, then accessibility and convenience are improved, but interaction and real-time feedback capability deteriorate

Engineering Contradiction:
ImproveaccessibilityVSAvoidfeedback capability
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system implements real-time feedback by capturing user movement data through image sensors, comparing it to standard form movements, and providing corrective feedback through the display device. This closed-loop feedback mechanism resolves the contradiction by enabling interactive correction while maintaining video-based accessibility.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system introduces an intermediary processing layer that includes image sensors, processing devices, and comparison algorithms. This intermediary analyzes user movements and generates feedback, bridging the gap between passive video viewing and active real-time interaction without requiring physical trainer presence.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If real-time feedback system with multiple sensors is implemented, then measurement precision and feedback quality are improved, but device complexity increases

Engineering Contradiction:
Improvemovement detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system employs multi-functional image sensors that simultaneously capture 2D visual data and 3D depth information. This multi-functionality improves measurement precision for movement analysis while avoiding the need for separate dedicated sensors for each measurement type, thereby controlling system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges 2D image data from RGB cameras with 3D depth data from depth sensors into a unified movement analysis framework. This combination enables comprehensive posture and movement detection with higher precision while integrating multiple sensor types into a single coordinated system rather than separate independent systems.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS20230130555A1Virtual trainer on mobile/IOT devices
Publication Date: 2023.04.27 SAMSUNG ELECTRONICS CO LTD
  • US20230130555A1 patent drawing
  • US20230130555A1 patent drawing
  • US20230130555A1 patent drawing

AI summary

A virtual training system and method are disclose. The system includes two-dimensional (2D) and three-dimensional (3D) image sensors, a biometric data sensor, a processor, and an output device. The 2D image sensor senses a 2D image of a user, and the 3D image sensor senses a 3D image of the user including a movement of the user. The biometric data sensor senses at least one biometric characteristic of the user. The processor generates feedback information in real time during a session relating to movement of the user compared to a standard form movement, which may be an exercise movement, a dance movement, a martial arts movement, or a physical therapy movement. Feedback is provided by the output device as an image of the user captured by at least one of the 2D image sensor and the 3D image sensor overlayed on an instructor avatar, which illustrates the standard form movement.