Skeleton Tracking Reliability Feedback for Game Motion Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Game devices with motion sensor interfaces face instability and erroneous operation recognition due to low reliability and detection accuracy of motion input information, leading to suboptimal user experience.
Innovation Solution
An image generation system that acquires skeleton information from an image sensor, estimates joint position information, and generates images based on reliability data, adjusting display states and object control accordingly to reflect the accuracy of motion input, thereby enhancing user interaction and game stability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If motion sensor interface is used for intuitive operation input, then ease of operation is improved, but reliability deteriorates due to low detection accuracy
Solution Approach 1:
The system calculates reliability values for detected skeleton information and provides feedback by displaying reliability indicators to the user. This allows users to understand the accuracy of their motion input and adjust their movements accordingly, improving operation recognition reliability while maintaining intuitive operation.
Solution Approach 2:
The system changes the parameter of reliability calculation based on multiple factors including detection accuracy, positional relationships between body parts, and temporal consistency. By dynamically adjusting reliability parameters based on these conditions, the system resolves the contradiction between intuitive operation and reliable recognition.
2Adaptability or versatility
If skeleton information is used for object control, then adaptability is improved, but stability deteriorates due to low detection accuracy
Solution Approach 1:
The system provides feedback by displaying reliability information and using it to modulate object control. When reliability is low, the system adjusts object control accordingly, preventing unstable behavior while maintaining adaptability to various motion inputs.
Solution Approach 2:
The system dynamically adjusts object control based on real-time reliability assessments. Control parameters are modified according to detection accuracy and positional relationships, allowing the system to adapt to varying input quality while maintaining stability through conditional control adjustments.
3Measurement precision
If joint position information is estimated from image data, then measurement precision is improved, but reliability deteriorates due to prediction uncertainty
Solution Approach 1:
The system changes reliability parameters based on multiple conditions including detection accuracy, positional relationships between joints, and temporal consistency. By calculating reliability as a composite parameter considering these factors, the system accurately reflects the uncertainty of estimated positions while maintaining precise measurements.
Solution Approach 2:
The system performs preliminary reliability assessment before using estimated joint positions for control. By pre-calculating reliability based on detection conditions and positional relationships, the system prepares reliability information in advance for subsequent control decisions.
Data Source
Figure 1
Figure 2
Figure 3A~3B
AI summary
An image generation system includes an image information acquisition section that acquires image information from an image sensor, a skeleton information acquisition section that acquires skeleton information based on the image information from the image sensor, the skeleton information specifying a motion of an operator, a reliability information acquisition section that acquires reliability information that indicates reliability of the skeleton information, and an image generation section that generates an image displayed on a display section. The image generation section generates an image corresponding to the acquired reliability information as the image displayed on the display section.