VR Controller Graphic Stabilization Under Variable Tracking Accuracy

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional VR and MR systems face inaccuracies in detecting the position and orientation of hand controllers, leading to less convenient user interfaces due to rapid changes in graphic positioning and orientation.

Innovation Solution

An information processing apparatus that acquires and controls the position or orientation of graphics based on high-accuracy first information when available and lower-accuracy second information, using a combination of sensors and markers to ensure smooth and accurate user interface operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional detection methods are used to track hand controller position and orientation, then the system can operate with simple hardware, but the detection accuracy is insufficient leading to graphic instability

Engineering Contradiction:

Improvedetection accuracy of hand controller position and orientationVSAvoidcomplexity of detection system

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The detection system is segmented into multiple independent components: markers attached to the hand controller, cameras mounted on HMDs for capturing marker positions, and a separate calculation unit for computing position and orientation. This segmentation allows each component to be optimized independently, improving overall detection accuracy without requiring a completely complex integrated system.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Markers serve as intermediaries between the hand controller and the cameras. These markers provide distinct visual features that cameras can easily detect and track, enabling accurate position and orientation measurement without requiring complex direct sensing of the hand controller itself.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the system uses detection information with varying accuracy, then it can maintain operation under different conditions, but the position and orientation of graphics change rapidly reducing user interface convenience

Engineering Contradiction:

Improveoperation capability under varying detection conditionsVSAvoiduser interface convenience

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system dynamically adjusts its operation based on detection accuracy. When high-accuracy detection is available, the system updates graphic positions freely; when accuracy decreases, the system restricts updates to only significant changes. This dynamic adaptation maintains system operation under varying conditions while preserving user interface smoothness.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system applies partial updates to graphic positions based on detection quality. Instead of always updating positions based on every detection result, the system selectively updates only when detection accuracy is sufficient or when changes exceed a threshold, preventing unnecessary graphic fluctuations that would degrade user interface convenience.

Inventive Principle:

Principle #16Partial or excessive action

3Speed

If the system updates graphic position based on every detection result, then it maintains real-time responsiveness, but detection inaccuracies cause graphic position to change rapidly

Engineering Contradiction:

Improveresponsiveness of graphic position updateVSAvoidstability of graphic position

Core Design Contradiction:

SpeedVSStability of the object's composition

Solution Approach 1:

The system incorporates feedback mechanisms by evaluating detection accuracy before updating graphic positions. The calculation unit assesses the quality of detection results and uses this feedback to determine whether to update graphic positions. This feedback loop maintains real-time responsiveness for accurate detections while filtering out unstable updates from inaccurate detections.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system changes operational parameters based on detection quality. When detection accuracy is high, the system allows frequent and free graphic position updates. When detection accuracy decreases, the system changes parameters to restrict updates to only those exceeding a significant threshold, thereby maintaining responsiveness during good detection conditions while ensuring stability during poor detection conditions.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS20250391142A1Information processing apparatus, information processing method, and non-transitory computer readable medium

Publication Date: 2025.12.25 CANON KK

AI summary

An information processing apparatus according to the present invention acquires information indicating a position or an orientation of an object for operating a virtual object; and controls a position or an orientation of a graphic corresponding to the object on a basis of the acquired information, wherein the position or the orientation of the graphic in a first state is controlled on a basis of first information that is information indicating the position or the orientation of the graphic in the first state in which the information is acquired with accuracy higher than predetermined accuracy and second information that is information indicating the position or the orientation of the graphic in a second state in which the information is not acquired with the accuracy higher than the predetermined accuracy.