Virtual Object Graphic Control with Dual-Accuracy Hand Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional VR and MR systems face inaccuracies in detecting the position and orientation of hand controllers, leading to less convenient user interfaces.
Innovation Solution
An information processing apparatus that acquires and controls the position and orientation of graphics based on high-accuracy and low-accuracy information, using a combination of sensors and markers to ensure precise graphic control.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional sensor-based detection methods are used to track hand controller position and orientation, then the system can operate with simpler hardware, but the detection accuracy becomes insufficient leading to graphic instability
Solution Approach 1:
The patent combines multiple detection methods (sensor-based detection and marker-based detection) into a unified tracking system. The HMD includes both sensors for detecting hand controller position/orientation and a camera for capturing marker patterns, merging these detection mechanisms to achieve higher accuracy than either method alone could provide.
Solution Approach 2:
The patent introduces a marker (intermediary object) attached to the hand controller that serves as a mediator between the physical hand controller and the digital tracking system. The camera captures this marker pattern, and the processing unit decodes it to obtain precise position and orientation information, acting as an intermediary that bridges physical and digital domains with high accuracy.
2Measurement precision
If the system uses high-accuracy marker-based detection, then graphic positioning accuracy improves, but the response speed decreases due to image processing requirements
Solution Approach 1:
The patent dynamically switches between detection modes based on availability and accuracy requirements. The system uses sensor-based detection for continuous tracking (faster response) and supplements it with marker-based detection (higher accuracy) when needed, creating a dynamic detection strategy that optimizes both speed and accuracy rather than using a static single method.
Solution Approach 2:
The system performs preliminary detection using the always-active sensors to maintain continuous tracking of hand controller position and orientation. This preliminary action provides a baseline tracking capability that responds quickly, while marker-based detection is performed periodically or on-demand to refine accuracy without requiring full image processing at every frame.
3Productivity
If the system continuously updates graphics based on real-time detection, then user interface responsiveness improves, but detection accuracy fluctuations cause graphic instability
Solution Approach 1:
The patent implements a feedback mechanism where the system continuously monitors detection accuracy from multiple sources (sensors and marker recognition) and uses this feedback to adjust graphic rendering. When detection accuracy is high, graphics are updated responsively; when accuracy fluctuates, the system compensates to maintain graphic stability, creating a feedback loop that balances responsiveness and stability.
Solution Approach 2:
The system prepares compensation data in advance by maintaining a history of detection results and predicting hand controller position/orientation when detection accuracy is temporarily low. This beforehand cushioning ensures that even when real-time detection is unreliable, the graphic display remains stable and continuous without abrupt jumps or interruptions.
Data Source
AI summary
An information processing apparatus according to the present invention acquires information indicating a position or an orientation of an object for operating a virtual object; and controls a position or an orientation of a graphic corresponding to the object on a basis of the acquired information, wherein the position or the orientation of the graphic in a first state is controlled on a basis of first information that is information indicating the position or the orientation of the graphic in the first state in which the information is acquired with accuracy higher than predetermined accuracy and second information that is information indicating the position or the orientation of the graphic in a second state in which the information is not acquired with the accuracy higher than the predetermined accuracy.