Mixed Reality Positioning Velocity Feedback Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In Mixed Reality systems using video see-through head-mounted displays, fast user movements lead to unclear images, making it difficult to accurately detect indices for positioning, resulting in accuracy degradation of positioning processing.

Innovation Solution

An information processing apparatus that includes an image acquisition unit, an estimation unit, a moving velocity acquisition unit, and a display control unit to generate and display a composite image, which informs the user of their moving velocity, thereby preventing accuracy degradation by determining and displaying a threshold for acceptable movement velocity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the user moves fast or shakes the head fast to improve interaction responsiveness, then the moving velocity of the camera increases, but the captured image becomes unclear and positioning accuracy deteriorates

Engineering Contradiction:
Improvemoving velocity of cameraVSAvoidpositioning accuracy
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The system measures the actual moving velocity of the camera using a gyro sensor, compares it with a predetermined threshold value, and provides feedback by displaying a warning message when the threshold is exceeded. This feedback mechanism enables the user to adjust their movement to maintain positioning accuracy while still allowing responsive interaction within acceptable limits.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces reliance on clear captured images for velocity detection with a gyro sensor that directly measures angular velocity. This substitution of the measurement mechanism allows the system to accurately determine camera movement velocity independent of image quality, enabling proper feedback control even when images are blurred due to fast movement.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Illumination intensity

If image adjustment techniques are applied to maintain image quality during movement, then white balance is adjusted through gain adjustment, but positioning accuracy still deteriorates when moving velocity is too high

Engineering Contradiction:
Improveimage qualityVSAvoidpositioning accuracy
Core Design Contradiction:
Illumination intensityVSMeasurement precision

Solution Approach 1:

The system replaces image-based velocity detection with direct gyro sensor measurement. This substitution allows the system to obtain accurate velocity information independent of image quality, making positioning accuracy determination reliable even when image adjustment techniques cannot prevent blurring due to excessive movement speed.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If the threshold for moving velocity is set low to maintain positioning accuracy, then positioning precision is improved, but the user's movement freedom and interaction responsiveness are restricted

Engineering Contradiction:
Improvepositioning accuracyVSAvoiduser movement freedom
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system provides real-time feedback by displaying warning messages when the camera's moving velocity exceeds the predetermined threshold. This feedback approach maintains positioning accuracy by guiding user behavior without physically restricting movement, allowing users to operate freely within acceptable limits and understand when adjustments are needed.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10078918B2Information processing apparatus, information processing method, and storage medium
Publication Date: 2018.09.18 CANON KK
  • US10078918B2 patent drawing
  • US10078918B2 patent drawing
  • US10078918B2 patent drawing

AI summary

An information processing apparatus configured to generate an image to be displayed on a display device including an image capturing unit includes, an image acquisition unit configured to acquire a captured image obtained by the image capturing unit, an estimation unit configured to estimate a position and an orientation of the image capturing unit based on the captured image, a first generation unit configured to generate an image of a virtual object based on the estimated position and orientation of the image capturing unit, a moving velocity acquisition unit configured to acquire a moving velocity of the image capturing unit, a second generation unit configured to generate an image representing the moving velocity, and a display control unit configured to cause the display device to display a composite image obtained by combining the image of the virtual object and the image generated by the second generation unit.