AR Interocular Parameter Correction via Hand Gesture Recognition

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing augmented reality technologies require a high workload from users to correct interocular parameters for virtual object display, leading to inaccurate adjustments and user discomfort.

Innovation Solution

An information processing device and method that recognizes hand gestures to adjust the positional relation between virtual objects, allowing for easier correction of interocular parameters through a sensor unit and correction unit, reducing user workload and improving accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional interocular parameter correction technology is applied, then the user can adjust interpupil distance, but the workload on the user becomes large

Engineering Contradiction:

Improveinterocular parameter correction accuracyVSAvoiduser workload

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The system performs interocular parameter correction automatically by detecting hand gestures and calculating positional relationships between virtual objects, eliminating the need for manual adjustment operations by the user while maintaining high correction accuracy

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical adjustment operations with automatic computer vision-based hand gesture recognition and computational geometry methods to determine interocular parameters, substituting user physical actions with automated digital processing

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If manual adjustment operations are required for interocular parameter correction, then the system can correct parameter values, but the operation becomes complex and time-consuming

Engineering Contradiction:

Improveparameter correction reliabilityVSAvoidcorrection time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary hand gesture recognition and virtual object positioning before final parameter calculation, preparing all necessary spatial data in advance to enable rapid and reliable interocular parameter determination without time-consuming manual operations

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system provides real-time feedback by displaying virtual objects and their positional relationships on the display unit, allowing the user to verify the detected hand gesture and calculated parameters, ensuring correction reliability while maintaining efficiency

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS11372249B2Information processing device and information processing method

Publication Date: 2022.06.28 SONY GROUP CORP

AI summary

Provided is an information processing device that includes a recognition unit that recognizes, based on a result of sensing by a sensor unit corresponding to a viewpoint position of a user, a hand gesture performed by the user to move, closer to a first object, a second object so that the positional relation between the first object and the second object becomes a first positional relation. The information processing device further includes a correction unit that corrects the user's interocular parameter related to virtual object display on a display unit based on a result of recognition of the hand gesture when it is determined that a predetermined end condition is satisfied. At least one of the first object and the second object is a virtual object.