AR Display Delay Elimination via Pre-Recognition Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

When a terminal changes attitude, such as when a user wearing a head-mounted display (HMD) turns their head, target objects can enter the angle-of-view of the AR display, causing a delay in the AR display of virtual objects until the position and attitude of the target object are recognized.

Innovation Solution

An information processing apparatus with a control unit that performs a previous recognition process using first image information from a first imaging unit outside the AR display angle-of-view to recognize the position and attitude of a target object. When the target object enters the AR display angle-of-view, the virtual object is AR-displayed based on the previously recognized position and attitude.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the terminal uses image information from the angle-of-view of AR display to recognize target objects, then the recognition accuracy within the display region is improved, but the AR display is delayed when target objects enter the angle-of-view

Engineering Contradiction:
Improverecognition accuracyVSAvoidAR display delay
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The control unit performs preliminary recognition of target objects using image information from the first imaging unit that captures regions outside the AR display angle-of-view. This preliminary recognition occurs before the target objects enter the display region, allowing the system to prepare recognition data in advance and eliminate display delays when objects enter the field of view.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system divides the imaging function into two separate imaging units: the first imaging unit captures regions outside the AR display angle-of-view for preliminary target object detection, while the second imaging unit captures the angle-of-view for final AR display. This segmentation allows each unit to specialize in specific functions, improving overall system performance.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If the terminal expands the imaging region to cover areas outside the AR display angle-of-view, then the ability to detect target objects in advance is improved, but the device complexity increases

Engineering Contradiction:
Improvetarget object detection capabilityVSAvoidimaging system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The first imaging unit is designed to perform multiple functions: it captures image information for preliminary target object recognition outside the display region, and also provides image information that can be used for AR display when objects are detected. This multi-functionality reduces the need for dedicated separate systems and minimizes overall device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12307609B2Information processing apparatus and information processing method
Publication Date: 2025.05.20 SONY GROUP CORP
  • US12307609B2 patent drawing
  • US12307609B2 patent drawing
  • US12307609B2 patent drawing

AI summary

[Object] To provide a technology of preventing delay of AR display of a virtual object.[Solving Means] An information processing apparatus according to the present technology includes a control unit. The control unit performs a previous recognition process of previously recognizing, on the basis of first image information from a first imaging unit of a terminal that is capable of imaging a region outside an angle-of-view of AR display of a display unit of the terminal, position and attitude of a target object outside the angle-of-view of AR display with respect to the terminal, and AR-displays, when the target object enters the angle-of-view of AR display, a virtual object with respect to the target object on the basis of the previously recognized position and attitude of the target object.