AR Display Control Mode Switching for Stable Virtual Object Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users find it burdensome to maintain the imaging direction of a mobile terminal towards a real object to keep virtual objects superimposed on a real space image in AR applications, making it difficult to operate and change the displayed information.

Innovation Solution

A display control device and method that allow transitioning between real-time recognition mode and still image operation mode, enabling the display of virtual objects on a still image of the real space without requiring continuous alignment with the real object, using a control unit to acquire images, detect objects of interest, and superimpose virtual images on the still images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the user maintains the imaging direction toward the real object to keep virtual objects superimposed, then the virtual object can be displayed on the real space image, but the user experience becomes burdensome and operability deteriorates

Engineering Contradiction:
Improvevirtual object display stabilityVSAvoiduser operability
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent segments the AR display into two distinct modes: real-time recognition mode for capturing and processing images, and still image operation mode for viewing and interacting with virtual objects. This segmentation allows the system to switch between maintaining accurate object tracking and providing stable, easy-to-operate display, resolving the contradiction between display stability and ease of operation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic switching between operational modes based on user interaction. The system transitions from real-time recognition mode to still image operation mode when specific conditions are met (e.g., object detection, user input), allowing the display characteristics to adapt dynamically. This dynamic behavior enables the system to provide both stable virtual object display and ease of operation at different times as needed.

Inventive Principle:
Principle #15Dynamics

2Duration of action of stationary object

If the user continuously points the mobile terminal at the real object, then the virtual object remains superimposed on the real space image, but the user cannot easily operate or change displayed information

Engineering Contradiction:
Improvevirtual object display durationVSAvoidinformation interaction ease
Core Design Contradiction:
Duration of action of stationary objectVSEase of operation

Solution Approach 1:

The patent performs preliminary actions by capturing real space images and detecting objects of interest before the user needs to interact with the virtual objects. The system pre-processes the visual information, identifies target objects, and prepares the virtual object superposition in advance. This preliminary processing allows the system to transition to a stable display mode where users can interact with pre-prepared virtual objects without needing to maintain continuous imaging alignment.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10198867B2Display control device, display control method, and program
Publication Date: 2019.02.05 SONY GROUP CORP
  • US10198867B2 patent drawing
  • US10198867B2 patent drawing
  • US10198867B2 patent drawing

AI summary

An apparatus comprising a memory storing instructions and a control unit is disclosed. The control unit may be configured to execute the instructions to: acquire an image of real space, detect an object of interest within the real space image, obtain a still image of the object. and display a virtual image relating to the object superimposed on the still image.