AR Display System Positioning Virtual Objects on Smartphones

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing display systems for virtual objects in augmented reality suffer from reduced visibility and operability due to the integration of virtual objects with real objects, leading to decreased user experience.

Innovation Solution

A display system comprising a head-mounted display and an information processing apparatus that uses an image capturing unit to detect information about the apparatus and display virtual objects adjacent to or partially superimposed on the information processing apparatus, maintaining visibility while enhancing operability through wireless communication and image processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If the virtual object is displayed in a state added to a real object, then the realistic feeling is improved, but the visibility is lowered

Engineering Contradiction:
ImprovevisibilityVSAvoidrealistic feeling
Core Design Contradiction:
Illumination intensityVSReliability

Solution Approach 1:

The patent divides the virtual object into multiple segments or components that can be independently positioned and rendered. This allows parts of the virtual object to be displayed in high-visibility areas while other parts are placed in less critical areas, maintaining both visibility and realistic integration with the real object.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different display qualities, transparency levels, or rendering techniques to different regions of the virtual object based on their spatial relationship with the real object. Critical areas are rendered with higher visibility while maintaining the overall realistic integration effect.

Inventive Principle:
Principle #3Local quality

2Reliability

If the virtual object is displayed in a state added to a real object, then the realistic feeling is improved, but the operability is lowered

Engineering Contradiction:
Improverealistic feelingVSAvoidoperability
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent introduces an intermediary layer or interface between the user and the virtual object that facilitates interaction without compromising the realistic integration. This intermediary layer provides touch targets, selection indicators, or interaction zones that make the virtual object operable while maintaining its integrated appearance with the real object.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent makes the virtual object dynamically adjustable in terms of its interaction properties, such as selectable regions, response thresholds, and interaction modes. This allows the system to adapt to different operational contexts and user needs while maintaining realistic integration.

Inventive Principle:
Principle #15Dynamics

3Illumination intensity

If the virtual object is displayed adjacent to or superimposed on the information processing apparatus, then the visibility is maintained, but the device complexity increases

Engineering Contradiction:
ImprovevisibilityVSAvoidsystem complexity
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The patent implements a universal display control mechanism that can handle multiple display scenarios (adjacent positioning, partial superimposition, full superimposition) using a single integrated system. This multi-functional approach reduces overall system complexity compared to implementing separate specialized systems for each display mode.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system automatically detects the information processing apparatus and autonomously determines the optimal display position and method for the virtual object, eliminating the need for manual configuration or complex user setup procedures. This self-configuration capability reduces operational complexity.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11842119B2Display system that displays virtual object, display device and method of controlling same, and storage medium
Publication Date: 2023.12.12 CANON KK
  • US11842119B2 patent drawing
  • US11842119B2 patent drawing
  • US11842119B2 patent drawing

AI summary

A display system that makes it possible to obtain high operability while maintaining visibility when a virtual object is displayed. The display system includes a smartphone as an information processing apparatus and smart glasses as a head mounted display that is capable of communicating with the smartphone and has an image capturing section. Information on the smartphone is detected from an image captured by the image capturing section. The smart glasses include a display section that is capable of displaying a virtual object, and a virtual object is displayed on the display section in a position adjacent to the smartphone or in a manner partially superimposing the virtual object on the smartphone, based on the detected information.