AR Display Control for Accurate Object Arrangement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality (AR) technologies face difficulties in setting a plane as a reference for displaying lines and accurately presenting virtual objects in real spaces, making tasks like object arrangement challenging.

Innovation Solution

An information processing apparatus that acquires user motion information to specify real surfaces in a real space and displays region images on corresponding virtual surfaces, allowing for easier arrangement of both virtual and real objects by determining the azimuth based on the real surface motion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional AR technology is used to display virtual objects, then virtual space can be superimposed on real space, but it is difficult to set a plane as a reference and accurately present virtual objects in real space

Engineering Contradiction:
Improveaccuracy of virtual object placementVSAvoiddifficulty in setting reference plane
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent introduces a laser marking device as an intermediary tool that projects reference lines (crosshairs) onto real surfaces. This mediator establishes an accurate reference plane by projecting vertical and horizontal lines that intersect at a target point, enabling precise virtual object placement without requiring complex manual plane setting in the AR system itself.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary action by pre-establishing reference planes and coordinate systems in the real space before virtual object placement. The laser marking device projects reference lines in advance to define the reference plane, and the AR system uses these pre-defined references to accurately position virtual objects, eliminating the need for complex real-time plane setting.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If laser marking device is used to project reference lines, then accurate reference plane can be established, but additional equipment and setup time are required

Engineering Contradiction:
Improveaccuracy of reference planeVSAvoidnumber of equipment pieces
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges the laser marking device functionality with the AR glasses system. The laser marking device is integrated or coordinated with the AR display system, allowing the reference lines to be projected and viewed simultaneously with the virtual objects. This combination reduces the need for separate equipment and streamlines the workflow by unifying the reference establishment and virtual object display processes.

Inventive Principle:
Principle #5Merging (Combining)

3Adaptability or versatility

If manual plane setting is required in AR system, then flexibility is maintained, but work efficiency decreases due to complex arrangement tasks

Engineering Contradiction:
Improveflexibility in virtual object arrangementVSAvoidwork efficiency in object arrangement
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The system implements feedback by continuously tracking the user's line of sight and head position through sensors in the AR glasses. This feedback mechanism allows the reference plane and virtual objects to automatically adjust and maintain accurate spatial relationships as the user moves, eliminating the need for manual re-setting while preserving flexibility. The system adapts to user movements automatically, maintaining both flexibility and efficiency.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20230214004A1Information processing apparatus, information processing method, and information processing program
Publication Date: 2023.07.06 SONY GROUP CORP
  • US20230214004A1 patent drawing
  • US20230214004A1 patent drawing
  • US20230214004A1 patent drawing

AI summary

An information processing apparatus according to an embodiment includes: an acquisition unit (100) that acquires motion information indicating a motion of a user, and a display control unit (100) that performs display control on a display unit capable of superimposing and displaying a virtual space on a real space. The display control unit specifies a real surface that is a surface in the real space based on the motion information, and displays a region image indicating a region for arranging a virtual object or a real object on a virtual surface that is a surface in the virtual space corresponding to the real surface according to an azimuth extracted based on the real surface.