AR Virtual Object Arrangement via Template Scene Graph

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) technologies struggle to naturally fuse virtual content with real space, making it difficult to create immersive and contextually relevant AR experiences.

Innovation Solution

An information processing device and method that utilize a template scene graph to define relative relationships between real and virtual objects, allowing for dynamic content arrangement and interaction based on spatial context and changes within the real space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional AR technology is used to display virtual content, then virtual content can be displayed in real space, but the virtual content cannot be naturally fused with the real space environment

Engineering Contradiction:
Improveintegration with real spaceVSAvoidcontextual relevance
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system performs preliminary actions by acquiring template data that defines relative relationships between real objects and virtual objects before displaying the augmented reality content. This pre-established template guides the subsequent arrangement of virtual content to ensure natural fusion with the real space environment.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically arranges virtual content based on detected spatial relationships between real objects. The display control unit adjusts the position and orientation of virtual objects in real-time according to the relative relationships detected from three-dimensional data, enabling adaptive integration with the real space environment.

Inventive Principle:
Principle #15Dynamics

2Ease of manufacture

If virtual content is arranged based on fixed templates, then content arrangement is simplified, but the system cannot adapt to changes in spatial context

Engineering Contradiction:
Improvecontent arrangement processVSAvoidresponse to spatial changes
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The determination unit continuously detects the relative relationships between real objects from three-dimensional data and provides feedback to the display control unit. This feedback mechanism enables the system to adapt the arrangement of virtual content according to changes in the real space environment while maintaining template-based guidance.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The template data structure is designed to be universal, defining relative relationships that can accommodate various real objects and virtual content types. This universal template framework allows the system to handle different spatial configurations and object combinations while maintaining ease of content arrangement.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If the system detects and processes three-dimensional data in real-time, then spatial context accuracy is improved, but processing complexity increases

Engineering Contradiction:
Improvespatial relationship detectionVSAvoidprocessing system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the processing task by separating the detection of relative relationships between real objects from the arrangement of virtual content. The determination unit focuses on detecting spatial relationships from three-dimensional data, while the display control unit handles the content arrangement based on detected relationships and template data, dividing complexity across functional units.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12283006B2Information processing device and information processing method
Publication Date: 2025.04.22 SONY GROUP CORP
  • US12283006B2 patent drawing
  • US12283006B2 patent drawing
  • US12283006B2 patent drawing

AI summary

A content display device that functions as an information processing device includes an acquisition unit, a determination unit, and a display control unit. The acquisition unit acquires template data defining relative relationships between a first real object, a second real object, and a virtual object. The determination unit determines the relative relationship between the first real object and the second real object from three-dimensional data of a real space detected by the sensor. The display control unit controls the display device to arrange the virtual object on or near the first real object so as to face the second real object, based on the relative relationships and the template data.