Template AR Content Mapping via Abstract Scene Representation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in accurately displaying template augmented reality (AR) content in unknown scenes, as they require ideal environment maps and constraints similar to the original scene, limiting the types of scenes and object conditions in which the content can be experienced.

Innovation Solution

An information processing apparatus that generates an environment map and abstract representation of an augmented reality application scene, compares it with a template AR abstract representation, and maps template AR content to the application scene based on the comparison, allowing for flexible display in various environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If template AR content is created for a specific scene using environment maps and sensors, then the AR content can be accurately displayed in that specific scene, but the AR content cannot be correctly displayed in another room or unknown scene

Engineering Contradiction:
Improveaccuracy of AR content displayVSAvoidapplicability to different scenes
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent creates a simplified abstract representation (graph structure) that captures the essential spatial relationships and object arrangements of a scene. This abstract model serves as a template that can be copied and applied to different physical scenes, allowing the same AR content to be adapted across multiple environments without requiring scene-specific recreation.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transforms detailed environment map data into an abstract representation with simplified parameters (graph nodes and edges representing spatial relationships). This parameter transformation enables the AR content to be adapted to different scenes by changing the abstract representation parameters to match the target scene's characteristics while maintaining the core AR experience.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If environment construction work is performed to reproduce original scene conditions in unknown scenes, then template AR content can be mapped to different environments, but the process significantly limits the type of scene and object conditions available

Engineering Contradiction:
Improveability to map AR content to different environmentsVSAvoidcomplexity of environment construction work
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts only the essential spatial relationship information from complex environment maps and represents it as a simplified abstract graph structure. This extraction process removes unnecessary environmental details while preserving the core spatial constraints needed for AR content mapping, thereby reducing the complexity of environment construction work required.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the environment map into discrete abstract representation elements (nodes representing objects/places and edges representing relationships). This segmentation allows the complex scene to be represented in manageable units that can be independently adjusted and matched across different scenes, simplifying the overall environment construction process.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If a large number of templates in accordance with assumed conditions are created to cope with variations in scene, then the AR experience can be adapted to user intentions, but the templates themselves become complicated and fixed AR experiences are limited to one experience

Engineering Contradiction:
Improveability to cope with scene variations and user intentionsVSAvoidcomplexity of multiple templates
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a dynamic matching system where a single abstract representation template can adapt to different scenes and user intentions through automated or semi-automated parameter adjustment. Instead of requiring multiple fixed templates, the system dynamically generates appropriate mappings by adjusting the abstract representation to match the target scene's characteristics and user requirements.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent develops a universal abstract representation framework that can serve multiple functions: representing different scene types, accommodating various object configurations, and supporting different user intentions. This single multi-functional template replaces the need for multiple specialized templates, reducing complexity while maintaining adaptability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12217370B2Information processing apparatus and information processing
Publication Date: 2025.02.04 SONY GROUP CORP
  • US12217370B2 patent drawing
  • US12217370B2 patent drawing
  • US12217370B2 patent drawing

AI summary

A template AR content can be favorably used in an application scene different from the scene at the time of creation.An environment map of an augmented reality application scene is generated. An abstract representation of the augmented reality application scene is generated on the basis of the environment map of the augmented reality scene. The abstract representation of the augmented reality application scene is compared with an abstract representation of a template augmented reality generated on the basis of a template augmented reality environment map, and template augmented reality content is mapped to the augmented reality application scene on the basis of a result of the comparison. Thus, augmented reality content for display is generated. For example, the abstract representation of the augmented reality application scene or the abstract representation of the template augmented reality can be edited.