Spatial Information Mapping for Location-Independent AR Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality technologies limit user interaction with virtual objects to specific locations, preventing seamless experience across different environments and places.

Innovation Solution

An electronic device with a camera, display, and processor that identifies and maps spatial information from real-time video captures, allowing users to add and manipulate virtual objects based on spatial data, enabling interaction and sharing of augmented reality images without geographical limitations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a virtual object is added to a real-time photographed image using conventional augmented reality methods, then the virtual object can be displayed in the current location, but the user cannot interact with the same virtual object in different places or share the AR experience across different locations

Engineering Contradiction:
Improvelocation independence of AR interactionVSAvoidspatial context information
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent extracts spatial information (location coordinates, orientation data, depth information) from the real-time photographed image and separates it from the visual content. This extracted spatial context is stored independently, allowing the virtual object to be repositioned and interacted with in different locations while maintaining the original spatial relationships, thus enabling location-independent AR experiences

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary action by capturing and storing spatial information about the environment and object positions before the user moves to different locations. This pre-captured spatial data includes coordinate systems, depth maps, and orientation information that are saved and later used to reconstruct the AR scene in new locations, enabling seamless cross-location interaction without requiring real-time presence in the original location

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If spatial information is mapped and stored for each image section to enable location-independent AR, then users can interact with virtual objects in different places, but the system complexity increases due to processing and managing spatial data from multiple image sections

Engineering Contradiction:
Improvecross-location AR capabilityVSAvoidspatial information processing system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the photographed image into multiple image sections and processes spatial information for each section independently. Each image section has its own mapped spatial data including location coordinates and orientation information. This segmentation allows the system to manage complex spatial data in smaller, more manageable units, reducing the overall system complexity while maintaining cross-location AR capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary spatial information mapping layer that translates real-world spatial relationships into a standardized digital representation. This intermediary layer includes coordinate transformation algorithms and spatial data structures that mediate between the physical environment and the virtual objects, simplifying the complexity of managing spatial information across multiple image sections and locations

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11763535B2Electronic device and control method thereof
Publication Date: 2023.09.19 SAMSUNG ELECTRONICS CO LTD
  • US11763535B2 patent drawing
  • US11763535B2 patent drawing
  • US11763535B2 patent drawing

AI summary

An electronic device is provided. The electronic device includes: a display; a camera; a memory; and a processor configured to identify a video captured in real time through the camera as a plurality of image sections, obtain spatial information corresponding to each image section, map the obtained spatial information to each of the plurality of image sections and store same in the memory, and control the display to add a virtual object image to the video and display the same on the basis of the spatial information mapped to each of the plurality of image sections when a user command for adding the virtual object image to the video is input.