Augmented Reality Content Suggestion via Social and Environmental Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality (AR) technologies face challenges in efficiently mapping large real-world environments and tracking objects in real-time, particularly when multiple devices need to collaborate, leading to increased time and effort in creating shared AR environments.

Innovation Solution

A system that enables multiple computing devices to relocalize within a shared AR environment by comparing features from captured images, allowing for collaborative mapping and object tracking, and provides a suggestion tool for AR content based on user social networking information and environmental characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple computing devices collaborate to map large environments in AR, then the productivity and coverage area increase, but the device complexity and coordination overhead increase

Engineering Contradiction:
Improvemapping speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the large environment mapping task into separate regions, with each computing device responsible for mapping a specific region. Devices capture images and identify points within their respective regions, then share data with a server that combines all regions into a complete environment map. This segmentation allows parallel processing across multiple devices, significantly improving mapping productivity while keeping individual device complexity manageable.

Inventive Principle:
Principle #1Segmentation

2Loss of time

If multiple computing devices relocalize simultaneously within a shared AR environment, then the time required for environment setup is reduced, but the computational resources and processing time per device increase

Engineering Contradiction:
Improveenvironment setup timeVSAvoidcomputational energy
Core Design Contradiction:
Loss of timeVSUse of energy by moving object

Solution Approach 1:

The patent implements a server that pre-processes and stores information about points identified in images from multiple devices. When a device needs to relocalize, it queries this pre-processed data rather than performing full image analysis independently. This preliminary action by the server reduces the computational energy required at each device during relocalization operations, while enabling multiple devices to relocalize simultaneously with reduced individual processing loads.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If AR content suggestions are personalized using social networking information, then content relevance improves, but user privacy concerns and data processing requirements increase

Engineering Contradiction:
Improvecontent personalizationVSAvoiduser privacy
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent introduces a server as an intermediary that receives social networking information and processes it to generate AR content suggestions. The server acts as a mediator between the user's personal data and the AR application, allowing personalized content delivery while centralizing data handling. This approach enables content adaptability based on user profiles and social connections, while the server can implement privacy-preserving processing techniques and control data access policies.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10719989B2Suggestion of content within augmented-reality environments
Publication Date: 2020.07.21 META PLATFORMS INC
  • US10719989B2 patent drawing
  • US10719989B2 patent drawing
  • US10719989B2 patent drawing

AI summary

In one embodiment, a method includes rendering an augmented-reality environment on a display associated with a first computing device associated with a first user; identifying one or more objects within the augmented-reality environment; determining a suggested augmented-reality content item based on social-networking information associated with the first user, and further based on characteristics associated with the identified objects; and presenting the suggested augmented-reality content item on a display associated with the first computing device.