Projection-Based AR Surface Selection and Content Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented-reality systems lack the ability to provide seamless and privacy-conscious integration of social networking data within an in-the-world experience, failing to adapt content dynamically based on user interactions and environment changes while respecting user privacy settings.

Innovation Solution

A projection-based augmented-reality system that includes interaction devices with visual and audio output, sensor devices, and controller modules, which model indoor environments, track user activities, and adapt content projection based on sensor data, leveraging social networking data only with explicit user permission and adhering to privacy settings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the augmented-reality system accesses social networking data to enhance user experience, then the personalization and relevance of projected content is improved, but user privacy protection deteriorates

Engineering Contradiction:
Improvecontent personalizationVSAvoidprivacy risk
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent introduces a privacy manager as an intermediary component that mediates between the augmented-reality system and social networking data. This privacy manager obtains user consent, anonymizes personal information, and controls data access permissions, allowing the system to leverage social networking data for personalized content while protecting user privacy through multiple layers of abstraction and control mechanisms.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If the system dynamically adapts content based on real-time sensor data and user interactions, then the user experience responsiveness is improved, but the system complexity increases

Engineering Contradiction:
Improvecontent adaptation speedVSAvoidsystem architecture complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent segments the augmented-reality system into distinct functional modules: environment sensors for data collection, privacy manager for data processing, content adapter for content modification, and projector for display. Each module operates independently with well-defined interfaces, enabling real-time content adaptation while managing system complexity through modular design that allows independent development, testing, and maintenance of each component.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If the augmented-reality system projects content onto diverse surfaces in varying environments, then the versatility of the system is improved, but the projection quality consistency deteriorates

Engineering Contradiction:
Improvesurface compatibilityVSAvoidprojection quality consistency
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent implements dynamic surface characterization and content adaptation mechanisms. The system continuously scans and characterizes projection surfaces using environment sensors, detecting variations in surface texture, color, curvature, and lighting conditions. Based on real-time surface analysis, the content adapter dynamically adjusts projection parameters including image distortion correction, brightness compensation, and color calibration, ensuring consistent projection quality across diverse surfaces and environmental conditions.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11070792B1Surface selection for projection-based augmented reality system
Publication Date: 2021.07.20 META PLATFORMS INC
  • US11070792B1 patent drawing
  • US11070792B1 patent drawing
  • US11070792B1 patent drawing

AI summary

A method includes retrieving a media content item for display to a user in an environment. The method includes receiving, from one or more interaction devices each including a projector and a camera, one or more media objects captured by one or more cameras, where one or more of the media objects include images of the user, and determining a location of the user in the environment based on an analysis of the one or more of the media objects. The method also includes identifying one of the interaction devices based on the determined location of the user and sending, to the identified interaction device, the media content item and instructions causing the projector associated with the identified interaction device to project the media content item.