Dynamic CGR Content Generation via Physical Feature Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing computer-generated reality (CGR) systems generate fixed experiences regardless of the physical environment, failing to adapt to distinct geometries, which limits the immersion and interaction with real-world settings.

Innovation Solution

Implementing a system that uses image sensors to detect physical environment features, generate feature descriptors, and dynamically create CGR experiences based on these descriptors, allowing the CGR environment to change according to the physical environment geometry.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If pre-canned fixed content is used to represent CGR environment, then device complexity is reduced and ease of manufacture is improved, but adaptability to different physical environments deteriorates

Engineering Contradiction:

Improveease of generating CGR contentVSAvoidadaptability to physical environment

Core Design Contradiction:

Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The system dynamically generates CGR content based on real-time detection of physical environment features using image sensors and feature descriptors, allowing the virtual environment to adapt and change according to the user's physical surroundings rather than using static pre-canned content

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system automatically detects physical features, generates feature descriptors, and creates appropriate CGR content without requiring manual configuration or pre-programming for each environment, enabling the system to self-adapt to different physical settings

Inventive Principle:

Principle #25Self-service

2Adaptability or versatility

If image sensors and dynamic feature detection are implemented, then adaptability to physical environment is improved, but device complexity increases

Engineering Contradiction:

Improveadaptability to physical environmentVSAvoidcomplexity of CGR system

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system uses universal image sensors and feature detection algorithms that can identify multiple types of physical features (edges, corners, surfaces, textures) across different environments, allowing a single system architecture to handle diverse physical settings without requiring environment-specific hardware or software

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Measurement precision

If feature descriptors are generated from image sensor data, then measurement precision of physical features is improved, but loss of time in processing increases

Engineering Contradiction:

Improveprecision of physical feature detectionVSAvoidtime to generate CGR content

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary processing by detecting physical features and generating feature descriptors in advance before full CGR content generation, allowing the most time-consuming processing to be done beforehand and enabling faster rendering and presentation of the final CGR experience

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11348305B2Techniques for locating virtual objects relative to real physical objects

Publication Date: 2022.05.31 APPLE INC

AI summary

In one implementation, a non-transitory computer-readable storage medium stores program instructions computer-executable on a computer to perform operations. The operations include obtaining first content representing a physical environment in which an electronic device is located using an image sensor of the electronic device. A physical feature corresponding to a physical object in the physical environment is detected using the first content. A feature descriptor corresponding to a physical parameter of the physical feature is determined using the first content. Second content representing a computer generated reality (CGR) environment is generated based on the feature descriptor and presented on a display of the electronic device.