CGR Object Recognition and Environment Mapping for Spatial Content Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current computer-generated reality (CGR) systems lack the ability to tailor experiences effectively based on recognized objects, resulting in a less relevant and engaging interaction for users within their environments.
Innovation Solution
A method and system that detect recognized objects within a user environment, generate a user environment map, and map CGR content associated with the object to the environment, thereby synthesizing a tailored CGR experience that enhances relevance and engagement by integrating CGR content with the physical or virtual objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If generic CGR content is displayed without object recognition, then system complexity is reduced, but user engagement and relevance deteriorate
Solution Approach 1:
The system performs preliminary actions by detecting objects in the user environment and generating environment maps before CGR content is displayed. This allows the system to pre-process spatial information and object data, enabling tailored CGR experiences to be composed and rendered efficiently without adding significant complexity during real-time operation.
Solution Approach 2:
The patent introduces an intermediary environment map that acts as a mediator between the physical user environment and the CGR content. This map serves as a data structure that bridges object detection results with CGR rendering, allowing the system to tailor experiences without direct complex interactions between object recognition and content delivery systems.
2Adaptability or versatility
If CGR content is dynamically mapped to recognized objects, then user engagement improves, but processing time and computational resources increase
Solution Approach 1:
The system generates environment maps and detects objects in advance before CGR content needs to be displayed. This preliminary processing of spatial and object data allows the system to have ready-to-use environmental representations, reducing the time required when actual CGR content composition and rendering occurs.
Solution Approach 2:
The patent implements dynamic environment maps that can be updated and modified as users move through different environments or as objects are detected. This dynamic approach allows the system to adapt CGR content mapping in real-time based on current environmental conditions while maintaining efficient processing through incremental updates rather than complete re-mapping.
Data Source
AI summary
In various implementations, a method is performed at a device including a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, the method includes detecting a representation of an object that is associated with computer-generated reality (CGR) content. In some implementations, the method includes obtaining a user environment map characterizing a user environment, wherein the user environment is limited by a volumetric region around the device. In some implementations, the method includes mapping a portion of the CGR content associated with the object to a portion of the user environment map. In some implementations, the method includes synthesizing a CGR environment in accordance with the mapping.