Adaptive Virtual Element Modality in CGR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies for displaying computer-generated reality (CGR) environments do not provide sufficient features for adapting or tailoring the modalities of virtual objects/elements based on their location within the physical environment.
Innovation Solution
The implementation includes devices and methods that enable the presentation of virtual elements in a CGR environment based on attributes of the physical environment, such as surfaces, allowing creators to design adaptive appearances, functions, and interactive features for virtual elements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual elements are displayed in CGR environments with fixed modalities, then the display system is simple, but the adaptability to different physical environment locations is insufficient
Solution Approach 1:
The patent implements dynamic modality changes for virtual elements based on their spatial location and orientation relative to physical surfaces. The system automatically adjusts the modality (e.g., 2D display, 3D display, augmented reality overlay) according to detected surface attributes, transforming a static display system into a dynamic one that adapts to different environmental contexts without manual intervention.
Solution Approach 2:
The system assigns different display modalities to different local regions of the physical environment based on surface detection. Each virtual element's modality is determined by its local spatial relationship with detected surfaces (e.g., horizontal surfaces vs. vertical surfaces), creating locally optimized display qualities that match the surrounding physical context.
2Ease of operation
If virtual elements adapt their modality based on location, then the user experience is enhanced, but the system complexity increases
Solution Approach 1:
The system performs self-service by automatically detecting physical surfaces and determining appropriate virtual element modalities without user input. The detection system autonomously analyzes the physical environment and selects display modes based on pre-configured rules, eliminating the need for users to manually adjust settings while still providing enhanced user experience.
Solution Approach 2:
The system implements feedback loops where the display system continuously monitors the physical environment, detects surface attributes, and adjusts virtual element modalities in real-time based on this feedback. This closed-loop approach ensures that virtual elements automatically adapt to changing environmental conditions, enhancing user experience through continuous optimization.
Data Source
AI summary
Various implementations disclosed herein include devices, systems, and methods that enable a device to provide a view of virtual elements and a physical environment where the presentation of the virtual elements is based on positioning relative to the physical environment. In one example, a device is configured to detect a change in positioning of a virtual element, for example, when a virtual element is added, moved, or the physical environment around the virtual element is changed. The location of the virtual element in the physical environment is used to detect an attribute of the physical environment upon which the presentation of the virtual element depends. Thus, the device is further configured to detect an attribute (e.g., surface, table, mid-air, etc.) of the physical environment based on the placement of the virtual element and present the virtual element based on the detected attribute.