AR Object Integration Using Physical Analogues to Cut Rendering Load
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems consume excessive processing power and memory resources due to inefficient rendering of virtual objects and sounds, particularly in head-mounted or mobile devices, and fail to leverage previously mapped physical spaces for improved efficiency.
Innovation Solution
An augmented reality system that detects physical objects corresponding to analogous virtual objects and modifies graphics or sounds to integrate these objects into the experience, reducing the need for full virtual object rendering and optimizing resource usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If existing augmented reality systems render virtual objects with high resolution and realism, then the realism and detail of virtual imagery is improved, but excessive processing power and memory resources are consumed
Solution Approach 1:
The system applies partial rendering by selectively rendering only certain virtual objects or portions of virtual objects based on their importance, user attention, or interaction probability. Less critical virtual objects are rendered at lower resolutions or omitted entirely, while important objects receive full rendering resources. This partial action approach maintains realism for key elements while reducing overall processing power and memory consumption.
2Productivity
If existing augmented reality systems transfer memory between main memory and GPU dedicated memory, then virtual objects can be rendered, but the transfer bandwidth is limited and latency is high
Solution Approach 1:
The system performs preliminary actions by pre-loading virtual object data into GPU dedicated memory during periods when the GPU is not actively rendering, or by predicting which virtual objects will be needed next and loading them in advance. This preliminary preparation reduces the need for frequent memory transfers during active rendering, thereby reducing latency and improving overall productivity.
3Illumination intensity
If existing augmented reality systems simulate complex sounds from virtual objects, then the realism of audio experience is improved, but excessive processing resources are consumed
Solution Approach 1:
The system extracts and separates different sound components from virtual objects, processing only the essential sound elements that contribute most to realism. Non-essential or redundant sound processing is removed or simplified. This extraction approach maintains acceptable audio realism while significantly reducing the processing resources required for sound simulation.
4Reliability
If existing augmented reality systems map and render the same physical spaces and virtual objects repeatedly, then complete coverage is achieved, but processing power is wasted on redundant operations
Solution Approach 1:
The system applies local quality by varying the rendering and mapping quality across different regions of the physical space. Areas that have been thoroughly mapped and are stable receive lower processing priority, while new or changing areas receive higher priority. This local differentiation ensures complete coverage over time while avoiding redundant processing in already-mapped regions, reducing overall energy loss.
Data Source
AI summary
This disclosure describes embodiments of methods, non-transitory computer-readable media, and systems for detecting that a physical space includes a physical object corresponding to an analogous virtual object from an augmented reality experience and rendering (or otherwise modifying) the augment reality experience to integrate the physical object as part of the experience. In particular, the disclosed systems can determine that a physical object within a physical environment corresponds to an analogous virtual object of an augmented reality experience. Based on this correspondence, the disclosed systems can modify one or more of the virtual graphics, sound, or other features corresponding to the augmented reality experience to represent the virtual object using the physical object. For example, the disclosed systems can modify acoustic features of a sound for the augmented reality experience to simulate the sound originating from (or being affected by) the physical object.