Responsive AR Content Layout for Occlusion and View Obstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) systems fail to accurately detect physical objects in real-world spaces and intelligently lay out AR content, leading to issues like glitching, disappearance of content, and user frustration due to changes in object size, occlusion, or orientation, which hinder the viewing of important object features.
Innovation Solution
An intelligently responsive AR system that detects physical objects and dynamically adjusts the layout of AR content based on changes in the user's view, ensuring that AR content is displayed without masking important areas of the object, using a combination of object permanence, computer vision, and machine learning to track objects and determine overlay-acceptable regions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If AR content is overlaid on the physical object, then the AR content is visually integrated with the object, but the AR content may mask important areas of the object such as trademarks, labels, text, or illustrations
Solution Approach 1:
The system applies different properties to different regions of the object surface. It identifies and classifies various areas (e.g., trademarks, labels, text, illustrations) and determines overlay-acceptable regions where AR content can be placed without masking important features. This local differentiation allows AR content to be visually integrated while preserving critical object information.
2Area of stationary object
If the user device is moved away from the object, then the field of view expands, but the AR text becomes too small for the user to read and interact with
Solution Approach 1:
The AR content layout is made dynamic and responsive to changes in viewing conditions. The system continuously monitors the relative position and distance between the user device and the object, and automatically adjusts the AR content size, position, and layout accordingly. This dynamic adaptation ensures AR content remains readable and interactable across varying distances while maintaining visual integration with the object.
3Device complexity
If the AR system uses fixed layout for AR content, then the implementation is simple, but the system fails to detect objects accurately in response to changes in movement, occlusion, or orientation
Solution Approach 1:
The system implements continuous feedback loops that monitor changes in object position, orientation, and occlusion status. Based on this feedback, the AR content layout is automatically adjusted to maintain accurate object detection and proper content positioning. The system detects when objects move, become occluded, or change orientation, and responds by reconfiguring the AR content layout accordingly, ensuring reliable performance without excessive complexity.
4Stability of the object's composition
If the AR content is always overlaid on the object, then the visual integration is maintained, but the user's view of certain areas of the physical object is hindered
Solution Approach 1:
The system utilizes the dimensional space around the object, not just the surface overlay. When overlaying AR content would hinder the user's view of important object areas, the system positions AR content in adjacent spatial regions or uses layered transparency techniques. This allows AR content to remain visually integrated with the object while preserving unobstructed views of critical features like trademarks, labels, and illustrations.
Data Source
AI summary
Once AR content associated with a physical object is generated and displayed on the screen of a user device (e.g., a smartphone), various changes, such as movement or partial occlusion of the object, may affect the user device's view of the object. This may result in glitching or disappearance of the AR content. Additionally, the AR content may hinder a user's view of certain areas of interest of the object. In some embodiments, an intelligently responsive AR system may be implemented. Upon detection of a physical object, the AR system may display a first UI having AR content in a first layout. In response to a change affecting the user device's view of the object, the AR system may display a second UI, having AR content arranged in a second layout. The first and second layouts may be arranged to prevent masking any areas of interest on the object.