AR Object Occlusion via Dual Shader Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality technologies lack precise and accurate methods for object occlusion, which is crucial for providing effective assembly instructions in complex construction and assembly tasks, such as LEGO sets, leading to user frustration and inefficiency.
Innovation Solution
A method and system for performing object occlusion in augmented reality environments, involving image capture, determination of virtual item location and orientation, and rendering using specific shaders to depict occlusion by physical items, allowing for accurate step-by-step assembly guidance without instruction booklets.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional augmented reality techniques are used to display assembly instructions, then the instructions can be provided in an augmented reality environment, but the object occlusion is imprecise and inaccurate leading to user frustration
Solution Approach 1:
The patent introduces virtual representations (shaders) as intermediaries between the physical objects and the augmented reality display. These shaders act as mediators that simulate how physical objects would occlude virtual objects, providing precise occlusion effects without requiring direct physical interaction. The first shader represents the physical item and the second shader represents the virtual item, with their interaction determining the final occlusion display.
Solution Approach 2:
The patent changes the rendering parameters of virtual objects based on their spatial relationship with physical objects. By adjusting shader properties (transparency, occlusion strength) according to the position and orientation of physical items, the system achieves precise occlusion effects. The rendering function dynamically modifies visual parameters to reflect the actual occlusion state.
2Manufacturing precision
If multiple virtual items are rendered simultaneously, then comprehensive assembly guidance is provided, but rendering accuracy and occlusion precision deteriorate
Solution Approach 1:
The patent segments the rendering process into distinct stages: first rendering the physical item representation with appropriate occlusion properties, then rendering virtual items that are occluded by the physical item. This segmentation allows each rendering operation to focus on specific objects with optimized parameters, maintaining precision even when multiple items are displayed.
Solution Approach 2:
The patent applies different rendering qualities and shader properties to different regions of the augmented reality display based on local requirements. Virtual items in occluded regions use different rendering functions compared to visible regions, with local adjustments to transparency and occlusion strength. This ensures high rendering accuracy where needed while managing overall system complexity.
Data Source
AI summary
A method for performing object occlusion is disclosed. The method includes capturing an image of a physical item, determining a location and an orientation of a first virtual item with an augmented reality registration function; generating an augmented reality image, wherein the augmented reality image comprises a rendering of the first virtual item in the image using a first rendering function to depict the location and orientation of the first virtual item in the image and a rendering of a second virtual item in the image with a second rendering function; displaying the augmented reality image, wherein occlusion of the first virtual item by the physical item is shown in the augmented reality image based on occlusion of the first virtual item by the second virtual item wherein the first virtual item depicts a next step in the step-by-step instructions for the assembly.