Occlusion Augmentation in Live Image Processing Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Digital imaging devices face challenges in maintaining a clear view of objects of interest when they are occluded by dynamic objects, such as hands or tools, during manual tasks, as these occlusions obscure important features necessary for tasks like assembly or inspection.
Innovation Solution
An image processing system that continuously captures and renders live images, creates a three-dimensional representation of the scene, and detects occlusions to augment the image by replacing or mitigating occluded portions with data from the three-dimensional representation, allowing for clear visualization of objects even when obscured by dynamic objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a camera continuously captures live images of a scene, then the object of interest can be monitored in real-time, but the view of the object is occluded by dynamic objects such as hands or tools during manual tasks
Solution Approach 1:
The system creates a three-dimensional representation (copy) of the scene that can be manipulated independently of the live camera feed. When occlusion occurs in the live image, the system retrieves and displays the corresponding view from the stored three-dimensional representation, allowing the object of interest to remain visible even when physically occluded in the real world
Solution Approach 2:
The system transitions from two-dimensional live image planes to a three-dimensional representation of the scene. This dimensional change allows the system to access and display views of the object from different angles and perspectives that are not affected by occlusion in the current camera view
2Loss of information
If the system stores a three-dimensional representation of the scene, then occluded portions can be replaced with data from the representation, but the system complexity increases
Solution Approach 1:
The system performs preliminary action by creating and storing a three-dimensional representation of the scene before occlusion occurs. This pre-captured data is then readily available for retrieval and display when occlusion happens, eliminating the need for complex real-time processing during occlusion events
Solution Approach 2:
The three-dimensional representation serves as an intermediary between the live camera feed and the final displayed image. When occlusion is detected, this intermediary data source provides the missing visual information, simplifying the overall system architecture by decoupling the capture and display functions
Data Source
AI summary
An example image processing system augments live images of a scene to reduce or eliminate occlusion of an object of interest. The image processing system can detect an occlusion of an object in a live image of the scene. The image processing system can further access a data store that stores a three-dimensional representation of the scene with the object being present. The image processing system augments the live image to depict the object without at least a portion of the occlusion, using data provided with the three-dimensional representation of the scene.