Stereoscopic Imaging Overlay Scaling Using Scene Depth
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D stereoscopic imaging systems fail to provide an automatic method for creating graphical overlays that accurately position graphics with correct depth and scale within the image, leading to distorted perceptions.
Innovation Solution
A system and method for determining depth information from stereoscopic image data, calculating a scaling factor, and generating a composite view with overlays positioned correctly in depth and scale using disparity maps or depth sensors, ensuring overlays do not collide with the scene.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If graphical overlays are created on composite stereoscopic images without considering depth information, then the overlay creation process is simple and fast, but the perceived depth and scale of the graphic become incorrect and distorted
Solution Approach 1:
The system performs preliminary computation of depth information from stereoscopic image pairs before overlay generation. Disparity maps are calculated in advance to determine depth values for all pixels, which are then stored and reused during overlay composition. This preliminary action enables accurate depth-based overlay positioning without adding complexity during the actual overlay generation process.
Solution Approach 2:
The patent introduces disparity maps as an intermediary data structure between the stereoscopic image pairs and the final overlay composition. These disparity maps serve as a mediator that contains depth information, allowing the system to accurately position overlays at correct depth planes without directly manipulating the complex stereo image data during overlay generation.
2Manufacturing precision
If graphical overlays are positioned at arbitrary locations on the composite image, then the overlay placement process is simple, but the graphic appears at incorrect depth locations and with wrong scale
Solution Approach 1:
The system segments the stereoscopic image into multiple depth planes based on disparity values. Each pixel is assigned to a specific depth plane, and overlays are then placed on individual planes rather than on the composite image. This segmentation enables precise depth-based positioning while maintaining ease of operation through automated plane assignment.
Solution Approach 2:
The patent transitions from two-dimensional overlay placement on composite images to three-dimensional overlay placement in the depth space of the stereoscopic scene. By utilizing the depth dimension provided by disparity maps, the system achieves precise spatial positioning of overlays at correct depth locations and with appropriate scaling, effectively adding a third dimension to the overlay placement process.
3Loss of information
If multiple graphical overlays are added to enhance information display, then the information density increases, but the risk of overlay collision with scene elements increases
Solution Approach 1:
The system performs preliminary depth analysis of the stereoscopic scene to identify regions occupied by scene elements before overlay generation. By pre-computing depth information and analyzing the 3D scene structure, the system can determine safe overlay placement regions that avoid collision with actual scene objects, ensuring complete information display without harmful overlays.
Data Source
AI summary
Examples relate to a system, to a method and to a computer program for an optical imaging system, such as a microscope, and to an optical imaging system comprising such a system. The system is configured to obtain stereoscopic image data of a scene from a stereoscopic imaging device of the optical imaging system. The system is configured to determine depth information on at least a portion of the scene. The system is configured to determine a scaling factor of an information overlay to be overlaid over the stereoscopic image data based on the depth information. The system is configured to generate a stereoscopic composite view of the stereoscopic image data and the information overlay, with the information overlay being scaled according to the scaling factor. The system is configured to provide a display signal comprising the stereoscopic composite view to a stereoscopic display device.