Depthmap Overlay for Panoramic Image Object Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Navigation and map systems face challenges in distinguishing between foreground and background objects in 2D representations of 3D images, leading to difficulties in selecting and emphasizing specific objects, which can result in confusion for users.
Innovation Solution
The use of depthmap information generated from LIDAR or other optical distancing systems to overlay 3D data onto panoramic images, allowing for the accurate identification and graphical enhancement of selected objects by comparing depth data with surrounding points, thereby distinguishing between objects and applying graphical effects such as blurring, highlighting, or simulated spotlight effects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If 2D representation of 3D images is used in navigation systems, then the system complexity is reduced and ease of operation is improved, but the ability to distinguish between foreground and background objects deteriorates
Solution Approach 1:
The patent applies dimensionality change by integrating depthmap data (3D information) with 2D panoramic images. When a user selects an object in the 2D image, the system uses depthmap information to identify objects at similar depths, effectively adding a depth dimension to the 2D interaction. This allows the system to distinguish between foreground and background objects while maintaining the simplicity of 2D image display and selection.
2Measurement precision
If depthmap information is used to identify and enhance selected objects, then the precision of object identification is improved, but the device complexity increases
Solution Approach 1:
The patent applies segmentation by separating the image processing into distinct functional components: the original 2D image processing for selection, the depthmap processing for depth-based object identification, and the composite generation for visual enhancement. This segmentation allows the system to achieve precise object identification using depth information while managing complexity through modular processing steps.
Solution Approach 2:
The depthmap serves as an intermediary data structure that bridges the 2D image selection and the 3D spatial understanding. By using the depthmap as a mediator, the system can translate 2D pixel selections into 3D object identifications without requiring complex direct 3D processing, thus improving identification precision while controlling device complexity.
3Loss of information
If graphical effects are applied to enhance selected objects, then the clarity of visual cues is improved, but the processing time increases
Solution Approach 1:
The patent applies local quality by applying graphical effects only to the specific region containing the selected object and its depth-similar neighbors, rather than processing the entire image. This localized approach enhances the visual clarity of the selected object while minimizing the processing time required, as only a portion of the image undergoes enhancement operations.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach effectively enhances the user's ability to identify and interact with specific objects in 3D space within 2D images, improving navigation and map applications by providing clear visual cues and accurate object selection, even when objects are geographically distant but appear close in 2D representation.
Implementation Method 1
depthmap information generated from LIDAR or other optical distancing systems
Data Source
Figure 1
Figure 2A~2B
Figure 3A~3B
AI summary
One or more systems, devices, and/ormethods foremphasizing objects in an image, such as apanoramic image,are disclosed. For example, a methodincludesreceiving a depthmap generated from an optical distancing system, wherein the depthmap includes position data and depth data for each of a plurality of points. The optical distancing system measures physical data. The depthmap is overlaid on the panoramic image according to the position data. Data is received that indicatesa location on the panoramic image and, accordingly,a first point of the plurality of points that is associated with the location. The depth data of the first point is compared to depth data of surrounding points to identifyan area on the panoramic image corresponding to a subset of the surrounding points. The panoramic image is altered with a graphical effect that indicates the location.