Depth Image Edge Enhancement via Joint Weighting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional edge detection techniques fail to produce high-quality edges in low-resolution depth images from depth imagers like structured light or time of flight cameras, leading to poor performance in subsequent image processing operations such as feature extraction and object recognition.
Innovation Solution
An image processing system performs first and second edge detection operations on depth and 2D images, applies a joint edge weighting operation to generate an edge mask, and uses this mask to enhance the edge quality of the depth image, leveraging better-defined edges from the 2D image to improve edge detection in the depth image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional edge detection techniques are applied to depth images, then the processing is simple and fast, but the edge quality is poor with missed edges and spurious edges
Solution Approach 1:
The patent combines edge detection results from multiple images (depth image and at least one additional image such as a 2D image) to generate an enhanced edge image. By merging the edge information from different image sources, the system achieves more accurate edge detection while maintaining reasonable processing complexity through parallel processing of multiple images.
2Measurement precision
If multiple images are processed to enhance edge quality, then edge detection accuracy improves, but processing time and computational load increase
Solution Approach 1:
The patent performs preliminary edge detection operations on multiple images simultaneously or in parallel before combining the results. This preliminary action allows the system to prepare edge information from all images in advance, reducing the overall processing time when generating the final enhanced edge image.
3Reliability
If conventional edge detection is used on low-resolution depth images, then processing is computationally efficient, but the detected edges are unreliable for subsequent operations
Solution Approach 1:
The patent introduces an intermediary process that combines edge detection results from multiple images using a combination operation. This intermediary step acts as a mediator between the individual edge detection results and the final enhanced edge image, filtering out spurious edges and reinforcing reliable edges to improve overall edge reliability for subsequent processing operations.
Data Source
AI summary
An image processing system comprises an image processor configured to perform first and second edge detection operations on respective first and second images to obtain respective first and second edge images, to apply a joint edge weighting operation using edges from the first and second edge images, to generate an edge mask based on results of the edge weighting operation, to utilize the edge mask to obtain a third edge image, and to generate a third image based on the third edge image. By way of example only, in a given embodiment the first image may comprise a first depth image generated by a depth imager, the second image may comprise a two-dimensional image of substantially the same scene as the first image, and the third image may comprise an enhanced depth image having enhanced edge quality relative to the first depth image.