Saliency-Based Frame Color Enhancement for Depth Illusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display processing systems struggle to effectively depict object depth and create an illusion of depth in images, particularly in photographic images, while also managing power consumption efficiently.
Innovation Solution
A method and apparatus that detect scene changes and down-sample images to generate saliency or depth maps, applying color mapping functions to adjust high-saliency and low-saliency colors, reducing power usage by analyzing these maps only after a threshold number of frames or scene changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If saliency analysis is performed on every frame to enhance depth perception, then image quality and depth illusion are improved, but power consumption increases
Solution Approach 1:
The system performs saliency analysis periodically based on frame counters rather than on every frame. A frame counter increments with each received frame and triggers saliency map generation only when it reaches a threshold value, converting continuous processing into periodic action to reduce power consumption while maintaining acceptable image quality
Solution Approach 2:
The system dynamically adjusts processing intensity based on scene change detection. When a scene change is detected between frames, the frame counter is reset and saliency analysis is triggered, allowing the system to adapt processing frequency to content variability rather than using a fixed periodic schedule
2Measurement precision
If full-resolution images are processed for saliency map generation, then depth map accuracy is improved, but processing time and computational load increase
Solution Approach 1:
The processing is segmented into two stages: first, a down-sampled version of the image is processed to generate an initial saliency map; second, this initial map is used to guide selective processing of the full-resolution image. This segmentation allows the system to capture general saliency patterns efficiently while applying detailed processing only where needed
Solution Approach 2:
The system applies partial processing by generating a complete saliency map from the down-sampled image first, then using this map to selectively enhance specific regions in the full-resolution image rather than processing the entire high-resolution image uniformly. This partial action approach achieves sufficient depth map accuracy with reduced computational burden
3Manufacturing precision
If color mapping functions are applied to every frame, then color enhancement quality is improved, but processing speed decreases
Solution Approach 1:
Color mapping function application is triggered periodically based on the same frame counter mechanism used for saliency analysis. The CMF is applied only when the frame counter reaches the threshold, converting continuous color enhancement into periodic action to improve processing speed while maintaining acceptable color enhancement quality
Solution Approach 2:
The system performs preliminary saliency analysis on down-sampled frames to identify regions requiring color enhancement before applying the color mapping function to full-resolution frames. This preliminary action guides subsequent detailed processing, ensuring color enhancement is applied efficiently to only the most relevant regions
Data Source
AI summary
The present disclosure relates to methods and devices for display processing including an apparatus, e.g., a DPU. The apparatus may detect at least one of a scene change between successive frames of a plurality of frames or a threshold number of received frames of the plurality of frames. The apparatus may also generate at least one of a saliency map, an object segmentation map, or a depth map based on a down-sampled image of a first frame. The apparatus may also apply a CMF for a color space associated with the plurality of frames to the plurality of pixels in one or more subsequent frames of the plurality of frames, the CMF being applied until at least one of a subsequent scene change or a subsequent threshold number of received frames.