Vehicle Camera Super-Resolution for Rearview Mirror Clarity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Vehicle camera systems face reduced image resolution in central regions due to stretching, leading to diminished pixel detail, especially in rear-view images affected by optical aberrations, which compromises the accuracy of scene viewing and detection.

Innovation Solution

The implementation of spatially-implemented super-resolution techniques, including de-noising and sharpening filters, is applied to identified regions of interest within image frames to enhance image sharpness and resolution, using a processor to apply these filters and improve pixel detail without introducing blur.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the center region of the raw image is enlarged for display on the rear view mirror device, then the field of view is improved, but the resolution on a per pixel basis in the center region is reduced

Engineering Contradiction:
Improvefield of viewVSAvoidresolution
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent segments the image processing approach by applying different operations to different regions: the center region is enlarged while the periphery is scaled down, and then super-resolution is specifically applied to the enlarged center region to restore its resolution

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality enhancement by using super-resolution techniques specifically on the enlarged center region where resolution degradation occurs, while leaving other regions with their original quality characteristics

Inventive Principle:
Principle #3Local quality

2Measurement precision

If multi-frame super-resolution is used to enhance resolution, then pixel detail is improved, but processing time and computational complexity increase

Engineering Contradiction:
Improvepixel detailVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies partial action by using only a limited number of frames (e.g., 2-5 frames) for super-resolution processing rather than extensive multi-frame sequences, achieving sufficient resolution enhancement while limiting processing time

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent applies super-resolution selectively only to the enlarged center region rather than the entire image, reducing the computational burden and processing time while maintaining pixel detail where it matters most

Inventive Principle:
Principle #3Local quality

3Measurement precision

If single-frame de-blurring is applied to mitigate blurring, then image sharpness is improved, but noise may be introduced or amplified

Engineering Contradiction:
Improveimage sharpnessVSAvoidnoise
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent converts the harmful effect of noise amplification during de-blurring into a benefit by first applying noise reduction filters to remove noise, then applying de-blurring operations to enhance sharpness, thereby achieving both noise reduction and sharpness improvement

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentUS9336574B2Image super-resolution for dynamic rearview mirror
Publication Date: 2016.05.10 GM GLOBAL TECHNOLOGY OPERATIONS LLC
  • US9336574B2 patent drawing
  • US9336574B2 patent drawing
  • US9336574B2 patent drawing

AI summary

Method for applying super-resolution to images captured by a camera device of a vehicle includes receiving a plurality of image frames captured by the camera device. For each image frame, a region of interest is identified within the image frame requiring resolution related to detail per pixel to be increased. Spatially-implemented super-resolution is applied to the region of interest within each image to enhance image sharpness within the region of interest.