Display Controller for Bayer Image False Color and Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In digital cameras using Bayer coding imagers, restoring lost information through demosaicing processing leads to a decline in resolution and the occurrence of artifacts like false color, which is difficult to fully address, and adjusting the lowpass filter to reduce false color also reduces resolution, creating a trade-off.

Innovation Solution

A display control apparatus and imaging apparatus that enhance regions where resolution changes or false color is generated due to varying lowpass filter characteristics, allowing users to easily recognize and adjust for image quality deterioration on a small screen.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If demosaicing processing is performed to restore lost information in Bayer coding imager, then image information is recovered, but resolution declines and artifacts occur

Engineering Contradiction:
Improveimage informationVSAvoidresolution
Core Design Contradiction:
Loss of informationVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by introducing a lowpass filter before the imaging element to prevent high-frequency noise and aliasing artifacts from entering the demosaicing process. This pre-processing step reduces the burden on demosaicing algorithms, allowing them to work with cleaner data and produce fewer artifacts while maintaining resolution.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses an optical lowpass filter as an intermediary component between the lens and the imaging element. This physical filter acts as a mediator that selectively attenuates high-frequency components before they reach the sensor, preventing aliasing and reducing the need for aggressive demosaicing processing that would degrade resolution.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Object-generated harmful factors

If lowpass filter effect is increased to reduce false color, then false color is reduced, but resolution deteriorates

Engineering Contradiction:
Improvefalse colorVSAvoidresolution
Core Design Contradiction:
Object-generated harmful factorsVSManufacturing precision

Solution Approach 1:

The patent applies dynamics by making the lowpass filter characteristics adjustable rather than fixed. The optical lowpass filter can be dynamically controlled to vary its cut-off frequency and attenuation characteristics, allowing optimization for different imaging conditions and enabling users to balance between false color reduction and resolution preservation.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements parameter changes by allowing adjustment of the lowpass filter's cut-off frequency and transmission characteristics. By changing these parameters, the system can adapt to different imaging scenarios, reducing false color when needed while preserving resolution when high-frequency details are important.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If lowpass filter is adjusted manually by user, then appropriate settings can be achieved, but confirmation of false color is difficult on small viewfinder screen

Engineering Contradiction:
Improvemanual settingVSAvoidfalse color confirmation
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent applies dimensionality change by transitioning from a small two-dimensional viewfinder screen to a larger three-dimensional display interface. The enhanced display presents image data in multiple dimensions including zoomed-in views, different focus planes, and comparative displays that make false color and resolution issues visible and confirmable to users.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent uses copying by creating multiple copies of the image data at different processing stages and display resolutions. The enhanced display shows enlarged portions of the image, alternative focus plane copies, and processed versions that allow users to visually confirm the presence and location of false color artifacts without requiring a large original screen.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10911681B2Display control apparatus and imaging apparatus
Publication Date: 2021.02.02 SONY GROUP CORP
  • US10911681B2 patent drawing
  • US10911681B2 patent drawing
  • US10911681B2 patent drawing

AI summary

A display control apparatus according to an embodiment of the present disclosure includes a display controller that performs enhancement on a region where resolution is changed in response to changing of lowpass characteristics or a region where false color is generated or changed in response to changing of the lowpass characteristics in image data generated on the basis of light incident via a lowpass filter.