Hybrid Camera Image Augmentation for Low-Light Quality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mobile device cameras struggle to capture high-quality images in low-light conditions due to the infrared cut-off filter, which blocks significant light energy, and the limitations of lower-powered flashes, resulting in darker images and excessive processing time.

Innovation Solution

A system and method that adjusts camera image data by detecting poor quality characteristics in visible light images and augmenting them with non-visible light camera data, forming hybrid images that meet predetermined quality thresholds, while conserving battery power and processing time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If an infrared cut-off filter is used in the visible light camera, then color image quality is improved, but light energy transmission is reduced

Engineering Contradiction:
Improveimage qualityVSAvoidlight energy
Core Design Contradiction:
Manufacturing precisionVSLoss of energy

Solution Approach 1:

The patent combines data from two separate camera systems - a visible light camera with infrared cut-off filter and a non-visible light camera without filter - into a hybrid image. The infrared data is extracted from non-visible light image data and used to augment the visible light image data, effectively merging the strengths of both systems to overcome the light energy loss caused by the infrared cut-off filter.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The non-visible light camera acts as an intermediary that captures infrared data which is then processed and integrated into the visible light image. This intermediary system provides the infrared information that would otherwise be blocked by the infrared cut-off filter in the visible light camera, allowing color image quality to be maintained while compensating for lost light energy.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Use of energy by moving object

If a lower-powered flash is used, then power consumption is reduced, but image brightness is insufficient

Engineering Contradiction:
Improvepower consumptionVSAvoidimage brightness
Core Design Contradiction:
Use of energy by moving objectVSIllumination intensity

Solution Approach 1:

The patent merges visible light image data with infrared data from the non-visible light camera to create a hybrid image. This combination allows the system to use lower-powered flashes while compensating for reduced brightness through the integration of infrared information, thereby maintaining adequate image brightness while reducing power consumption.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system changes the parameter composition of the image by integrating infrared data into the visible light image. This parameter change allows the image to maintain sufficient brightness characteristics even when the flash power is reduced, as the infrared component compensates for the reduced visible light illumination.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If excessive image processing is performed, then image quality is improved, but processing time increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by having the non-visible light camera continuously capture infrared data in the background, preparing this data in advance for potential integration with visible light images. This preliminary capture and processing of infrared data reduces the need for excessive post-processing when visible light images require enhancement, thereby improving image quality while minimizing additional processing time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The non-visible light camera system operates autonomously to capture and prepare infrared data that can be self-applied to enhance visible light images. This self-service approach allows the system to improve image quality through automatic integration of infrared data without requiring excessive manual or complex processing interventions.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach ensures mobile device cameras capture images of sufficient quality in various lighting conditions, reducing the need for excessive processing and power consumption by combining visible and non-visible light data to enhance image quality.

Implementation Method 1

receive image data from a visible light camera of a mobile device

Methodology Applied
Scientific EffectVisible light detection: Light

Implementation Method 2

receive corresponding non-visible light image data from a non-visible light camera of the mobile device

Methodology Applied
Scientific EffectInfrared radiation detection: Infrared Radiation

Data Source

PatentEP2658245B1System and method of adjusting camera image data
Publication Date: 2016.04.13 BLACKBERRY LTD
  • EP2658245B1 patent drawingFigure 1
  • EP2658245B1 patent drawingFigure 2
  • EP2658245B1 patent drawingFigure 3

AI summary

Systems and methods of adjusting camera image data include receiving image data from a visible light camera module are described. A quality factor of the image data can be determined based on at least one predetermined characteristic. The quality factor can be compared to a predetermined threshold. Image data from a non-visible light camera module can be requested when the quality factor is below the predetermined threshold. Image data from the non-visible light camera module can be received in response to the request. The received image data from the visible light camera module can be augmented with the received image data from the non-visible light camera module to form hybrid image data. The image sensor can be adjusted based on a quality factor of the hybrid image such that the visible light camera captures a subsequent image having a quality factor that meets or is greater than the predetermined threshold.