Multi-Camera Image Fusion for Ghost and Flare Removal

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging technologies struggle to effectively remove unnecessary light such as ghost and flare from captured images, which degrades image quality and reduces the accuracy of image processing tasks like detecting specific subjects.

Innovation Solution

An information processing apparatus and method that detects the position of light sources in image data, estimates unnecessary light generation positions, and adjusts blend ratios to combine image data from multiple cameras, reducing or removing unnecessary light through a database-driven approach.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple imaging apparatuses are used to capture images from different angles, then unnecessary light can be removed by combining images, but the device complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidnumber of imaging apparatuses
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The imaging system is divided into multiple independent imaging apparatuses, each capturing images from different angles. This segmentation allows the system to capture the same scene from multiple perspectives, enabling the removal of unnecessary light by combining images where each apparatus captures different glare patterns.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

An image processing apparatus acts as an intermediary that receives images from multiple imaging apparatuses, estimates unnecessary light generation positions, and combines the images to remove glare. This intermediary processing step enables the system to leverage multiple images without requiring complex real-time coordination between imaging devices.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If image processing is performed to remove unnecessary light, then image quality improves, but the processing time and complexity increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by capturing multiple images simultaneously from different angles before the actual image processing. By having multiple pre-captured images ready, the processing stage can quickly estimate unnecessary light positions and combine images without requiring complex real-time analysis, thus reducing processing time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex mechanical or optical light blocking mechanisms with computational image processing methods. Instead of using physical filters or shutters to prevent unnecessary light, the system uses algorithms to estimate and remove glare from captured images, significantly reducing the mechanical complexity and processing time.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If light source position detection is performed accurately, then unnecessary light generation position estimation improves, but the measurement precision requirements increase

Engineering Contradiction:
Improvelight source position detection accuracyVSAvoiddetection complexity
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The image processing apparatus uses the captured images themselves to detect light source positions and estimate unnecessary light generation points. By analyzing the brightness distribution and gradient information from the captured images, the system performs self-detection without requiring external detection devices, thus maintaining measurement precision while reducing detection complexity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses feedback from the captured images to iteratively refine light source position detection and unnecessary light generation position estimation. By analyzing the relationship between detected light sources and actual glare positions in the images, the system continuously improves its estimation accuracy, making the detection process more robust without requiring extremely high initial measurement precision.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12573173B2Information processing apparatus, information processing method, program, imaging apparatus, and imaging system
Publication Date: 2026.03.10 SONY SEMICON SOLUTIONS CORP
  • US12573173B2 patent drawing
  • US12573173B2 patent drawing
  • US12573173B2 patent drawing

AI summary

This information processing apparatus includes an image processing unit that detects a position of a light source in image data captured by an imaging apparatus and estimates an unnecessary light generation position in the image data on the basis of the detected position of the light source. The image processing unit detects, with respect to a plurality of pieces of image data respectively captured by a plurality of imaging apparatuses having partially common fields of view, positions of light sources and estimates unnecessary light generation positions on the basis of the detected positions of the light sources and combines pieces of image data of common field-of-view portions respectively captured by the plurality of imaging apparatuses and generates image data of the unnecessary light generation position with unnecessary light removed or reduced.