Distributed Image Processing for Minimizing Stitching Artifacts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In panoramic or 360-degree image stitching, differences in color-balance and exposure-control parameters between cameras result in visible artifacts at image boundaries, and require substantial processing time for corrections on the host system.

Innovation Solution

A method where each camera determines its own set of image processing parameters, including statistics like histograms and color temperature, which are then combined by a master to create composite parameters for uniform adjustment across cameras, applied locally to optimize image stitching.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If each camera determines its own color-balance and exposure-control parameters individually, then each camera can independently optimize its image quality, but visible artifacts appear at image boundaries in stitched images

Engineering Contradiction:
Improveimage qualityVSAvoidvisible artifacts at boundaries
Core Design Contradiction:
Manufacturing precisionVSObject-affected harmful factors

Solution Approach 1:

A master camera is introduced as an intermediary to coordinate parameter determination across the camera array. The master camera receives image data from all cameras, determines unified color-balance and exposure-control parameters, and distributes them back to individual cameras. This intermediary role resolves the contradiction by enabling centralized parameter optimization while maintaining distributed image capture and processing.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent merges the parameter determination function from individual cameras into a centralized process at the master camera. Instead of each camera independently determining parameters, the system combines all image data at the master, which then determines unified parameters for the entire array. This merging eliminates parameter inconsistencies that cause boundary artifacts in stitched images.

Inventive Principle:
Principle #5Merging (Combining)

2Object-affected harmful factors

If additional corrections for color, brightness, and contrast be performed on the host for each camera image to be spliced, then artifact visibility is reduced, but substantial processing time on the host is required

Engineering Contradiction:
Improveartifact visibilityVSAvoidprocessing time
Core Design Contradiction:
Object-affected harmful factorsVSLoss of time

Solution Approach 1:

Color-balance and exposure-control parameters are determined and applied in advance during image capture, before images are transferred to the host system. This preliminary action at the camera level prevents the need for time-consuming corrective processing at the host, thereby reducing processing time while maintaining image quality and minimizing artifacts.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Individual cameras perform self-service by independently applying color-balance and exposure-control adjustments to their own captured images using parameters determined by the master camera. This distributed self-service approach eliminates the need for centralized host processing, significantly reducing processing time while maintaining consistent parameter application across all cameras.

Inventive Principle:
Principle #25Self-service

3Stability of the object's composition

If centralized parameter determination is performed by a master camera, then consistency across stitched images is improved, but communication overhead and system complexity increase

Engineering Contradiction:
Improveparameter consistencyVSAvoidsystem complexity
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The master camera performs multiple functions: capturing its own image data, receiving image data from other cameras, determining color-balance and exposure-control parameters, and distributing these parameters back to individual cameras. This multi-functionality consolidates the system's complexity into a single device, maintaining parameter consistency while avoiding the need for complex inter-camera communication and coordination protocols.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9438794B2Method and apparatus for distributed image processing in cameras for minimizing artifacts in stitched images
Publication Date: 2016.09.06 OMNIVISION TECHNOLOGIES INC
  • US9438794B2 patent drawing
  • US9438794B2 patent drawing
  • US9438794B2 patent drawing

AI summary

A method for coordinated adjustment of a first image captured by a first camera and a second image captured by a second camera includes determining a first set of image processing parameters from the first image and a second set of image processing parameters from the second image, transmitting the first set of image processing parameters to a master, the master not being the first camera; combining at least the first and second sets of processing parameters into a combined or composite set of parameters; transmitting the composite parameters from the master to the first camera; and using a processor of the first camera to apply the composite parameters to the first image, and a processor of the second camera to apply composite parameters to the second image. An apparatus has at least two cameras configured to implement the method.