Serial Camera Chain for Flexible Composite Image Stitching

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional image processing systems are inflexible and costly to reconfigure when changing the number of cameras used to generate a composite image, as the hardware configuration is fixed and requires redesign for different camera setups.

Innovation Solution

A serial chain of imaging units where each camera generates an in-situ image and stitches it with a composite image from the previous camera, allowing for easy addition or removal of cameras and flexible scaling of the system, with a system controller managing the processing and stitching of images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a fixed hardware configuration is used in conventional image processing systems, then the system is simple to implement, but the system lacks flexibility and requires costly redesign when changing the number of cameras

Engineering Contradiction:

Improveflexibility in changing number of camerasVSAvoidhardware configuration complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The stitching processor is divided into multiple identical imaging units connected in series, each capable of independent operation. Each unit contains the same hardware components (image sensor, composition unit, buffer), allowing the system to be configured with different numbers of units without redesigning the overall architecture. This segmentation enables flexible adaptation while maintaining hardware simplicity.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system transitions from a static fixed-configuration architecture to a dynamic reconfigurable architecture where the number of imaging units can be changed based on operational needs. The serial connection with shared memory resources allows the system to dynamically adapt the number of active imaging units without requiring hardware redesign, achieving both flexibility and cost-effectiveness.

Inventive Principle:

Principle #15Dynamics

2Area of stationary object

If multiple cameras are used to create an extended composite view, then the coverage area is improved, but the hardware configuration becomes more complex and costly to reconfigure

Engineering Contradiction:

Improvecoverage area of composite imageVSAvoidcost and time of hardware redesign

Core Design Contradiction:

Area of stationary objectVSEase of manufacture

Solution Approach 1:

The system segments the stitching processor into multiple identical imaging units, each handling one camera's image data. This modular segmentation allows the system to scale coverage area by simply adding more identical units rather than redesigning the hardware architecture, significantly reducing manufacturing cost and time for reconfiguration.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Each imaging unit is designed as a universal module that can function independently or be combined with other identical units. The same hardware design serves multiple functions: single-camera operation, multi-camera operation, and various configurations. This universality eliminates the need for custom hardware designs for different camera numbers, reducing redesign costs and time.

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If a serial chain of imaging units is used, then the system becomes more flexible and scalable, but the processing time and data transmission requirements increase

Engineering Contradiction:

Improvescalability of imaging systemVSAvoidimage processing time

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

Each imaging unit contains a buffer that pre-stores received image data before the composition operation. This preliminary buffering allows the serial processing to proceed efficiently without waiting for data transmission during the composition step, reducing overall processing time while maintaining scalability.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The shared memory resource acts as an intermediary between imaging units, enabling efficient data exchange without direct point-to-point connections. This intermediary mechanism simplifies data transmission in the serial chain and reduces the time required for image data to move between units during the stitching process.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS9485424B2Image processing system and method using serially coupled cameras for providing extended view

Publication Date: 2016.11.01 OMNIVISION TECHNOLOGIES INC

AI summary

A system and method for generating an image includes a plurality of imaging units coupled together and a system controller coupled to the plurality of imaging units for providing at least one signal to each of the plurality of imaging units. Each of the imaging units comprises: an image sensing unit for generating an in-situ image, each in-situ image being a portion of the image; an input for receiving the in-situ image; a composition unit for receiving a first composite image and producing a second composite image, the second composite image being a combination of the first composite image and the in-situ image; and an output at which the second composite image is provided.