Real-Time Stereo Image Rectification Hardware System

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional methods for real-time stereo image rectification using two cameras face challenges due to complex calculations and system complexity, making real-time operation difficult, especially in industrial applications where camera parameters can vary.

Innovation Solution

A hardware system comprising a coordinate generation module, rectification coordinate generation module, bilinear interpolation value generation module, memories, and a control module that uses a calibration matrix to generate and apply rectification coordinates and bilinear interpolation values, enabling real-time stereo image rectification without relying on software systems or universal computers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If conventional software-based rectification methods are used, then rectification can be performed, but real-time operation becomes difficult due to complex calculations involving multiplication and inversion of 3×3 matrices

Engineering Contradiction:

Improverectification speedVSAvoidsystem complexity

Core Design Contradiction:

SpeedVSDevice complexity

Solution Approach 1:

The patent replaces the software-based calculation system with a hardware-based system. Specifically, it uses dedicated hardware circuits including a coordinate generation module, rectification coordinate generation module, bilinear interpolation value generation module, and rectification module to perform real-time stereo image rectification without relying on complex software matrix operations

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The rectification system is divided into multiple independent functional modules: coordinate generation module (110), rectification coordinate generation module (120), bilinear interpolation value generation module (130), rectification coordinate memory (140), bilinear interpolation memory (150), image buffer (160), and rectification module (170). Each module handles a specific aspect of the rectification process, enabling parallel processing and real-time operation

Inventive Principle:

Principle #1Segmentation

2Loss of time

If lookup tables are used to store pre-calculated operation results, then operation time is shortened, but flexibility is lost when camera parameters such as relative location or focusing distance vary

Engineering Contradiction:

Improveoperation timeVSAvoidparameter adaptability

Core Design Contradiction:

Loss of timeVSAdaptability or versatility

Solution Approach 1:

The system dynamically adapts to changing camera parameters through the control module (180) which monitors camera calibration values and triggers recalculation of rectification coordinates and bilinear interpolation values when parameter changes are detected. This allows the hardware system to maintain real-time performance while adapting to varying camera configurations

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The control module implements a feedback mechanism that continuously monitors camera parameters and automatically initiates recalculation of rectification data when changes are detected, ensuring the system remains adaptive without requiring manual intervention or losing real-time capability

Inventive Principle:

Principle #23Feedback

3Productivity

If universal computers are used for camera calibration and rectification, then calibration can be performed, but the system becomes unsuitable for industrial applications requiring real-time operation

Engineering Contradiction:

Improvereal-time processing capabilityVSAvoidsystem implementation

Core Design Contradiction:

ProductivityVSEase of manufacture

Solution Approach 1:

The patent replaces general-purpose computer systems with a dedicated hardware system designed specifically for stereo image rectification. The system uses specialized modules implemented in hardware (likely FPGA or ASIC) that perform rectification operations in real-time without relying on software execution on universal computers

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The hardware system is self-contained and performs all rectification operations autonomously without requiring external computer control. The control module coordinates the various hardware modules, and the system can independently handle camera calibration data and perform real-time rectification suitable for industrial applications

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS7643067B2Rectification system and method of stereo image in real-time

Publication Date: 2010.01.05 SAMSUNG ELECTRONICS CO LTD

AI summary

Disclosed is a system and a method for rectifying stereo images, which are acquired by two cameras, in real-time by using a calibration matrix resulting from camera calibration. The system includes a coordinate generation module; a rectification coordinate generation module; a bilinear interpolation value generation module; a rectification coordinate memory; a bilinear interpolation memory; an image buffer; an rectification module; and a control module. A structure of a hardware system capable of real-time stereo rectification is provided, and the operation results have been verified by implementing a hardware device. The real-time stereo rectification system makes it possible to acquire rectified images in real-time without using a separate computer system or a software program.