Multi-Camera Stereo Calibration Error Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Multi-camera stereo imaging systems face challenges in maintaining calibration over time due to wear and tear, thermal events, and other factors, leading to incorrect operation of 3D imaging functions, which is impractical for consumer mobile devices and requires unwieldy manual recalibration.

Innovation Solution

A multi-camera error compensating software system that conducts dynamic recalibration with minimal user interaction by analyzing plural images to determine calibration errors and modify parameters, allowing for seamless reprocessing of image frames and notification of decalibration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual recalibration is performed to maintain camera calibration, then calibration accuracy is improved, but device complexity and ease of operation deteriorate

Engineering Contradiction:
Improvecalibration accuracyVSAvoidease of recalibration
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs automatic recalibration using captured images and feature point detection algorithms, eliminating the need for manual user intervention. The processor automatically detects feature points in images, calculates calibration parameters, and updates camera calibration data without requiring user expertise or manual adjustment.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical recalibration procedures with an automated computational system. Instead of physically adjusting camera mounts or using manual calibration tools, the system uses image processing algorithms and feature point analysis to automatically compute and apply calibration corrections.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If frequent recalibration is performed to maintain calibration accuracy, then measurement precision is improved, but loss of time increases

Engineering Contradiction:
Improvecalibration accuracyVSAvoidtime for recalibration
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs recalibration periodically or on-demand based on detected calibration degradation, rather than requiring frequent manual interventions. The automatic nature of the process allows it to be executed efficiently at appropriate intervals without disrupting normal device operation.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

By replacing time-consuming manual recalibration procedures with automated image-based computational methods, the system significantly reduces the time required for calibration maintenance while preserving accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If dynamic recalibration with image analysis is implemented, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improveease of recalibrationVSAvoidsoftware system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system uses the device's existing camera and processor to perform self-calibration, leveraging resources already present in the device. This approach minimizes the need for additional specialized hardware while maintaining ease of operation through automatic execution.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The calibration system utilizes the device's existing imaging and processing capabilities for multiple purposes - both for normal operation and for calibration maintenance. The same camera used for capturing images is also used for calibration, and the same processor used for general computation handles the calibration algorithms.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10855972B2Method and apparatus for compensating for camera error in a multi-camera stereo camera system
Publication Date: 2020.12.01 DELL PROD LP
  • US10855972B2 patent drawing
  • US10855972B2 patent drawing
  • US10855972B2 patent drawing

AI summary

A system and method multi-camera error compensation including recording a plurality of raw images via a plurality of digital cameras and an application processor processing with a multi-view stereo imaging system one or more plural image frames from the raw images captured by the plurality of digital cameras. The plural images may be stored in memory and the detection conducted for calibration loss of at least one digital camera via the processor executing instructions for a multi-camera error compensating system to determine loss of calibration in plural images. The multi-camera error compensating system conducts dynamic recalibration of plural image calibration parameters based on at least one plural image frame and in response to detection of calibration loss via the multi-camera error compensating system and a processor reprocesses the plural image frame from a reprocessing queue according to the recalibrated plural image parameters.