Camera Auto-Calibration Using Gyroscope Motion Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional camera calibration methods require a known target, user intervention, and are typically performed only once during manufacturing, failing to account for environmental changes and providing continuous calibration, leading to potential inaccuracies and the need for additional equipment.

Innovation Solution

A method using a gyroscope to measure camera movement between consecutive image frames, allowing for automatic calibration without a known target, by calculating calibration parameters based on the difference between predicted and actual locations of points in the images, and applying these parameters to process raw image data to correct distortions and improve image accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If camera calibration is performed during manufacturing, then initial calibration is achieved, but the calibration cannot be updated later and does not account for environmental changes

Engineering Contradiction:
Improvecalibration adaptabilityVSAvoidcalibration system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The camera system performs self-calibration by automatically comparing predicted point locations (based on gyroscope data) with actual detected point locations in images, and adjusting calibration parameters without external intervention or specialized equipment

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses feedback from the difference between predicted and actual point locations to iteratively adjust calibration parameters, creating a closed-loop system that continuously improves calibration accuracy based on real-world performance

Inventive Principle:
Principle #23Feedback

2Ease of operation

If conventional calibration methods are used, then calibration is performed with manufacturer equipment, but it requires additional equipment and user intervention

Engineering Contradiction:
Improvecalibration operation easeVSAvoidcalibration equipment requirements
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The camera system performs self-calibration by automatically comparing predicted point locations (based on gyroscope data) with actual detected point locations in images, and adjusting calibration parameters without external intervention or specialized equipment

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The gyroscope serves as an intermediary device that provides motion data to predict point locations, enabling calibration without requiring specialized calibration equipment or targets

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If single-time calibration is performed, then manufacturing process is simplified, but calibration accuracy degrades due to environmental changes

Engineering Contradiction:
Improvecalibration precisionVSAvoidmanufacturing efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The calibration parameters are made dynamic rather than static, allowing them to be updated continuously based on real-world performance and environmental conditions, transforming calibration from a one-time manufacturing step to an ongoing adaptive process

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs continuous calibration updates by constantly comparing predicted and actual point locations and adjusting parameters in real-time, ensuring calibration accuracy is maintained throughout the camera's operational life rather than just at manufacturing

Inventive Principle:
Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables continuous, automatic camera calibration in various devices, reducing manufacturing costs and complexity, improving image accuracy by accounting for environmental changes and eliminating the need for user intervention and specialized equipment, while providing high-quality calibration parameters for computer vision and machine vision applications.

Implementation Method 1

receiving in the processor from a gyroscope a measurement of rotational velocity of the camera corresponding to a time between the first and second image frames

Methodology Applied
Scientific EffectGyroscope: Gyroscope

Data Source

PatentUS11205283B2Camera auto-calibration with gyroscope
Publication Date: 2021.12.21 QUALCOMM INC
  • US11205283B2 patent drawing
  • US11205283B2 patent drawing
  • US11205283B2 patent drawing

AI summary

Embodiments include devices and methods for automatically calibrating a camera. In various embodiments, an image sensor may capture an image. Locations of one or more points including in the captured image frames may be predicted and detected. Calibration parameters may be calculated based on differences between predicted locations of a selected point within an image frame and observed locations of the selected point within the captured image frame. The automatic camera calibration method may be repeated until the calibration parameters satisfy a calibration quality threshold.