Self-Calibrating Multi-Camera System Using Human Body Key Points

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current camera calibration methods require human intervention and are time-consuming, making them costly and inefficient for self-calibration in multi-camera systems.

Innovation Solution

A system that uses people as calibration markers, identifies body key points, synchronizes frames using timestamps, and implements automatic re-calibration to reduce human intervention, utilizing multi-camera tracking and a self-healing scheme to maintain calibration accuracy despite changes in camera position, focus, or aspect ratio.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual calibration methods using reference objects are used, then calibration accuracy can be achieved, but human intervention and time consumption increase

Engineering Contradiction:
Improvecalibration accuracyVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system enables cameras to perform self-calibration automatically by detecting and tracking moving objects in the scene. The calibration process does not require external reference objects or manual intervention - the cameras use the natural visual information from moving objects to compute their relative positions and orientations, thereby serving themselves for calibration purposes

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The invention extracts calibration information from the visual features of moving objects that naturally pass through the camera fields of view. Instead of introducing external reference objects, the system extracts useful calibration data from the moving objects themselves, separating the calibration function from dedicated reference objects

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If manual calibration methods are used, then calibration can be performed, but cost and human effort increase

Engineering Contradiction:
Improvecalibration accuracyVSAvoidcalibration effort
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The system enables cameras to perform self-calibration automatically by detecting and tracking moving objects in the scene. The calibration process does not require external reference objects or manual intervention - the cameras use the natural visual information from moving objects to compute their relative positions and orientations, thereby serving themselves for calibration purposes

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The invention replaces manual mechanical calibration operations with automated computer vision algorithms. The system uses image processing and feature matching to automatically determine camera parameters, substituting the mechanical/manual calibration process with an automated digital computation process

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If feature matching between cameras is used for calibration, then calibration can be achieved, but the process becomes complex and time-consuming

Engineering Contradiction:
Improvecalibration accuracyVSAvoidcalibration process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system enables cameras to perform self-calibration automatically by detecting and tracking moving objects in the scene. The calibration process does not require external reference objects or manual intervention - the cameras use the natural visual information from moving objects to compute their relative positions and orientations, thereby serving themselves for calibration purposes

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The invention utilizes the dynamic motion of objects in the scene to facilitate calibration. By tracking moving objects across multiple frames and cameras, the system leverages the temporal and spatial dynamics of object motion to simplify the calibration process, making it more robust and easier to execute

Inventive Principle:
Principle #15Dynamics

4Reliability

If traditional calibration methods are used, then initial calibration can be achieved, but re-calibration requires significant human intervention when camera changes occur

Engineering Contradiction:
Improvecalibration stabilityVSAvoidre-calibration ease
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system enables cameras to perform self-calibration automatically by detecting and tracking moving objects in the scene. The calibration process does not require external reference objects or manual intervention - the cameras use the natural visual information from moving objects to compute their relative positions and orientations, thereby serving themselves for calibration purposes

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors the calibration status and automatically triggers re-calibration when changes in camera configuration or environmental conditions are detected. This feedback mechanism ensures that the calibration remains accurate over time without requiring manual intervention, as the system self-adjusts based on ongoing observations

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10827116B1Self calibration system for moving cameras
Publication Date: 2020.11.03 AIFI INC
  • US10827116B1 patent drawing
  • US10827116B1 patent drawing
  • US10827116B1 patent drawing

AI summary

The present invention describes a system for calibrating a plurality of cameras in an area. The system functions by using moving objects to calibrate, in particular using people.In addition, the system implements automatic re-calibration in a specific way to reduce human intervention, cost and time.