Video Camera Calibration via Moving Object Trajectory Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video camera calibration methods face challenges in accurately determining the disappearing direction, especially when there are few edges in the image or excessive noise, leading to unstable and computationally intensive estimations.

Innovation Solution

A device and method that detect moving targets, extract feature points, track their trajectories, and determine the disappearing direction based on the major moving direction of objects, reducing reliance on edge detection and grouping line segments to improve accuracy and reduce computational workload.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If edge detection and line segment grouping methods are used to determine disappearing direction, then the method can work with available image data, but the measurement precision and stability deteriorate when edges are few or noise is excessive

Engineering Contradiction:
Improvedisappearing direction estimation accuracyVSAvoidestimation stability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent introduces moving objects as an intermediary element between the image data and the disappearing direction determination. By tracking feature points on moving objects and analyzing their motion trajectories, the system obtains a more reliable indicator of the disappearing direction that is less sensitive to edge detection failures and noise interference.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the parameter used for determination from static image features (edges and line segments) to dynamic motion parameters (feature point trajectories and moving directions). This parameter transformation enables the system to achieve stable and accurate disappearing direction estimation even when image quality is poor.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If all detected line segments are used for initial estimation of disappearing direction, then comprehensive data is utilized, but the computing load increases significantly

Engineering Contradiction:
Improveestimation accuracyVSAvoidcomputational efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent extracts only the relevant information needed for disappearing direction determination by focusing on feature points of moving objects. This extraction approach avoids the computational burden of processing all detected line segments while retaining the essential information needed for accurate estimation.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system uses the natural motion of objects in the scene to provide the information needed for calibration. By leveraging the self-motion of objects and their trajectories, the system obtains disappearing direction data without requiring intensive computation on all image features.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9953421B2Device for determining disappearing direction and method thereof, apparatus for video camera calibration and method thereof
Publication Date: 2018.04.24 SONY GROUP CORP
  • US9953421B2 patent drawing
  • US9953421B2 patent drawing
  • US9953421B2 patent drawing

AI summary

A disappearing direction determination device and method, a video camera calibration apparatus and method, a video camera and a computer program product are provided. The device comprises: a moving target detecting unit for detecting in the video image a moving target area where a moving object locates; a feature point extracting unit for extracting at least one feature point on the moving object in the detected moving target area; a moving trajectory obtaining unit for tracking a movement of the feature point in a predetermined number of video image frames to obtain a movement trajectory of the feature point; and a disappearing direction determining unit for determining, according to the movement trajectories of one or more moving objects in the video image, a disappearing direction pointed by a major moving direction of the moving objects. Thus, a disappearing direction and video camera gesture parameters can be determined accurately.