Vision Calibration Using Vanishing Point Orientation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video capture technologies face challenges in accurately determining the geographic location of objects within video frames, even when the location of the video capture device is known, due to uncertainty in angular orientation and resource-intensive calculations required for precise object location identification.

Innovation Solution

A computer-implemented method that determines the geographic locations of objects in video frames by receiving video data from a moving video capture device, calculating the angular orientation using determined lines and vanishing points, and correlating this information with the device's geographic location to pinpoint object locations within the frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If resource-intensive calculations are used to determine object locations, then measurement precision is improved, but use of energy and computational resources increases

Engineering Contradiction:
Improveobject location precisionVSAvoidcomputational energy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts and utilizes the vanishing point from the video frames as a key geometric feature. By identifying the vanishing point and using it to determine camera orientation, the system avoids resource-intensive full-scene calculations while achieving accurate object location determination.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs preliminary determination of camera angular orientation using vanishing point detection before proceeding to object location calculation. This preliminary action establishes a reference frame that simplifies subsequent location computations, reducing overall computational requirements.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If complex calculations are performed to identify object geographic locations, then measurement precision is improved, but productivity decreases

Engineering Contradiction:
Improveobject location accuracyVSAvoidobject identification speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent extracts the vanishing point as a distinctive geometric feature that encodes camera orientation information. This extraction approach allows rapid determination of spatial relationships without requiring complex calculations on all image elements, thereby maintaining both accuracy and speed.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the computational parameters from full-scene geometric analysis to vanishing point-based orientation estimation. This parameter change simplifies the calculation while preserving the essential information needed for accurate object location determination.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If angular orientation determination is skipped, then device complexity is reduced, but measurement precision of object locations deteriorates

Engineering Contradiction:
Improvecalculation complexityVSAvoidobject location accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces the vanishing point as an intermediary element that mediates between the video frames and the camera orientation. By calculating the vanishing point first and using it as a bridge, the system determines angular orientation with reduced computational complexity while maintaining measurement precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Ease of operation

If the vanishing point method is used to determine angular orientation, then ease of operation is improved, but device complexity increases due to additional processing steps

Engineering Contradiction:
Improveobject location determination easeVSAvoidimage processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent employs self-service by allowing the vanishing point to automatically encode the camera orientation information. The geometric properties of the vanishing point inherently contain the angular orientation data, eliminating the need for separate orientation sensing hardware or complex calibration procedures.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11282225B2Calibration for vision in navigation systems
Publication Date: 2022.03.22 MAPBOX INC
  • US11282225B2 patent drawing
  • US11282225B2 patent drawing
  • US11282225B2 patent drawing

AI summary

A computer-implemented method includes receiving a video comprising image frames depicting multiple objects. The video is captured by a video capture device moving relative to the surface of the Earth while the video is captured. A geographic location of the video capture device is received for each of the image frames and an angular orientation of the video capture device is determined based on the image frames. The determining the angular orientation includes determining a line in the image frames of the video for each object of a plurality of the multiple objects. The determined line corresponds to two-dimensional positions of the object in the image frames. The computer-implemented method includes determining a vanishing point of the image frames based on the determined lines and determining the angular orientation of the video capture device based on the determined vanishing point.