Digital Photo Pixel Positioning via 3D LIDAR Model

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital photos obtained from vehicles equipped with cameras and position-determining systems often lack sufficient position information, requiring additional maps or drawings for context, especially in complex environments like urban areas with high-rise buildings.

Innovation Solution

A method that incorporates a three-dimensional model generated using LIDAR technology, where each pixel in the digital photo includes position information, allowing for the determination of corresponding points in the model, and subsequent correction of position errors using reliability indicators and weighting factors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If digital photos are taken from moving vehicles with position-determining systems, then data collection speed is improved, but position information accuracy deteriorates due to motion blur and timing errors

Engineering Contradiction:
Improvedata collection speedVSAvoidposition information accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent performs preliminary actions by capturing multiple photos at different positions before final processing, and pre-calculates position information for each pixel using the three-dimensional model. This allows the system to maintain high vehicle speed while ensuring accurate position data is obtained through post-processing of previously captured images.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a three-dimensional model copy of the environment that serves as a reference framework. Instead of relying solely on direct position measurements from moving vehicles, the system uses this digital twin to accurately determine position information by matching photo content with the three-dimensional model, thereby compensating for motion-induced errors.

Inventive Principle:
Principle #26Copying

2Loss of information

If additional maps or drawings are used to supplement digital photos, then position information completeness is improved, but system complexity increases

Engineering Contradiction:
Improveposition information completenessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges the two-dimensional photo data with three-dimensional model data into a single integrated system. By embedding position information directly into photo pixels and correlating them with three-dimensional model points, the system eliminates the need for separate maps or drawings while maintaining complete position information.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent transitions from two-dimensional photo representation to three-dimensional spatial modeling. By adding the depth dimension through three-dimensional models, the system inherently provides complete position information (x, y, z coordinates) without requiring additional two-dimensional maps or drawings.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If a strict point-on-line criterion is used to match pixels with three-dimensional model points, then position precision is improved, but measurement reliability deteriorates due to angular errors

Engineering Contradiction:
Improveposition precisionVSAvoidmeasurement reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent changes the matching criterion from a strict point-on-line condition to a more flexible approach that considers the three-dimensional spatial relationship between pixels and model points. By using the three-dimensional model to calculate actual distances and positions, the system maintains precision while accommodating angular errors and measurement uncertainties.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the derivation of precise spatial information directly from digital photos, enhancing accuracy and reducing the need for additional maps, while allowing for high-speed data collection without motion blur, even in challenging environments.

Implementation Method 1

generating a three-dimensional model by means of a LIDAR device

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS10264239B2Method for producing a digital photo wherein at least some of the pixels comprise position information, and such a digital photo
Publication Date: 2019.04.16 CYCLOMEDIA TECHNOLGY
  • US10264239B2 patent drawing
  • US10264239B2 patent drawing
  • US10264239B2 patent drawing

AI summary

Method for producing a digital photo comprising pixels, wherein at least some of the pixels comprise position information, the method comprising of: taking a photo with a known geometry of the optical system with which the photo is taken; recording the position from which the photo has been taken; recording the direction in which the photo has been taken; providing a three-dimensional model comprising points which are comprised by at least an outer surface of an object in the field of view of the position where the photo has been taken, wherein the points comprise position information; relating a pixel on the one hand and a corresponding point in the three-dimensional model on the other; and recording, in a manner associated with the pixel, the position information of the corresponding pixel.