Nonlinear Image Correction for Continuous Scene Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for displaying image data and locating points of interest in images, particularly in surveying applications, face challenges in accurately reproducing real-world scenes and efficiently identifying points of interest across multiple images captured from different locations.

Innovation Solution

The method involves displaying image data from multiple locations on a monitor with nonlinear corrections based on the imaging device's location relative to the perspective center, allowing for a continuous and accurate representation of the scene, and using techniques like inverse transformations and slidable indicators to precisely locate points of interest.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If multiple images from different locations are displayed without nonlinear correction, then the display process is simple, but the displayed image does not accurately resemble the real-world scene

Engineering Contradiction:
Improveaccuracy of scene reproductionVSAvoidcomplexity of display processing
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies nonlinear corrections by transforming image parameters (pixel coordinates) based on the imaging device's location relative to the perspective center. This changes the display parameters to accurately reproduce the real-world scene geometry, resolving the contradiction between accuracy and complexity by introducing a mathematical transformation rather than physical complexity.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If traditional methods are used to locate points of interest across multiple images, then the process is straightforward, but the efficiency and precision of identification are low

Engineering Contradiction:
Improveefficiency of point identificationVSAvoidprecision of point location
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent creates a corrected copy of the original image data that accurately represents the real-world scene geometry. By working with this corrected copy rather than the raw images, the system enables efficient and precise point identification while maintaining accuracy, as points can be located in the corrected image and then mapped back to corresponding locations in the original images.

Inventive Principle:
Principle #26Copying

3Stability of the object's composition

If images are displayed from different perspective centers, then each image maintains its original characteristics, but the continuous view of the scene is disrupted

Engineering Contradiction:
Improvecontinuity of scene displayVSAvoiddistortion of image data
Core Design Contradiction:
Stability of the object's compositionVSLoss of information

Solution Approach 1:

The patent segments the scene into multiple image portions captured from different locations, then applies individual nonlinear corrections to each portion based on its specific imaging device location. This segmentation approach allows each image to be processed independently to maintain its characteristics while ensuring that when combined, they form a continuous and accurate scene representation.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP2838420B1Image display improvements
Publication Date: 2019.12.18 TRIMBLE INC
  • EP2838420B1 patent drawingFigure 1A
  • EP2838420B1 patent drawingFigure 1B
  • EP2838420B1 patent drawingFigure 2A~2B

AI summary

A method for displaying arrays of digital image data on a display monitor as a continuous image includes determining nonlinear corrections for each of the arrays of digital image data. Each nonlinear correction may be based in part on a location of the imaging device used to capture the array of digital image data relative to a location of the perspective center from which the array of digital image data will be displayed on the display monitor. The method also includes transforming each array of digital image data using the corresponding nonlinear correction. The method also includes displaying the arrays of corrected image data on the display monitor to produce a continuous display of the scene captured by the imaging device, where relative sizes and positions of objects in the scene are substantially reproduced in the display of the scene.