Perspective Distortion Correction for Optical Pattern Decoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for decoding optical patterns, such as barcodes, on mobile devices are limited by processing power and accuracy, especially in environments with multiple patterns, varying orientations, and uneven lighting, which increases computational demands and latency.

Innovation Solution

The use of depth data from laser-ranging systems, combined with image data, for semantic image segmentation and perspective distortion correction, enables efficient detection and decoding of optical patterns by segmenting images into foreground and background regions and correcting for perspective distortions, thereby reducing computational resources and improving accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If image analysis is used to decode barcodes on mobile devices, then decoding capability is provided, but processing power requirements increase and accuracy decreases in complex environments

Engineering Contradiction:
Improvedecoding capabilityVSAvoidprocessing power requirements
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the image processing task by using depth data to identify and isolate the barcode region from the rest of the image. This segmentation allows the system to focus computational resources only on the relevant barcode area rather than analyzing the entire image, thereby reducing processing power requirements while maintaining decoding capability in complex environments

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If traditional image analysis methods are used without depth data, then device complexity is lower, but accuracy decreases in environments with multiple patterns, varying orientations, and uneven lighting

Engineering Contradiction:
Improvedetection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces depth data as an intermediary element that mediates between the camera image and the barcode detection process. This depth information acts as an additional dimension that helps distinguish the barcode from other patterns and elements in the scene, improving detection accuracy in complex environments without requiring complex image processing algorithms

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If semantic image segmentation using depth data is implemented, then detection accuracy improves in complex environments, but computational demands and latency increase

Engineering Contradiction:
Improvedetection accuracyVSAvoidprocessing latency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary action by using depth data to pre-identify and segment the barcode region before applying detailed image analysis. This preliminary segmentation based on depth information reduces the amount of data that requires intensive processing, thereby maintaining high detection accuracy while reducing overall processing latency

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the speed and accuracy of optical pattern detection and decoding on mobile devices, reducing latency and improving performance in complex environments by focusing processing on regions of interest and correcting for distortions, allowing for quicker scanning of multiple patterns.

Implementation Method 1

receive a depth map of the real scene, wherein data for the depth map is acquired by the laser-ranging system

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS11810304B1Perspective distortion correction of discrete optical patterns in images using depth sensing
Publication Date: 2023.11.07 SCANDIT AG
  • US11810304B1 patent drawing
  • US11810304B1 patent drawing
  • US11810304B1 patent drawing

AI summary

Depth information from a depth sensor, such as a LiDAR system, is used to correct perspective distortion for decoding an optical pattern in a first image acquired by a camera. Image data from the first image is spatially correlated with the depth information. The depth information is used to identify a surface in the scene and to distort the first image to generate a second image, such that the surface in the second image is parallel to an image plane of the second image. The second image is then analyzed to decode an optical pattern on the surface identified in the scene.