Image Rectification for Inventory Perspective Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional machine vision systems for inventory management face inefficiencies when recognizing items at oblique angles due to foreshortening effects, requiring resource-intensive processing to account for different scales and distortions, which increases processor time and memory usage.

Innovation Solution

The system generates rectified image data by applying perspective transformation to acquired images, simulating a view from directly overhead, allowing items of the same height and type to appear at a consistent scale, thereby reducing the need for extensive scale iterations in subsequent processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional machine vision systems process images at oblique angles, then item recognition is possible, but processing resources and time increase significantly due to foreshortening effects and scale variations

Engineering Contradiction:
Improveitem recognition accuracyVSAvoidprocessing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary rectification of oblique images to a top-down perspective before item recognition. By transforming the image viewpoint in advance using perspective transformation algorithms, the system eliminates foreshortening effects and scale variations, allowing subsequent recognition processes to operate on standardized views, thereby improving both accuracy and efficiency

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the perspective parameter of the image from an oblique angle to a top-down view. This parameter transformation standardizes the appearance of items by eliminating depth-related distortions, ensuring that all items are viewed from a consistent angle and scale, which directly addresses the measurement precision and productivity contradiction

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If traditional systems account for different scales and distortions through extensive processing, then recognition accuracy is maintained, but processor time and memory usage increase

Engineering Contradiction:
Improverecognition accuracyVSAvoidprocessor resource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system applies perspective transformation to convert oblique images to top-down views before recognition. This preliminary action standardizes the image geometry, eliminating the need for subsequent complex scale and distortion corrections, thereby reducing processor resource consumption while maintaining recognition accuracy

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system extracts and corrects only the essential perspective distortion through a single transformation step, rather than performing multiple iterative corrections for scale and distortion. By taking out the core geometric transformation need, the system reduces computational overhead while achieving the necessary recognition precision

Inventive Principle:
Principle #2Taking out (Extraction)

3Device complexity

If oblique angle images are processed without rectification, then processing is simpler, but items of the same type appear at different scales making recognition difficult

Engineering Contradiction:
Improveprocessing complexityVSAvoiditem scale consistency
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system changes the perspective parameter from oblique to top-down view, which standardizes the apparent scale of items. This single parameter transformation resolves the scale inconsistency problem caused by oblique angles, making items of the same type appear at consistent scales without requiring complex multi-step processing

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10909667B1Image rectification using transformation data
Publication Date: 2021.02.02 AMAZON TECH INC
  • US10909667B1 patent drawing
  • US10909667B1 patent drawing
  • US10909667B1 patent drawing

AI summary

Image data representative of an inventory location may be acquired by cameras. Described are techniques to process such image data to remove one or more perspective effects. For example, transformation data that corresponds to the inventory location may first be determined. Such transformation data is determined based on associations between points in a common plane and alternate points in a virtual camera plane. Transformed image data may then be generated by applying the transformation data to the image data that is representative of the inventory location.