Image Transform Selection via Structural Content Characterization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems face challenges in accurately aligning images due to insufficient structural content, leading to poor accuracy and failure in image processing tasks, particularly in scenarios with limited structural information.

Innovation Solution

An electronic device equipped with a processor that characterizes the structural content of images by determining relevant metrics and selects an appropriate transform from a set of transforms based on these characterizations to align images, ensuring optimal transform performance by matching the degree of freedom in the data with the dimensionality of the transform.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a high-dimensional transform is applied to images with insufficient structural content, then the transform may fail catastrophically, but using a lower-dimensional transform reduces alignment accuracy

Engineering Contradiction:
Improvetransform reliabilityVSAvoidimage alignment accuracy
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The system dynamically adapts the transform dimensionality based on the measured structural content of the input images. By calculating metrics such as the number of detectable features, texture complexity, and edge density, the system selects the appropriate transform dimension (e.g., 2D, 3D, or 4D) to match the available structural information, preventing catastrophic failures while maintaining optimal alignment accuracy

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the transform parameters (dimensionality and complexity) based on the characterized structural content of the images. When structural content is sufficient, higher-dimensional transforms with more parameters are applied for improved accuracy; when structural content is limited, lower-dimensional transforms with fewer parameters are used to ensure reliability

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If image processing complexity is increased to improve alignment accuracy, then processing time and energy consumption increase

Engineering Contradiction:
Improveimage alignment accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary characterization of the image structural content before applying the transform. By pre-calculating metrics such as feature density, texture complexity, and structural richness, the system determines the appropriate transform complexity in advance, avoiding unnecessary computational overhead from overly complex transforms when simple transforms suffice

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system applies only the necessary level of transform complexity required for the given image content. Rather than always applying the most complex transform available, the system uses partial action by selecting transform dimensionality that matches the structural content, thereby reducing processing time and energy consumption while maintaining sufficient alignment accuracy

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10157439B2Systems and methods for selecting an image transform
Publication Date: 2018.12.18 QUALCOMM INC
  • US10157439B2 patent drawing
  • US10157439B2 patent drawing
  • US10157439B2 patent drawing

AI summary

An electronic device for selecting a transform is described. The electronic device includes at least one image sensor, a memory, and a processor coupled to the memory and to the at least one image sensor. The processor is configured to obtain at least two images from the at least one image sensor. The processor is also configured to characterize structural content of each of the at least two images to produce a characterization for each image that is relevant to transform performance. The processor is further configured to select at least one transform from a set of transforms based on the characterization. The processor is additionally configured to apply the at least one transform to at least one of the images to substantially align the at least two images.