Image Processing Device for Cross-Modality Similarity Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods struggle to accurately determine similarity between images of different modalities, such as visible and far-infrared images, due to disparities in pixel value ranges, leading to ineffective similarity indicators like absolute sum of pixel values.

Innovation Solution

An image processing device and method that deform images in multiple ways, calculate differences using various similarity evaluation methods, normalize these differences, and integrate them to assess similarity accurately across different image types.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple similarity evaluation methods are used to improve accuracy across different image types, then measurement precision improves, but device complexity increases

Engineering Contradiction:
Improvesimilarity detection accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the similarity evaluation process into multiple independent evaluation methods (e.g., absolute difference, correlation coefficient, mutual information), each handling specific image type combinations. This allows the system to select appropriate evaluation methods based on image modality pairs, improving accuracy without requiring all methods to run simultaneously, thus managing complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal similarity evaluation framework that can handle multiple image type combinations (visible-visible, visible-far-infrared, far-infrared-far-infrared) using a set of standardized evaluation methods. This multi-functional approach allows the same system to adapt to different image pairs without requiring separate processing pipelines, improving versatility while maintaining manageable complexity through standardized interfaces.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Productivity

If absolute sum of pixel values is used for similarity evaluation, then processing speed improves, but measurement precision deteriorates when comparing images of different modalities

Engineering Contradiction:
Improveprocessing speedVSAvoidsimilarity detection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent changes the evaluation parameter from absolute pixel value sum to normalized metrics such as correlation coefficient and mutual information. These parameters are scale-invariant and can handle different value ranges of visible and far-infrared images. The system calculates these normalized parameters instead of raw pixel differences, improving accuracy for cross-modality comparison while maintaining computational efficiency through optimized algorithms.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces normalized similarity metrics as intermediary measures between raw pixel values and final similarity assessment. These intermediary metrics (correlation coefficient, mutual information) bridge the gap between different image modalities by transforming raw pixel data into comparable standardized scores, enabling accurate cross-modality comparison without directly comparing incompatible pixel value ranges.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11475233B2Image processing device and image processing method
Publication Date: 2022.10.18 NEC CORP
  • US11475233B2 patent drawing
  • US11475233B2 patent drawing
  • US11475233B2 patent drawing

AI summary

In order to ensure that similarity is detected with high accuracy, regardless of the types of images constituting a group of images to be evaluated for similarity, the image processing device includes difference calculation means 11 for deforming one of two or more images constituting an image group in one or more deforming ways, and calculating a degree of difference between the deformed image and the other image or images in the image group for each pixel using multiple ways for similarity evaluation, normalization means 12 for normalizing each degree of difference by each of the multiple ways for similarity evaluation, and difference integration means 15 for integrating normalized degrees of difference.