Image Matching Apparatus Appearance Editing for Verification Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image matching systems require users to visually check composite images for matching results, which can be inefficient due to changes in appearance such as glasses, hair, or aging, as they only adjust orientation and size, not fully accounting for differences in appearance.

Innovation Solution

An information processing apparatus and method that acquires two-dimensional and three-dimensional images, generates composite images by editing the appearance of either or both images to match, including adjustments for hair, accessories, facial expressions, and aging, to enhance visual comparison efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If only orientation and size adjustments are performed when generating composite images, then the device complexity is low, but the check operation efficiency is insufficient due to appearance changes

Engineering Contradiction:
Improvecheck operation efficiencyVSAvoidimage processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system performs preliminary appearance editing on the captured image before composite image generation. By pre-adjusting appearance elements such as hair, accessories, and facial features, the system prepares the image in advance to match the registered image, thereby improving check operation efficiency without significantly increasing overall system complexity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediate appearance editing process between image acquisition and composite image generation. This intermediary step acts as a mediator that transforms the captured image appearance to better align with the registered image, resolving the contradiction by adding a controlled processing layer that improves efficiency while maintaining manageable complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If appearance editing is performed on both two-dimensional and three-dimensional images, then the matching accuracy is improved, but the processing time increases

Engineering Contradiction:
Improvematching accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system applies appearance editing selectively to specific local regions and elements of the images rather than uniformly processing the entire image. By focusing editing on critical appearance features that impact matching accuracy, the system improves matching precision while minimizing the overall processing time required

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically adjusts editing parameters and intensity based on the specific characteristics of the captured image and the registered image. By changing processing parameters adaptively, the system optimizes the balance between achieving sufficient matching accuracy and minimizing processing time for each individual case

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11398024B2Information processing apparatus, information processing method, and non-transitory storage medium
Publication Date: 2022.07.26 NEC CORP
  • US11398024B2 patent drawing
  • US11398024B2 patent drawing
  • US11398024B2 patent drawing

AI summary

An information processing apparatus according to the invention includes: an acquisition unit that acquires a two-dimensional image of a person and a three-dimensional registered image of a registrant; and a generation unit that, when superimposing the two-dimensional image and the three-dimensional registered image to generate a composite image, performs an editing process for changing an appearance of the person or the registrant for at least one of the two-dimensional image, the three-dimensional registered image, and the composite image.