Image Feature Extraction for Efficient Retrieval

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital still cameras and cellular phones with limited processing power struggle to efficiently analyze images, leading to inaccurate and time-consuming face detection, which limits their ability to retrieve specific images, especially in group photos, and increases power consumption.

Innovation Solution

An image processing system that includes an imaging device for capturing images and an image processing apparatus for extracting features, allowing for efficient transmission and retrieval of images by extracting and recording features such as face information, color representation, and similarity calculations, enabling faster and more accurate image retrieval.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If image analysis is performed on small CEs with limited processors, then the device can process images locally, but the analysis accuracy and thoroughness are insufficient

Engineering Contradiction:
ImproveLocal image processing capabilityVSAvoidImage analysis accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system divides image processing into two segments: feature extraction is performed on the small CE device using limited processing power, while similarity calculation and retrieval are performed on the server using powerful processing resources. This segmentation allows each component to operate within its capability constraints while achieving overall system accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A server acts as an intermediary between the small CE device and the image retrieval system. The server receives extracted features, performs complex similarity calculations, and returns retrieval results. This intermediary enables the small device to achieve accurate image analysis without requiring high processing power locally.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If face detection is performed with high definition, then detection accuracy improves, but processing time increases significantly

Engineering Contradiction:
ImproveFace detection accuracyVSAvoidProcessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system extracts only the essential features from the image (such as face characteristics, color distribution, and pattern information) and transmits only these extracted features to the server for similarity calculation. This extraction approach maintains detection accuracy while significantly reducing the amount of data that needs to be processed, thereby reducing overall processing time.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Feature extraction is performed preliminarily on the small CE device before the image is transmitted to the server. By completing the feature extraction step in advance on the local device, the server only needs to perform the similarity calculation on the compact feature data, which dramatically reduces the processing time required for high-accuracy face detection.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If image processing is performed on the imaging device, then retrieval function improves, but power consumption increases

Engineering Contradiction:
ImproveImage retrieval functionVSAvoidPower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The power-intensive tasks are segmented and distributed: the small CE device performs low-power feature extraction using its limited processor, while the server performs high-power similarity calculations using its powerful processing resources. This segmentation allows the imaging device to provide retrieval functionality without consuming excessive power, as the heavy computational burden is shifted to the server.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The server serves as an intermediary that handles the power-intensive similarity calculation and retrieval operations. By offloading these computationally demanding tasks to the server, the imaging device can provide advanced retrieval functions without requiring high processing power and associated power consumption on the portable device.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11281712B2System, apparatus, method, program and recording medium for processing image
Publication Date: 2022.03.22 SONY GROUP CORP
  • US11281712B2 patent drawing
  • US11281712B2 patent drawing
  • US11281712B2 patent drawing

AI summary

An image processing system may include an imaging device for capturing an image and an image processing apparatus for processing the image. The imaging device may include an imaging unit for capturing the image, a first recording unit for recording information relating to the image, the information being associated with the image, and a first transmission control unit for controlling transmission of the image to the image processing apparatus. The image processing apparatus may include a reception control unit for controlling reception of the image transmitted from the imaging device, a feature extracting unit for extracting a feature of the received image, a second recording unit for recording the feature, extracted from the image, the feature being associated with the image, and a second transmission control unit for controlling transmission of the feature to the imaging device.