Image Search Reducing Processing Load via Feature Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current information processing systems face challenges in efficiently reducing the processing load for similarity level calculations in image-based searches, particularly when dealing with stereoscopic images, leading to increased time consumption and reduced accuracy.

Innovation Solution

The system employs a combination of multiple imagers, a display controller, an index image selector, reducers, a calculator, and a candidate presenter to reduce the number of search targets based on object features, such as size and shape, and presents search results with high similarity levels, utilizing a stereoscopic display to enhance user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the number of search targets is reduced based on object features, then the processing load for similarity level calculations is reduced, but the accuracy of search results may be compromised

Engineering Contradiction:
Improveprocessing load reductionVSAvoidsearch accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent segments the search target set into multiple groups based on object features (size, shape, color). The first reducer divides search targets into size-based groups, and the second reducer further segments them by shape characteristics. This segmentation allows the system to process only relevant groups for similarity calculation, reducing overall processing load while maintaining search accuracy through feature-based filtering.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies preliminary action by performing feature-based filtering before similarity level calculations. The index image selector and reducers pre-process the search targets by matching object features (size, shape, color) against the imaged object, narrowing down the candidate set beforehand. This preliminary filtering ensures that only highly relevant targets undergo computationally intensive similarity calculations.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If multiple imagers are used to capture stereoscopic images, then the quality and depth information of the imaged object is improved, but the processing time and computational complexity increase

Engineering Contradiction:
Improvedepth information accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts only the essential depth information from the multiple imagers without processing all image data in full detail. The system uses the parallax information from the plurality of imagers to determine size and shape features, then extracts only the necessary depth characteristics for search target filtering, avoiding unnecessary processing of complete stereoscopic image pairs.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary processing of stereoscopic images to extract size and shape features before the main search operation. By pre-processing the depth information from multiple imagers to establish object characteristics, the system reduces the computational burden during the actual search and similarity calculation phases.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If the number of search targets is significantly reduced, then the similarity level calculation becomes faster, but the risk of eliminating potential matches increases

Engineering Contradiction:
Improvecalculation speedVSAvoidmatch completeness
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies local quality by using different filtering strategies for different regions of the search space. The first reducer applies size-based filtering with broader criteria to maintain match completeness, while the second reducer applies more stringent shape-based filtering only to the already-narrowed candidate set. This graduated approach ensures that potential matches are not eliminated by overly aggressive early filtering.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system performs partial filtering by applying feature-based reduction only to the extent necessary to achieve acceptable processing speeds. The reducers are configured to maintain a sufficient number of candidate targets, ensuring that while calculation speed improves, the candidate set remains large enough to include all potential matches for the final similarity evaluation.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS8600971B2Information processing apparatus, storage medium, information processing method and information processing system for examining an object on an imaged image
Publication Date: 2013.12.03 NINTENDO CO LTD
  • US8600971B2 patent drawing
  • US8600971B2 patent drawing
  • US8600971B2 patent drawing

AI summary

An example of a game apparatus includes a CPU. The CPU activates two outward cameras to allow a user to image, for example, a flower. The CPU filters data for search included in a database. The CPU obtains color information, shape information and a size of the imaged flower. A shape category is obtained, and with the shape category, data for search included in a database for search is further filtered. Then, by comparing the color information, the shape information, and the size of the imaged flower with the data for search to be used, a score of a degree of approximation of the color information and scores of the degree of matching of the shape information and size, etc. are obtained. Then, images of flowers as candidates are presented in the descending order of the score (similarity level).