Display Control Device for Image Search with Representative Thumbnails

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulties in finding specific images from large collections due to the need for frequent changes in search display forms and the potential selection of unimpressive representative images, which are not helpful in the image search process.

Innovation Solution

A display control apparatus and method that extracts representative images based on user interaction and meta-information, such as date and time, to facilitate easy image retrieval by arranging and displaying thumbnail images in a user-friendly interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If representative images are extracted and displayed for image search, then the search efficiency is improved, but the accuracy of representing the entire image group deteriorates when the extracted representative image is meaningless or unimpressive to the user

Engineering Contradiction:
Improveimage search efficiencyVSAvoidrepresentative image accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs preliminary actions by extracting and displaying multiple candidate representative images (including first representative image from chronological order and second representative image from image recognition categories) before the user makes a selection. This allows the user to choose the most appropriate representative image from multiple options rather than being forced to accept a single potentially meaningless image.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adapts the representative image selection based on user interaction. When the user selects a different representative image from the displayed candidates, the system updates the representative image and accordingly updates the display of related images. This dynamic adjustment ensures the representative image accurately reflects user preferences and improves search accuracy over time.

Inventive Principle:
Principle #15Dynamics

2Reliability

If the search display form is changed frequently to find the intended image, then the search completeness is improved, but the time and effort required for searching increases

Engineering Contradiction:
Improvesearch completenessVSAvoidsearching time and effort
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system segments the image group into multiple categories based on image recognition results (e.g., people, landscapes, objects). By organizing images into these segments and displaying representative images from each category, the system allows users to quickly navigate to relevant categories without frequently changing the entire search display form, thus reducing searching time while maintaining search completeness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces representative images as intermediary elements between the user and the full image collection. Instead of requiring users to directly browse through all images or frequently change search parameters, the representative images serve as mediators that provide a summarized view of different image groups, enabling faster navigation and reducing the time and effort needed for comprehensive image searching.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If all images are displayed for user selection, then the search accuracy is improved, but the device complexity and user interface complexity increase

Engineering Contradiction:
Improveimage selection accuracyVSAvoiddisplay interface complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system extracts and displays only the most relevant representative images from the full image collection based on image recognition categories and user selection. Instead of displaying all images simultaneously, which would create interface complexity, the system extracts key representative images that capture the essence of different image groups, maintaining search accuracy while simplifying the user interface.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system adds a categorical dimension to image organization by displaying representative images grouped by recognition categories (e.g., people, landscapes, objects). This dimensional organization allows users to navigate and select images based on category rather than browsing through all images in a flat list, reducing interface complexity while maintaining or improving selection accuracy through structured presentation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentEP3644174B1Display control device, display control method, and display control program
Publication Date: 2024.12.25 SONY GROUP CORP
  • EP3644174B1 patent drawingFigure 1
  • EP3644174B1 patent drawingFigure 2
  • EP3644174B1 patent drawingFigure 3A~3C

AI summary

Provided is a display control apparatus including: a control unit that performs control of displaying a plurality of representative images extracted from a search target image group, and image group information that indicates presence of an image other than the representative images in the search target image group and is displayed in a form different from the representative images between a plurality of the representative images.