Display Control Apparatus Hierarchical Image Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image browsing technologies on mobile devices and terminals lack effective usability in searching and organizing images beyond time-based classification, especially with the advancement of image recognition techniques.

Innovation Solution

A display control apparatus and method that classifies and displays images into categories, groups, and subgroups based on 'import time', 'main photographic subject', 'event', 'favorite', and 'film location' using image recognition technologies, allowing users to easily switch between hierarchical display modes for efficient browsing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If images are classified and displayed using multiple categories (import time, main photographic subject, event, favorite, film location), then the usability of image browsing is improved, but the device complexity increases

Engineering Contradiction:
Improveusability of image browsingVSAvoidclassification system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the image classification system into multiple independent categories (import time, main photographic subject, event, favorite, film location), each handling a specific aspect of image organization. This segmentation allows the complex task of image classification to be divided into manageable, specialized modules that can be processed independently, improving usability without overwhelming the system with monolithic complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces multiple classification dimensions by adding categories beyond the traditional time-based sorting. By incorporating semantic dimensions (photographic subject, event, location) alongside temporal dimensions (import time), the system creates a multi-dimensional classification space that enables more flexible and intuitive image browsing, transforming a one-dimensional time axis into a multi-axis classification framework.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If image recognition techniques are used to classify images by photographic subject and event, then the search capability is improved, but the processing time and energy consumption increase

Engineering Contradiction:
Improveimage search capabilityVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent applies image recognition techniques to pre-process and classify images into categories (main photographic subject, event, film location) during the initial import or in background processing, rather than performing recognition analysis only when the user searches. This preliminary classification creates ready-to-use metadata that accelerates subsequent search operations, trading initial processing time for faster user-facing search performance.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces manual image classification (mechanical user effort) with automated image recognition technology. By using computational algorithms to automatically identify photographic subjects, events, and locations, the system substitutes human cognitive and manual work with automated processing, significantly improving search capability and productivity despite the computational resources required.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of information

If hierarchical display modes (category, group, subgroup) are implemented, then the organization of large image collections is improved, but the interface complexity increases

Engineering Contradiction:
Improveimage organization structureVSAvoidinterface structure
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the hierarchical display into distinct levels (category level, group level, subgroup level), where each level serves a specific organizational function. The category level provides high-level grouping (e.g., events or locations), the group level organizes images within categories (e.g., by time periods or themes), and the subgroup level presents individual images. This segmentation preserves the complete organizational structure while making each level manageable and intuitively understandable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a multi-level hierarchical structure that adds vertical dimensionality to the interface, organizing images across multiple nested levels rather than a single flat list. This hierarchical dimensioning allows efficient navigation through large image collections by providing progressive disclosure of content, where users can drill down from broad categories to specific images, preserving organizational information while maintaining interface clarity through structured progression.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentEP2983077B1Display control device, display control method, and display control program
Publication Date: 2021.04.28 SONY GROUP CORP
  • EP2983077B1 patent drawingFigure 1A~1B
  • EP2983077B1 patent drawingFigure 2
  • EP2983077B1 patent drawingFigure 3A~3B

AI summary

A display control apparatus includes a display control unit for controlling a display unit for displaying an image, the display control unit being configured to display a plurality of represented images that represent a plurality of image groups classified depending on related information of the images on the display unit in a first display mode, and display related images relating to the represented images between a plurality of the represented images displayed in the first display mode depending on a user input on the display unit in a second display mode.