Hierarchical Summary Data for Moving Image Search

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in efficiently searching and managing large quantities of moving image contents due to the difficulty in isolating specific contents amidst numerous similar images, leading to increased time and effort as the amount of content grows.

Innovation Solution

An image processing apparatus and method that generates first and second layer summary data from images within moving image contents at different frequencies, allowing for efficient searching and management by utilizing these summary data to search and compress the contents.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If metadata comparison is used to search moving image contents, then search capability is provided, but search efficiency deteriorates when numerous similar images exist

Engineering Contradiction:
Improvesearch capabilityVSAvoidsearch time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent segments the search process into two distinct layers: first layer summary data for coarse-grained filtering and second layer summary data for fine-grained matching. This segmentation allows the system to quickly eliminate unrelated contents using the first layer, then apply the more computationally intensive second layer only to relevant candidates, thereby resolving the contradiction between providing comprehensive search capability and maintaining search efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a hierarchical dimension to the search process by creating multiple layers of summary data with different levels of detail. The first layer provides a coarse overview for rapid filtering, while the second layer provides detailed information for precise matching. This dimensional approach transforms a single-layer exhaustive search into a multi-layer progressive search, significantly improving efficiency when dealing with numerous similar images.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If representative moving image is used for search, then search is simplified, but ability to isolate specific content deteriorates when content quantity grows

Engineering Contradiction:
Improvesearch simplicityVSAvoidcontent isolation accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent segments the representation of moving image contents into two hierarchical levels: first layer summary data capturing coarse characteristics for broad categorization, and second layer summary data capturing fine characteristics for precise identification. This segmentation enables the system to maintain search simplicity through hierarchical filtering while improving content isolation accuracy by using progressively more detailed representations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a hierarchical dimension to content representation by creating multiple layers of summary data. The first layer provides a simplified view for initial filtering, while the second layer provides a detailed view for precise matching. This dimensional approach allows the system to balance search simplicity with content isolation accuracy, as users can perform searches at different levels of granularity depending on their needs.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If all moving image contents are managed, then comprehensive management is achieved, but management efficiency deteriorates with increasing content volume

Engineering Contradiction:
Improvecomprehensive managementVSAvoidmanagement efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments the management of moving image contents into two hierarchical layers: first layer summary data for comprehensive but coarse management, and second layer summary data for detailed but selective management. This segmentation allows the system to maintain comprehensive management coverage while improving efficiency by enabling rapid filtering at the first layer before applying more resource-intensive processing at the second layer.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a hierarchical dimension to content management by creating multiple layers of summary data with different levels of detail and processing requirements. This dimensional approach transforms flat, exhaustive management into a multi-level hierarchical management system, where contents are managed comprehensively at the first layer and selectively at the second layer, thereby improving overall management efficiency while maintaining reliability.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS8891019B2Image processing apparatus, image processing method, and program
Publication Date: 2014.11.18 SONY GROUP CORP
  • US8891019B2 patent drawing
  • US8891019B2 patent drawing
  • US8891019B2 patent drawing

AI summary

An image processing apparatus includes: a first layer summary data generation section; a second layer summary data generation section; a first search section; and a second search section.