Multimedia Annotation Texts for Efficient Segment Search

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for searching multimedia data, such as video or audio recordings, are inefficient, requiring traversal of large datasets to find specific segments, which is unacceptable in time-sensitive field applications like technical engineering.

Innovation Solution

A method and system for processing multimedia data by generating annotation texts that include metadata like start and stop times, importance, security levels, and keywords, which are associated with corresponding partitions, enabling efficient searching and filtering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If general searching methods (traversing all video or audio contents) are used, then comprehensive search coverage is achieved, but searching efficiency deteriorates

Engineering Contradiction:
Improvesearch coverageVSAvoidsearching efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies preliminary action by generating annotation texts and extracting keywords from multimedia data in advance, before the actual search operation. This preprocessing creates an indexed structure that enables rapid retrieval without traversing the entire data set, thus resolving the contradiction between comprehensive search coverage and searching efficiency

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces annotation texts as an intermediary layer between the raw multimedia data and the search query. These annotation texts contain extracted keywords that serve as mediators, allowing the search system to locate relevant segments without directly examining the entire multimedia content, thereby improving efficiency while maintaining reliability

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If annotation texts with metadata are generated and associated with multimedia partitions, then searching efficiency is improved, but device complexity increases

Engineering Contradiction:
Improvesearching efficiencyVSAvoiddata structure complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing multimedia data into distinct partitions and generating separate annotation texts for each partition. This segmentation organizes the data into manageable units with associated metadata, making the overall system more tractable despite the increased structure, while enabling efficient targeted searches without processing the entire data set

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10691879B2Smart multimedia processing
Publication Date: 2020.06.23 EMC IP HLDG CO LLC
  • US10691879B2 patent drawing
  • US10691879B2 patent drawing
  • US10691879B2 patent drawing

AI summary

Embodiments of the present disclosure intend to provide a method and system for processing multimedia data. According to one aspect of the present disclosure, there is provided a method for processing multimedia data, comprising: generating an annotation text; and associating the annotation text with a corresponding partition in the multimedia data. By using the processing method and system according to the embodiments of the present disclosure, for example, multimedia data searching efficiency may be effectively enhanced.