Video Search Using Semantic Pattern Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video search technologies are limited by text-based search methods, which struggle to effectively find multimedia data, especially across different languages, and do not allow for efficient video search on Internet TV using remote controls.

Innovation Solution

A video search method and system that uses meta-data from query clips, including index tags and semantic patterns, to retrieve similar video clips from a database, allowing users to search for videos based on content rather than keywords, and enables the establishment of a video database with segmented and indexed video bitstreams.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If text-based keyword search is used to search video content, then the search system is simple to implement, but the search accuracy and effectiveness are insufficient due to language limitations and insufficient text content

Engineering Contradiction:
Improvesimplicity of search systemVSAvoidsearch accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent introduces meta-data as an intermediary between the video content and the search query. Instead of directly searching video content or relying on text keywords, the system uses meta-data (including index tags and semantic patterns) extracted from video clips as a mediator. This allows the search to be performed on structured representations of video content rather than raw video data or limited text keywords, thereby improving search accuracy while maintaining system simplicity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the traditional text-based keyword matching mechanism with a semantic pattern matching mechanism. Instead of relying on text search algorithms, the system extracts semantic patterns from video content (such as object relationships, actions, and scene descriptions) and compares these patterns to query patterns. This substitution enables the system to understand video content semantically rather than just matching text strings, significantly improving search effectiveness across different languages.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If video content is used as search condition instead of keywords, then the search effectiveness is improved, but the device complexity increases due to meta-data processing requirements

Engineering Contradiction:
Improvesearch effectivenessVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the video content into discrete clips and extracts meta-data from each clip independently. The video database is organized as a collection of video clips with associated meta-data, where each clip has its own index tags and semantic patterns. This segmentation allows the search system to process and compare individual clip characteristics rather than analyzing entire videos, reducing the computational complexity while maintaining high search effectiveness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary extraction and organization of meta-data from video content during the database building phase. Index tags and semantic patterns are pre-computed and stored with each video clip before the actual search operation. This preliminary action means that during search operations, the system only needs to compare pre-extracted meta-data rather than analyzing video content in real-time, significantly reducing the complexity of the search process while maintaining high effectiveness.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If traditional MPEG-7 content description structure is used, then the content description is comprehensive, but the file structure becomes complicated and requires re-arrangement of all multimedia files

Engineering Contradiction:
Improvecontent description completenessVSAvoidfile structure complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent extracts only the essential meta-data elements (index tags and semantic patterns) from the comprehensive MPEG-7 content description framework. Instead of implementing the full MPEG-7 standard with its complex hierarchical structure, the system extracts and utilizes only the critical components needed for video search: index tags for content identification and semantic patterns for meaning representation. This extraction approach maintains content description completeness for search purposes while avoiding the file structure complexity of the full MPEG-7 standard.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies local quality by tailoring the meta-data structure specifically for video search functionality rather than implementing a universal content description standard. The meta-data includes index tags and semantic patterns that are locally optimized for search operations, rather than providing a comprehensive description suitable for all possible multimedia operations. This localized approach reduces file structure complexity while maintaining the necessary descriptive quality for video search.

Inventive Principle:
Principle #3Local quality

4Ease of operation

If keyword search is used on Internet TV, then the implementation is straightforward, but the user experience is poor due to language barriers and insufficient text content in videos

Engineering Contradiction:
Improveease of implementationVSAvoidvideo content information
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent uses meta-data as an intermediary to bridge the gap between video content and user queries on Internet TV. Instead of relying on text keywords that may not be available or accurate, the system extracts semantic patterns from video content and uses these patterns as intermediaries for matching user queries. This allows users to search video content on Internet TV without being limited by text content availability or language barriers, as the semantic patterns capture the essential meaning of video content independently of text descriptions.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS8515933B2Video search method, video search system, and method thereof for establishing video database
Publication Date: 2013.08.20 IND TECH RES INST
  • US8515933B2 patent drawing
  • US8515933B2 patent drawing
  • US8515933B2 patent drawing

AI summary

A video search method including following steps is provided. Meta-data of a query clip is received, wherein the meta-data includes an index tag and a semantic pattern. One or more candidate clips are retrieved from at least one video database according to the index tag. The semantic pattern is compared with a semantic pattern of each of the candidate clips, and each of the candidate clips is marked as a returnable video clip or a non-returnable video clip according to a comparison result. The candidate clips marked as the returnable video clip are served as a query result matching the query clip. A video search system and a method for establishing a video database are also provided.