Video Search Using Semantic Pattern Matching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video search technologies are limited by text-based search methods, which struggle to effectively find multimedia data, especially across different languages, and do not allow for efficient video search on Internet TV using remote controls.
Innovation Solution
A video search method and system that uses meta-data from query clips, including index tags and semantic patterns, to retrieve similar video clips from a database, allowing users to search for videos based on content rather than keywords, and enables the establishment of a video database with segmented and indexed video bitstreams.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If text-based keyword search is used to search video content, then the search system is simple to implement, but the search accuracy and effectiveness are insufficient due to language limitations and insufficient text content
Solution Approach 1:
The patent introduces meta-data as an intermediary between the video content and the search query. Instead of directly searching video content or relying on text keywords, the system uses meta-data (including index tags and semantic patterns) extracted from video clips as a mediator. This allows the search to be performed on structured representations of video content rather than raw video data or limited text keywords, thereby improving search accuracy while maintaining system simplicity.
Solution Approach 2:
The patent replaces the traditional text-based keyword matching mechanism with a semantic pattern matching mechanism. Instead of relying on text search algorithms, the system extracts semantic patterns from video content (such as object relationships, actions, and scene descriptions) and compares these patterns to query patterns. This substitution enables the system to understand video content semantically rather than just matching text strings, significantly improving search effectiveness across different languages.
2Measurement precision
If video content is used as search condition instead of keywords, then the search effectiveness is improved, but the device complexity increases due to meta-data processing requirements
Solution Approach 1:
The patent segments the video content into discrete clips and extracts meta-data from each clip independently. The video database is organized as a collection of video clips with associated meta-data, where each clip has its own index tags and semantic patterns. This segmentation allows the search system to process and compare individual clip characteristics rather than analyzing entire videos, reducing the computational complexity while maintaining high search effectiveness.
Solution Approach 2:
The patent performs preliminary extraction and organization of meta-data from video content during the database building phase. Index tags and semantic patterns are pre-computed and stored with each video clip before the actual search operation. This preliminary action means that during search operations, the system only needs to compare pre-extracted meta-data rather than analyzing video content in real-time, significantly reducing the complexity of the search process while maintaining high effectiveness.
3Loss of information
If traditional MPEG-7 content description structure is used, then the content description is comprehensive, but the file structure becomes complicated and requires re-arrangement of all multimedia files
Solution Approach 1:
The patent extracts only the essential meta-data elements (index tags and semantic patterns) from the comprehensive MPEG-7 content description framework. Instead of implementing the full MPEG-7 standard with its complex hierarchical structure, the system extracts and utilizes only the critical components needed for video search: index tags for content identification and semantic patterns for meaning representation. This extraction approach maintains content description completeness for search purposes while avoiding the file structure complexity of the full MPEG-7 standard.
Solution Approach 2:
The patent applies local quality by tailoring the meta-data structure specifically for video search functionality rather than implementing a universal content description standard. The meta-data includes index tags and semantic patterns that are locally optimized for search operations, rather than providing a comprehensive description suitable for all possible multimedia operations. This localized approach reduces file structure complexity while maintaining the necessary descriptive quality for video search.
4Ease of operation
If keyword search is used on Internet TV, then the implementation is straightforward, but the user experience is poor due to language barriers and insufficient text content in videos
Solution Approach 1:
The patent uses meta-data as an intermediary to bridge the gap between video content and user queries on Internet TV. Instead of relying on text keywords that may not be available or accurate, the system extracts semantic patterns from video content and uses these patterns as intermediaries for matching user queries. This allows users to search video content on Internet TV without being limited by text content availability or language barriers, as the semantic patterns capture the essential meaning of video content independently of text descriptions.
Data Source
AI summary
A video search method including following steps is provided. Meta-data of a query clip is received, wherein the meta-data includes an index tag and a semantic pattern. One or more candidate clips are retrieved from at least one video database according to the index tag. The semantic pattern is compared with a semantic pattern of each of the candidate clips, and each of the candidate clips is marked as a returnable video clip or a non-returnable video clip according to a comparison result. The candidate clips marked as the returnable video clip are served as a query result matching the query clip. A video search system and a method for establishing a video database are also provided.


