Multimedia Linking via Hub-Target Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multimedia technologies fail to efficiently associate complex relationships between sign language and written language, such as multiple non-adjacent words with a single video sequence, and lack effective navigation and synchronization mechanisms, making it difficult to create and present instructional materials for deaf and hearing individuals.
Innovation Solution
A method that defines segments and nodes within multimedia content, using a hub-target structure to link and synchronize text, audio, and video media, assisted by automatic media analysis for segment boundary prediction, allowing for efficient association and navigation of multimedia content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video tapes with associated books are used to provide instructional material, then the material can be provided in both visual and text formats, but the synchronization and association of words and phrases in the text to video sequences is difficult and labor-intensive
Solution Approach 1:
The patent segments both video content and text content into discrete units (video segments and text segments respectively). Each segment is assigned a unique identifier, allowing precise mapping between corresponding segments. This segmentation approach transforms the complex synchronization problem into a manageable task of matching identified segments, directly resolving the contradiction by enabling versatile association while maintaining simple synchronization through identifier matching.
Solution Approach 2:
The patent introduces an intermediary data structure (segment identification and association data) that mediates between video segments and text segments. This intermediary layer stores the mapping relationships without requiring complex real-time synchronization mechanisms, thus achieving versatile content association while keeping the synchronization system simple and manageable.
2Adaptability or versatility
If multiple non-adjacent words are associated with a single video sequence, then complex relationships between text and video can be represented, but current technologies do not support such relationships and lack navigation capability
Solution Approach 1:
The patent creates a universal hub-target association model where a single video segment (hub) can be associated with multiple text segments (targets), and vice versa. This multi-functional association structure enables representation of complex relationships including one-to-many, many-to-one, and many-to-many mappings. The system also provides navigation capability through hyperlinked references that allow users to jump between associated segments, thus achieving both versatile relationship representation and ease of navigation.
Solution Approach 2:
The patent implements a nested hierarchical structure where text segments can be nested within video segments and vice versa, with multiple levels of association. This nesting model allows complex relationships to be represented by embedding smaller association units within larger ones, enabling both sophisticated relationship representation and intuitive navigation through the nested hierarchy.
3Adaptability or versatility
If segment boundary indicators are not available from audio/video media itself, then the media can be processed flexibly, but the specification of segments becomes a slow and labor-intensive process
Solution Approach 1:
The patent enables the media processing system to automatically generate segment boundaries and identification data without requiring manual annotation. The system self-services by analyzing media content, detecting natural segment boundaries, and automatically creating the segment identification structures. This eliminates the labor-intensive manual specification process while maintaining processing flexibility, as the automatically generated segments can still be freely associated with text segments through the hub-target model.
Data Source
AI summary
A method for associating segments within various media such as text, audio and video is described. A system for navigating and presenting such media is presented. Additionally, a system for defining the segment locations and the associations between them is presented. A method for assisting the user when specifying the segment boundaries is described, which employs the output from automatic media analysis.


