Multimedia Linking via Hub-Target Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current multimedia technologies fail to efficiently associate complex relationships between sign language and written language, such as multiple non-adjacent words with a single video sequence, and lack effective navigation and synchronization mechanisms, making it difficult to create and present instructional materials for deaf and hearing individuals.

Innovation Solution

A method that defines segments and nodes within multimedia content, using a hub-target structure to link and synchronize text, audio, and video media, assisted by automatic media analysis for segment boundary prediction, allowing for efficient association and navigation of multimedia content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If video tapes with associated books are used to provide instructional material, then the material can be provided in both visual and text formats, but the synchronization and association of words and phrases in the text to video sequences is difficult and labor-intensive

Engineering Contradiction:
Improveassociation capabilityVSAvoidsynchronization complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments both video content and text content into discrete units (video segments and text segments respectively). Each segment is assigned a unique identifier, allowing precise mapping between corresponding segments. This segmentation approach transforms the complex synchronization problem into a manageable task of matching identified segments, directly resolving the contradiction by enabling versatile association while maintaining simple synchronization through identifier matching.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary data structure (segment identification and association data) that mediates between video segments and text segments. This intermediary layer stores the mapping relationships without requiring complex real-time synchronization mechanisms, thus achieving versatile content association while keeping the synchronization system simple and manageable.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple non-adjacent words are associated with a single video sequence, then complex relationships between text and video can be represented, but current technologies do not support such relationships and lack navigation capability

Engineering Contradiction:
Improverelationship representationVSAvoidnavigation capability
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent creates a universal hub-target association model where a single video segment (hub) can be associated with multiple text segments (targets), and vice versa. This multi-functional association structure enables representation of complex relationships including one-to-many, many-to-one, and many-to-many mappings. The system also provides navigation capability through hyperlinked references that allow users to jump between associated segments, thus achieving both versatile relationship representation and ease of navigation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements a nested hierarchical structure where text segments can be nested within video segments and vice versa, with multiple levels of association. This nesting model allows complex relationships to be represented by embedding smaller association units within larger ones, enabling both sophisticated relationship representation and intuitive navigation through the nested hierarchy.

Inventive Principle:
Principle #7Nested doll (Nesting)

3Adaptability or versatility

If segment boundary indicators are not available from audio/video media itself, then the media can be processed flexibly, but the specification of segments becomes a slow and labor-intensive process

Engineering Contradiction:
Improveprocessing flexibilityVSAvoidsegment specification efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent enables the media processing system to automatically generate segment boundaries and identification data without requiring manual annotation. The system self-services by analyzing media content, detecting natural segment boundaries, and automatically creating the segment identification structures. This eliminates the labor-intensive manual specification process while maintaining processing flexibility, as the automatically generated segments can still be freely associated with text segments through the hub-target model.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS7827297B2Multimedia linking and synchronization method, presentation and editing apparatus
Publication Date: 2010.11.02 KRISTJANSSON TRAUSTI THOR
  • US7827297B2 patent drawing
  • US7827297B2 patent drawing
  • US7827297B2 patent drawing

AI summary

A method for associating segments within various media such as text, audio and video is described. A system for navigating and presenting such media is presented. Additionally, a system for defining the segment locations and the associations between them is presented. A method for assisting the user when specifying the segment boundaries is described, which employs the output from automatic media analysis.