Multimedia Transcript Linking for Fast Video Frame Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multimedia data stream and text information are independent, leading to inefficient searching for corresponding video frames and poor user experience.
Innovation Solution
Establish a position correspondence between display text generated from a multimedia data stream and the stream itself, allowing synchronized presentation and interaction between the two.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If multimedia data stream and text information are kept independent, then the system structure is simple, but the user experience is poor and search efficiency is low
Solution Approach 1:
The patent merges the multimedia data stream and text information into a unified system by establishing position correspondence relationships between them. The text information is no longer independent but is linked to specific positions in the multimedia stream, allowing users to search text and directly locate corresponding video frames, thereby improving user experience while maintaining manageable system complexity through structured integration.
2Productivity
If text information is independently displayed without position linkage, then the display system is simple, but the search efficiency for corresponding video frames is low
Solution Approach 1:
The patent applies preliminary action by pre-establishing position correspondence relationships between text information and multimedia data stream positions during the data processing stage. This allows users to perform efficient searches without needing to manually scan through the entire multimedia stream, as the positional links are already in place to enable direct navigation to relevant video frames.
3Ease of operation
If position correspondence is established between display text and multimedia data stream, then the reading convenience is improved, but the system complexity increases
Solution Approach 1:
The patent implements a universal position correspondence mechanism that serves multiple functions: it enables reading convenience by allowing users to easily locate multimedia content through text, supports efficient searching, and provides a structured framework for managing the relationship between text and multimedia data. This multi-functional approach justifies the system complexity by delivering comprehensive benefits across multiple operational dimensions.
Data Source
AI summary
Disclosed are an interactive information processing method, an electronic device and a storage medium. The method includes establishing a correspondence between a multimedia data stream and a display text generated based on the multimedia data stream; presenting the multimedia data stream and the display text based on the correspondence; and in response to detecting a triggering operation triggering a display content in the display text, adjusting, based on a timestamp corresponding to the display content and the correspondence, the multimedia data stream to navigate to a playback position corresponding to the display content; the display content comprises a text corresponding to speech in the multimedia data stream; and the display text and the multimedia data stream are displayed on different display areas of a page respectively, and a display area occupied by the display text is not superimposed on a display area occupied by the multimedia data stream.