Streaming Media Audio Description Using Open Voice Gaps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing media streaming technologies fail to provide audible descriptions of attributes within video streams that are readily observable but not described by the foreground voice, limiting accessibility for users who cannot see the video.
Innovation Solution
A method and system that analyze multimedia streams to identify open time windows without foreground voice data, generate text strings describing the video content, convert them into synthesized voice segments, and integrate these segments into the audio stream within the time window, ensuring they do not overlap with foreground voice.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If synthesized voice segments are added to describe video content, then accessibility for sight-impaired users is improved, but audio stream complexity increases
Solution Approach 1:
The audio stream is segmented into multiple channels: foreground voice channel and background voice channel. The synthesized video descriptions are placed in the background voice channel, separating them from the primary audio content. This segmentation allows sight-impaired users to access video content through screen readers while maintaining the integrity and simplicity of the original audio stream for other users.
Solution Approach 2:
The patent introduces an intermediary processing system that generates synthesized voice segments from video content and inserts them into the audio stream at designated open time windows. This intermediary layer handles the complexity of video-to-audio conversion and timing synchronization, keeping the core media streaming system simple while enabling accessibility features.
2Ease of operation
If synthesized voice segments are inserted into the audio stream, then user interface engagement is improved, but processing requirements increase
Solution Approach 1:
The system performs preliminary analysis of the audio stream to identify open time windows before inserting synthesized voice segments. By pre-processing the audio stream to determine suitable insertion points, the system avoids complex real-time processing during playback and reduces the computational burden on the streaming infrastructure.
Solution Approach 2:
The patent implements dynamic adaptation of the audio stream by identifying open time windows based on the actual foreground voice content. The system dynamically adjusts the timing and placement of synthesized segments to match the variable structure of spoken content, enabling flexible engagement without requiring fixed, pre-determined insertion points.
3Loss of information
If open time windows are identified and synthesized segments are inserted, then information accessibility is improved, but time synchronization complexity increases
Solution Approach 1:
The patent replaces complex mechanical time-synchronization mechanisms with a data-driven approach using open time window identification. Instead of using precise timing mechanisms to synchronize video descriptions with visual content, the system identifies natural gaps in the audio stream and inserts synthesized segments there, simplifying the synchronization process while maintaining information accessibility.
Data Source
AI summary
Methods, computer program products, and systems are presented. The method computer program products, and systems can include, for instance: examining foreground voice data of a multimedia stream that includes a video stream data and an audio stream; identifying in dependence on the examining an open time window that is absent of foreground voice data; processing, in dependence on the identifying, media stream data of multimedia stream; generating, in dependence on the processing, a text string for deployment in the open time window, wherein the text string describes content of the video stream; converting the text string into a synthesized voice segment; and adapting the audio stream data so that the synthesized voice segment is included in the audio stream and time bounded within the open time window.