Dynamic Audio-Image Synchronization for Broadcast Terminals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing smart speakers fail to accurately synchronize images and audio in real-time, leading to a poor user experience due to pre-stored relationships between audio and image files, which are not dynamic enough to handle changing content during broadcasts.
Innovation Solution
A method and apparatus that divide play image data into groups based on content and send corresponding relationship information with audio data to a broadcast terminal, enabling synchronized playback by establishing a dynamic mapping between audio attributes and image groups, allowing for accurate synchronization of audio and image during playback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If pre-stored audio files and text files are used with pre-annotated corresponding relationships, then synchronization between played contents and displayed characters can be achieved, but accurate synchronization cannot be achieved during broadcast for real-time acquired characters and image information
Solution Approach 1:
The patent applies dynamics by making the correspondence relationship between audio and image data dynamic rather than static. The server generates and updates correspondence relationships in real-time during broadcast based on actual playback progress, allowing the system to adapt to changing content while maintaining synchronization accuracy. This resolves the contradiction by enabling the system to handle real-time acquired content dynamically while preserving reliable synchronization.
Solution Approach 2:
The patent applies preliminary action by pre-dividing image data into multiple groups and pre-establishing correspondence relationships with audio data attributes before broadcast. This preparation allows the terminal to quickly synchronize displayed content with played content in real-time without requiring complex processing during playback, thus achieving both high synchronization accuracy and real-time adaptability.
2Productivity
If image data is displayed in real-time during broadcast, then real-time content can be shown, but accurate synchronization with audio cannot be achieved
Solution Approach 1:
The patent applies segmentation by dividing image data into multiple groups corresponding to different segments of audio content. Each image group is associated with specific audio data attributes (such as time stamps or playback positions), allowing the terminal to display the appropriate image group at the correct moment during broadcast. This segmentation enables both real-time display capability and precise synchronization by matching displayed content with played content segment by segment.
Solution Approach 2:
The patent applies feedback by implementing a mechanism where the server monitors audio playback progress and sends corresponding image group identification information to the terminal in real-time. This feedback loop ensures that the displayed images are continuously synchronized with the played audio content, maintaining both real-time display capability and high synchronization precision during broadcast.
Data Source
AI summary
A method and apparatus for synchronously playing an image and an audio are provided. The method comprises: acquiring a play service request sent by a broadcast terminal; acquiring play image data and audio data corresponding to the play service request, the play image data being divided into a plurality of groups based on played content; and sending the play image data, the audio data, and information for determining a first corresponding relationship between each of the groups and an attribute of the audio data to the broadcast terminal, to enable the broadcast terminal to perform synchronization on the play image data and the audio data correspondingly to synchronously play the play image data and the audio data. Establishing the corresponding relationship between the audio data and the played content of each of the groups enables the broadcast terminal to accurately synchronize the played audio content and the displayed play image.