Audio-Text Synchronization in E-Ink Readers with Muted Multimedia
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In the context of electronic information, the synchronization between audio and text is often disrupted by multimedia content, such as sponsored content or questionnaires, which can cause interference and break the continuity of the audio and text experience.
Innovation Solution
A method and apparatus for synchronizing audio and text, which involves determining whether a page updated on a presentation interface contains multimedia content, controlling the audio to continue playing if the content is in a mute state, and updating the page to display corresponding target text based on the audio's playing identification.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multimedia content is inserted into the novel for advertising or interaction purposes, then the commercial value and user engagement are improved, but the synchronization between audio and text is disrupted
Solution Approach 1:
The system performs preliminary detection to identify multimedia content in advance before it disrupts the audio-text synchronization. By detecting the multimedia content ahead of time, the system can prepare appropriate handling actions (such as pausing audio or adjusting text display) to maintain synchronization integrity while still allowing the multimedia content to be displayed for user engagement.
Solution Approach 2:
The system introduces an intermediary control mechanism that mediates between the multimedia content display and the audio-text synchronization. This intermediary layer monitors both the multimedia content state and the audio playback state, and automatically adjusts one or the other to maintain synchronization, allowing both functions to coexist without mutual disruption.
2Reliability
If the audio is paused when multimedia content is detected, then the synchronization is maintained, but the continuity of audio playback is broken
Solution Approach 1:
The system dynamically adjusts the audio playback state based on the detected multimedia content characteristics and user interaction state. Rather than a fixed pause action, the system can adaptively choose between pausing, continuing, or adjusting the audio playback to maintain synchronization while minimizing disruption to playback continuity, making the system flexible and context-aware.
3Reliability
If the page is updated to show target text immediately, then the text display is kept current, but the user experience is disrupted by frequent page transitions
Solution Approach 1:
Instead of immediately updating the entire page when multimedia content is detected, the system performs a partial update by only adjusting the specific text elements that need to be synchronized with the audio. This selective updating approach maintains text display accuracy while minimizing the disruption caused by full page transitions, thereby improving reading experience.
Data Source
AI summary
This disclosure relates to a method and apparatus for synchronizing audio and text, a readable medium, and an electronic device, and relates to the technical field of electronic information, the method including: in response to a first page displayed on a presentation interface being updated to a second page, determining whether the second page includes multimedia content, wherein audio corresponding to text in the first page is played while the first page is displayed; if the second page includes the multimedia content and the multimedia content is in a mute playing state, controlling the audio to be played continuously; determining a first playing identification of the audio when the playing of the multimedia content is stopped, and determining corresponding target text in accordance with the first playing identification; and updating the second page to a third page on the presentation interface, the third page including the target text.


