Cross-Device Audio Reading With Synchronized Visual Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio reading technologies struggle with poor user experience due to the need for users to manually operate terminals to view non-text information, such as pictures or formulas, during audio playback, as these cannot be converted into speech.
Innovation Solution
A method where a first terminal device processes text and non-text information, sending non-text information to a second terminal device for display when speech information is played, allowing seamless viewing of non-text content without additional user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If text information is converted to speech information for audio reading, then users can obtain information during activities like driving or walking, but non-text information cannot be converted to speech and requires manual terminal operations to view
Solution Approach 1:
The patent introduces a second terminal device as an intermediary to display non-text information while the first terminal device performs audio reading. This mediator handles the display function, allowing the user to view non-text information (images, formulas, charts) without interrupting the audio playback or performing manual operations on the audio-playing device.
Solution Approach 2:
The patent segments the information presentation function into two parts: the first terminal device handles speech playback for text information, while the second terminal device handles visual display for non-text information. This segmentation allows each device to specialize in its strength, eliminating the need for users to manually switch between functions on a single device.
2Loss of information
If users manually operate the terminal device to view non-text information during audio playback, then they can access pictures and formulas, but the user experience deteriorates due to frequent interruptions
Solution Approach 1:
The system performs preliminary actions by automatically detecting when non-text information needs to be displayed and proactively sending it to the second terminal device before the user would need to request it. This eliminates the need for manual operations, as the display is prepared and available in advance.
Solution Approach 2:
The system implements self-service by automatically matching text information with corresponding non-text information and handling the display transmission without user intervention. The terminal devices autonomously coordinate to provide both audio and visual information streams, serving the user's information needs without requiring manual terminal operations.
3Device complexity
If all information is presented through speech, then audio reading is simple to implement, but non-text information loses its visual context and detail
Solution Approach 1:
The patent adds a visual dimension to the audio reading experience by introducing a second terminal device for display. Text information continues to be processed through speech in the audio dimension, while non-text information is simultaneously presented in the visual dimension, creating a multi-dimensional information presentation system that preserves both simplicity and information quality.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
This application provides an information processing method, a terminal device, and a distributed network. After determining target information including at least one piece of text information and at least one piece of non-text information, a first terminal device may determine, based on a preset playing speed and a first preset time, a first location respectively associated with each piece of non-text information. Next, TTS is sequentially performed on the at least one piece of text information, to obtain and sequentially play speech information respectively corresponding to the at least one piece of text information. When speech information corresponding to first text information is played, target non-text information is sent to a second terminal device, so that the second terminal device displays the target non-text information. The at least one piece of text information includes the first text information. An arrangement location of the first text information in the target information includes a second location. The second location is a first location associated with any piece of non-text information. The target non-text information is non-text information associated with the second location.