Audio-Content Synchronization in Touch Display Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Electronic devices struggle to correlate audio output with corresponding content from handwriting inputs, leading to limited display functionality and user experience.
Innovation Solution
The electronic device is equipped with a processor that executes applications, displays screens, acquires audio and handwriting inputs, and outputs audio while automatically scrolling to ensure that content related to the audio is displayed synchronously.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If audio input and handwriting input are performed independently without correlation, then the device can process multiple input types, but the display function becomes limited and user experience deteriorates
Solution Approach 1:
The patent merges audio input processing and handwriting input processing by establishing temporal and spatial correlation between them. The processor integrates both input streams to jointly control screen display operations, combining previously independent processing paths into a unified system that enhances both versatility and ease of operation.
2Productivity
If audio and content are displayed independently without correlation, then the device can output audio and display content simultaneously, but the user experience becomes limited
Solution Approach 1:
The patent implements feedback mechanisms where the displayed content provides visual feedback corresponding to the audio output, and the audio provides auditory feedback corresponding to the handwriting input. This bidirectional feedback loop creates a correlated display experience that enhances user experience while maintaining high output capability.
3Adaptability or versatility
If the device performs audio output and content display operations without correlation, then the device can execute multiple functions, but the display functionality remains limited
Solution Approach 1:
The patent introduces dynamic adjustment of screen display based on real-time audio playback state and handwriting input progression. The display operations adapt dynamically to the correlated audio-content timeline, allowing the system to execute multiple functions while providing enhanced display functionality through responsive, context-aware adjustments.
Data Source
AI summary
An electronic device includes: a speaker; a touch display; a processor operatively coupled to the speaker and the touch display. The processor is configured to execute an application; in response to the execution of the application, display a first screen corresponding to the application through the touch display; acquire an input to play back audio data of the application while the first screen is displayed; in response to the acquisition of the input, output audio corresponding to the audio data through the speaker; determine whether an object associated with the outputted audio exists; determine whether the object is displayed in the first screen based on the determination that the object associated with the outputted audio exists; and when the object is not displayed in the first screen, perform auto scroll so that the object is displayed through the first screen while the audio is output.