Wireless Streaming Sync Control for Input Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Latency issues occur during synchronization of audio and video data in multimedia streaming between electronic devices, leading to input lag and degraded user experience due to the need for external display devices to wait for corresponding time-stamped data, causing delays in output.
Innovation Solution
An electronic device with a wireless communication circuit and processor that connects to an external device, transmits audio and video data, and controls synchronization by determining if an input is sensed, sending a signal to stop synchronization between audio and video data if an input is detected, thereby reducing end-to-end latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the external display device waits for corresponding time-stamped video data before outputting audio data, then audio-video synchronization is improved, but input latency increases
Solution Approach 1:
The patent applies dynamics by making the synchronization behavior adaptive rather than static. The external display device dynamically adjusts its data processing mode based on whether user input is detected: in passive mode it synchronizes audio-video output, while in active mode it processes data immediately without waiting for corresponding timestamped data. This dynamic switching resolves the contradiction by allowing the system to optimize for synchronization when no input is present and for low latency when user interaction occurs.
Solution Approach 2:
The patent changes the operational parameter of the display device from a fixed synchronization mode to a variable mode that switches between two states: synchronized output and immediate output. This parameter change enables the system to adapt to different user interaction scenarios, reducing input latency during active use while maintaining audio-video synchronization during passive playback.
2Measurement precision
If the external display device buffers and compares time information to synchronize audio and video data, then synchronization accuracy is improved, but processing time increases
Solution Approach 1:
The patent makes the synchronization processing dynamic by switching between buffered comparison mode and immediate output mode based on user input detection. During passive playback, the device performs accurate time information comparison; during active interaction, it bypasses the buffering and comparison process to reduce processing time.
Solution Approach 2:
The patent applies preliminary action by detecting user input in advance and proactively switching to immediate data processing mode before the synchronization delay would significantly impact user experience. This allows the system to prepare for low-latency operation when needed.
3Reliability
If the external display device waits for all multimedia data before output, then data completeness is improved, but user interaction responsiveness deteriorates
Solution Approach 1:
The patent applies dynamics by switching between two operational modes: in passive mode, the device waits for complete multimedia data packets to ensure data completeness; in active mode triggered by user input detection, it processes and outputs data immediately even if not all data has been received, thereby improving interaction responsiveness.
Solution Approach 2:
The patent uses feedback from user input detection to control the data processing behavior. When user input is detected, the system receives feedback that immediate responsiveness is prioritized over complete data receipt, and adjusts its operation accordingly to reduce interaction delay.
Data Source
AI summary
An electronic device is provided. The electronic device includes a wireless communication circuit, at least one processor, and a memory operatively coupled to the at least one processor. The electronic device may be configured to be connected to an external electronic device by using the wireless communication circuit, transmit audio data and video data for reproduction of multimedia in the external electronic device by using the wireless communication circuit, determine whether an input to the multimedia is detected, when the input to the multimedia is detected, transmit information instructing to stop synchronization between the audio data and the video data to the external electronic device.