Audio Multiplexing for High-Speed Video Reproduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing streaming distribution methods face issues with increased network bandwidth waste during high-speed reproduction, audio data gaps leading to uneven video output timing, buffer underflow/saturation, and decreased sound quality due to inefficient audio data distribution.
Innovation Solution
An encoding device that multiplexes audio data within a predetermined range into specific pictures, ensuring all audio data is distributed at speeds up to a certain threshold but not beyond, thereby optimizing bandwidth usage and maintaining synchronized audio and video reproduction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If audio data and video data are evenly multiplexed in audiovisual content, then the data structure is simple and easy to distribute, but audio data gaps are caused during high-speed reproduction leading to uneven video output timing and quality degradation
Solution Approach 1:
The patent segments audio data and video data into separate streams rather than evenly multiplexing them. Audio data is extracted and distributed independently from video data, allowing different distribution strategies for each type of data based on their specific requirements during high-speed reproduction
Solution Approach 2:
The patent implements dynamic distribution of audio data based on reproduction speed requirements. When high-speed reproduction is detected, the system adjusts audio data distribution to prevent gaps, ensuring timing synchronization is maintained even as playback speed increases
2Speed
If pictures of audiovisual content are thinned for variable high-speed reproduction, then distribution bandwidth is reduced and high-speed reproduction becomes possible, but audio data gaps are caused leading to buffer underflow or saturation
Solution Approach 1:
The patent performs preliminary extraction and separation of audio data from video data before distribution. By preparing audio data independently in advance and distributing it separately, the system ensures audio continuity is maintained even when video pictures are thinned for high-speed reproduction
Solution Approach 2:
The patent introduces an intermediary processing step where audio data is extracted and distributed through a separate channel from video data. This intermediary approach allows independent control of audio distribution timing and rate, preventing buffer underflow or saturation during high-speed playback
3Speed
If the distribution device increases audiovisual content distribution speed to match reproduction speed, then the reproduction device can reproduce at required speed, but network bandwidth is wasted in proportion to the reproduction speed
Solution Approach 1:
The patent segments the audiovisual stream into separate audio and video components distributed at different rates. Video data is thinned for high-speed reproduction while audio data is distributed separately at an optimized rate, eliminating the need to distribute full-resolution audio at the same increased rate as video, thus reducing bandwidth waste
Solution Approach 2:
The patent changes the distribution parameters of audio and video data independently. Video data distribution rate is increased to match high-speed reproduction requirements, while audio data distribution rate is optimized separately to avoid proportional bandwidth increase, achieving speed improvement without proportional bandwidth waste
4Device complexity
If audio data is thinned along with video pictures, then data distribution is simplified, but audio reproduction quality decreases and timing synchronization becomes uneven
Solution Approach 1:
The patent segments audio and video data distribution paths, allowing audio data to be distributed with different thinning ratios than video. This segmentation enables independent optimization of audio timing and distribution, maintaining precise timing synchronization even when video is heavily thinned for high-speed reproduction
Data Source
AI summary
The present invention is to solve a problem that, at the time of high-speed reproduction using compressed video data, an audio distribution bandwidth increases simply in proportion to a high-speed reproduction rate. An encoding device includes: an audio encoding part configured to encode an audio signal; a video encoding part configured to encode a video signal; and a multiplexing part configured to multiplex audio data outputted by the audio encoding part and video data outputted by the video encoding part. The multiplexing part is configured to, at the time of high-speed reproduction, multiplex by locating audio data within a predetermined range into a picture configuring video data, the picture being distributed at a speed equal to or less than a predetermined reproduction speed but being not distributed at a speed more than the predetermined reproduction speed.