Seamless Multi-Angle Video Switching via Frame Delay Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional multiplexing and demultiplexing apparatuses fail to maintain a seamless playback experience during special playback modes like multi-angle playback due to frame delays, causing discomfort for users as they cannot ensure a fixed frame rate when switching between clips with different frame delays.
Innovation Solution
A multiplexing apparatus that adjusts frame delays of coded streams to ensure equal delay amounts between access units, and a demultiplexing apparatus that decodes and plays back these streams seamlessly by utilizing delay information to maintain a consistent frame rate, eliminating gaps during special playback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional multiplexing and demultiplexing apparatuses are used to support multi-angle playback, then special playback functionality is enabled, but frame delays cause gaps at connections between access units resulting in poor playback quality
Solution Approach 1:
The patent applies preliminary action by adjusting frame delays during the multiplexing stage before playback occurs. The multiplexing apparatus pre-calculates and sets appropriate frame delays for each access unit based on its type (IDR, I, P, or B picture), ensuring that when demultiplexing occurs, the playback can proceed seamlessly without gaps. This advance preparation eliminates the need for complex real-time adjustments during playback.
Solution Approach 2:
The patent changes the frame delay parameter dynamically based on the type of access unit being processed. Different frame delay values are assigned to different picture types (IDR, I, P, B) to optimize playback continuity. By adjusting this temporal parameter according to the specific characteristics of each access unit, the system maintains seamless playback while supporting multi-angle functionality.
2Manufacturing precision
If frame delays are adjusted to eliminate gaps during playback, then playback quality improves, but the complexity of the multiplexing and demultiplexing apparatus increases
Solution Approach 1:
The patent manages complexity by systematically changing only one key parameter - the frame delay value - based on well-defined picture types. Rather than implementing complex algorithms for real-time delay calculation, the system uses predetermined delay values associated with each access unit type (IDR, I, P, B pictures). This parameter-based approach simplifies the apparatus design while achieving seamless playback.
Solution Approach 2:
The multiplexing apparatus performs self-service by automatically determining and setting appropriate frame delays for each access unit based on its type classification. The system does not require external control or complex coordination during demultiplexing, as the frame delay information is already embedded in the multiplexed stream during encoding. This self-contained approach reduces overall system complexity.
3Ease of operation
If seamless playback is achieved by adjusting frame delays, then user comfort improves, but the difficulty of detecting and measuring frame delay parameters increases
Solution Approach 1:
The patent addresses detection difficulty by using discrete, well-defined frame delay parameters associated with standard picture types (IDR, I, P, B) rather than continuous or arbitrary delay values. This discretization makes the parameters easier to detect and measure, as they correspond to recognizable categories in the video stream structure. The systematic nature of these parameter changes facilitates automated detection during demultiplexing.
Solution Approach 2:
The demultiplexing apparatus benefits from self-service as the frame delay information is automatically available within the multiplexed stream structure itself. The system does not require external measurement or complex detection algorithms, as the delay parameters are inherently embedded in the coded stream during multiplexing. This self-contained information structure simplifies the detection and measurement process.
Data Source
AI summary
A multiplexing apparatus which does not make a user who watches a moving picture feel uncomfortable, the moving picture including: (i) a coding unit (42) for generating one or more coded streams so that no gap occurs at the connection of predetermined two access units in a process of decoding, in sequence, the two access units in all of the access units included in the coded streams; and (ii) a multiplexing unit (18) for multiplexing, with other information, the coded streams generated in the coding unit (42).