Multi-Viewpoint Video Switching Delay Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In multi-viewpoint shooting scenarios, the existing bitstream coding schemes result in significant switching delays when switching between video images from different angles, leading to poor user experience due to frame freezing and delayed responses.
Innovation Solution
The proposed solution involves an encoding and decoding method that includes a first type bitstream and a second type bitstream for each viewpoint. The bitstreams are configured such that a random access frame in the second type bitstream serves as a reference frame, allowing for viewpoint switching before the completion of a random access segment, thereby reducing switching delays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a fixed intra prediction frame interval is used for encoding multiple viewpoint bitstreams, then decoding stability is ensured, but viewpoint switching delay increases significantly
Solution Approach 1:
The patent segments the bitstream into two types: first type bitstreams with random access frames at fixed intervals for decoding stability, and second type bitstreams with random access frames at variable intervals optimized for switching. This segmentation allows the system to maintain reliability while reducing switching delays by selecting appropriate bitstream types during viewpoint transitions.
Solution Approach 2:
The patent introduces dynamic adjustment of random access frame intervals by using two different bitstream types. The system dynamically selects between fixed-interval (first type) and variable-interval (second type) random access frames based on whether viewpoint switching is anticipated, thereby adapting the encoding strategy to operational requirements and reducing switching delays.
2Loss of time
If random access frames are placed frequently to reduce switching delay, then viewpoint switching responsiveness improves, but encoding complexity and bitstream size increase
Solution Approach 1:
The patent divides the encoding process into two modes corresponding to first type and second type bitstreams. The first type uses fixed-interval random access frames for normal operation with lower encoding complexity, while the second type uses variable-interval frames optimized for switching scenarios. This segmentation allows the system to reduce switching delays without permanently increasing encoding complexity.
Solution Approach 2:
The patent changes the parameter of random access frame interval from fixed to variable by introducing two bitstream types. The second type bitstream adjusts the interval dynamically based on viewpoint switching requirements, reducing switching delay without requiring frequent random access frames in all scenarios, thereby controlling encoding complexity.
3Loss of time
If random access frames are placed frequently to reduce switching delay, then viewpoint switching responsiveness improves, but transmission bandwidth requirements increase
Solution Approach 1:
The patent segments bitstream transmission into first type and second type bitstreams. The first type maintains fixed-interval random access frames for bandwidth efficiency during normal playback, while the second type uses variable-interval frames optimized for switching operations. This segmentation reduces overall bandwidth requirements compared to using frequent random access frames continuously.
Solution Approach 2:
The patent changes the random access frame interval parameter from consistently frequent to conditionally frequent. By using variable intervals in the second type bitstream only when needed for switching, the system reduces the total quantity of data transmitted while still achieving low switching delays when viewpoint changes occur.
Data Source
AI summary
An encoding and decoding method are disclosed. The method includes: Each of multiple viewpoint bitstreams includes a first type bitstream and a second type bitstream; when a first image frame in a first type bitstream of a first viewpoint bitstream is played, receiving a switching request that indicates to play a second viewpoint bitstream; determining a first random access frame that is in a first type bitstream and/or a second type bitstream of the second viewpoint bitstream and has a play moment after and closest to the first image frame; decoding to obtain the first random access frame based on encoded data of the first random access frame in the second viewpoint bitstream, and decoding to obtain and play an image frame that is in the first type bitstream of the second viewpoint bitstream by using the first random access frame as a reference frame.