Multicamera Temporal Inter-view Prediction for Video Bitrate Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current broadcasting infrastructure is unable to transmit high-resolution, high-frame-rate media content in real time due to excessive data requirements, necessitating a reduction in bitrate for efficient broadcasting.
Innovation Solution
A method and apparatus for reducing bitrate in stereoscopic and multiview video content by determining the movement of a multicamera device using accelerometers or gyroscopes, selecting frames based on camera position and direction, and entering these frames into a reference frame list for temporal inter-view prediction, which reduces data transmission needs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high-resolution media content with higher frames per second is transmitted, then video quality is improved, but the bitrate requirement increases excessively
Solution Approach 1:
The system performs preliminary actions by determining camera movement between time instances before encoding, using accelerometer and gyroscope data to predict which frames from alternative views will be useful as reference frames, thereby preparing compression strategies in advance
Solution Approach 2:
The patent introduces movement determination data from accelerometers and gyroscopes as an intermediary that bridges the gap between different camera views, enabling the system to identify corresponding frames across multiple cameras based on device motion rather than direct frame comparison
2Adaptability or versatility
If the number of views in multiview video is increased, then viewing experience is improved, but the data amount increases making real-time transmission difficult
Solution Approach 1:
Frames captured by one camera are made universally usable as reference frames for multiple other camera views. A single frame from camera A can serve as a reference for encoding frames from cameras B, C, and D if the movement conditions align, thereby distributing the compression workload across all views
Solution Approach 2:
The system discards redundant frame data by not encoding all frames from all cameras independently. Instead, it recovers efficiency by selectively using frames from one view as references for other views, eliminating unnecessary duplicate encoding of similar content
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables efficient and intelligent temporal inter-view prediction, allowing for reduced bitrate transmission of stereoscopic and multiview video content while maintaining quality, thereby addressing the limitations of current broadcasting infrastructure.
Implementation Method 1
determining the position and direction of a camera based on an accelerometer or a gyroscope of the camera
Implementation Method 2
determining the position and direction of a camera based on an accelerometer or a gyroscope of the camera
Data Source
AI summary
The invention relates to a method and apparatus for implementing the method. The method comprises determining movement of a multicamera device between a first time and a second time, the multicamera comprising at least a first camera and a second camera; selecting a frame from the first camera at the first time; and entering the selected frame to a reference frame list of a frame from the second camera at the second time; where position and direction of the first camera at the first time is the same as position and direction of the second camera at the second time, and wherein the first camera and the second camera are different.