A Complexity Adaptive Screen Content Coding Method for Virtual Reality Devices
A technology of screen content coding and virtual reality, applied in the field of screen content coding of virtual reality devices, can solve the problems of different coding complexity limitations, inability to flexibly adjust coding complexity, and high encoder requirements, so as to meet the coding complexity requirements Effect
Active Publication Date: 2022-01-28
HOHAI UNIV
View PDF6 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, the above-mentioned screen content encoding method still has the following disadvantages in the screen content video encoding for virtual reality head-mounted devices: different helmet-mounted virtual reality devices have different encoding complexity restrictions; There are left and right eye views, and the encoding process is more complicated than ordinary screen content encoding; in terms of mode selection, a coding unit needs to choose from multiple encoding modes, palette modes, and intra-frame block copy modes, and recursively decompose The coding structure makes each coding unit (except the smallest unit) face the choice of whether to further decompose into smaller units
The Screen Content Coding Standard (HEVC-SCC) reference software model in the existing high-efficiency video coding standard uses an exhaustive search method to calculate the rate-distortion cost for each possible mode of the current coding unit and decompose it into smaller The rate-distortion cost of each mode after the unit, from which the optimal mode is selected, has higher requirements on the encoder and cannot flexibly adjust the encoding complexity
Existing low-complexity screen content coding algorithms cannot make a flexible trade-off between coding efficiency and complexity to meet different application requirements
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0023] Such as figure 1 As shown, a method for encoding screen content of a complexity-adaptive virtual reality device includes the following steps:
[0024] (1) Calculating the classifier features of the target optimization function and coding unit;
[0025] (2) Consider the impact of classification errors on rate-distortion and encoding complexity, and learn encoding strategies based on reinforcement learning algorithms;
[0026] (3) During encoding, the learned encoding strategy is used instead of exhaustive encoding selection to select an encoding mode for the encoding unit.
[0027] Firstly, the coding unit target optimization function is calculated. The objective optimization function is the reward of the encoding strategy. The reward V(π, T i ) consists of two parts: the encoding rate-distortion cost V rd (π, T i ) and the encoding complexity cost V c (π, T i ), where T i Decision tree created for the ith training example. The objective optimization function c...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a method for encoding screen content of a virtual reality device with self-adaptive complexity, which comprises the following steps: (1) calculating the target optimization function and the classifier features of the encoding unit; (2) considering classification errors for rate-distortion and The influence of encoding complexity, based on the reinforcement learning algorithm to learn the encoding strategy; (3) when encoding, the learned encoding strategy is used instead of exhaustive encoding selection to select the encoding mode for the encoding unit. The present invention proposes a complexity-adaptive coding method for screen content of a virtual reality device, which flexibly adjusts the coding complexity of the screen content video of a virtual reality head-mounted display device.
Description
technical field [0001] The invention relates to the field of screen content video communication, in particular to a screen content encoding method for a complexity-adaptive virtual reality device. Background technique [0002] Due to the advantages of price and convenience, a head-mounted virtual reality device (Head Mounted Display, HMD for short) is welcomed by ordinary consumers. With the growth of users and application content and the rise of cloud technology, the demand for screen content sharing between such devices has increased sharply, resulting in applications such as cloud games, wireless screen display, mirroring screen, and screen virtualization. In such applications, screen sharing usually requires real-time transmission of screen content video between virtual reality devices, so there is a high requirement for transmission delay. Screen content video coding is one of the core technologies that determine system performance in screen content video communication...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): H04N19/103H04N19/186H04N19/147
CPCH04N19/103H04N19/147H04N19/186
Inventor 徐媛媛
Owner HOHAI UNIV