Check patentability & draft patents in minutes with Patsnap Eureka AI!

Panoramic video code rate allocation method, device, mobile terminal and storage medium

A panoramic video and bit rate allocation technology, applied in the field of video coding, can solve problems such as difficult to accurately predict the user's viewing area, and achieve the effect of overcoming the difficulty of accurately predicting the user's viewing area, reducing stuttering, and good tolerance

Active Publication Date: 2022-06-17
SHENZHEN UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a code rate allocation method, device, mobile terminal, and storage medium for a panoramic video, so as to reduce the influence of viewing area prediction errors, overcome the problem that it is difficult to accurately predict the user's viewing area on the mobile terminal, and reduce the user's viewing time. Caton, improve user experience quality

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Panoramic video code rate allocation method, device, mobile terminal and storage medium
  • Panoramic video code rate allocation method, device, mobile terminal and storage medium
  • Panoramic video code rate allocation method, device, mobile terminal and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0029] figure 1 This is a flowchart of a method for allocating a bit rate of a panoramic video according to Embodiment 1 of the present invention. This embodiment is applicable to the case where the mobile terminal divides the video frame according to the user's view area and then allocates the bit rate to the video segment in the process of receiving the panoramic video. The device may be implemented by means of hardware and / or software, and may generally be integrated into a mobile terminal. like figure 1 shown, including the following steps:

[0030] S11. Collect historical user viewport prediction error degrees in real time.

[0031] Specifically, in the playback process of panoramic video, in order to ensure the user experience quality, save bandwidth and reduce resource consumption, the video frame is usually divided into segments to obtain independently transmitted and decoded tiles. The user viewport makes predictions and determines the tiles to be downloaded accor...

Embodiment 2

[0064] figure 2 This is a flowchart of a method for allocating a bit rate of a panoramic video according to Embodiment 2 of the present invention. The technical solution of this embodiment is further refined on the basis of the above-mentioned technical solution. Optionally, in the process of determining the target video segment to be downloaded and the bit rate of the target video segment, additional consideration is given to hardware resources and bandwidth available to the mobile terminal. and buffer conditions to ensure that the mobile terminal can complete decoding in a short time, thereby avoiding interruption of video playback and further reducing video freezes. Specifically, in this embodiment, before substituting the weight of the target tile into the preset maximizing experience quality model, and determining the target video clip to be downloaded and the bit rate of the target video clip according to the preset maximizing experience quality model, further It inclu...

Embodiment 3

[0076] image 3 This is a schematic structural diagram of an apparatus for allocating a bit rate of a panoramic video according to Embodiment 3 of the present invention. The apparatus may be implemented by means of hardware and / or software, and may generally be integrated into a mobile terminal. like image 3 As shown, the device includes:

[0077] The historical error collection module 31 is used for real-time collection of historical user viewport prediction error degrees;

[0078] The segmentation mode determination module 32 is used to determine the optimal tile segmentation mode according to the historical user viewport prediction error degree;

[0079] The block weight determination module 33 is configured to determine the weight of the target image block and the target image block in the current prediction user's view area according to the optimal image block segmentation method;

[0080] The bit rate determination module 34 is used for substituting the weight of the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a panoramic video code rate allocation method, device, mobile terminal and storage medium. The method includes: collecting the prediction error degree of the historical user's viewing area in real time; determining the optimal block segmentation method according to the historical user's viewing area prediction error degree; determining the target block in the current predicted user's viewing area according to the optimal block segmentation method and the weight of the target tile; substituting the weight of the target tile into a preset maximum quality of experience model, and determining the target video segment to be downloaded and the bit rate of the target video segment according to the preset maximum quality of experience model. The technical solution provided by the embodiments of the present invention realizes better tolerance to prediction errors, reduces the impact of viewing area prediction errors, and overcomes the problem that it is difficult to accurately predict the user's viewing area on the mobile terminal, thereby reducing the user's viewing time. Caton, which improves the quality of user experience.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of video coding, and in particular, to a method, device, mobile terminal and storage medium for allocating a bit rate of panoramic video. Background technique [0002] In recent years, panoramic video has entered thousands of households. Because of its panoramic feature, it can bring a unique viewing experience to viewers, making it more and more popular among users. But the panorama feature also makes the panorama video much larger than the traditional video under the same perceptual quality, so the transmission of the panorama video needs to consume more bandwidth, which is very difficult in the wireless network. Secondly, compared with traditional video, panoramic video brings higher computing and battery overhead to mobile terminals with limited resources, which greatly reduces the experience quality and popularization speed of panoramic video in mobile terminals. However, when a u...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N21/218H04N21/2343H04N21/442
CPCH04N21/21805H04N21/2343H04N21/442H04N21/44209
Inventor 张磊索琰琰伍曦明崔来中
Owner SHENZHEN UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More