Unlock instant, AI-driven research and patent intelligence for your innovation.

VR panoramic video space-time slicing method with low transmission flow

A technology for transmitting traffic and spatio-temporal slicing, applied in the field of VR video transmission, which can solve the problems of frequent head movement, less frequent head movement, different time and space dimension compression coding efficiency, etc., and achieve the effect of accurate reference value

Active Publication Date: 2022-04-01
BEIHANG UNIV
View PDF21 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] However, the mechanism based on spatio-temporal slice transmission still has the following problems: how to determine the slice method of each video, that is, how many slices are divided in space, and how many frames are contained in the time segment in time
[0010] Furthermore, it should be noted that applying a fixed spatio-temporal slicing scheme to all videos is not an optimal processing method: First, due to the difference in content of different types of videos, the head movement rules of users are different when watching. Yes, for example, for interview videos, the user's attention is often focused on the host and guests, and the head movement is less frequent; for short videos, the user's attention will be affected by the sound and screen switching, and the head movement is more frequent
Secondly, due to the difference in picture content, the time-space dimension compression coding efficiency of different videos is different, resulting in the same space-time slicing scheme having different traffic

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • VR panoramic video space-time slicing method with low transmission flow
  • VR panoramic video space-time slicing method with low transmission flow
  • VR panoramic video space-time slicing method with low transmission flow

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0115] 1) Data set creation:

[0116] a) Based on the open-source VR user video dataset, sports videos are selected. There are 8 video samples in total, the duration is between 120 seconds and 180 seconds, and the projection method is ERP (Equi-Rectangular Projection, cylindrical projection).

[0117] b) Use the crop function of ffmpeg to segment the picture. When the number of blocks is given as t, the horizontal and vertical directions of the video picture are divided into t equal parts. When the length of a given time segment is d frames, by specifying the GoP (Group of Picture) parameter of the encoder as d, it is ensured that each time segment of the encoded video contains d frames of pictures. After being processed by the mp4dash tool, it is converted into a streaming media format for storage, and the video size is recorded.

[0118] c) Use the head movement data in the existing data set to perform preprocessing for traffic simulation.

[0119] d) Simulate different sp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a VR panoramic video space-time slicing method with low transmission flow, which belongs to the field of video transmission of wireless communication, and specifically comprises the following steps: firstly, collecting video and user data, and setting each video as TD space-time slice combinations; counting the video size under each combination and the transmission flow when each user watches the video; for each type of video, calculating a video file size and a transmission block proportion, and multiplying to obtain a transmission flow statistical model; for a new to-be-segmented VR video, calculating an I-P frame compression ratio W when t is equal to 1, and correcting the compression ratio in the transmission flow statistical model; calculating the size of the corrected to-be-segmented video after time-space slicing, and multiplying the size by the slicing ratio to obtain the upper bound of the flow needing to be transmitted when the user watches the to-be-segmented video; according to the method, the space-time slice transmission is effectively utilized to reduce the transmission flow of the VR panoramic video, and the space-time two-dimensional slices are optimized.

Description

technical field [0001] The invention belongs to the field of wireless communication VR video transmission, and in particular relates to a VR panoramic video space-time slicing method with low transmission traffic. Background technique [0002] VR panoramic video is considered to be one of the main services with high bandwidth requirements in future mobile communication application scenarios. In order to ensure user experience, the video resolution is often 8K or above. In order to improve user experience as much as possible under limited transmission bandwidth, it is necessary to design an efficient transmission mechanism for VR video services. [0003] Generally, when a user watches a panoramic video, he or she only watches a part of the entire video picture, and the transmission of the remaining part can be avoided. Based on this, the researchers proposed a viewpoint-adaptive VR video transmission method. The implementation method is to spatially segment the VR video scre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N21/4402H04N21/81H04N21/845G06F16/75
Inventor 王君来娄函韩圣千
Owner BEIHANG UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More