VR panoramic video optimization transmission method suitable for cellular network

A panoramic video and transmission method technology, which is applied in the field of computer network application layer protocol, can solve the problems of cellular network bandwidth waste, high server and device overhead, and high network delay, so as to reduce communication overhead, have little impact, and ensure communication quality Effect

Active Publication Date: 2022-03-18
FUDAN UNIV
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The present invention aims to overcome the deficiencies of the prior art, and provides a VR panoramic video optimization transmission method suitable for cellular networks, so as to solve the problem of excessive waste of cellular network bandwidth, high network delay, server and equipment problems in traditional VR panoramic video transmission. Problems such as excessive terminal overhead

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • VR panoramic video optimization transmission method suitable for cellular network
  • VR panoramic video optimization transmission method suitable for cellular network
  • VR panoramic video optimization transmission method suitable for cellular network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The implementation process of the present invention is described below with a specific case.

[0034] Operations on the server side:

[0035] (1) Project the collected original panoramic video (3D) to a plane (2D) by means of equidistant cylindrical projection;

[0036] (2) Divide the planar image obtained by projection into blocks, and mark each block with the coordinates of its upper left corner;

[0037] (3) Divide the video into short video sequences of 2 seconds;

[0038] (4) Perform saliency detection for each short video, predict the focus area of ​​the video, and record the block coordinates of the focus area;

[0039] (5) For each short video, the server stores three backups, corresponding to the perspectives of three positions in the panoramic video, the blocks within the visible range and the blocks in the focus area are compressed with high quality, and other blocks are compressed with Low quality compression.

[0040] The process of video transmission: ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of computer network application layer protocols, in particular to a VR panoramic video optimization transmission method suitable for cellular networks. The method of the present invention includes: projection, compression, slicing and block of VR panoramic video; using saliency detection to carry out multi-focus redundant storage of the video, wherein a 3D convolutional neural network is used to carry out supervised learning on the sample video to obtain a prediction model It is used to predict the salient area, and then perform multi-focus redundant storage; the window adaptive transmission protocol, which is an application layer protocol based on UDP, and ensures that there is a buffer space for the real-time transmission of the video stream; the prediction based on the head motion direction prediction Transmission, use machine learning methods to establish a direction prediction model, use the prediction model to predict the video clips that the client will need in the next period of time, and effectively improve the video fluency of the client through pre-transmission. The invention has a simple model, can remarkably improve transmission efficiency, and ensure real-time performance.

Description

technical field [0001] The invention belongs to the technical field of computer network application layer protocols, and in particular relates to a transmission method for efficiently transmitting VR panoramic video under a cellular network. Background technique [0002] From the perspective of global VR (virtual reality) product shipments in recent years, consumer-grade VR all-in-one machines will become the mainstream market trend for a long time in the future, and with the popularization of 5G networks, VR all-in-one machines will soon be equipped with 5G chips. In the network environment, the communication between the device side and the server side is realized. As VR content production becomes more sophisticated and video quality is higher and higher, the bandwidth and delay requirements of cellular networks are much higher than ordinary flat video, while the existing VR panoramic video transmission technologies are mostly based on traditional flat video The simple imp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N13/106H04N13/117H04N13/363H04N19/149H04N19/176H04N19/423H04L65/60H04L65/80
CPCH04N13/363H04N13/117H04N13/158H04N19/176H04N19/149H04N19/423H04L65/80H04L65/75
Inventor 蒋林华陈恩涛张冠华曾新华庞成鑫宋梁
Owner FUDAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap