VR panoramic video optimized transmission method suitable for cellular network

A technology of panoramic video and transmission method is applied in the field of computer network application layer protocol, which can solve the problems of waste of cellular network bandwidth, high server and device overhead, and high network delay, so as to reduce communication overhead, reduce impact, and ensure communication quality. Effect

Active Publication Date: 2021-09-17
FUDAN UNIV
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The present invention aims to overcome the deficiencies of the prior art, and provides a VR panoramic video optimization transmission method suitable for cellular networks, so as to solve the problem of excessive waste of cellular network bandwidth, high network delay, server and equipment problems in traditional VR panoramic video transmission. Problems such as excessive terminal overhead

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • VR panoramic video optimized transmission method suitable for cellular network
  • VR panoramic video optimized transmission method suitable for cellular network
  • VR panoramic video optimized transmission method suitable for cellular network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The implementation process of the present invention is described below with a specific case.

[0034] Operations on the server side:

[0035] (1) Project the collected original panoramic video (3D) to a plane (2D) by means of equidistant cylindrical projection;

[0036] (2) Divide the planar image obtained by projection into blocks, and mark each block with the coordinates of its upper left corner;

[0037] (3) Divide the video into short video sequences of 2 seconds;

[0038] (4) Perform saliency detection for each short video, predict the focus area of ​​the video, and record the block coordinates of the focus area;

[0039] (5) For each short video, the server stores three backups, corresponding to the perspectives of three positions in the panoramic video, the blocks within the visible range and the blocks in the focus area are compressed with high quality, and other blocks are compressed with Low quality compression.

[0040] The process of video transmission: ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of computer network application layer protocols, and particularly relates to a VR panoramic video optimized transmission method suitable for a cellular network. The VR panoramic video optimized transmission method comprises the following steps of: projecting, compressing, slicing and blocking a VR panoramic video; performing multi-focus redundant storage on the video by using saliency detection, performing supervised learning on a sample video by using a 3D convolutional neural network to obtain a prediction model for predicting a salient region, and then performing multi-focus redundant storage; adopting a window self-adaptive transmission protocol which is an application layer protocol based on a UDP and ensures that a buffer space exists during instant transmission of a video stream; and based on pre-transmission of head motion direction prediction, using a machine learning method to establish a direction prediction model, and predicting video clips required by a client in a next period of time by using the prediction model, thereby effectively improving the video fluency of the client in a pre-transmission mode. According to the VR panoramic video optimized transmission method, the model is simple, the transmission efficiency can be remarkably improved, and the real-time performance is ensured.

Description

technical field [0001] The invention belongs to the technical field of computer network application layer protocols, and in particular relates to a transmission method for efficiently transmitting VR panoramic video under a cellular network. Background technique [0002] From the perspective of global VR (virtual reality) product shipments in recent years, consumer-grade VR all-in-one machines will become the mainstream market trend for a long time in the future, and with the popularization of 5G networks, VR all-in-one machines will soon be equipped with 5G chips. In the network environment, the communication between the device side and the server side is realized. As VR content production becomes more sophisticated and video quality is higher and higher, the bandwidth and delay requirements of cellular networks are much higher than ordinary flat video, while the existing VR panoramic video transmission technologies are mostly based on traditional flat video The simple imp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N13/106H04N13/117H04N13/363H04N19/149H04N19/176H04N19/423H04L29/06
CPCH04N13/363H04N13/117H04N13/158H04N19/176H04N19/149H04N19/423H04L65/80H04L65/75
Inventor 蒋林华陈恩涛张冠华曾新华庞成鑫宋梁
Owner FUDAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap