Mobile virtual reality transmission method and system based on terminal computing storage

A technology of virtual reality, transmission method, applied in transmission system, input/output of user/computer interaction, calculation, etc.

Active Publication Date: 2020-11-17
SHANGHAI JIAOTONG UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, how to realize the characteristics of the framework itself based on VR, and make full use of the computing and storage resources of the user's mobile device, so as to minimize the demand for communication resources of MoVR, has not yet been clarified.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mobile virtual reality transmission method and system based on terminal computing storage
  • Mobile virtual reality transmission method and system based on terminal computing storage
  • Mobile virtual reality transmission method and system based on terminal computing storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0050] This embodiment provides a mobile virtual reality transmission method based on terminal computing and storage. Based on the existing VR generation framework, this method proposes a specific implementation strategy of MoVR and the corresponding computing scheduling and caching strategy on the user's mobile device. .

[0051] First, based on existing frameworks for generating VR videos, such as figure 1 shown. Specifically, eye tracking and rendering must be performed on the user's mobile device (i.e. figure 1 The calculation is completed on the client side in ); for the stitching and spherical projection, since the input is all original 3D videos, the amount of data required for processing and transmission is huge, so it can be completed offline on the cloud server to reduce repeated calculations and Repeated transmission wastes computing and communication resources; for the extraction part, since its input is all 2D video and requires the user's current FOV (field of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a mobile virtual reality transmission method based on terminal computing and storage, including: step S1, for a certain multi-angle video, obtain 2D 360-degree VR video offline on a cloud server through stitching and spherical projection; step S2, For a certain moment, the user's mobile device sends a request to the VR video obtained in step S1 and obtains the corresponding FOV through eye tracking; step S3, obtains the corresponding 3D FOV based on the caching and calculation scheduling strategy of the user's mobile device, so as to satisfy the user's requirements. Time request; step S4, at the next time, the user's mobile device sends a VR video transmission request under the next FOV, and then repeats the operations of steps S2 to S3. At the same time, a mobile virtual reality transmission system based on terminal computing and storage is provided. The present invention makes full use of computing and storage resources of base stations and mobile devices, and achieves the minimum target of air interface data volume for wireless VR transmission while meeting the requirements of VR transmission time delay and user mobile terminal energy consumption.

Description

technical field [0001] The present invention relates to the technical field of mobile virtual reality (MoVR, Mobile Virtual Reality), in particular to a mobile virtual reality transmission method and system based on terminal computing and storage. Background technique [0002] Virtual reality technology (VR) has attracted attention because it aims to bring users an immersive experience that breaks time and space. At present, VR devices that can provide high-quality experience need to obtain video through a wired network, which limits the user's mobility and weakens the user's immersive experience. Therefore, to provide a truly immersive experience, mobile virtual reality (MoVR) must be implemented. )technology. However, the requirement of high resolution (such as 8K) and low latency (20ms) for virtual reality video has led to an increase in the transmission rate of wireless communication to the order of Gbit / s, which undoubtedly puts enormous pressure on cellular network op...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08H04L29/06G06T15/00G06T3/00G06T1/60G06T1/20G06F3/01
CPCH04L67/10G06F3/013G06T1/20G06T1/60G06T3/005G06T15/005G06T2207/10016H04L67/568H04L67/131
Inventor 孙亚萍陈智勇陶梅霞
Owner SHANGHAI JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap