A location-based virtual reality compression method

Abstract

The invention provides a virtual reality compression method based on positions for reducing the high transmission bandwidth requirement of a VR system and providing a foundation for the virtual reality system to realize the wireless transmission of high-quality image frames by using the current wireless network technology. The main idea is as follows: 1) an encoding end discretizes a continuous virtual space of virtual reality into panorama sets of different positions, and combines the panorama sets of adjacent positions into a large number non-overlapped units; 2) the panorama of each unit located at the central position is encoded and compressed into a key frame, and the rest panoramas are entirely encoded and compressed into P frames only referring to the key frame; and 3) by means of the above operations, the encoding end encodes and compresses the virtual space used by the virtual reality into one or more panorama video streams, a decoding end firstly decodes the key frame of the current covering the current position of the user and stores the key frame in a memory, and then quickly decodes the P frames of the corresponding positions according to the specific position of the user, therefore the user moves in the virtual space.

Description

technical field [0001] The invention belongs to the technical field of virtual reality, in particular to a position-based virtual reality compression method. Background technique [0002] Virtual reality (Virtual Reality, hereinafter referred to as VR), while providing users with subversive immersive interactive experience, also brings huge computing and rendering overhead to the VR system itself. In order to achieve high-quality VR application experience and meet the three performance requirements of VR applications: 1) low response delay, 2) high frame refresh rate and 3) high-quality images, VR systems usually entrust the heavy rendering work to a powerful The host is complete. The host transmits the rendered picture frame to the head-mounted display worn by the user in real time. Due to the high frame refresh rate and high-quality picture requirements of VR applications, the transmission of these picture frames usually consumes several Gbps of bandwidth resources. [...

AI Technical Summary

Problems solved by technology

However, since the video compression technology is designed for the optimization of resources dominated by the time dimension of video, it cannot be directly applied in VR scenarios.

Images