Immersive media data transmission method adapting to human eye perception condition
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
A technology of media data and human perception, which is applied in the field of video transmission and computer vision, and can solve problems such as large data flow
Inactive Publication Date: 2019-07-30
NANJING UNIV
View PDF7 Cites 8 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
[0006] In view of the above situation, the present invention proposes an immersive media data transmission method that adapts to human perception, and solves the problem of excessive data flow during transmission by assigning different video qualities to different visual areas
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0034]In this embodiment, the H.264 quantization parameter q of each region is regulated, and the specific implementation steps are as follows:
[0035] Step 1, low-quality immersive media data is pre-transmitted. The panorama data is compressed and transmitted to the local end according to QP=48 (ie, q≈161).
[0036] Step 2, when the user browses smoothly, the image quality in the field of view area is calculated according to compression, where q min is the corresponding value when QP=22, that is, it is equal to 8, and θ is the centrifugal angle of the center of the field of view in the horizontal direction. Among them, the details of each parameter are shown in Table 1.
[0037] Table 1 Values of each parameter in the model when the quantitative parameter q is adjusted
[0038]
[0039] In practical application, it is suggested to adopt the reference table of discrete control parameters to realize partition quality control. Here, the transmission of 4K panorama im...
Embodiment 2
[0052] In this embodiment, the resolution s of each region is regulated, and the specific implementation steps are as follows:
[0053] Step 1, low-quality immersive media data is pre-transmitted. The panorama data is compressed and transmitted to the local end according to s=1024x540.
[0054] Step 2, when the user browses smoothly, the image quality in the field of view area is calculated according to compression, where s max It is 4096x2160, and θ is the centrifugal angle of the center of the field of view in the horizontal direction. Among them, the details of each parameter are shown in Table 3.
[0055] Table 3 Values of parameters in the model when adjusting the resolution s
[0056]
[0057] It can be seen from the above table that the control parameter c is in is a fixed value in , and in is context-dependent, which may be due to the fact that existing Vive headsets do not provide sufficient pixel density to accurately reflect the amplitude changes cause...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
PUM
Login to view more
Abstract
The invention discloses an immersive media data transmission method adapting to a human eye perception condition. The method comprises the following steps of S1, before a user starts to browse, pre-storing part of low-quality panoramic video data to a user side; s2, when the user starts to browse stably, enabling the server side to transmit the high-quality view field area content according to thecurrent visual behavior of the user, and distributing the non-uniformly distributed image quality under the current view field based on the current sight drop point of the user; s3, during the process that the visual focus of the user is migrated to the next region from the current region, providing the data in the view field of the VR helmet by the pre-stored low-quality panoramic video data, and continuously pre-storing the low-quality panoramic video data to the user side; and S4, when the user recovers stable browsing and the sight line is migrated again, repeating the steps S2 and S3 until the observation is stopped. According to the method, the size of the VR data flow can be effectively reduced, and meanwhile it can be guaranteed that the subjective perception quality of the videocontent in the whole view field area is not changed.
Description
technical field [0001] The invention relates to the fields of video transmission and computer vision, in particular to an immersive media data transmission method adapted to human perception. Background technique [0002] At present, immersive media, such as VR (virtual reality) helmets and VR glasses, have gradually entered the public eye, and many top IT companies (such as Facebook / Oculus, HTC, Google, etc.) are increasing their investment in the immersive media market. Excellent VR equipment needs to ensure high-definition visual scenes and interactive behaviors without perceptual delay. The stable transmission of high-frame-rate high-definition video data brought about by this has put forward certain requirements on network bandwidth. How to efficiently transmit VR data streams with high quality is an urgent problem in the current VR market. [0003] At present, in order to ensure interaction without perceptual delay and high-quality visual experience, the data transmit...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to view more 
Login to view more