Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Overall user experience quality assessment method of VR audio and video

A quality of experience and video quality technology, applied in the multimedia field, can solve the influence of audio-video interaction without combining panoramic video and spatial audio characteristics, does not consider audio-video spatial interaction, and is not suitable for overall audio and video user experience quality assessment. and other issues to achieve high accuracy and high correlation.

Active Publication Date: 2018-10-19
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF7 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Most of the existing audio and video overall quality assessment methods are aimed at traditional audio and video, and do not combine the characteristics of panoramic video and spatial audio in the VR environment and the influence of audio and video interaction
my country's authorized publication number is CN 103379358B patent "method and device for evaluating multimedia quality" discloses a method and device for evaluating multimedia quality, but it does not take into account the spatial interaction of audio and video, and is not suitable for audio and video in a VR environment. Video Overall User Experience Quality Evaluation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Overall user experience quality assessment method of VR audio and video
  • Overall user experience quality assessment method of VR audio and video
  • Overall user experience quality assessment method of VR audio and video

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0052] This embodiment describes the overall user experience quality evaluation model of VR audio and video based on two sections of VR audio and video, one of which is the lossless reference audio and video Reference.mp4, and the other is the lossy audio and video to be tested Test.mp4. The reference video and the video to be tested have the same content and a panoramic video in latitude and longitude format with a resolution of 4096*2048. Both videos have a duration of 10s and a frame rate of 30fps. Damaged video is obtained by H.264 compression encoding of lossless video. The code rate of the reference video is 50Mbps, and the code rate of the video to be tested is 3Mbps.

[0053] The reference and tested VR audio and video content is a dialogue scene in a coffee shop, with a total of 6 sound sources: background sound, male voice, female voice, wai...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an overall user experience quality assessment method of VR audio and video, particularly relates to an audio and video overall user experience quality assessment method in a virtual reality environment, and belongs to the field of multimedia technology. The implementation method of the invention is as follows: with respect to to-be-measured VR audio and video and referenceVR audio and video, respectively calculating a video quality parameter, an audio quality parameter, an audio and video time parameter and an audio and video space parameter of the to-be-measured VR audio and video through video quality, audio quality and audio and video time interaction and audio and video space interaction models in a first layer; and inputting the four parameters into an overall quality fusion model in a second layer, and finally outputting an overall quality score of the to-be-measured VR audio and video, wherein the space interaction model is implemented by a function relationship designed based on subjective feeling of users. By adoption of the overall user experience quality assessment method disclosed by the invention the influence of the audio and video space interaction on the overall user experience quality of the VR audio and video can be reflected, and the assessment effect better conforms to the subjective feeling of the users.

Description

technical field [0001] The invention relates to a method for evaluating overall user experience quality of audio and video, in particular to evaluating overall user experience quality of audio and video in a virtual reality environment, and belongs to the field of multimedia technology. Background technique [0002] Virtual reality (Virtual Reality, referred to as VR) technology has brought people a new audio and video experience, in which panoramic video and spatial audio are an integral part of the immersive experience. With its good user experience and human-computer interaction, virtual reality technology is widely used in many fields such as entertainment, education, medical treatment and industry, and has changed the original production design method to a certain extent. In the virtual reality environment, it is not only the panoramic video that affects the user experience, but also the spatial audio and the mixed effect of audio and video, which means that the user ex...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N17/00
CPCH04N17/004
Inventor 王晶罗逸雨张博闫昭宇杨舒
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products