Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Audio processing method and apparatus, and terminal device

A technology for audio processing and audio data, applied in stereo systems, electrical components, etc., can solve the problems of inability to restore scene audio effects displayed by specific VR applications, poor user experience, mismatched sense of space, etc.

Inactive Publication Date: 2019-01-29
HUAWEI TECH CO LTD
View PDF9 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in this technical solution, algorithmic reverberation is mainly used to simulate the late reverberation effect of audio, so that the output audio signal has a certain sense of space.
However, the algorithmic reverberation is still difficult to simulate the sense of space corresponding to the specific scene displayed by the VR application. Therefore, in this technical solution, there is still a mismatch between the VR audio effect provided by the VR device and the VR visual effect displayed to the user by the real VR application. problems, and thus cannot provide the audio effect to restore the scene displayed by a specific VR application, and the user experience is poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Audio processing method and apparatus, and terminal device
  • Audio processing method and apparatus, and terminal device
  • Audio processing method and apparatus, and terminal device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The embodiments of the present application will be described below in conjunction with the drawings.

[0039] The embodiments of the present application are applied to a situation where a VR application is used to show a user an audio and video effect that simulates a real environment (scene). Specifically, when applying this application, the embodiments of this application provide a terminal device that implements VR applications, which can be a mobile phone or a VR device; if the terminal device is a mobile phone, it includes implementation of the audio processing method provided in the following embodiments Audio processing device, and also need to be used with VR glasses and audio output devices (such as headsets) when implementing this application. VR glasses are used to cooperate with mobile phones to show users the scenes provided by VR applications, and audio output devices are used to cooperate with mobile phones to output VR applications. Of course, the terminal ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The application relating to the technical field of virtual audios of VR discloses an audio processing method and apparatus, and a terminal device so that the VR audio effect provided by the VR devicecan match the spatial sense of the VR visual effect displayed by the VR application to the user. The audio processing method comprises the following steps that: according to audio sound channel information in original audio data, the original audio data are virtualized by using a head related transfer function (HRTF) database; sampling reverberation data corresponding to the location selected by the user are selected from a sampling reverberation database, wherein the sampling reverberation database includes sampling reverberation data corresponding to the location in a scene displayed by theVR application; reverberation convolution processing is carried out on the virtualized audio data by using the sampling reverberation data corresponding to the location selected by the user; and soundmixing is carried out on the virtualized audio data after reverberation convolution processing and binaural audio data are generated. The audio processing method and apparatus, and the terminal device are applied to audio processing.

Description

Technical field [0001] This application relates to the virtual audio technology field of VR (Virtual Reality, virtual reality), and in particular to an audio processing method. Background technique [0002] VR is a technology that uses computer graphics, sound systems, and various reality and control interface devices to provide immersive experience in an interactive three-dimensional environment generated on a computer. Currently, research in the field of virtual reality is very extensive. Among them, the experience of virtual audio in VR is getting more and more attention. [0003] Currently, when using a VR device, the VR application opened by the user will usually show the user some audio and video effects that simulate the real environment through the VR device. Among them, the audio effect provided by the VR device mainly uses the HRTF (Head Related Transfer Function) technology to achieve the effect of simulating real environment audio. However, this kind of processing tec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04S7/00
CPCH04S7/302H04S7/305
Inventor 徐德著白鹤群赵翔宇
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com