Unlock instant, AI-driven research and patent intelligence for your innovation.

An audio processing method and system

An audio processing and audio technology, applied in the field of signal processing, can solve the problem that the client cannot play 3603Daudio, and achieve the effect of improving the audio experience, the sense of presence, and the user experience.

Active Publication Date: 2017-11-07
BEIJING TWIRLING IN TIME CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In order to overcome the above-mentioned defects of the prior art, the object of the present invention is to provide a cloud audio processing method, server and system, which can effectively and high-quality generate virtual surround sound, and is mainly used for audio processing with virtual reality headsets Stereo headphones are played, and the generation of the virtual surround sound is carried out on the cloud server, which is well adapted to the existing network type based on the cloud architecture, and the generation and storage of the virtual surround sound are performed by the server, thus solving the current problem There is a problem that the client cannot play various 3603D audio, especially the audio suitable for virtual reality applications

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An audio processing method and system
  • An audio processing method and system
  • An audio processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] Embodiment one: if figure 1 As shown, a kind of audio object processing includes the following processing steps:

[0033] Obtain the rotation angle of the user's head through the head tracking device;

[0034] Encoding the audio object into a higher order (preferably 2nd or 3rd order) Ambisonic B-format signal according to said rotation angle;

[0035] Convert said ambisonic B-format signal into a virtual loudspeaker array signal; as a first-order B-format signal [W 1 x 1 Y 1 Z 1 ] T As an example, convert the virtual loudspeaker array signal [L 1 L 2 …L N ] T The process is to perform the following operations:

[0036]

[0037] Wherein, N is the number of virtual speakers included in the virtual speaker topology. The G matrix used in the above formula is an ambisonic decoding matrix, which can be obtained by calculating the pseudo-inverse matrix.

[0038] The virtual speaker array signal of the audio object is binaurally transcoded based on the bina...

Embodiment 2

[0062] Figure 2a -c describes an embodiment based on multi-channel audio transmission in the cloud to improve the effect of immersive experience. It should be noted that the present invention covers two application scenarios (1) audio real-time communication (conference scenario), such as Figure 2b Shown; (2) audio download, such as Figure 2c shown;

[0063] For the two scenarios, there are three forms of input: a separate audio object, sound field input (wxy form), and binaural recording signals.

[0064] Such as Figure 2b As shown, for the audio download scenario:

[0065] The storage server stores binaural recording signals, ambisonic recording signals (sound field signals), and / or audio objects, and the binaural transcoding server obtains the above-mentioned signals from the storage server, and converts the audio objects into ambisonic signals on the binaural transcoding server side, For example, a first-order horizontal direction B-format signal, ie, wxy, is summ...

Embodiment 3

[0071] Such as image 3 Shown, a kind of cloud audio processing server, acquisition unit, obtains the rotation angle of the user's head rotation that the head tracking device in the client sends; Acquisition unit, respectively collects binaural recording signal, ambisonic recording signal, audio object; The ear transcoding unit is connected to the acquisition unit and the acquisition unit respectively, and performs binaural transcoding on the audio signals of different formats according to the rotation angle, wherein for the binaural recording signal, according to the rotation angle Perform interpolation to generate binaural recording binaural signals; and if higher spatial accuracy is required, the binaural transcoding unit rotates the audio object signal according to the rotation angle, and encodes the rotated audio object signal into a high-order B-format audio object signal, after binaural transcoding to generate high-order B-format audio object binaural signal, the superp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a cloud audio processing method, server and system. The cloud audio processing method comprises the steps of, aiming at audio signals in different formats, carrying out binaural transcoding for the audio signals in different formats respectively based on a head rotation angle of a client so as to generate binaural audio signals in corresponding formats; and superposing the binaural signals in the corresponding formats to obtain a virtual acoustical signal output by audio ears. The audio processing of the audio processing method is carried out on a cloud server, so that the cloud audio processing method well adapts to cloud architecture based audio processing and storage, and the problems of low quality of the virtual acoustical signal generated by the mobile terminal and great computation burden are reduced. In addition, aiming at the possible delay caused by processing on the server, the cloud audio processing method further comprises a step of carrying out smoothing processing for the angle to remove the delay.

Description

technical field [0001] The present invention relates to the technical field of signal processing, in particular to an audio processing method, server and system. Background technique [0002] When using a virtual reality head-mounted display (HMD) to present content to users, virtual 3D audio technology is used to play audio content to users through stereo headphones. One way to improve the sense of presence is to track user head movements ( head tracking) to process the sound accordingly. For example, if the original sound is perceived by the user as coming from the front, when the user turns his head 90 degrees to the left, the sound should be processed so that the user perceives the sound as coming from the right 90 degrees. The virtual reality device here can be of many kinds, such as a display device with head tracking, or just a stereo headset with head tracking sensors. [0003] There are also multiple ways to implement head tracking. It is more common to use a var...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04S7/00G10L19/008
CPCG10L19/008H04S7/304H04S7/306
Inventor 张晨孙学京刘皓
Owner BEIJING TWIRLING IN TIME CO LTD