Virtual sound field real-time interaction system based on binaural effect

A virtual sound field and binaural effect technology, applied in the directions of speaker distribution, electrical components, signal processing, etc., can solve the problems that users cannot achieve an immersive experience, and the sound field interaction is not enough, and achieve flexibility and interactivity. Noise Interference, Sharing and Interaction Ease of Action

Active Publication Date: 2019-09-20
SHANGHAI ARTSBANG CULTURE COMM CO LTD
View PDF8 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0014] This invention patent has the following disadvantages: 1. The extraction and reconstruction of sound field information only processes the sense of space; 2. It can only follow the user's position to interactively output the corresponding sound field, and the sound field interaction is not enough to allow users to achieve immersive experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual sound field real-time interaction system based on binaural effect
  • Virtual sound field real-time interaction system based on binaural effect

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] A binaural effect-based virtual sound field real-time interactive system includes the following modules: an audio signal acquisition module, a sound field rendering module, a virtual sound field interaction module and an output module. The virtual sound field real-time interactive system collects source information through a specific microphone array, and performs sound field rendering from the frequency, time, orientation and loudness of each sound source according to the binaural effect, and then according to the user's head rotation, Information such as position movement outputs corresponding sound effects in different directions in real time.

[0045] Each module in the virtual sound field real-time interactive system of this embodiment is described in detail below:

[0046] 1. Audio signal acquisition module

[0047] The audio signal acquisition module includes a single group or multiple groups of microphone arrays, and these microphone arrays are composed of a se...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a virtual sound field real-time interaction system based on a binaural effect, and the system comprises an audio signal collection module which is used for collecting multiple paths of audio signals; a sound field rendering module which is used for performing sound field rendering on the audio signals and acquiring multiple paths of audio signals with reconstructed sound field information based on a binaural effect; a virtual sound field interaction module which is used for splicing multiple paths of audio signals with reconstructed sound field information in real time according to the head parameters and the user orientation information, and constructing a real-time sound effect in the whole sound field; and the output module is used for outputting a real-time sound effect according to the individual adjustment parameters. Compared with the prior art, audio is processed from the sound and the space sense of the sound field, the original sound field is highly restored and reproduced, and the method has the advantages of flexibility, interactivity, user friendliness and the like.

Description

technical field [0001] The invention relates to a real-time interactive system, in particular to a virtual sound field real-time interactive system based on binaural effect. Background technique [0002] The human auditory system is not only responsible for the function of "listening", but also responsible for the balance function of the whole human body, and the judgment of sound position and propagation direction is an important part of it. People can't distinguish the direction of the sound source when they are close to one ear, but they can with both ears. Auditory localization is the ability of a person to determine the location of a sound source without visual cues - we call it spatial localization of sound or binaural effect. The human ears are symmetrically distributed on both sides of the head, and the auricles and the human head can effectively cover the sound, and when the direct sound and reflected sound of the sound source are sent to the human ear, the time an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04R3/12
CPCH04R3/12H04R2430/00
Inventor 王雨霓秦明昌
Owner SHANGHAI ARTSBANG CULTURE COMM CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products