A virtual sound customization method and device based on auditory matching

A virtual sound and auditory technology, applied in the field of 3D virtual sound, to reduce confusion, improve accuracy, improve efficiency and precision

Active Publication Date: 2021-07-20
SOUTH CHINA UNIV OF TECH
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the defects of the above-mentioned existing personalized HRTF matching and virtual sound customization methods, the present invention provides a virtual sound customization method and device based on auditory matching

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A virtual sound customization method and device based on auditory matching
  • A virtual sound customization method and device based on auditory matching
  • A virtual sound customization method and device based on auditory matching

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The present invention will be further described below in conjunction with the accompanying drawings, but the protection scope of the present invention is not limited to the scope indicated by the embodiments.

[0048] figure 1 It is a principle block diagram of a virtual sound customization method based on auditory matching in the present invention. It uses the neural network to establish the nonlinear mapping relationship between the physiological feature value and the auditory score; further, the auditory score predicted by the neural network is used as the matching factor, and the HRTF data matching the user's hearing is selected from the known HRTF database. As an approximation of personalized HRTF; finally, the auditory-matched HRTF is used for binaural virtual sound synthesis to realize the user customization of virtual sound. This method is superior to the existing methods of HRTF matching using non-auditory factors and virtual sound customization. It is manifes...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a virtual sound customization method and device based on auditory matching. The method of the invention includes: extracting HRTF-related physiological feature values ​​from the 3D model of the user's head; inputting the auditory evaluation neural network to predict the auditory score; selecting the HRTF data corresponding to the highest auditory score from the known HRTF database, as the user Auditory matching HRTF data; the original single-channel signal, auditory matching HRTF data, and room impulse response are sequentially processed by time domain convolution processing or equivalent frequency domain filtering processing to obtain user-customized binaural virtual acoustic signals. The present invention utilizes the 3D sensing device of the existing mobile terminal to cover HRTF-related physiological feature quantities; at the same time, it directly establishes the nonlinear relationship between the physiological feature value and the subjective sense of hearing, and improves the accuracy of HRTF matching and virtual sound customization. Helps reduce the positioning error of the virtual sound playback device and improve the user's immersion.

Description

technical field [0001] The present invention relates to the technical field of 3D virtual sound, in particular to a method and device for customizing 3D virtual sound based on auditory matching, which generates virtual sound satisfying individual auditory characteristics. Background technique [0002] Head-related transfer function (head-related transfer function, HRTF) is the core data of 3D virtual sound technology. The binaural virtual sound signal synthesized by calculating the HRTF with the original single-channel signal and the room impulse response reconstructs the binaural sound pressure signal corresponding to a sound source in a real 3D sound scene from a physical point of view, and can be played back through headphones. Allow users to obtain the same or similar subjective experience as the real sound source (that is, the sense of presence and immersion). [0003] From the perspective of physical origin, HRTF characterizes the interaction of sound waves with human...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04S3/00H04S7/00G06N3/04G06N3/08
CPCH04S3/00H04S7/30G06N3/08G06N3/045
Inventor 宋昊钟小丽刘雪洁王杰
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap