VR Spatial Sound Effect Generation Method Based on Scene Dynamic Matching

By constructing a scene-sound source parameter mapping model, real-time collection of VR scene features and user status data, and the generation of spatial sound effects that match the current scene using deep neural networks and physical acoustic models, the problem of discontinuous sound propagation in VR spatial sound effect generation is solved, improving immersion and development efficiency.

CN122086352BActive Publication Date: 2026-06-30NANJING JINYU INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
NANJING JINYU INFORMATION TECH CO LTD
Filing Date
2026-04-21
Publication Date
2026-06-30

AI Technical Summary

Technical Problem

Existing VR spatial sound generation technology fails to establish a dynamic and continuous correlation model based on the physical characteristics of the scene where the sound source is located, resulting in the sound propagation effect not evolving realistically and continuously with changes in the scene, thus affecting the immersive experience.

Method used

By constructing a scene-sound source parameter mapping model, real-time collection of VR scene features and user status data, end-to-end training using deep neural networks, and combining physical acoustic models and binaural cue correction, spatial sound effects matching the current scene are generated, and sound effect parameters are updated in real time.

Benefits of technology

It achieves dynamic synchronization between sound effects and scenes, improves immersion and development efficiency, reduces sound effect stuttering and abrupt changes, and enhances the realism and comfort of the auditory experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122086352B_ABST
    Figure CN122086352B_ABST
Patent Text Reader

Abstract

This invention discloses a VR spatial sound effect generation method based on scene dynamic matching, belonging to the field of spatial sound effect technology. It involves real-time acquisition of scene and user data to generate feature vectors, outputting initial sound source parameters through a pre-trained model, and then combining these with user state correction to obtain a sound source parameter package. Based on this, basic sound effects are mapped and synthesized in real time to output matched spatial sound effects. Continuous monitoring of data changes and dynamic triggering of parameter updates and sound effect adjustments achieves real-time dynamic matching between sound effects and the VR scene. This invention solves the problem of sound effects being disconnected from the scene through real-time scene matching and acoustic parameter calculation; it enhances the realism of sound source localization by combining a physical model and binaural cue correction; it eliminates the need for a scene-customized sound effect library by relying on a pre-trained generalization model, reducing development costs; and it uses incremental adjustment to achieve a smooth transition, avoiding auditory abruptness and fatigue, balancing immersion and comfort.
Need to check novelty before this filing date? Find Prior Art