The invention relates to the technical field of
audio signal processing and sound reinforcement, and discloses a field
sound field adaptive generation
system based on multi-
modal stage data, which comprises a multi-
modal sensing network, a
central processing unit and a multi-channel
sound field generation array, and is characterized in that the multi-
modal sensing network is used for acquiring image depth, audio and spatial geometric data; the
central processing unit constructs a dynamic acoustic
voxel map and solves a sound source attitude, calculates shielding loss based on sound
ray tracking, executes a
routing decision between a
direct path mode and a reflection path mode, and generates
adaptive filter parameters and beam forming weights; the
sound field generation array executes acoustic rendering, radiates physical sound
waves and generates a field sound field matched with the stage environment. According to the method, visual attitude information and a
multipath routing mechanism are fused, a non-line-of-
sight transmission channel is constructed by using an environment reflecting surface, sound source
directivity deviation is compensated in real time, the problems of coverage blind areas caused by dynamic shielding and definition reduction caused by attitude change are solved, and sound reinforcement stability in a complex stage environment is improved.