The invention is applicable to the field of intelligent audio adjustment, and provides an immersive audio-video follow-up adjustment method and
system, and the method comprises the steps: constructing a multi-dimensional
perception system, and collecting multi-source information in real time; carrying out fusion
processing on the collected multi-source information based on a deep neural
network model, mining a
dynamic mapping relation between a
user state and the video content through space-
time correlation analysis, and identifying a user interaction intention and an emotional tone and a space scene attribute of the video content; according to a fusion
processing result, calling a dynamic parameter adjustment engine, and generating an audio parameter adjustment scheme in real time; a user experience feedback
closed loop is constructed, a
visual attention area of a user is collected through
eye movement tracking equipment, and personalized adjustment preference parameters are generated; according to the method and the device, the audio effect is accurately matched with the
user state and the audio and video content, the naturalness and the adaptability of immersive experience are remarkably improved, universality and individual differences are considered, and the audio experience which is more suitable for scenes and needs of the user is brought to the user.