The invention discloses a music driving fluid generation method and
system based on multi-dimensional
semantic mapping, and belongs to the technical field of
computer graphics and
audio signal processing. The method comprises the following steps that music input by a user is received, characteristics such as
rhythm,
frequency spectrum and energy are obtained through audio analysis, and emotion vectors and color information changing along with time are obtained through a music
emotion recognition and color palette generation module; in a unified parameter space, the audio, emotion and color
semantics are mapped into fluid colors,
fluid simulation parameters and camera and environment
control parameters, and
fluid models such as shallow water
waves or height fields are driven to generate multi-style fluid scenes changing along with music. Compared with an existing
music visualization mode which only depends on
frequency band energy to drive simple and
special effects, the method can achieve consistent expression of music emotion,
rhythm, fluid form and audio-visual
atmosphere in multiple scenes, and can be applied to scenes such as
music visualization, immersive interactive art display and emotion relaxation assistance.