The invention discloses an auditory disorder patient
rehabilitation training
system based on
virtual reality. The
system comprises a
perception fusion module, a basic
perception reconstruction module, a language content integration module, a
rehabilitation training module and a
virtual reality auxiliary module. The invention belongs to the technical field of auditory
rehabilitation training, and particularly relates to an auditory disorder patient
rehabilitation training system based on
virtual reality, which adopts a multi-stage cross-
modal attention-enhanced voice audiovisual characterization method, converts sound signals into visual light
waves and tactile vibration data through a
deep learning model, and displays the visual light
waves and tactile vibration data on the basis of the visual light
waves and tactile vibration data. High-precision and real-time multi-
modal data fusion is realized; basic auditory reconstruction is carried out by adopting an
audio frequency generation dynamic adjustment method combined with voiceprint
dynamic mapping, personalized sound scene mapping is effectively and dynamically generated, and a patient is helped to reconstruct basic
perception ability for sound; a cross-
modal contrast learning method is adopted to assist lip language synchronous training, and voice context background prompts are provided in the
rehabilitation training process.