The invention discloses a multi-
modal self-adaptive child voice
interaction method for an educational
service robot, relates to the technical field of voice
signal processing, and provides a multi-
modal self-adaptive child voice
interaction method for an educational
service robot through multi-array
microphone dynamic acquisition and beam forming, self-adaptive
noise suppression, multi-speaker separation and
speaker identification, and child exclusive model training and online
fine tuning. Technical means such as context semantic correction and multi-
modal fusion are adopted, so that the target voice focusing and recognition accuracy is greatly improved; multi-person voice tracks are distinguished through an end-to-end network, and rapid distinguishing of a multi-source voice scene is realized in combination with model optimization of child range features; meanwhile, correct vocabularies and pronunciation information are traced back to a speaker
library and a child sound model by using real-time semantic correction and
interactive feedback, and multi-mode cooperation of a camera and a positioning sensor is used for assisting, so that beams are quickly adjusted and interference is suppressed when a child moves at will and
environmental noise suddenly increases, and the
sound quality of the child is improved. And natural and smooth voice interaction experience is provided in class and family scenes.