The invention relates to the technical field of intelligent blind guiding, and discloses an intelligent blind guiding cap
system based on multi-
modal perception, which comprises a multi-
source data acquisition module, a
data processing module, a multi-terminal interaction and prompt module and a
collaboration and optimization module. Through multi-
modal perception fusion, visual information of the obstacle is captured, sound source and temperature and
humidity data are also included, and correlation reasoning is carried out, so that the problem of a single-
modal perception blind area is solved, the accuracy of obstacle recognition in complex environments such as rainy days is improved, and the safety of the blind guiding process is greatly enhanced; meanwhile, through layered adaptive interaction and integration of
bone conduction hearing, micro-vision display, tactile vibration and other multi-sensory prompt
modes, users with residual vision and mild hearing impairment are covered, the prompt information receiving rate is increased, and adaptive coverage of different user groups is achieved.