The invention discloses intelligent glasses based on a multi-mode vision-
language model and an environment
perception method, and relates to the technical field of
visual impairment assistance, and the intelligent glasses comprise a glasses main body, a camera unit, an edge calculation unit, a
bone conduction audio unit, a touch interaction unit, a power
supply management unit and a
wireless communication unit; the edge calculation module is internally provided with a lightweight multi-
modal vision-
language model and is used for carrying out preprocessing and semantic analysis on the acquired environment image and generating environment description information, and the
bone conduction audio unit broadcasts the environment description information to a wearer in a voice form; the multi-mode vision-
language model is used for synchronously
processing vision and language features, obstacles, traffic signals, character signboards and scene
semantics are effectively recognized, the
perception dimension is more comprehensive, rich environment semantic description can be provided, accurate recognition of multiple elements such as obstacles, identifiers and characters in a complex environment is achieved, and the recognition efficiency is improved. And the safety of navigation guidance for
visually impaired people is improved.