The invention relates to a visual
transformer substation intelligent inspection
system and method based on a multi-mode large
language model, and belongs to the technical field of power
system intelligence. The
system obtains image, temperature, vibration and
noise data of substation equipment in real time through a multi-
modal data acquisition module, and performs preprocessing and fusion. A high-precision three-dimensional semantic model is constructed by using a three-dimensional dynamic modeling module, and the device attributes are automatically labeled by fusing LLM semantic understanding capability. A multi-
modal large
language model (LLM) engine is combined with cross-
modal feature extraction, a dynamic
knowledge base and a self-adaptive reasoning unit to realize accurate diagnosis of equipment faults. An
augmented reality (AR) interaction module displays the real-time state of equipment through AR glasses and supports
natural language interaction. The self-interpretation decision support module generates interpretable fault reports and maintenance suggestions, and the communication and feedback module is responsible for data uploading and remote alarm. According to the method, multi-dimensional
perception, dynamic knowledge reasoning and self-adaptive decision support of the
equipment state are realized, the intelligent level of substation inspection is remarkably improved, the inspection efficiency is improved by more than 40%, the omission ratio is reduced to less than 1%, and rapid diagnosis of more than 95% of novel faults is supported.