The invention provides a multi-
modal LLM-based building risk prediction management and control method and
system, and relates to the technical field of building safety management, and the method comprises the steps: analyzing sensor data, a text report, an image video and a voice instruction of a
building construction site through a multi-
modal feature extraction module, and generating a structured
feature vector set; performing cross-
modal semantic fusion and risk
coupling analysis by using a multi-modal LLM
inference engine to generate a
potential risk identification set and a
risk level assessment result; dynamically matching a management and control rule of the building
safety specification library based on the risk identifier, and outputting a strategy set consisting of an equipment regulation and control instruction, a personnel early warning notification and a regional management and control suggestion; driving a field execution device to implement a control action, and collecting a multi-modal feedback
data stream; and calculating a
strategy execution efficiency index through a closed-
loop optimization module, dynamically updating LLM
model parameters and rule weights, and forming a self-
adaptive optimization link. The
system correspondingly comprises a multi-modal
feature extraction and fusion module, an LLM
inference engine module, a dynamic strategy generation module, an execution feedback module and a closed-
loop optimization module. According to the method, the problems of key feature omission and risk response
lag in traditional single-mode analysis are solved, and the risk prediction accuracy and the management and control real-time performance are remarkably improved.