The invention discloses a steel
ladle hoisting
safety monitoring and early warning method,
system and equipment and a medium. The method comprises the following steps: acquiring double-side images in a steel
ladle hoisting process; inputting the bilateral images into a multi-target detection model, and outputting bounding boxes, category labels and confidence coefficients of the plurality of key targets; obtaining a local
cutting image of each key target according to the bilateral images and the bounding box, the category
label and the confidence of each key target, and generating a
structured text in combination with the bounding box position, the relative pixel distance and the category
label of each key target; inputting the local
cutting image, the
structured text and the prompt word template of each key target into a multi-
modal big
language model, and outputting a behavior
label, a
risk level, a reason, a recommendation action and an instruction state of the current steel
ladle hoisting scene through multi-
modal reasoning; early warning is conducted according to the recommended action, and the steel ladle hoisting equipment is controlled according to the instruction state. According to the invention, intelligent monitoring and linkage early warning in the steel ladle hoisting process can be realized.