The invention discloses a vehicle
collision detection, description and
early warning system and method based on a driving video, and belongs to the technical field of
artificial intelligence and intelligent traffic safety. According to the
system, on the basis of a vision-
language model, vehicle-mounted videos such as an automobile data recorder are automatically analyzed, and detection, severity grading,
natural language description generation and real-time early warning of vehicle collision events are achieved. The
system extracts high-dimensional semantic features of video frames through a CLIP model, focuses key information through an attention weighting network, inputs the key information into a deep classification network composed of a plurality of full connection
layers, a batch normalization layer and an
activation function, and outputs a multi-level accident severity
classification result. Integrating target detection and environment information, and generating a structured accident description text by using a
fine tuning BART model; a sliding window and
time sequence modeling mechanism is adopted, and recognition and early warning of the pre-collision state are achieved. The method effectively solves the technical problems of lack of semantic understanding, inaccurate severity judgment, incapability of early warning and the like of a traditional method, has high accuracy, high
interpretability and real-
time response capability, and is suitable for intelligent driving assistance and traffic
safety monitoring scenes.