This invention discloses a method and
system for capturing collisions of navigation aids based on
shore-based video, relating to the field of waterway
navigation aid supervision. First, the
shore-based video
stream is adaptively enhanced with defogging and
image stabilization. A dual-
stream deep learning algorithm is then used for pixel-level recognition and semantic segmentation of the vessel and
navigation aid. Subsequently, a spatiotemporal
interaction model is constructed to calculate the
relative motion trend and
mask overlap index of the two in real time.
Frequency domain analysis technology is used to filter out the
periodic wave displacement of the
navigation aid and extract the non-periodic abrupt displacement caused by the collision. Finally, based on multi-criteria judgment of overlap and abrupt displacement, the
system automatically triggers the extraction and preservation of multi-dimensional evidence. This
system includes modules for video acquisition, pixel-level recognition,
interactive analysis, interference filtering and judgment, and evidence preservation. This invention solves the pain points of significant interference in the marine environment, difficulty in obtaining collision evidence, and high
false alarm rates, significantly enhancing the intelligence and rule of law level of navigation aid supervision.