Video fusion method, apparatus and device, and computer readable storage medium

Abstract

Embodiments of the invention disclose a video fusion method, apparatus and device, and a computer readable storage medium. The method comprises the steps of extracting and collecting characteristic points of a visible light video and a terahertz video of a passing target in a terahertz safety check channel by utilizing SIFT feature descriptors respectively; and fusing the terahertz video and the visible light video according to time and spatial mapping relations, wherein a calculation process for the time and spatial mapping relations comprises the steps of, based on frame frequency proportioncoefficients of the visible light video and the terahertz video and a track speed curve of a preset characteristic point, determining the time mapping relation between the visible light video and theterahertz video, wherein the track speed curve is an outer contour change rate of the preset characteristic point of the shot object in the visible light video and the terahertz video; and determining the spatial mapping relation between the visible light video and the terahertz video according to a spatial position relation between collection devices of the visible light video and the terahertzvideo, and the time mapping relation. According to the video fusion method, apparatus and device, the real-time fusion of the visible light video and the terahertz video is realized; the safety checkefficiency of a terahertz safety check system is improved; and the practical requirements of safety check work are met.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of security inspection, and in particular to a video fusion method, device, equipment, and computer-readable storage medium. Background technique [0002] As an important part of social security management, the security inspection system is gradually applied in various application scenarios, such as subways, airports, museums or tourist attractions. [0003] Terahertz waves are far-infrared electromagnetic radiation with a wavelength between 30 μm and 3 mm, which can penetrate materials such as paper, plastic, and cloth. Terahertz imaging videos obtained by using terahertz waves as a signal source for imaging can be found hidden in human clothing. items below. Due to the low ionization energy of terahertz waves, there is no harm to the human body, and terahertz imaging can detect metal objects and non-metal contraband (such as explosives, ceramic knives, glass knives, drugs, etc.),...

AI Technical Summary

Problems solved by technology

[0005] However, human body security imaging based on terahertz technology has low resolution, low signal-to-noise ratio of video frame rate, poor contrast, and not rich in details. It is impossible to know the size, shape, and exact location of contraband. It can provide simple prompts to hand inspectors (such as the approximate range of prohibited items). When there is a large flow of people in the security check, the map judge cannot even determine the specific person carrying suspicious contraband, and the hand inspector needs to check each item in turn A manual touch that has passed the security check can accurately locate the prohibited items, and the security check efficiency is low.

Images