General-purpose intelligent security inspection system

Abstract

This invention provides a universal intelligent security inspection system applicable to mobile vehicles, including a communication interface, a user interface, a camera, a storage device, and a processor. The communication interface connects to the vehicle to receive baseline height information and transmit motion control commands. The user interface receives natural language commands, the camera captures real-time images, and the storage device stores a map database and commands. The processor executes commands to correct the camera projection matrix based on the baseline height information, parses the natural language commands to generate inspection parameters, compares real-time image feature points with the map database to determine the current position, and then generates motion control commands based on the inspection parameters and the current position, transmitting them to the vehicle. Finally, it analyzes the real-time images to determine if any abnormal conditions have occurred in the environment.

Claims

1. A universal intelligent security inspection system, suitable for installation on a mobile vehicle, comprising: A communication interface for communicating with the mobile vehicle to receive baseline altitude information from the mobile vehicle and transmit a motion control command to the mobile vehicle; a user interface for receiving a natural language command associated with an inspection task; a camera for capturing a real-time image during the inspection task; a storage device for storing a map database and multiple commands; and a processor electrically connected to the communication interface, the user interface, the camera, and the storage device, the processor executing the commands to implement the inspection task, wherein the commands drive the processor to perform the following steps: calibrating a projection matrix of the camera based on the baseline altitude information; parsing the natural language command to generate multiple inspection parameters; capturing multiple feature points from the real-time image and comparing the feature points with the map database to determine a current position of the mobile vehicle; Based on the inspection parameters and the current location, the motion control command is generated and transmitted to the mobile vehicle through the communication interface; and the real-time image is analyzed to determine whether an abnormal state has occurred in the environment of the inspection task.

2. The general intelligent security inspection system as described in claim 1, wherein parsing the natural language instruction to generate the inspection parameters involves running a large language model to convert the natural language instruction into the inspection parameters corresponding to the inspection task, the inspection parameters including at least one of movement speed setting, sensor sensitivity setting, and inspection range.

3. The general intelligent security inspection system as described in claim 1, wherein the processor runs a visual language model to extract the feature points, compares the feature points with the map database, and determines whether the abnormal state occurs in the environment of the inspection task.

4. The general-purpose intelligent security inspection system as described in claim 1, wherein the communication interface includes at least one of a USB interface and a CAN bus interface.

5. The general-purpose intelligent security inspection system as described in claim 1 further includes a millimeter-wave radar electrically connected to the processor, wherein the instructions are used to drive the processor to correct a detection tilt angle of the millimeter-wave radar based on the basic height information, and to receive a liveness detection signal sent by the millimeter-wave radar during the inspection task.

6. The general intelligent security patrol system as described in claim 5, wherein the abnormal state includes the difference between the real-time image and a pre-stored image in the map database exceeding a threshold, or receiving the liveness detection signal sent by the millimeter-wave radar.

7. The general-purpose intelligent security inspection system as described in claim 5, wherein before performing the inspection task, the processor is further used to drive the user interface to display or play a task confirmation content associated with the inspection parameters, and after receiving a user confirmation command through the user interface, it controls the mobile vehicle to move and simultaneously starts the camera and the millimeter-wave radar to perform the inspection task.

8. The general-purpose intelligent security inspection system as described in claim 1 further includes an alarm device electrically connected to the processor, the alarm device including at least one of a display screen and a speaker, and the storage device further storing an alarm database; the processor is further configured to drive the alarm device to output a preset alarm sound or a warning screen from the alarm database when it determines that the abnormal state has occurred in the environment of the inspection task.

9. The general-purpose intelligent security inspection system as described in claim 1 further includes a wireless communication device electrically connected to the processor, wherein the processor is further configured to control the wireless communication device to send a notification message associated with the abnormal state and the real-time image to a central control center when the abnormal state is determined to occur in the environment of the inspection task.

10. The general-purpose intelligent security inspection system as described in claim 1, wherein the processor does not rely on a global positioning system signal when determining the current location of the mobile vehicle.

Images