Safety inspection system and data processing method thereof

By combining ultra-wideband radar technology and millimeter wave imaging technology, machine learning algorithms are used to identify contrabands, and the problem of difficult to automatically distinguish contrabands from high false alarm rates in the existing technology is solved, and efficient and accurate security inspection is achieved.

CN109375220BActive Publication Date: 2025-05-02TSINGHUA UNIVERSITY +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN201811632225.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-03-30
Filing Date
2018-12-28
Publication Date
2025-05-02
Estimated Expiration
2038-12-28

AI Technical Summary

Technical Problem

Existing millimeter wave imaging equipment is difficult to automatically distinguish whether suspicious objects are contraband, resulting in high false alarm rates. Ultra-wideband radar technology cannot accurately locate the location of contraband and is susceptible to environmental interference.

Method used

Combining ultra-wideband radar technology and millimeter wave imaging technology, ultra-wideband signal acquisition equipment, millimeter wave imaging equipment and data processing equipment are used to identify ultra-wideband reflected signals and millimeter wave images, identify contraband and display alarm messages.

Benefits of technology

It significantly improves the efficiency and accuracy of security inspections, can quickly classify and accurately locate contraband, and reduces the false alarm rate.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN109375220B_ABST
    Figure CN109375220B_ABST
Patent Text Reader

Abstract

Disclosed are a security inspection system and a data processing method thereof. The security inspection system includes: an ultra-wideband signal acquisition device, which acquires an ultra-wideband reflection signal reflected by an object to be inspected; a millimeter wave imaging device, which acquires millimeter wave holographic data of the object to be inspected; a data processing device, which stores an ultra-wideband database and a millimeter wave image library, and is configured to: identify, according to the ultra-wideband database, contraband in the ultra-wideband reflection signal whose probability of being carried by the object to be inspected exceeds a predetermined probability, reconstruct a millimeter wave image of the object to be inspected according to the millimeter wave holographic data, and identify an area of ​​interest in the millimeter wave image according to the millimeter wave image library, and identify the contraband in the area of ​​interest according to the millimeter wave image library; and a display, which displays the millimeter wave image and an alarm message related to the contraband.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese Patent Application No. 201810293156.1 filed on March 30, 2018, the entire disclosure of which is incorporated herein by reference. Technical Field

[0003] The present disclosure generally relates to the field of security inspection technology, and more particularly to a security inspection system and a data processing method combining millimeter wave imaging and ultra-wideband radar technology. Background Art

[0004] In order to ensure public safety, it is necessary to conduct security checks at the entrances of important public places. Compared with X-ray inspections, millimeter waves are non-ionizing and can penetrate shielding materials such as clothing, plastic and paper, making them particularly suitable for human body security checks for the public. Millimeter wave human body security inspection technology can be mainly divided into two types: active imaging and passive imaging. Compared with passive imaging, active millimeter wave imaging has high image resolution and strong recognition ability for suspicious objects, so it has more application prospects. Active millimeter wave imaging equipment can obtain three-dimensional millimeter wave images of the human body surface, and often uses automatic recognition algorithms to detect suspicious items carried by the human body. However, since millimeter wave images only have shape information, it is impossible to quickly classify suspicious objects. Existing millimeter wave imaging equipment generally uses image shape information to identify whether the human body surface carries suspicious objects, but it is difficult to automatically distinguish whether suspicious objects are contraband, resulting in a very high false alarm rate.

[0005] In addition, ultra-wideband radar technology can be used to perform security checks by detecting the resonant frequency of objects. Since only one-dimensional signals are processed, the detection speed is fast, but this technology cannot accurately locate the position of contraband and is easily affected by environmental interference.

[0006] Therefore, there is an urgent need for a security inspection system and method that can quickly classify suspicious objects and accurately locate the position of the suspicious objects. Summary of the invention

[0007] According to one aspect of the present disclosure, there is provided a safety inspection system, comprising:

[0008] An ultra-wideband signal acquisition device is used to acquire an ultra-wideband reflection signal reflected by the object to be inspected;

[0009] Millimeter wave imaging equipment to obtain millimeter wave holographic data of the object to be inspected;

[0010] The data processing device stores an ultra-wideband database and a millimeter wave image library and is configured to:

[0011] According to the ultra-wideband database, identifying the contraband in the ultra-wideband reflected signal whose probability of being carried by the object to be inspected exceeds a predetermined probability,

[0012] reconstructing a millimeter wave image of the object to be inspected according to the millimeter wave holographic data, and identifying a region of interest in the millimeter wave image according to a millimeter wave image library, and

[0013] identifying the contraband in the region of interest according to the millimeter wave image library;

[0014] as well as

[0015] A display displays the millimeter wave image and an alarm message related to the contraband.

[0016] In an embodiment, the data processing device is further configured to: identify the ultra-wideband reflection signal using a first machine learning algorithm; and identify the millimeter wave image using a second machine learning algorithm.

[0017] In an embodiment, the first machine learning algorithm and the second machine learning algorithm are neural network algorithms.

[0018] In an embodiment, when the contraband is identified in the region of interest, the alarm message includes information about the type of the contraband and the location in the millimeter wave image.

[0019] In an embodiment, the ultra-wideband database and the millimeter wave image library are established for contraband.

[0020] In an embodiment, the ultra-wideband signal acquisition device comprises:

[0021] an ultra-wideband signal source configured to generate an ultra-wideband signal;

[0022] An ultra-wideband signal transmitting antenna, coupled to the ultra-wideband signal source and configured to transmit the ultra-wideband signal into free space;

[0023] an ultra-wideband signal receiving antenna configured to receive an ultra-wideband reflected signal reflected by the object to be detected; and

[0024] The collection and control unit is coupled to the ultra-wideband signal transmitting antenna and the ultra-wideband signal receiving antenna, and is configured to control the transmission of the ultra-wideband signal and collect the ultra-wideband reflected signal.

[0025] In an embodiment, the millimeter wave imaging device comprises:

[0026] a millimeter wave transceiver antenna array, comprising a plurality of sub-units arranged in an array, configured to transmit and receive millimeter wave signals; and

[0027] The millimeter wave transceiver is coupled to the millimeter wave transceiver antenna array and is configured to generate a millimeter wave signal and transmit it to free space through the millimeter wave transceiver antenna array, and collect the millimeter wave reflected signal received by the millimeter wave transceiver antenna array to obtain the millimeter wave holographic data of the object to be inspected.

[0028] In an embodiment, the millimeter wave imaging device further comprises:

[0029] A slider, coupled to the millimeter wave transceiver antenna array and configured to support the reciprocating motion of the millimeter wave transceiver antenna array along the slide rail direction;

[0030] A synchronous gear configured to drive the millimeter wave transceiver antenna array to reciprocate through a synchronous toothed belt; and

[0031] A drive motor is configured to drive the synchronous gear and the synchronous toothed belt.

[0032] According to another aspect of the present disclosure, a method for processing security check data is provided, comprising:

[0033] Acquire an ultra-wideband reflection signal reflected by the object to be inspected;

[0034] Acquire millimeter wave holographic data of the object to be inspected;

[0035] According to the ultra-wideband database, identifying the contraband in the ultra-wideband reflected signal whose probability of being carried by the object to be inspected exceeds a predetermined probability,

[0036] reconstructing a millimeter wave image of the object to be inspected according to the millimeter wave holographic data, and identifying a region of interest in the millimeter wave image according to a millimeter wave image library,

[0037] identifying the contraband in the region of interest based on the millimeter wave image library; and

[0038] The millimeter wave image and an alarm message related to the contraband are displayed.

[0039] In an embodiment, the ultra-wideband reflection signal is identified using a first machine learning algorithm; and the millimeter wave image is identified using a second machine learning algorithm.

[0040] In an embodiment, the first machine learning algorithm and the second machine learning algorithm are neural network algorithms.

[0041] In an embodiment, when the contraband is identified in the region of interest, the alarm message includes information about the type of the contraband and the location in the millimeter wave image.

[0042] In an embodiment, the ultra-wideband database and the millimeter wave image library are established for contraband.

[0043] According to the embodiments of the present disclosure, the efficiency and accuracy of security inspection can be significantly improved by combining ultra-wideband radar technology with millimeter wave imaging technology. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0045] Figure 1 is a schematic diagram showing the structure of a safety inspection system according to an embodiment of the present disclosure;

[0046] Figure 2 is a schematic diagram showing the structure of an ultra-wideband signal acquisition device according to an embodiment of the present disclosure;

[0047] Figure 3 is a schematic diagram showing the structure of a millimeter wave imaging device according to an embodiment of the present disclosure; and

[0048] Figure 4 is a flowchart illustrating a data processing method for security check according to an embodiment of the present disclosure.

[0049] Throughout the drawings, the same or similar reference numerals refer to the same or similar parts. DETAILED DESCRIPTION

[0050] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In addition, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0051] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The words "a", "an (kind)" and "the" used herein should also include the meanings of "multiple" and "multiple", unless the context clearly indicates otherwise. In addition, the terms "including", "comprising" and the like used herein indicate the presence of the features, steps, operations and / or components, but do not exclude the presence or addition of one or more other features, steps, operations or components.

[0052] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification, and should not be interpreted in an idealized or overly rigid manner.

[0053] Some block diagrams and / or flow charts are shown in the accompanying drawings. It should be understood that some blocks or combinations thereof in the block diagrams and / or flow charts may be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that these instructions, when executed by the processor, may create a device for implementing the functions / operations described in these block diagrams and / or flow charts.

[0054] Therefore, the technology of the present disclosure can be implemented in the form of hardware and / or software (including firmware, microcode, etc.). In addition, the technology of the present disclosure can take the form of a computer program product on a computer-readable medium storing instructions, which can be used by an instruction execution system or in combination with an instruction execution system. In the context of the present disclosure, a computer-readable medium can be any medium that can contain, store, transmit, propagate, or transmit instructions. For example, a computer-readable medium can include, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, device, or propagation medium. Specific examples of computer-readable media include: magnetic storage devices, such as magnetic tapes or hard disks (HDDs); optical storage devices, such as compact disks (CD-ROMs); memories, such as random access memories (RAMs) or flash memory; and / or wired / wireless communication links.

[0055] Figure 1 It is a schematic diagram showing the structure of a security inspection system according to an embodiment of the present disclosure.

[0056] like Figure 1 As shown, the security inspection system 100 according to this embodiment may include an ultra-wideband signal acquisition device 101 , a millimeter wave imaging device 102 , a data processing device 103 and a display 104 .

[0057] The ultra-wideband signal acquisition device 101 acquires the ultra-wideband reflection signal reflected by the object to be inspected. When the person to be inspected enters the security inspection system, the ultra-wideband signal acquisition device can acquire the reflection signal of the ultra-wideband (UWB) signal irradiated on the person to be inspected. The reflection signal is a one-dimensional ultra-wideband spectrum signal. The one-dimensional ultra-wideband spectrum signal carries the resonant frequency of the object (for example, a pistol, a knife or an explosive), so it can achieve rapid detection and classification of the object.

[0058] The millimeter wave imaging device 102 obtains the millimeter wave holographic data of the object to be inspected. Electromagnetic waves with a wavelength of 1 to 10 mm can be called millimeter waves. The special electromagnetic characteristics of electromagnetic waves in this band make millimeter waves applicable to the field of human security inspection. Active millimeter wave imaging technology mainly utilizes the penetrability of millimeter waves. When the object to be inspected stands in the imaging area of ​​the millimeter wave imaging device 102, the millimeter wave imaging device 102 scans the object to be inspected. The millimeter wave emitted by the millimeter wave imaging device 102 penetrates the clothes and is reflected back by the human body or other hidden objects on the body surface. The device obtains a holographic image of the object to be inspected based on the reflected millimeter wave holographic data. Millimeter wave radiation belongs to electromagnetic wave radiation, not ionizing radiation, so it has no ionizing hazard to the human body, and the electromagnetic radiation power of the scanning signal is only one thousandth of that of the mobile phone signal. In addition, the active millimeter wave imaging effect is good. In actual imaging, contraband such as hidden pistols, knives, bombs, drugs, etc. can be seen at a glance.

[0059] In the embodiment of the present disclosure, the ultra-wideband signal acquisition device 101 and the millimeter wave imaging device 102 can be arranged on both sides of the security inspection channel, such as Figure 1 However, it should be noted that the placement positions of the ultra-wideband signal acquisition device 101 and the millimeter wave imaging device 102 are not limited thereto.

[0060] The data processing device 103 stores an ultra-wideband database and a millimeter wave image library. Both the ultra-wideband database and the millimeter wave image library are pre-established for contraband (such as pistols, knives, bombs, drugs, etc.). In an implementation, the ultra-wideband database includes ultra-wideband spectrum signals corresponding to various contraband, and the millimeter wave image library includes millimeter wave images corresponding to various contraband.

[0061] The data processing device 103 identifies the contraband in the ultra-wideband reflection signal whose probability of being carried by the object to be inspected exceeds the predetermined probability based on the ultra-wideband database. In an embodiment, the data processing device 103 can compare the ultra-wideband reflection signal with the ultra-wideband signal corresponding to various contraband in the ultra-wideband database, and give the probability that the object to be inspected carries various contraband. If the probability of a certain contraband exceeds the predetermined probability, the contraband is output. For example, the predetermined probability can be set to 50%. If the probability of identifying a pistol in the ultra-wideband reflection signal is 70%, a pistol with a probability of 70% can be output. However, it should be noted that the value of the predetermined probability can be set according to the specific circumstances of the security inspection. In addition, in an embodiment, the comparison can be performed using a first machine learning algorithm, that is, the ultra-wideband reflection signal is identified using the first machine learning algorithm. The first machine learning algorithm can be, but is not limited to, a neural network algorithm.

[0062] The data processing device 103 reconstructs the millimeter wave image of the object to be inspected according to the millimeter wave holographic data, and identifies the region of interest in the millimeter wave image according to the millimeter wave image library. In an embodiment, the data processing device 103 can compare the reconstructed millimeter wave image with the millimeter wave images of various contraband in the millimeter wave image library, so as to identify the region where the contraband exists in the millimeter wave image. In addition, in an embodiment, the millimeter wave image is identified using a second machine learning algorithm. The second machine learning algorithm can be, but is not limited to, a neural network algorithm.

[0063] The data processing device 103 further identifies the contraband in the region of interest based on the millimeter wave image library. In an embodiment, if the contraband identified in the ultra-wideband reflection signal with a probability exceeding a predetermined probability is a pistol, the contraband in the region of interest is compared with the millimeter wave image corresponding to the pistol in the millimeter wave image library to determine whether there is a pistol in the region of interest. This enables fast and accurate positioning of contraband (e.g., a pistol).

[0064] The display 104 displays the millimeter wave image and an alarm message related to the contraband. In an embodiment, when the contraband is identified in the region of interest, the alarm message includes information related to the type of the contraband and the location in the millimeter wave image.

[0065] In the security inspection system 100 provided in the embodiment of the present disclosure, the rapid classification and positioning of contraband in security inspection is achieved by combining ultra-wideband radar technology with millimeter wave imaging technology. Thereby, passengers carrying non-contraband items such as mobile phones and keys are quickly released, which significantly improves the efficiency of security inspection. In an embodiment, the object to be inspected is first scanned by an ultra-wideband signal, and an ultra-wideband reflection signal reflected by the object to be inspected is obtained, so as to quickly detect the category of the contraband carried. Then, by scanning the object to be inspected by millimeter waves and obtaining a millimeter wave holographic image of the object to be inspected, the area (i.e., position) of the suspicious object is determined. Finally, the contraband is further compared with the area of ​​the suspicious object to determine the exact location of the contraband. This solves the problem that ultra-wideband radar technology cannot accurately locate contraband and the problem that millimeter wave imaging technology cannot accurately give the type of contraband. Thereby significantly improving the efficiency and accuracy of security inspection.

[0066] Figure 2 FIG. 2 is a schematic diagram showing the structure of an ultra-wideband signal acquisition device 200 according to an embodiment of the present disclosure.

[0067] like Figure 2As shown, the ultra-wideband signal acquisition device 200 may include an ultra-wideband signal source 201 , an ultra-wideband signal transmitting antenna 202 , an ultra-wideband signal receiving antenna 203 and a collection and control unit 204 .

[0068] The ultra-wideband signal source 201 is configured to generate an ultra-wideband signal. In an embodiment, a typical frequency of the ultra-wideband signal is 0.1-5 GHz.

[0069] The UWB signal transmitting antenna 202 is coupled to the UWB signal source 201 and configured to transmit the UWB signal generated by the UWB signal source 201 to free space. When the person to be inspected enters the security inspection system, the UWB signal transmitted by the UWB signal transmitting antenna 202 can illuminate the person to be inspected.

[0070] The ultra-wideband signal receiving antenna 203 is configured to receive the ultra-wideband reflected signal reflected by the object to be inspected, that is, to receive the reflected signal of the ultra-wideband signal irradiated thereon by the person to be inspected.

[0071] The acquisition and control unit 204 is coupled to the ultra-wideband signal transmitting antenna 202 and the ultra-wideband signal receiving antenna 203. The acquisition and control unit 204 can control the ultra-wideband signal transmitting antenna 202 to transmit the ultra-wideband signal and collect the ultra-wideband signal receiving antenna 203 to receive the ultra-wideband reflected signal. The reflected signal is a one-dimensional ultra-wideband spectrum signal. The one-dimensional ultra-wideband spectrum signal carries the resonant frequency of contraband (for example, a pistol, a knife or an explosive), so it can achieve rapid detection and classification of items.

[0072] In the ultra-wideband signal acquisition device 200 provided in the embodiment of the present disclosure, rapid detection and classification of contraband can be achieved by acquiring the ultra-wideband reflection signal reflected by the object to be detected.

[0073] Figure 3 is a schematic diagram showing the structure of a millimeter wave imaging device 300 according to an embodiment of the present disclosure.

[0074] like Figure 3 As shown, the millimeter wave imaging device 300 includes a millimeter wave transceiver antenna array 301 , a millimeter wave transceiver 302 , a slider 303 , a synchronous gear 304 and a driving motor 305 .

[0075] The millimeter wave transceiver antenna array 301 includes a plurality of sub-units arranged in an array, and is configured to transmit and receive millimeter wave signals. The millimeter wave transceiver antenna array 301 can be configured as a linear array to achieve an up-and-down scanning mode, or a horizontal scanning mode.

[0076] The millimeter wave transceiver 302 is coupled to the millimeter wave transceiver antenna array 301, and is configured to generate a millimeter wave signal and transmit it to free space through the millimeter wave transceiver antenna array 301, and collect the millimeter wave reflection signal received by the millimeter wave transceiver antenna array 301 to obtain the millimeter wave holographic data of the object to be inspected. In an embodiment, when the object to be inspected stands in the imaging area of ​​the millimeter wave imaging device 300, the millimeter wave transceiver antenna array 301 scans the object to be inspected, and the millimeter wave emitted by the millimeter wave transceiver antenna array 301 penetrates the clothing and is reflected back by the human body or other hidden objects on the body surface. After the millimeter wave transceiver antenna array 301 receives the reflected millimeter wave, the millimeter wave transceiver 302 collects the reflected millimeter wave to obtain the millimeter wave holographic data, thereby obtaining the millimeter wave holographic image of the object to be inspected.

[0077] The slider 303 is coupled to the millimeter wave transceiver antenna array 301 and is configured to support the reciprocating motion of the millimeter wave transceiver antenna array 301 along the direction of the slide rail 306. In the embodiment of the present disclosure, the slider 303 supports the millimeter wave transceiver antenna array 301 to reciprocate horizontally along the direction of the slide rail 306, thereby realizing millimeter wave scanning of the object to be inspected.

[0078] The synchronous gear 304 is configured to drive the millimeter wave transceiver antenna array 301 to reciprocate horizontally along the direction of the slide rail 306 through the synchronous toothed belt 307 .

[0079] The driving motor 305 is coupled to the synchronous gear 304 and the synchronous toothed belt 307 , and is configured to drive the synchronous gear 304 and the synchronous toothed belt 307 .

[0080] In the millimeter wave imaging device 300 provided in the embodiment of the present disclosure, a millimeter wave holographic image of the object to be inspected is obtained by emitting millimeter waves and receiving millimeter waves reflected by the object to be inspected, thereby realizing automatic detection of suspicious objects.

[0081] Figure 4 is a flowchart illustrating a data processing method for security check according to an embodiment of the present disclosure.

[0082] like Figure 4 As shown, in operation S1, an ultra-wideband reflection signal reflected by the object to be detected is obtained. In this embodiment, the reflection signal is a one-dimensional ultra-wideband spectrum signal. The one-dimensional ultra-wideband spectrum signal carries the resonant frequency of an object (e.g., a pistol, a knife, or an explosive), so rapid detection and classification of the object can be achieved.

[0083] In operation S2, the millimeter wave holographic data of the object to be inspected is obtained. After the millimeter wave penetrates the clothing of the person to be inspected, it is reflected back by the human body or other hidden objects on the body surface, and a holographic image of the object to be inspected is obtained through the reflected millimeter wave holographic data. Millimeter wave radiation is electromagnetic wave radiation, not ionizing radiation, so it has no ionizing hazard to the human body, and the electromagnetic radiation power of the scanning signal is only one thousandth of that of a mobile phone signal. In addition, active millimeter wave imaging has good effects. In actual imaging, contraband such as hidden pistols, knives, bombs, drugs, etc. can be clearly seen.

[0084] In operation S3, based on the ultra-wideband database, identify the contraband in the ultra-wideband reflection signal whose probability of being carried by the object to be inspected exceeds the predetermined probability. In an embodiment, the ultra-wideband reflection signal can be compared with the ultra-wideband signal corresponding to various contraband in the ultra-wideband database to give the probability of the object to be inspected carrying various contraband. If the probability of a certain contraband exceeds the predetermined probability, the contraband is output. For example, the predetermined probability can be set to 50%. If the probability of identifying a pistol in the ultra-wideband reflection signal is 70%, a pistol with a probability of 70% can be output. However, it should be noted that the value of the predetermined probability can be set according to the specific situation of the security inspection. In addition, in an embodiment, the comparison can be performed using a first machine learning algorithm, that is, the ultra-wideband reflection signal is identified using the first machine learning algorithm. The first machine learning algorithm can be, but is not limited to, a neural network algorithm.

[0085] In operation S4, a millimeter wave image of the object to be inspected is reconstructed according to the millimeter wave holographic data, and a region of interest in the millimeter wave image is identified according to the millimeter wave image library. The millimeter wave image is compared with millimeter wave images corresponding to various contraband in the millimeter wave image library, so as to identify the region where the contraband exists in the millimeter wave image. In addition, in an embodiment, a second machine learning algorithm is used to identify the millimeter wave image. The second machine learning algorithm can be, but is not limited to, a neural network algorithm.

[0086] In an embodiment, the ultra-wideband database and the millimeter wave image library are both pre-established for contraband (e.g., pistols, knives, bombs, drugs, etc.). In an implementation, the ultra-wideband database includes ultra-wideband spectrum signals corresponding to various contraband, and the millimeter wave image library includes millimeter wave images corresponding to various contraband.

[0087] In operation S5, the contraband is identified in the region of interest according to the millimeter wave image library. In an embodiment, if the contraband identified in the ultra-wideband reflection signal with a probability exceeding a predetermined probability is a pistol, the contraband in the region of interest is compared with the millimeter wave image corresponding to the pistol in the millimeter wave image library to determine whether there is a pistol in the region of interest. This enables fast and accurate positioning of contraband (e.g., a pistol).

[0088] In operation S6, the millimeter wave image and an alarm message related to the contraband are displayed. In an embodiment, when the contraband is identified in the region of interest, the alarm message includes information related to the type of the contraband and the location in the millimeter wave image.

[0089] The data processing method provided in the embodiments of the present disclosure not only solves the problem that ultra-wideband radar technology cannot accurately locate contraband, but also solves the problem that millimeter wave imaging technology cannot accurately give the type of contraband, thereby significantly improving the efficiency and accuracy of security inspection.

[0090] The above detailed description has described numerous embodiments of the security inspection system and inspection method by using schematic diagrams, flow charts and / or examples. Where such schematic diagrams, flow charts and / or examples contain one or more functions and / or operations, it should be understood by those skilled in the art that each function and / or operation in such schematic diagrams, flow charts or examples can be implemented individually and / or together by various structures, hardware, software, firmware or substantially any combination thereof. In one embodiment, several parts of the subject matter described in the embodiments of the present invention can be implemented by application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), digital signal processors (DSPs), or other integrated formats. However, it should be recognized by those skilled in the art that some aspects of the embodiments disclosed herein can be equivalently implemented in an integrated circuit in whole or in part, implemented as one or more computer programs running on one or more computers (e.g., implemented as one or more programs running on one or more computer systems), implemented as one or more programs running on one or more processors (e.g., implemented as one or more programs running on one or more microprocessors), implemented as firmware, or substantially implemented as any combination of the above, and those skilled in the art will have the ability to design circuits and / or write software and / or firmware code based on the present disclosure. Furthermore, those skilled in the art will recognize that the mechanisms of the subject matter of the present disclosure can be distributed as a program product in a variety of forms, and that the exemplary embodiments of the subject matter of the present disclosure are applicable regardless of the specific type of signal-bearing medium actually used to perform the distribution. Examples of signal-bearing media include, but are not limited to: recordable media such as floppy disks, hard drives, compact disks (CDs), digital versatile disks (DVDs), digital tapes, computer memories, etc.; and transmission media such as digital and / or analog communication media (e.g., fiber optic cables, waveguides, wired communication links, wireless communication links, etc.).

[0091] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above separately, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. The scope of the present disclosure is defined by the attached claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A safety inspection system, comprising: An ultra-wideband signal acquisition device is used to acquire an ultra-wideband reflection signal reflected by the object to be inspected; Millimeter wave imaging equipment to obtain millimeter wave holographic data of the object to be inspected; The data processing device stores an ultra-wideband database and a millimeter wave image library and is configured to: According to the ultra-wideband database, the category of contraband in the ultra-wideband reflected signal whose probability of being carried by the object to be inspected exceeds a predetermined probability is identified; reconstructing a millimeter wave image of the object to be inspected according to the millimeter wave holographic data, and identifying a region of interest in the millimeter wave image according to a millimeter wave image library, and Comparing the region of interest identified in the millimeter wave image with a millimeter wave image in the millimeter wave image library corresponding to the contraband identified in the ultra-wideband reflection signal, thereby identifying the contraband in the region of interest; as well as A display displays the millimeter wave image and an alarm message related to the contraband.

2. The safety inspection system according to claim 1, wherein: The data processing device is also configured to: Using a first machine learning algorithm to identify the ultra-wideband reflection signal; and The millimeter wave image is recognized using a second machine learning algorithm.

3. The safety inspection system according to claim 2, wherein: The first machine learning algorithm and the second machine learning algorithm are neural network algorithms.

4. The safety inspection system according to claim 1, wherein: In the case where the contraband is identified in the region of interest, the alarm message includes information about the type of the contraband and the location in the millimeter wave image.

5. The safety inspection system according to claim 1, wherein: The ultra-wideband database and the millimeter wave image library are established for contraband.

6. The safety inspection system according to claim 1, wherein: Ultra-wideband signal acquisition equipment includes: an ultra-wideband signal source configured to generate an ultra-wideband signal; An ultra-wideband signal transmitting antenna, coupled to the ultra-wideband signal source and configured to transmit the ultra-wideband signal into free space; an ultra-wideband signal receiving antenna configured to receive an ultra-wideband reflected signal reflected by the object to be detected; and The collection and control unit is coupled to the ultra-wideband signal transmitting antenna and the ultra-wideband signal receiving antenna, and is configured to control the transmission of the ultra-wideband signal and collect the ultra-wideband reflected signal.

7. The security inspection system according to claim 1, wherein: The millimeter wave imaging device comprises: a millimeter wave transceiver antenna array, comprising a plurality of sub-units arranged in an array, configured to transmit and receive millimeter wave signals; and The millimeter wave transceiver is coupled to the millimeter wave transceiver antenna array and is configured to generate a millimeter wave signal and transmit it to free space through the millimeter wave transceiver antenna array, and collect the millimeter wave reflected signal received by the millimeter wave transceiver antenna array to obtain the millimeter wave holographic data of the object to be inspected.

8. The safety inspection system according to claim 7, wherein: The millimeter wave imaging device also includes: A slider, coupled to the millimeter wave transceiver antenna array and configured to support the reciprocating motion of the millimeter wave transceiver antenna array along the direction of the slide rail; A synchronous gear configured to drive the millimeter wave transceiver antenna array to reciprocate through a synchronous toothed belt; and A drive motor is configured to drive the synchronous gear and the synchronous toothed belt.

9. A method for processing data for security inspection, comprising: Acquire an ultra-wideband reflection signal reflected by the object to be inspected; Acquire millimeter wave holographic data of the object to be inspected; According to the ultra-wideband database, the category of contraband in the ultra-wideband reflected signal whose probability of being carried by the object to be inspected exceeds a predetermined probability is identified; reconstructing a millimeter wave image of the object to be inspected according to the millimeter wave holographic data, and identifying a region of interest in the millimeter wave image according to a millimeter wave image library, Comparing the region of interest identified in the millimeter wave image with a millimeter wave image in the millimeter wave image library corresponding to the contraband identified in the ultra-wideband reflection signal, thereby identifying the contraband in the region of interest; as well as The millimeter wave image and an alarm message related to the contraband are displayed.

10. The data processing method according to claim 9, wherein: The ultra-wideband reflection signal is identified using a first machine learning algorithm; and the millimeter wave image is identified using a second machine learning algorithm.

11. The data processing method according to claim 10, wherein: The first machine learning algorithm and the second machine learning algorithm are neural network algorithms.

12. The data processing method according to claim 9, wherein: In the case where the contraband is identified in the region of interest, the alarm message includes information about the type of the contraband and the location in the millimeter wave image.

13. The data processing method according to claim 9, wherein: The ultra-wideband database and the millimeter wave image library are established for contraband.

Citation Information

Patent Citations

  • Method and device for detecting hidden dangerous article

    CN102759753A

  • Safety inspection system

    CN209784532U