Human Security Scanner

Abstract

The disclosed invention includes security screening systems and devices for detecting and classifying human bodies, whether moving or stationary, and articles, whether being carried or concealed in wheeled luggage, in real time. The invention combines radio wave technology, magnetometer technology, and optical sensors to detect dielectric and / or metallic objects on targets moving through portals formed by the invention. The sensed data is then sent to a computing processor of the system to form a 2D image, which determines the type of object, the location of the object, and other additional information about the target and / or object.

Description

Technical Field

[0001] <Field of the Invention> The present invention relates to security screening and also to the detection of concealed dielectric and metallic objects carried by an individual or in a piece of luggage.

Background Art

[0002] The threat detection system closest to the present invention is the Rapiscan Systems Secure 1000 SP. The Secure 1000 SP uses backscatter technology, image processing software, and an operator interface to screen passengers for a wide range of potential threats including liquids, contraband, ceramics, explosives, narcotics, concealed currency, and weapons. The Secure 1000 SP generates simultaneous front and back scans. The Secure 1000 SP can detect small objects and threats hidden on a passenger. It can detect organic and inorganic threats, metallic and non-metallic objects, and can detect concealed liquids, ceramics, weapons, plastic explosives, narcotics, metals, contraband, and currency, etc. The Secure 1000 SP requires one pose with no additional movement by the passenger. A full scan can be completed in a few seconds. The Secure 1000 SP generates an image by bouncing very low-dose x-rays off a person. This image is then analyzed (or, parsed / analyzed) by an operator to identify hidden potential threats.

[0003] The Lapiscan Systems Secure 1000 SP is limited in that it requires a person to be in a single position for scanning, the operator to determine what threats are present and review the scanned images, uses X-rays for scanning, performs backscatter and no pass-through imaging, and is designed to operate at security checkpoints, as opposed to use in arrays where multiple individuals and their belongings can be scanned without causing security bottlenecks. The Lapiscan Systems Secure 1000 SP cannot detect radioactive / nuclear materials. [Disclosure of the Invention] [Problems that the invention aims to solve]

[0004] There is a need for a lower-cost multi-threat detection system that can simultaneously detect various threats with very short processing times. [Means for solving the problem]

[0005] <Summary of the Invention> The present invention includes a security screening device (or apparatus), system, and method comprising a portal comprising two side pillars electronically connected to either an overhead beam (i.e., an arch) or a floor / underfloor cable duct, wherein the portal forms an inspection area, and each of the two side pillars comprises a linear array (or linear array) of two or more millimeter-wave emitters, preferably 16 to 256 millimeter-wave emitters, and a linear array of two or more millimeter-wave receivers, which may preferably include one or more magnetometers, one or more video cameras, radio frequency generation, distribution, and demodulation modules, data acquisition processors, and imaging processors, wherein the overhead beam (or, if there is no overhead beam, a separate third pillar) comprises a power input system and a computing processor, and the emitters emit cyclic broadband radio waves (or cyclic broadband radio waves) toward two or more of the receivers located on either one of the opposing sides of the two side pillars or on the same side pillar.The receiver senses the cyclic broadband radio signal, which is a direct signal unaffected by a moving target moving within the inspection area (unaffected direct signal), or a signal transmitted via a moving target moving through the inspection area (transmitted signal), or a scattered signal reflected after being affected by a moving target moving through the inspection area (reflected return signal). The receiver sends the sensed signal to a data acquisition processor, and then to an imaging processor, which provides one or more two-dimensional images of the moving target based on the unaffected direct signal or the transmitted signal and the reflected signal. The imaging processor further analyzes the sensed data to select one or more sections of the one or more two-dimensional images, the one or more sections corresponding to the one or more detected objects of interest, the one or more magnetometers provide auxiliary magnetic field data to the processor for the analysis, and the one or more video cameras track the objects of interest. [Brief explanation of the drawing]

[0006] The present invention is illustrated by the following drawings.

[0007] Figure 1 shows an exemplary diagram of a portal according to the present invention.

[0008] Figure 2 shows an embodiment of the present invention having an overhead beam.

[0009] Figure 2A shows an embodiment of the present invention without an overhead beam.

[0010] Figure 3 shows a schematic diagram of an image obtained from a dielectric attached to the body in "reflection" mode. 21-Body; 22-Dielectric; 23-Emitter; 24-Receiver; 25-2D image; 26-Selected pattern; A-Radio waves reflected from the body; B-Radio waves reflected from the body after passing through the dielectric; C-Radio waves reflected from the dielectric.

[0011] Figure 4 shows a schematic diagram of an image obtained from a dielectric attached to the body in "transmission" mode. 21-Body, 22-Dielectric, 23-Emitter, 24-Receiver, 25-2D image, 26-Selected pattern, D-Radio waves passing over or under the dielectric, E-Radio waves passing through the dielectric.

[0012] Figure 5 shows an exemplary distribution of anomalies detected by the present invention for targets having objects of interest (brighter portion of the histogram) and targets without objects of interest (darker portion of the histogram on the left side of the figure).

[0013] Figure 6 shows an example of a graph obtained as a result of the passive magnetic measurement system of the present invention after a time sweep of the three magnetic field components (Bx, By, Bz) from the sensor when a target having a magnetized object passes through the device portal. The horizontal axis represents time in seconds, and the vertical axis represents the magnetic field component values ​​in nanotesla (nT).

[0014] Figure 7 shows a software interaction diagram of the present invention. [Modes for carrying out the invention]

[0015] <Detailed description of preferred embodiments> Definition: This patent application deals with a millimeter-wave emitter that emits radiation in the range of 0.3–300 GHz and a millimeter-wave receiver that receives radiation in this range. The preferred operating range is 10–20 GHz.

[0016] The present invention is implemented in the form of a portal structure having side pillars 100 and an optional overhead beam 110 connecting the side pillars. The height of the portal is 1.5 to 2.5 meters. Each side pillar comprises a vertical linear array of transceiver antennas 101 (two or more millimeter-wave emitters) and a vertical linear array of sensors 102 (two or more millimeter-wave receivers), along with corresponding electronic components (e.g., radio frequency generation, distribution, and demodulation module 105, data acquisition processor 106, imaging processor 107), one or more magnetometers 104, one or more video cameras 103, and a horizontal overhead beam (or floor duct, or a third separate pillar) comprises a power input system 108 and a computing processor 109.

[0017] The detection of concealed objects 22 hidden on a moving target, performed by the device, is based on at least one or two combined techniques: 1. Dielectric object detection is performed as each target moves through an aperture created by the device via active sensing using coherent radiation, the coherent radiation having a continuously varying frequency in the range of 5 to 20 GHz. The transmitted cyclic broadband radio signal changes in time, frequency, or both time and frequency. Through such radiation and deformation, the device of the present invention forms a computer image of the moving target / person and the associated dielectric object located on or near the target's body. The system that performs this function is referred to herein as the microwave dielectric detection (MDD) subsystem of the present invention. This system performs the detection of concealed objects with an optical path length of 2 to 20 cm hidden on a moving target. The optical path length (OPL) in a medium having a constant refractive index "n" is equal to "ns", where "s" is the geometric length.

[0018] Optionally, the emitters are arranged in a vertical line with equal spacing between them, and the receivers are arranged in a vertical line with equal spacing between them.

[0019] With one linear polarization or two orthogonal polarizations, the emitter transmits a broadband radio signal and the receiver senses the broadband radio signal.

[0020] The sensed signal is received by a data acquisition processor and an image stream is generated from the sensed data. The data acquisition and imaging processor provides separation of the phases of the cyclic broadband radio signal. The imaging processor provides a cross-eye image (or cross-eyed image) of the target based on the positions of the emitter and receiver on both sides of the inspection area.

[0021] 2. Passive magnetometry (PM) is implemented with a microwave dielectric detection subsystem for the supplementary detection of metallic objects having residual magnetization. The system that performs this function is referred to herein as the passive magnetometer (PM) subsystem of the present invention.

[0022] In addition to these two technologies, the detected object tracking is performed by a third technology that includes a video camera subsystem designed to provide video fixation (or video fixation) of the target / person when an alarm for detecting a hidden object is generated. The processor processes and analyzes the optical image flow. This processing includes per-target classification based on joint analysis (or joint analysis) of optical data, magnetometer data, and radio wave data.

[0023] The structural configuration of the device.

[0024] Figure 1 shows the functional diagram of the device of the present invention. Each side pillar houses MDD subsystem components (transmitting antenna and receiving antenna, data processing board, FPGA chip board) and PM subsystem components. Each side pillar also houses two video cameras and a pillar-mounted computer that executes part of the data processing and data acquisition operations. The arch / overhead beam has an arch computer, and the arch computer is responsible for the final data processing operation. The arch / overhead beam further includes an auxiliary module including power supply and network components. The side pillars are connected to the arch using connectors that provide data exchange between the arch and each side pillar, and between the two side pillars. When the overhead beam / arch is not used, the side pillars may be connected via, for example, a floor / underfloor cable duct. The cable duct can also house a computing processor and / or a power input system.

[0025] MDD subsystem.

[0026] The MDD subsystem includes a low-power radar system with inverse synthetic aperture (ISAR), which generates a synthetic aperture using the movement of the target instead of a transmitter (see, for example, Grishin Yu.P., Ipatov V.P. et al. “Radiotechnical Systems,” Edited by Yu. M. Kazarinov, 1990).

[0027] Each side pillar of the device of the present invention includes a vertical linear array of 16 to 128 transmitting antennas and 1 to 128 receiving antennas, all evenly distributed along the height of each side pillar of the device. After analysis of the received signals (both direct and reflected signals from objects and targets within the detection area), a flat 2D image of the inspection area is formed in height and range coordinates. The range value is determined from the analysis of the broadband signal, and the height value is determined from the analysis of the signal radiated by the vertical lines of the transmitting antennas. This system has no horizontal axis resolution and assumes that one person is present in the inspection area at a time. Signal processing is performed according to an "inverse synthetic aperture" algorithm on an FPGA chip using "fast time" and "slow time" Fourier transforms (or fast Fourier transform and short-time Fourier transform) and a window filter.

[0028] The receiving and transmitting antennas of the device of the present invention are fabricated using planar technology and provide the required characteristics in the frequency range of 10 to 20 GHz. The total radiated power of the device remains at approximately -40 dBm.

[0029] The MDD subsystem operates in two modes: 1. Radio wave reflection mode; 2. Radio wave transmission mode.

[0030] The reflection mode is based on the fact that the human body is an almost perfect reflector to radio waves in the frequency range in which they are used. If there is a dielectric material in the path of the radio wave relative to the body, some of the wave is reflected from the front of the dielectric material, and some of the wave passes through the dielectric material and is then reflected from the body. Refer to Figure 3, which shows the operating principle of the reflection mode and an example image that is generated. In this example image, the horizontal axis is the distance the wave travels, and the vertical axis is the number of transmitters on the vertical ruler.

[0031] In reflection mode, the fact that the propagation speed of radio waves within a dielectric is slower than the speed of light in air causes a delay in the arrival of the reflected wave at the receiver. This delay is interpreted as an additional path taken by the wave before reflection, and therefore the image of the rear surface of the dielectric is "pressed" into the surrounding body image. The generated image in the example of Figure 3 shows regions of wave reflection from the front and back of the dielectric on the belt. Above and below this region, there is only one reflective surface, namely the upper part of the torso and part of the forelegs. Therefore, the presence of the front and back dielectric surfaces in the microwave image is interpreted as an anomaly.

[0032] The transmission mode is based on the fact that when radio waves travel from a transmitter on one side pillar to a receiver on the other side pillar through a dielectric object, the apparent path length of the wave increases due to the slower propagation through the dielectric (see the left side of Figure 4). As a result, the image within the dielectric region is shifted to the right into the region of the longer path (see the right side of Figure 4). In Figure 4, the left side illustrates the operating principle of the "pass-through" mode. The right side of Figure 4 shows an example of an image of a person with a dielectric in their body. The horizontal axis is the distance the wave travels, and the vertical axis is the number of transmitters based on the height of the side pillars. Therefore, the detection of a right-shifted portion of the image within the microwave image is interpreted as an anomaly.

[0033] The reflection and transmission of anomalies obtained from the device are further aggregated over the entire passage of the moving target through the entire inspection area, and the resulting data is used to generate an overall detection signal / alarm.

[0034] When the target moves through the inspection area at a speed of 1-3 m / s, the device sequentially examines the person in the following order: 1. When the target approaches the plane of the device and transmitter-receiver, the front of the body is screened using reflection mode; 2. When the target crosses the transmitter-receiver's initial plane (or first plane), the front of the body is screened using the transmission mode; 3. The rear of the body is screened using the transmission mode before the target passes the final plane (or last plane) of the transmitter-receiver; 4. After the target passes through the initial plane of the transmitter-receiver, the posterior part of the body is screened using the reflection mode; 5. While the target remains within the transmitter-receiver plane, the sides of the body are screened using the reflex mode.

[0035] Since the system has two transmitter-receiver planes (transmitter left + receiver right, transmitter right + receiver left), the above inspection sequence occurs twice simultaneously (i.e., once from each side).

[0036] The transmitter wavelength is approximately 30 mm. Radiation phase correlation is required for efficient selection of moving human body parts, meaning that during the scanning period, the body part should not move more than a few millimeters. Therefore, the scanning period should not exceed a few milliseconds; for example, a scanning period of 2 ms. If there are 128 emitters, each emitter should generate a signal with a duration of approximately 20 μs. To achieve the required image contrast (corresponding to the required path length resolution of 1-3 mm), the bandwidth of the cyclic emitter signal must be 5-10 GHz. This means that each emitter must scan a specified range of 10 GHz in 20 μs. The linear chirp method is best suited to solving this problem.

[0037] The received signal must be digitized and processed. A two-dimensional Fourier transform is used, which imposes limitations on the choice of processor. An FPGA (Field Programmable Gate Array) is selected, which allows it to receive the digitized data in pipeline mode, process it at the same bitrate, and transfer the already prepared image to the next processor.

[0038] The following processor provides a confidence value corresponding to the detected object of interest and a numerical representation corresponding to the detected object.

[0039] In general, the number of anomalies (i.e., the track length) obtained when passing a target containing dielectric objects on the body significantly exceeds the number of anomalies obtained when passing a target without dielectric objects (see Figure 5). When passing a target without dielectric objects on the body, the device should generally detect two or fewer anomalies over the entire duration of the pass. In contrast, when a target with dielectric objects passes through the device, up to 20 anomalies may be detected. Figure 5 shows an illustrative distribution of anomaly track lengths detected when passing a target without dielectric objects on the body (dark portion of the histogram on the left) and a target with dielectric objects (e.g., plastic) strapped to its legs (brighter portion of the histogram).

[0040] PM subsystem.

[0041] The device of the present invention further includes a passive magnetometer subsystem that enables the detection of objects having remanent magnetization. The PM subsystem includes, for example, 20 (10 per side pillar) 3-axis MagDRV type magnetic field sensors arranged along a side pillar, and four MagDAQ boards (i.e., sensor digitization and power supply boards) that provide the magnetic field sensors.

[0042] Passive magnetometry technology is based on the fact that digitized instantaneous values ​​of the magnetic field along three mutually perpendicular axes at the sensor location completely determine the magnetic field vector B at these points.

[0043] Figure 6 shows an example of the time sweep (or sweep time) of three magnetic field components (Bx, By, Bz) from one of the sensors as a target with a magnetized object passes through the device's portal. The horizontal axis represents time in seconds, and the vertical axis represents the magnetic field component values ​​in nanotesla (nT).

[0044] After subtracting a constant component of the magnetic field (i.e., the Earth's magnetic field), the PM subsystem determines the magnetic field generated by a nearby magnetized object, which in the first approximation can be considered as a point magnetic dipole having a magnetic moment m.

[0045] When a target containing a magnetized object passes through the portal, the measured magnetic field value initially increases and then decreases (as shown in Figure 6). The distribution of magnetic field values ​​between components Bx, By, and Bz depends on the position of the magnet, its intensity, and the orientation of its dipole moment in space.

[0046] In the direction determined by the unit vector n, the magnetic field B created by a magnetic dipole m at a distance r is given by the equation B(r) = [3n(n,m)-m] / r 3 This is given by (see, for example, Jackson JD Classical Electrodynamics. 2nd ed., John Wiley & Sons, New York, 1975, p.182).

[0047] In the PM subsystem of the present invention, the magnetic field B is measured at multiple points (i.e., sensor locations). Then, the inverse problem of determining the coordinates (x,y,z) and dipole moment components (mx,my,mz) that can generate such a magnetic field is solved numerically / mathematically. Finally, if the value of the calculated vector m exceeds a threshold, an anomaly is generated and further processed in the same manner as anomalies obtained from the MDD subsystem. Such further processing is described below.

[0048] Data processing algorithms and software configurations.

[0049] The principles of data processing and signal reception related to the detection of the object of interest (i.e., anomalies) are as follows:

[0050] 1. The first stage involves screening for anomalies, which are manifestations of the presence of an object of interest detected by either the MDD subsystem or the PM subsystem.

[0051] 2. Next, each type of anomaly is collected into separate groups to create a track of length, which is a collection of similar anomalies of a given type from adjacent consecutive frames.

[0052] 3. Finally, if the track length reaches a threshold at any point, an alarm will be triggered to indicate the detection of an object of interest.

[0053] The prototype software runs on the Linux open-source OS and consists of four separate programs with the following functions: 1. hss_pfdev: Provides microwave images from the system. 2. hss_rfpipeline: Detects anomalies from microwave images. 3. hss_gspipeline: Acquires video images from the camera. 4. hss_server: Uses the PM subsystem to receive anomalies, aggregates all received anomalies into a track, and issues a detection signal.

[0054] The programs hss_pfdev, hss_rfpipeline, and hss_gspipeline run on the embedded computer mounted on the side pillar, while the program hss_server runs on the arch computer. A software interaction diagram is shown in Figure 7. The software is pre-installed on the device as executable files and starts automatically when powered on.

[0055] This invention generally includes the following:

[0056] 1. Systems and devices for real-time detection and classification of items concealed in the bodies of moving or stationary people, as well as items concealed in transported or wheeled packages. The following technologies may also be utilized: - Cyclic scanning of a broadband radio signal in an inspection area by multiple fixed distributed transmitters. Receiving the scattered and direct broadband radio signal by a set of fixed distributed receivers. Transmitters / emitters and receivers / sensors are located on each of two side pillars connected via an overhead beam (i.e., an arch). This structure forms a portal, the portal comprises two side pillars electronically connected to the overhead beam, and the portal forms an inspection area. One of each of the two side pillars comprises a linear vertical array of 16-124 millimeter-wave emitters and 8-124 millimeter-wave receivers, one or more magnetometers, and two or more video cameras. The system further comprises a power input system and a computing processor. The emitters transmit a cyclic broadband radio signal toward the inspection area, and the receivers sense the broadband radio signal after it has been transmitted through a target and / or any object or scattered by a target and / or any object. The broadband radio signals are either unaffected direct or scattered signals, which are redirected or otherwise affected after affecting the target moving through the inspection area. The receiver then sends the sensed data to the computing processor, which then provides one or more two-dimensional images of the target based on the unaffected direct and scattered signals. The computing processor further analyzes the sensed data to select one or more sections of the one or more two-dimensional images, the one or more sections corresponding to the detected object of interest. One or more magnetometers provide the processor with supplemental magnetic field data for the analysis, for example, for further confirmation of the object of interest. One or more video cameras may provide tracking of the object of interest, possibly beyond the inspection area. Additional optical sensors may also be utilized in the device; - Drawing a two-dimensional image of a human target and a set of luggage based on scattered and direct radio signals; - Analysis of radio wave image streams by selecting image sections corresponding to hidden objects (anomalous objects) and acquiring their characteristics; - Supplementing the characteristics of moving or stationary people or objects obtained as a result of the above analysis with data from other sensors such as magnetometers, optical sensors (video cameras, stereo cameras, depth sensors, sensors present in the area, etc.); - Classify objects based on a set of their properties.

[0057] This system and device further enable embodiments that include, in particular, the following options:

[0058] 1. Cyclic scanning of millisecond-wideband (having a bandwidth of 1 to 10 GHz) radio signals in the millimeter range with (or with) a given frequency switching of the inspection area by multiple fixed transmitters.

[0059] 2. Cyclic scanning using (or involving) transmitter isolation: ○ Includes time division of the transmitter ○ Includes separation of transmitters by frequency, or ○A combination of both methods.

[0060] 4. Cyclic scanning using transmitter configuration: ○Full height (height), adjacent, approximately 1.5~2.5m, or ○ Equally spaced, height steps positioned a few centimeters apart (i.e., 2-3 cm) from each other. Therefore, the linearity of the device—minimum number of devices with minimum pitch and full height (cycle time requirement).

[0061] The transmitters are positioned on different sides of the human movement area to obtain cross-sectional images from a "portal" configuration with different field-of-view angles (aperture synthesis, on the X and Y axes).

[0062] 5. Cyclic scanning of one or two orthogonal polarizations (co-polarity and cross-polarization) of radio signals.

[0063] The image stream is multi-channel and has the following options: 1) When one polarization (or polarization / polarization) is used, for example (an image can be represented by several color coding schemes (or color coding schemes), for example, as a color image in HSV): a) Channel A: Provides data as a brightness gradient based on the characteristics of the received scattered or transmitted signal; b) Channel B: Provides data based on the characteristics of the target / scatterer's moving velocity; 2) When two orthogonal polarizations are used (the image can be represented as a color image or as a set of images in several color coding schemes, e.g., RGB): a) Channel A: Provides data as a brightness gradient based on the characteristics of the received scattering or transmitted signal; b) Channel B: Provides data based on the characteristics of the target / scatterer's moving velocity; c) Channel C: Provides data as collinear vertical polarization (or colinear vertical polarization) based on the characteristics of the received scattered or transmitted signal; d) Channel D: Provides data as cross-linear polarization (or cross-linear polarization) based on the characteristics of the received scattered or transmitted signal; e) Channel E: Provides data as collinear horizontal polarization (or colinear horizontal polarization) based on the characteristics of the received scattered or transmitted signal.

[0064] 6. Reception of scattered and direct broadband radio signals.

[0065] Multiple fixed receivers positioned on different sides of the human movement area so that a person and luggage (moving target) move through the inspection area and form an image stream.

[0066] 7. The phases of these signals are separated to receive scattered and direct broadband radio signals (coherent signal reception method).

[0067] 8. Scattering and direct reception of broadband radio signals in two orthogonal polarizations (same polarity and cross-polarization).

[0068] 9. Scattering and direct reception of broadband radio signals due to receiver positioning: ○Full height (height), adjacent, approximately 1.5~2.5m, or ○Height steps placed at equal intervals of a few centimeters (i.e., 2-3 cm) from each other.

[0069] 10. Construction of a two-dimensional image of a person and luggage based on scattered and direct radio signals with transmitters and receivers located on different sides of the person's movement area, wherein each pillar includes a receiver and a transmitter, and a cross-eye image may be obtained from different field of view angles (or, in order to obtain a cross-eye image from different field of view angles, construct a two-dimensional image of a person and luggage based on scattered and direct radio signals with transmitters and receivers located on different sides of the person's movement area, where each pillar includes a receiver and a transmitter).

[0070] 11. Analysis of multiple two-dimensional images of human bodies and luggage based on scattered and direct radio signals, with selection of image sections corresponding to concealed objects (anomalies), for example: - Includes searching for (detecting) patterns (anomalies) in images or image flows; - Includes the use of image regions containing patterns / anomalies of interest (segmentation); - Including the use (tracking) of the location of anomalies of interest in a series (stream) of images; - Including cases where the anomaly of interest is a combination of brightness and color of an image region (including cases where the brightness of the image region corresponds to the intensity of scattering in that region, and the color of the region corresponds to the speed and direction of movement of an object in that region); - This includes using information about the location of detected anomalies in the image in the form of coordinates (pixels) of the corners of the rectangle (ROI - region of interest) containing them, or the coordinates of one of those corners, width, and height, and a confidence level of accuracy in finding the pattern; - This includes adding information about anomalous locations obtained from microwave image analysis (features), and the reliability of the accuracy of detecting anomalies in the added information; - For each anomaly, this includes forming an array of numbers containing a numerical representation of this information; -This additional information includes cases where it is obtained by calculating at least one of the following image characteristics: maximum and / or minimum values, mean, median, brightness and / or standard deviation of velocity; - Such characteristics are determined to be within the entire region of anomaly (ROI), and / or inside and outside of it, and within individual parts of the ROI (including the left, right, top, bottom, center, top of the ROI, bottom of the ROI, left side of the ROI, and right side of the ROI, within the image region whose dimensions are either preset as parameters (number of pixels by width and / or height) or determined according to the size and / or position of the ROI as a specified percentage of the width and / or height of the ROI).

[0071] 12. Optical image flow analysis (camera, stereo pair, TOF, etc.): - Includes searching for (detecting) objects within an image or image flow; - For example, this includes recognizing the type of object in an image, such as a person, body part, carry luggage, wheeled luggage, or animal; - Includes markup (segmentation) of the image region containing the recognized object; - This includes tracking the position of an object of interest in a series (stream) of images; - This includes obtaining additional information regarding the movement of people and / or objects through the system, their positions, speeds, numbers, types, etc.; -This includes cases where additional information is obtained from the analysis of video images; -This includes cases where additional information is obtained from depth map analysis; -This includes cases where this additional information is a tracking parameter for a moving object; - Including cases where a track is generated by referencing such a track for a specific person and / or object from a numerical representation of such information.

[0072] 13. To obtain additional information about magnetized objects on a person's body and in luggage within the screening area, use multiple fixed fluxgate magnetometers positioned on different sides of the area of ​​movement of the person to continuously monitor the distortion of the Earth's magnetic field as the person and luggage move through the screening area, for example: - Including the use of single-axis and / or two-axis and / or three-axis magnetometers; - Including the use of a fluxgate magnetometer; - Including the detection of the presence of magnetized objects on the human body or in luggage; - This includes using the fact that a magnetized object is present on a person or luggage as evidence of the possibility of the presence of firearms or cold steel; - When a person passes through the system, they form a track of such signs. It includes.

[0073] 14. Combining track data from radio image analysis, optical image analysis, and magnetometer data, for example: - Including joint analysis of moving object track parameters derived from the analysis of wireless images from one or different sides of the portal; - Including joint analysis of moving object track parameters obtained from the analysis of optical images from one or different sides of the portal; - Including joint analysis of parameters of radio and optical images of moving objects obtained from the same or different sides of the portal; - Includes joint analysis of radio and optical image parameters of a moving object obtained from one or different sides of the portal, with added track parameters obtained from the analysis of magnetometer data; -Considering the joint analysis described above, this involves forming an array of numbers that characterize the parameters of the moving object track ("path"), where each position in the array has a number that characterizes a fixed parameter (feature). Includes.

[0074] 15. Classifying the trajectories ("paths") of people moving using a numerical array that includes the results of joint analysis, for example: - Includes a method of binary classification (or binary classification) into classes of pathways of interest and pathways of interest; - A method of classifying pathways into more than two classes (including at least one class of pathways of interest and at least one class of pathways of no interest); -Includes signal output related to a pathway belonging to a certain class; - Including the emission of audio signals, optical signals, or images (photographs, video streams) of a person or detected object, superimposed on a frame, or any combination of the above signals; - An output of an image of a person or detected object, with a frame superimposed thereon, and the color, line thickness, fill type, shape, or any combination thereof, corresponding to a class of the detected object according to predefined or configurable matching rules;

[0075] The present invention may include one or more of the following radiation methods: ● Linear frequency sweep (defined as sweep up) and return (sweep down) in the 10-20 GHz range over a time of 16 μs; the transmitter on one side of the gantry is switched on only during the sweep up; the transmitter on the other side of the gantry is switched on only during the sweep down; ● The transmitter on the opposite side of the portal is only switched on by sweeping up; ● The transmitter on the opposite side of the portal will only be turned on by sweeping down.

[0076] The following are possible, but are not limited to, receiving methods: ● High-frequency mixer - supplies the reference (emission) signal and the received measurement frequency, phase, and beat amplitude after mixing.

[0077] The following are possible processing methods, but are not limited to these: ● Fourier sweep by frequency (or Fourier transform swept by frequency) - obtain the distance from the transmitter to the scattering point + the distance from the scattering point to the receiver; Fourier by frame - obtain the phase change rate at each scattering point; find the maximum value of the second Fourier transform - determine the object velocity; ● Correction Procedure - Geometry Accounting; Formation of 2x-dimensional Image Panels (for each receiver and each side of the portal); ● Images are acquired from both the opposite side and the side in question.

[0078] Therefore, essentially, the present invention includes:

[0079] A security screening device comprising a power input system, a computing processor, and a portal, wherein the portal comprises two electronically connected side pillars, the portal forms an inspection area, and each of the two side pillars comprises a linear array of two or more millimeter-wave emitters, a linear array of one or more millimeter-wave receivers, one or more magnetometers, and one or more video cameras, the two or more millimeter-wave emitters transmit a cyclic broadband radio signal toward the inspection area, the one or more receivers sense the cyclic broadband radio signal emitted by the two or more millimeter-wave emitters, and the cyclic broadband radio signal is an unaffected direct signal or the inspection area The signal is scattered after colliding with a target moving through the receiver, the receiver transmits the sensed data to the computing processor, the computing processor transmits the sensed data to the computing processor, the computing processor provides one or more two-dimensional images of the target based on the unaffected direct signal and the scattered signal, the computing processor analyzes the sensed data to select one or more sections of the one or more two-dimensional images, the one or more sections corresponding to a detected object of interest, the one or more magnetometers provide supplemental magnetic field data to the computing processor for the analysis, and the one or more video cameras track the object of interest.

[0080] In some embodiments, the transmitted cyclic broadband radio signal has a bandwidth of 5 to 20 GHz, and the frequency of the transmitted signal changes.

[0081] In some embodiments, the transmitted cyclic broadband radio signal changes in time, frequency, or both.

[0082] In some embodiments, the emitters are arranged within a vertical line at equal intervals from each other, and the receivers are arranged within a vertical line at equal intervals from each other.

[0083] In some embodiments, the emitter transmits the cyclic broadband radio signal, and the receiver detects the cyclic broadband radio signal with a single orthogonal polarization.

[0084] In some embodiments, the processor creates an image stream from the sensed data.

[0085] In some embodiments, the processor provides phase separation of cyclic broadband radio signals.

[0086] In some embodiments, the portal has a height of 1.5 to 2.5 meters.

[0087] In some embodiments, the processor provides a cross-eye image of the target based on the positions of the emitter and receiver on both sides of the inspection area.

[0088] In some embodiments, the analysis further includes providing a confidence value corresponding to the detected concealed object of interest.

[0089] In some embodiments, the analysis further includes providing a numerical representation of the detected object of interest.

[0090] In some embodiments, the analysis further includes optical image flow analysis.

[0091] In some embodiments, the analysis further includes providing one of two or more classifications for each target based on a joint analysis of optical data, magnetometer data, and radio wave data.

[0092] In some embodiments, the portal further comprises an overhead beam connecting the two side pillars, the overhead beam housing, the power input system, and the computing processor.

[0093] In some embodiments, each of the side pillars further comprises a radio frequency generation, distribution, and demodulation module and a data acquisition processor.

[0094] In some embodiments, one of each of the two side pillars comprises 16 to 128 millimeter-wave emitters.

[0095] In some embodiments, the two side pillars are electronically connected via a floor cable duct.

[0096] In some embodiments, the emitter transmits the broadband radio signal in two orthogonal polarizations, and the receiver detects it.

[0097] The benefit resulting from this invention is the significantly lower cost of implementing a security screening system. Unlike conventional square emitter arrays that provide a complete 3D image of the inspection area, the linear emitter array used in this invention provides a sufficient 2D image. In the 2D image, the horizontal axis corresponds to the distance the radio waves travel from the emitter to the target / scatterer and from the target / scatterer to the receiver, and the vertical axis corresponds to the vertical coordinate of the target / scatterer. Since the linear emitter array contains fewer elements than conventional square arrays, the cost of the system is reduced.

[0098] Another resulting advantage of the present invention is its ease of assembly. The side pillar of the present invention connects to an overhead beam or floor cable duct via a composite connector that allows for simple single-click assembly and disassembly of the entire device / system.

[0099] A description of preferred embodiments of the present invention is provided for illustrative and explanatory purposes. The exact embodiments disclosed are not exhaustive, and the present invention is not limited thereto. Many changes and modifications will be apparent to those skilled in the art. The scope of the present invention is intended to be defined by the appended claims and their equivalents.

[0100] Furthermore, the terms “example” or “exemplary” are used herein to mean that they serve as examples, cases, or illustrations. Any embodiment or design described herein as “exemplary” should not necessarily be construed as being preferable or advantageous to other embodiments or designs. Rather, the use of the words “example” or “exemplary” is intended to concretely present a concept. Where used in this application, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless otherwise specified or it is clear from the context, “X uses A or B” is intended to mean either of the natural inclusive substitutions. That is, if X uses A, if X uses B, or if X uses both A and B, then “X uses A or B” is satisfied under any of the aforementioned examples. Furthermore, the articles “a” and “an” used in this application and the appended claims should generally be construed as meaning “one or plural” unless otherwise specified or it is clear from the context that they refer to a singular form.

Claims

1. Security screening devices 2 and 2a: Portal 1, wherein the portal comprises two electronically connected side pillars 100, and the portal forms an inspection area 120. Each of the two side pillars includes a portal 1 comprising a linear array 101 of two or more millimeter-wave emitters and a linear array 102 of two or more millimeter-wave receivers; The two or more millimeter-wave emitters transmit cyclic broadband radio signals toward the inspection area for searching for the hidden object 22 concealed in the moving target 21. The moving target moves within the inspection area at an average speed of up to 5 m / s; Each emitter from the linear array of emitters cyclically scans a range having a bandwidth of 5 to 20 GHz within 10 to 50 microseconds; The one or more receivers sense the cyclic broadband radio signal emitted by the two or more millimeter-wave emitters, the cyclic broadband radio signal comprising a direct signal unaffected by the moving target, a signal transmitted through the moving target, and a signal reflected back after affecting the moving target; The one or more receivers send the sensed signal to a data acquisition processor 106, and then to an imaging processor 107, which provides one or more two-dimensional images 25 of the moving target based on the processing of the unaffected direct signal or the transmitted signal and the reflected signal; the one or more two-dimensional images have an optical path length resolution better than 2 cm; The imaging processor 107 selects one or more sections from the one or more two-dimensional images, and the one or more sections correspond to a detected hidden object of interest in the device.

2. The device according to claim 1, wherein the transmitted cyclic broadband radio signal varies in time, frequency, or both time and frequency.

3. The device according to claim 1, wherein the emitters are arranged on a vertical line at equal intervals from each other, and the receivers are arranged on a vertical line at equal intervals from each other.

4. The device according to claim 1, wherein the emitter transmits the cyclic broadband radio signal with a single linear polarization, and the receiver senses the cyclic broadband radio signal with a single linear polarization.

5. The imaging processor generates an image stream from the sensed data, according to claim 1.

6. The imaging processor provides phase separation of the cyclic broadband radio signal, as described in claim 1.

7. The device according to claim 1, wherein the imaging processor provides a cross-eye image of the target based on the positions of the emitter and receiver on both sides of the inspection area.

8. The device according to claim 1, further comprising one or more magnetometers 104; the one or more magnetometers providing supplemental magnetic field data to the computing processor for the processing.

9. The device according to claim 1, further comprising providing a confidence value corresponding to the detected concealed object of interest.

10. The device according to claim 1, wherein the processing further comprises providing a numerical representation corresponding to the detected object of interest.

11. The device according to claim 1, further comprising one or more video cameras 103, wherein the one or more video cameras track the object of interest.

12. The device according to claim 11, wherein the processing further includes optical image flow analysis, and the processing further includes providing one of two or more classifications for each target based on a joint analysis of optical data, magnetometer data, and radio wave data.

13. The device according to claim 1, wherein the portal further comprises an overhead beam connecting the two side pillars, the overhead beam housing a power input system and the acquisition processor.

14. The device according to claim 1, wherein each of the side pillars further comprises a radio frequency generation, distribution, and demodulation module 105, a data acquisition processor 106, and an imaging processor 107.

15. The device according to claim 1, wherein each of the two side pillars comprises 16 to 256 millimeter-wave emitters, the emitters transmit the cyclic broadband radio signal in two orthogonal polarizations, and the receiver senses the cyclic broadband radio signal in two orthogonal polarizations.

Images