Security inspection system

Abstract

To provide a security inspection system capable of performing security inspections efficiently.SOLUTION: According to an embodiment, a security inspection system equipped with a plurality of antennas, a data collection unit, and an inspection unit is provided. The security inspection system comprises a portion information acquisition unit and a processing unit. The portion information acquisition unit acquires portion information based on information recognized by a sensor. The processing unit generates first or second instruction information based on the portion information. When the first instruction information is generated, the data collection unit collects received data based on reflected waves received by some of the plurality of antennas set based on the first instruction information. When the second instruction information is generated, the inspection unit performs a security inspection on part of received data set based on the second instruction information.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] Embodiments of the present invention relate to a security inspection system. [Background technology]

[0002] In recent years, security inspection systems utilizing radar equipment have been developed. In these security inspection systems, for example, radio waves are transmitted (irradiated) onto a target (specifically, an object or person), and the reflected waves from that target are received. Based on the radar data derived from these received reflected waves, the target can be inspected (i.e., a security inspection of the target object is performed).

[0003] However, when the aforementioned security checks are conducted on, for example, pedestrians, it is necessary to carry out such security checks efficiently. [Prior art documents] [Patent Documents]

[0004] [Patent Document 1] U.S. Patent Application Publication No. 2016 / 0291148 [Overview of the project] [Problems that the invention aims to solve]

[0005] Therefore, the problem that this invention aims to solve is to provide a security inspection system that can perform security inspections efficiently. [Means for solving the problem]

[0006] According to one embodiment, a security inspection system is provided comprising: a plurality of antennas configured to transmit radio waves to a target and receive reflected waves from the target; a data collection unit for collecting received data based on the reflected waves; and an inspection unit for performing security inspections on the target based on the collected received data. The security inspection system comprises a part information acquisition unit and a processing unit. The part information acquisition unit acquires part information relating to a part of the target based on information recognized by a sensor that acquires information about the target. The processing unit generates first or second instruction information based on the acquired part information. If the first instruction information is generated, the data collection unit collects received data based on reflected waves received by some of the plurality of antennas configured based on the first instruction information. If the second instruction information is generated, the inspection unit performs security inspections on some of the received data configured based on the second instruction information. [Brief explanation of the drawing]

[0007] [Figure 1] A diagram illustrating the general operation of the security inspection system according to the embodiment. [Figure 2] A diagram showing an example of the system configuration of a security inspection system. [Figure 3] A diagram showing an example of the hardware configuration of the inspection device. [Figure 4] A block diagram showing an example of the functional configuration of an inspection device. [Figure 5] A sequence chart illustrating an example of the processing procedure for a security inspection system when conducting security checks on individuals being inspected. [Figure 6] A diagram illustrating the process for obtaining body part information. [Figure 7] A diagram showing an example of a data structure for body part information. [Figure 8] A diagram illustrating the overview of coordinate transformation for body parts. [Figure 9] A diagram showing an overview of the index information included in the preliminary data. [Figure 10] A diagram showing an overview of analyzable region information included in advance information. [Figure 11] A diagram for explaining an overview of the first instruction information generation process. [Figure 12] A diagram for explaining an overview of the second instruction information generation process. [Figure 13] A diagram showing an overview of radar sensing processing in a radar device. [Figure 14] A diagram showing an example of a radar image. [Figure 15] A diagram for explaining an overview of efficient security inspection realized in this embodiment. [Figure 16] A diagram showing an overview of security inspection using a statistical model. [Figure 17] A block diagram showing an example of the functional configuration of an inspection device in a modification of this embodiment. [Figure 18] A sequence chart showing an example of the processing procedure of a security inspection system when learning a statistical model. [Figure 19] A diagram conceptually showing a radar image with an inspection target site added as a label. [Figure 20] A diagram conceptually showing a radar image with an inspection target site and index information added as labels.

Embodiments of the Invention

[0008] Hereinafter, embodiments will be described with reference to the drawings. The security inspection system according to this embodiment uses radar data (also referred to as observation data and received data observed by a radar device) obtained by using a radar device including a plurality of antennas configured to transmit radio waves to a target and receive reflected waves from the target, and is configured to perform a security inspection on the target based on the radar data.

[0009] In this embodiment, the target is assumed to be a person passing through a predetermined area or an item, etc., possessed by such person. However, the target may also be, for example, a package containing items or the items, etc., contained within such package. In the following description, the target will be assumed to be a person (hereinafter referred to as the "inspection subject").

[0010] First, with reference to Figure 1, an overview of the operation of the security inspection system according to this embodiment will be described. The security inspection system 1 (and the radar device 2 used in it) according to this embodiment is installed in facilities such as airports, train stations, shopping malls, concert halls, and exhibition halls, and is used as a hazardous materials detection system to perform security checks, such as determining whether a person P being inspected is carrying a predetermined object (for example, a hazardous material) as they move near the radar device 2.

[0011] The security inspection system 1 according to this embodiment acquires part information relating to the body parts of the person being inspected P, performs radar sensing processing on the person being inspected P using a radar device 2 (i.e., transmits radio waves to the person being inspected P and receives reflected waves from the person being inspected P), generates a radar image (image) including the person being inspected P based on the radar data (radar data based on reflected waves from the person being inspected P) collected by the radar sensing processing, and operates to perform a security inspection (recognition of whether the person being inspected is in possession of dangerous goods) based on the radar image.

[0012] In other words, the security inspection system 1 according to this embodiment provides a mechanism for achieving efficient security inspection by utilizing the body parts (body part information) of the person being inspected P in each phase of sensing, radar image generation, and security inspection.

[0013] In this embodiment, the security inspection system 1 is intended to perform security inspections on, for example, a person P who is moving (walking). The radar device 2 used in the security inspection system 1 comprises a plurality of panels 2a and 2b arranged to surround the space in which the person P is moving. In other words, the security inspection system 1 is capable of performing security inspections on a person P who is passing between the plurality of panels 2a and 2b.

[0014] Each of the multiple panels 2a and 2b is equipped with multiple transmitting radar modules Tx, which include transmitting antennas that transmit radio waves to the inspected person P passing between the multiple panels 2a and 2b, and multiple receiving radar modules Rx, which include receiving antennas that receive reflected waves from the inspected person P. Note that the multiple panels 2a and 2b may be in the form of pillars or gates, rather than panels.

[0015] In this embodiment, the transmitting radar module Tx may consist of a single transmitting antenna or multiple transmitting antennas. In this embodiment, the receiving radar module Rx may consist of a single receiving antenna or multiple receiving antennas. Furthermore, the transmitting radar module Tx and the receiving radar module Rx may be placed (mounted) at any position on the above-described multiple panels 2a and 2b.

[0016] As described above, the radar device 2 operates by transmitting radio waves from the transmitting radar module Tx (transmitting antenna) to the person being inspected P, and receiving reflected waves from the person being inspected P with the receiving radar module Rx (receiving antenna). In the following explanation, the combination of the transmitting radar module Tx and the receiving radar module Rx that operates in this manner will be referred to as the transmitting and receiving radar module.

[0017] In this embodiment, a combination of a transmitting radar module Tx, which consists of one or more transmitting antennas, and a receiving radar module Rx, which consists of one or more receiving antennas, is described as a transmitting / receiving radar module. However, the transmitting / receiving radar module may consist of one or more transmitting / receiving antennas configured to transmit radio waves to a person under inspection P and to receive reflected waves from the person under inspection P. For example, the transmitting / receiving radar module may consist of one or more transmitting antennas and one or more receiving antennas.

[0018] Figure 2 shows an example of the system configuration of the security inspection system 1 according to this embodiment. As shown in Figure 2, the security inspection system 1 includes a radar device 2, an optical sensor device 3, and an inspection device 4.

[0019] The radar device 2 comprises multiple panels 2a and 2b, each containing multiple transmitting radar modules Tx and multiple receiving radar modules Rx, as shown in Figure 1. The radar device 2 operates by activating the above-mentioned transmitting and receiving radar modules (any combination of transmitting radar module Tx and receiving radar module Rx) so that the reflected waves from the person under inspection P transmitted from the transmitting radar module Tx are received by some or all of the receiving radar modules Rx on the multiple panels 2a and 2b. The radar device 2 outputs radar data based on the reflected waves from the person under inspection P received by the receiving radar modules Rx to the inspection device 4. The receiving radar modules Rx that receive the reflected waves are located on the panels (2a, 2b) on the same side as the transmitting radar module Tx that transmitted the radio waves and / or on the opposite side (2a, 2b) of the multiple panels 2a and 2b, which are arranged to straddle the space in which the person under inspection P moves. A master (not shown) is provided to supply a clock, reference signal, and trigger to the transmitting and receiving radar modules, enabling synchronized and coordinated measurements between them.

[0020] The optical sensor device 3 is, for example, located near the radar device 2 and includes an optical sensor configured to image the person being inspected P as it passes between a plurality of panels 2a and 2b. The optical sensor may be provided in two locations near the radar device 2. For example, it may be provided on the entrance side (one side of the plurality of panels 2a and 2b arranged side by side) and the exit side (the other side of the plurality of panels 2a and 2b arranged side by side) of the radar device 2 through which the person being inspected P passes. This arrangement allows imaging of the front and back of the person being inspected P as it passes through the radar device 2. The optical sensor includes an imaging device such as a camera, and the optical sensor device 3 acquires an image (hereinafter referred to as a camera image) including the person being inspected P as information (information recognized by the sensor) captured by the optical sensor. The optical sensor device 3 outputs the acquired camera image to the inspection device 4. Note that other sensors capable of acquiring body part information may be used instead of the optical sensor device 3 (optical sensor).

[0021] The inspection device 4 is connected to the radar device 2 and the optical sensor device 3, and is an electronic device (information processing device) configured to perform security checks on the person being inspected P. The inspection device 4 performs security checks using radar data output from the radar device 2, taking into account the body part information of the person being inspected P acquired based on the camera image output from the optical sensor device 3.

[0022] In Figure 2, the radar device 2, optical sensor device 3, and inspection device 4 are shown as separate devices. However, in the security inspection system 1, at least two of these devices—for example, the radar device 2, optical sensor device 3, and inspection device 4—may be configured as a single integrated unit.

[0023] Figure 3 shows an example of the hardware configuration of the inspection device 4. As shown in Figure 3, the inspection device 4 includes a CPU 41, non-volatile memory 42, main memory 43, and communication device 44, etc.

[0024] The CPU 41 is a processor for controlling the operation of various components within the inspection device 4. The CPU 41 may be a single processor or may consist of multiple processors. The CPU 41 executes various programs loaded from the non-volatile memory 42 into the main memory 43. In addition to the CPU 41, a GPU may be provided so that the GPU performs various inspection processes.

[0025] The communication device 44 is a device configured to perform wireless or wired communication. This communication device 44 enables communication between the inspection device 4, the radar device 2, and the optical sensor device 3.

[0026] Although only the non-volatile memory 42 and main memory 43 are shown in Figure 3, the inspection device 4 may also include other storage devices such as an HDD (Hard Disk Drive) and an SSD (Solid State Drive). Furthermore, the inspection device 4 may also include an input device (such as a mouse or keyboard) and a display device (such as a display).

[0027] Figure 4 is a block diagram showing an example of the functional configuration of the inspection device 4. As shown in Figure 4, the inspection device 4 includes a part information acquisition unit 401, a central processing unit 402, a data collection unit 403, a radar image generation unit 404, an inspection unit 405, and an output processing unit 406.

[0028] In this embodiment, some or all of the parts 401 to 406 shown in Figure 4 are implemented by causing the GPU 41 (i.e., the computer of the inspection device 4) to execute a predetermined program (hereinafter referred to as the security inspection program), i.e., by software. This security inspection program may be stored and distributed on a computer-readable storage medium, or it may be downloaded to the inspection device 4 via a network.

[0029] Here, it has been explained that some or all of the parts 401 to 406 are implemented by software, but some or all of these parts 401 to 406 may also be implemented by hardware such as ICs (Integrated Circuits), or by a combination of software and hardware.

[0030] The body part information acquisition unit 401 acquires (inputs) the camera image output from the optical sensor device 3 as described above. The body part information acquisition unit 401 acquires body part information relating to the body parts of the person being examined P included in the acquired camera image. The body part information is acquired based on the skeleton, etc., of the person being examined P as determined from the camera image.

[0031] The central processing unit 402 generates first or second instruction information based on the part information acquired by the part information acquisition unit 401. That is, the central processing unit 402 can generate at least one of the first or second instruction information based on the part information. As will be described in detail later, the first instruction information corresponds to operational radar module instruction information (signal) for instructing the operation of a transmit / receive radar module (or its operation) that has been set based on the part information from among the multiple transmit radar modules Tx and multiple receive radar modules Rx (combinations) provided in the radar device 2 (multiple panels 2a and 2b). The second instruction information corresponds to analysis area instruction information (signal) for instructing the area of ​​the person being inspected P who is to undergo security inspection (i.e., the area to be analyzed for security inspection) that has been set based on the part information. When the central processing unit 402 generates the first instruction information (operational radar module instruction information), the central processing unit 402 outputs the first instruction information to the radar device 2. When the central processing unit 402 generates second instruction information (analysis area instruction information), the central processing unit 402 outputs the second instruction information to the radar image generation unit 404.

[0032] Here, as described above, when the first instruction information is output from the central processing unit 402, the radar device 2 activates the transmit / receive radar module (a combination of a transmit radar module Tx and a receive radar module Rx) instructed by the first instruction information. As a result, the radar device 2 transmits radio waves from the transmit radar module Tx of the transmit / receive radar module instructed by the first instruction information, and receives reflected waves from the person being inspected P with the receive radar module Rx of the same transmit / receive radar module. The radar device 2 outputs radar data based on these reflected waves from the person being inspected P to the inspection device 4.

[0033] The data acquisition unit 403 collects (inputs) radar data output from the radar device 2. In other words, when the central processing unit 402 generates first instruction information, the data acquisition unit 403 collects radar data based on reflected waves received by the transmitting and receiving radar modules (some of the multiple transmitting radar modules Tx and multiple receiving radar modules Rx) that are set up based on the first instruction information (location information).

[0034] The radar image generation unit 404 generates a radar image including the person being inspected P based on the radar data collected by the data acquisition unit 403. Furthermore, when the central processing unit 402 generates second instruction information, the radar image generation unit 404 generates a radar image corresponding to the area of ​​the person being inspected P (for example, an area encompassing a portion of the person being inspected P) set based on the second instruction information (part information). In other words, the radar image generation unit 404 generates a radar image for performing security inspections on a portion of the radar data collected by the data acquisition unit 403 (radar data corresponding to a portion of the person being inspected P set based on the second instruction information).

[0035] The inspection unit 405 performs a security inspection based on the radar image generated by the radar image generation unit 404 (i.e., on the area of ​​the person to be inspected P, which is set based on the second instruction information).

[0036] The output processing unit 406 executes a process to output the results of the security inspection performed by the inspection unit 405.

[0037] In this explanation, the inspection device 4 is described as including parts 401 to 406, but some of these parts 401 to 406 may be located on the radar device 2 or optical sensor device 3 side.

[0038] The following describes an example of the processing procedure of the security inspection system 1 when conducting a security inspection on subject P, referring to the sequence chart in Figure 5.

[0039] First, as described above, a person under inspection P moving through a facility where the radar device 2 is installed is guided to pass between the multiple panels 2a and 2b provided by the radar device 2. In this case, the optical sensor (e.g., a camera) provided in the optical sensor device 3 is positioned to capture an image of the person under inspection P as they pass between the multiple panels 2a and 2b, and captures an image of the person under inspection P (step S1).

[0040] If the process in step S1 is executed, the optical sensor device 3 acquires a camera image including the person being inspected P captured by the optical sensor and outputs the camera image to the inspection device 4 (step S2).

[0041] The body part information acquisition unit 401 included in the inspection device 4 acquires the camera image output in step S2. Based on the acquired camera image, the body part information acquisition unit 401 acquires skeletal information representing the skeleton of the person being inspected P included in the camera image. Based on the above-mentioned camera image and skeletal information, the body part information acquisition unit 401 acquires body part information relating to the body parts of the person being inspected P (step S3).

[0042] Here, with reference to Figure 6, an overview of the process in step S3 will be explained. First, the part information acquisition unit 401 analyzes the camera image 100 to extract the subject P included in the camera image 100 and acquires skeletal information 101 representing the skeleton composed of each part of the subject P. In the example shown in Figure 6, the skeleton represented by the skeletal information 101 is composed of multiple parts such as the head, shoulders, arms (elbows), hands, abdomen (waist), knees, and feet.

[0043] Next, the part information acquisition unit 401 identifies the position on the camera image 100 for each part that constitutes the skeleton represented by the acquired skeletal information, and acquires part information including camera coordinate values ​​representing the position identified for each part. That is, for each person being examined P, the part information acquisition unit 401 acquires information that identifies at least one part from among the head, shoulders, arms (elbows), hands, abdomen (waist), knees, and feet, and the corresponding position information. The position information may be information indicating the center position of the part, or information indicating the range of the part. The camera coordinate values ​​included in the part information include the x-coordinate value (x') and y-coordinate value (y') defined in the camera image 100. That is, the part information in this embodiment can be said to correspond to part coordinate information that represents each part of the person being examined P with camera coordinate values ​​(x', y').

[0044] Figure 7 shows an example of the data structure of the part information obtained in step S3. As shown in Figure 7, the part information includes the camera coordinate values ​​(x coordinate and y coordinate values) of the part (part name) that constitutes the skeleton represented by the skeletal information.

[0045] In the part information shown in Figure 7, the x-coordinate value of part A of the subject P is "x a '" and the y coordinate value is "y a It is shown that the camera coordinates of part A are (xa', ya'), but the part information includes the camera coordinates of all parts of the subject P (all parts that make up the skeleton represented by the skeletal information).

[0046] Returning to Figure 5, the central processing unit 402 performs a region coordinate transformation based on the camera image and the region information acquired in step S3 (step S4).

[0047] Here, with reference to Figure 8, we will explain the overview of the coordinate transformation performed in step S4.

[0048] First, the part information acquired in step S3 described above includes camera coordinate values ​​(i.e., x and y coordinate values ​​defined in the camera image), but in the part coordinate transformation, these camera coordinate values ​​are transformed into global coordinate values. The global coordinate values ​​are coordinate values ​​(3D spatial coordinates) that represent the position in real space where the subject P (each part) exists, and include the x, y, and z coordinate values ​​defined in that real space.

[0049] In this case, for example, the position in real space corresponding to a reference point included in the camera image (i.e., global coordinate value) is pre-stored in the central processing unit 402, and in step S4, based on the correspondence between the camera coordinate value representing the position of the reference point in the camera image and the global coordinate value representing the position of the reference point in real space, the camera coordinate value (x',y') of each part of the subject P included in the above-mentioned part information is converted to global coordinate value (x,y,z).

[0050] In Figure 8, for example, a global coordinate value (0,0,0) representing the position of a reference point (origin) is pre-stored, where the edge of a panel provided on radar device 2 included in the camera image is used as the reference point. Based on the correspondence between the camera coordinate value of the reference point and the global coordinate value, the camera coordinate value (x a ',y a ´) is the global coordinate value (x a ,y a ,z aAn example of conversion to ) is shown. Here, we have described the body coordinate transformation performed on the camera coordinate values ​​of body part A of subject P, but the same body coordinate transformation is performed on the camera coordinate values ​​of other body parts as well.

[0051] In step S4, the camera coordinate values ​​of each part of the subject P included in the body part information are converted to global coordinate values. However, a further process may be performed to obtain (fill in) global coordinate values ​​representing the positions of new parts of the subject P (parts other than those that constitute the skeleton as represented by the skeletal information described above) using the global coordinate values ​​converted from the camera coordinate values.

[0052] Returning to Figure 5, the central processing unit 402 generates first and second instruction information based on the part information after the part coordinate transformation has been performed in step S4 (i.e., part information including global coordinate values ​​representing the location of each part of the subject P) (step S5).

[0053] The process of step S5 will be described in detail below. In this embodiment, the central processing unit 402 has prior information stored in advance, and in step S5, the first and second instruction information is generated using this prior information. The prior information includes index information and analyzable area information.

[0054] Here, Figure 9 shows an overview of the index information included in the pre-information. As shown in Figure 9, the index information corresponds to an identifier assigned to each combination of the transmitting radar module Tx and the receiving radar module Rx (i.e., the transmitting and receiving radar modules).

[0055] In the example shown in Figure 9, for example, the combination of transmitting radar module Tx1 and receiving radar module Rx1 is assigned the index information "#1". Also, for example, the combination of transmitting radar module Tx2 and receiving radar module Rx2 is assigned the index information "#2". Furthermore, for example, the combination of transmitting radar module Txn and receiving radar module Rxn (where n is an integer greater than or equal to 3) is assigned the index information "#n". Also, for example, the combination of transmitting radar module TxN and receiving radar module RxN (where N is an integer greater than or equal to n+1) is assigned the index information "#N".

[0056] In Figure 9, for the sake of explanation, only the index information "#1", "#2", ..., "#n", ..., "#N" is shown. However, in this embodiment, different index information is assigned when at least one of the transmitting radar module Tx and the receiving radar module Rx is different (i.e., index information is assigned to all combinations of transmitting radar module Tx and receiving radar module Rx).

[0057] Next, Figure 10 shows an overview of the analyzable region information included in the prior information. In this embodiment, the analyzable region information includes an analyzable region that corresponds to a space in which security inspections can be performed by operating a combination of a transmitting radar module Tx and a receiving radar module Rx (i.e., a transmitting and receiving radar module) to which the above-mentioned index information is assigned (i.e., a region that can be analyzed by transmitting radio waves and receiving reflected waves by the transmitting and receiving radar modules).

[0058] Here, the analyzable region included in the analyzable region information is defined by the range of global coordinate values ​​(x-coordinate, y-coordinate, and z-coordinate values), as shown in Figure 10.

[0059] Specifically, in the example shown in FIG. 10, for example, by operating a transmission / reception radar module (a combination of a transmission radar module Tx1 and a reception radar module Rx1) to which index information "#1" is assigned, a space (i.e., an analyzable area corresponding to the index information "#1") Ω1 where a security inspection can be performed has an x coordinate value of x_1 ini is greater than or equal to x_1 end and less than or equal to the following range. Also, the y coordinate value of the analyzable area Ω1 corresponding to the index information "#1" is y_1 ini is greater than or equal to y_1 end and less than or equal to the following range. The z coordinate value of the analyzable area Ω1 corresponding to the index information "#1" is z_1 ini is greater than or equal to z_1 end and less than or equal to the following range.

[0060] Here, only the analyzable area Ω1 corresponding to the index information "#1" has been described, but the same applies to analyzable areas corresponding to other index information (for example, the analyzable area Ω2 corresponding to the index information "#2", etc.).

[0061] Here, as described above, in step S5, the first and second instruction information is generated using the above-described prior information. Hereinafter, the process of generating the first instruction information (hereinafter referred to as the first instruction information generation process) and the process of generating the second instruction information (hereinafter referred to as the second instruction information generation process) will be described.

[0062] First, the first instruction information generation process will be described. In the first instruction information generation process, based on the part information (global coordinate values of each part of the inspection target person P) and the prior information (index information and analyzable area information), a transmission / reception radar module (a combination of a transmission radar module Tx and a reception radar module Rx) to be operated for the security inspection is set.

[0063] Specifically, the central processing unit 402 identifies index information corresponding to an analyzable region (an appropriate region close to the target area) that encompasses the global coordinate values ​​(3D spatial coordinates) of pre-specified parts (hereinafter referred to as "target areas") among the various body parts of the person being inspected P, and sets the identified index information (and the transmit / receive radar module to which it is assigned). In other words, in the first instruction information generation process, a transmit / receive radar module capable of transmitting radio waves to a region encompassing the target area (the location in real space where it exists) and receiving reflected waves from that region is set (i.e., first instruction information is generated that specifies an antenna to transmit radio waves corresponding to the target area and an antenna to receive reflected waves from the target area).

[0064] In the security check to determine whether or not subject P is in possession of dangerous materials, inspections will be conducted on each body part (e.g., abdomen, arms, etc.). The inspection may focus on one body part or multiple body parts.

[0065] Figure 11 is a diagram illustrating the overview of the first instruction information generation process. Note that Figure 11 assumes that parts A through D are being examined.

[0066] According to Figure 11, the global coordinate value is (x a ,y a ,z a If part A is selected as the target area for examination, then the appropriate region close to part A (the analyzable region encompassing the global coordinate values ​​of part A) is the analyzable region Ω. A Therefore, the analyzable region Ω A This indicates that the first instruction information is generated with the corresponding index information "#A" set.

[0067] While a detailed explanation will be omitted here, if site B is selected as the target site for examination, a first instruction information with the index information "#B" is generated; if site C is selected as the target site for examination, a first instruction information with the index information "#C" is generated; and if site D is selected as the target site for examination, a first instruction information with the index information "#D" is generated.

[0068] Next, the second instruction information generation process will be explained. In the second instruction information generation process, the analysis area is set based on the body part information (global coordinate values ​​of each body part of the subject P), prior information (index information and analyzable area information), and the first instruction information (index information set in the first instruction information).

[0069] Specifically, the central processing unit 402 sets the region that includes the global coordinate values ​​of the inspection target area, which are included in the part information of the analyzable region corresponding to the index information set in the first instruction information (i.e., a part of the analyzable region), as the analysis region.

[0070] Figure 12 is a diagram illustrating the overview of the second instruction information generation process. In the example shown in Figure 12, for example, a predetermined area 200 centered on the global coordinate value (spatial coordinate position) of the area to be inspected is set as the analysis area (that is, the analysis area is set based on the spatial coordinate information of the area to be inspected). In other words, in the second instruction information generation process, second instruction information is generated that designates the area encompassing the area to be inspected as the area where security inspection will be performed.

[0071] Furthermore, the size and resolution of the analysis area set in the second instruction information generation process can be set arbitrarily. Specifically, the analysis area is set considering the area to be inspected (the area where it is detected whether or not the inspected person P is possessing a hazardous material), the field of view of the radar device 2, the resolution, the size of the hazardous material, etc.

[0072] Furthermore, the second instruction information setting process is executed each time a security inspection is performed (i.e., for each person P being inspected), but in order to reduce the processing load of the second instruction information setting process, a process may be executed to select the optimal analysis area (i.e., the set analysis area) from among several predetermined analysis areas based on, for example, the global coordinate values ​​of the area being inspected.

[0073] Furthermore, the analysis region set in the second instruction information setting process shall be defined by the range of global coordinate values ​​(x-coordinate, y-coordinate, and z-coordinate values), similar to the analyzable region described above.

[0074] Returning to Figure 5, the central processing unit 402 outputs the first instruction information generated in step S5 to the radar device 2 (step S6). The first instruction information contains index information assigned to the transmit / receive radar module, and the execution of the process in step S6 instructs the radar device 2 to operate the transmit / receive radar module.

[0075] In step S6, the radar device 2 performs radar sensing processing according to the first instruction information output from the central processing unit 402 (inspection device 4).

[0076] Specifically, radar device 2 operates the transmit / receive radar module to which the index information set in the first instruction information is assigned (step S7).

[0077] When the process in step S7 is executed, the transmitting radar module Tx of the activated transmitting and receiving radar module transmits radio waves to the person under inspection P, and the receiving radar module Rx of the same transmitting and receiving radar module receives the reflected waves from the person under inspection P. As a result, the radar device 2 acquires radar data based on the reflected waves from the person under inspection P (step S8).

[0078] Here, Figure 13 shows an overview of the radar sensing process in radar device 2. In Figure 13, we assume that the first instruction information, in which index information "#A", "#B", "#C", and "#D" is set as shown in Figure 11 above, is output from inspection device 4 to radar device 2.

[0079] In this case, as shown in Figure 13, radar sensing processing is performed by sequentially operating the transmit / receive radar modules to which each of the index information "#A", "#B", "#C", and "#D" is assigned. As a result, radar data A is acquired in accordance with the operation of the transmit / receive radar module to which index information "#A" is assigned, radar data B is acquired in accordance with the operation of the transmit / receive radar module to which index information "#B" is assigned, radar data C is acquired in accordance with the operation of the transmit / receive radar module to which index information "#C" is assigned, and radar data D is acquired in accordance with the operation of the transmit / receive radar module to which index information "#D" is assigned.

[0080] Returning to Figure 5, the radar data acquired in step S8 is output from the radar device 2 to the inspection device 4 (step S9).

[0081] Next, the data acquisition unit 403 included in the inspection device 4 collects the radar data output from the radar device 2 in step S9 (step S10).

[0082] Here, the second instruction information generated in step S5 described above is output from the central processing unit 402 to the radar image generation unit 404. The second instruction information includes a defined analysis area, and when this second instruction information is output to the radar image generation unit 404, the unit is instructed to generate a radar image corresponding to the analysis area (i.e., to perform a security check on the analysis area).

[0083] The radar image generation unit 404 generates a radar image including the person being inspected P (a radar image corresponding to a part of the person being inspected P) based on the second instruction information output from the central processing unit 402 and the radar data collected in step S10 (step S11). In step S11, a radar image of at least the analysis region (the region encompassing the part of the person being inspected P) set in the second instruction information is generated. In other words, in step S11, a radar image is generated using a portion of the radar data collected in step S10 (the radar data necessary to image the analysis region).

[0084] Figure 14 conceptually shows the radar image (imaging image) generated in step S11. Here, we assume that radar data A to D are collected according to the operation of the transmitting and receiving radar modules to which index information "#A", "#B", "#C", and "#D" are assigned, as explained in Figure 13 above.

[0085] In this case, the radar image generation unit 404 generates radar image A corresponding to the analysis region encompassing part A based on radar data A (part of it), generates radar image B corresponding to the analysis region encompassing part B based on radar data B (part of it), generates radar image C corresponding to the analysis region encompassing part C based on radar data C (part of it), and generates radar image D corresponding to the analysis region encompassing part D based on radar data D (part of it).

[0086] Note that Figure 14 is a diagram for conceptually explaining radar images, and therefore, for convenience, the same radar images A to D are shown. However, these radar images A to D will be different depending on the corresponding areas A to D (i.e., the analysis area) and whether or not hazardous materials are being carried in those areas A to D.

[0087] Returning to Figure 5, the radar image generated in step S11 is output from the radar image generation unit 404 to the inspection unit 405, along with the index information set in the first instruction information and the name of the inspection target area (or part) for which the analysis region is set in the second instruction information.

[0088] The inspection unit 405 acquires the radar image output from the radar image generation unit 404, index information, and the area to be inspected, and performs a security inspection on the person being inspected P (step S12).

[0089] The process of step S12 will be described in detail below. In this embodiment, the inspection unit 405 holds, for example, a pre-prepared statistical model, and obtains the results of the security inspection using this statistical model and the radar image output from the radar image generation unit 404. This statistical model is constructed (generated) to output (estimate) as the result of a security inspection of the subject P whether or not a hazardous material exists in the analysis region corresponding to the radar image (i.e., whether the subject P is in possession of a hazardous material in the area included in the analysis region) by inputting a radar image.

[0090] According to this, the inspection unit 405 can obtain the results of the security inspection output from the statistical model by inputting the radar image generated in step S10 into the statistical model held by the inspection unit 405.

[0091] Furthermore, statistical models are generated based on technologies such as artificial intelligence (AI), machine learning, or deep learning. Specifically, statistical models can be generated by applying various machine learning algorithms, such as neural networks or random forests. In other words, the process in step S12 described above (i.e., security inspection) can be realized, for example, by AI-based radar image recognition processing.

[0092] Here, a statistical model may be prepared for each area to be inspected. In this case, by inputting the radar image generated in step S11 into the statistical model prepared for the area to be inspected acquired by the inspection unit 405, it is possible to obtain highly accurate security inspection results that take into account the area to be inspected.

[0093] Furthermore, a statistical model may be prepared for each index of information (i.e., a combination of the transmitting radar module Tx and the receiving radar module Rx). In this case, by inputting the radar image generated in step S11 into the statistical model prepared for the index information acquired by the inspection unit 405 (i.e., the transmitting and receiving radar modules operated in the radar device 2), it is possible to obtain highly accurate security inspection results that take into account the transmitting and receiving radar modules (and their locations, etc.) that were operated for security inspection.

[0094] Furthermore, a statistical model may be prepared for each combination of the above-mentioned target body part and index information.

[0095] Furthermore, the statistical model may be constructed to output security inspection results by inputting, for example, the area to be inspected, along with the radar image. Alternatively, the statistical model may be constructed to output security inspection results by inputting index information along with the radar image. Furthermore, the statistical model may be constructed to output security inspection results by inputting the area to be inspected and index information along with the radar image.

[0096] When the process in step S12 is executed, the output processing unit 406 outputs the results of the security check performed in step S12 (step S13).

[0097] Here, the output processing unit 406 includes, for example, a display processing unit or an alarm processing unit. The display processing unit displays the results of the security inspection on, for example, a display device provided in the inspection device 4 (i.e., it displays whether or not the person being inspected P is in possession of dangerous goods). In this case, the display processing unit may, for example, superimpose text or a mark indicating that the person being inspected P is in possession of dangerous goods onto the camera image as a result of the security inspection. Furthermore, as described above, the results of the security inspection are obtained by inputting the radar image into a statistical model, but the display processing unit may also display on the camera image that dangerous goods are in possession of the inspected area (i.e., it highlights the inspected area on the camera image). In other words, the display processing unit may display the degree of danger for each part of the person being inspected P.

[0098] On the other hand, if the alarm processing unit obtains, for example, the result of a security inspection that inspector P is in possession of dangerous goods, it will issue an alarm to inspector P that inspector P is in possession of dangerous goods. Note that "issuing an alarm" includes, for example, emitting an alarm sound or illuminating a lamp in radar device 2. Here, it has been explained that the alarm will be issued to inspector P, but in order to prevent inspector P from concealing dangerous goods, the alarm may also be issued to the administrator of security inspection system 1 (inspection device 4).

[0099] As described above, in Figure 5, the processes in steps S1 to S13 are explained as being executed in order, but the order of these processes may be changed. Specifically, in Figure 5, the first and second instruction information is generated in step S5 (i.e., the first and second instruction information generation processes are executed), but the processes in steps S6 to S10 (i.e., the radar sensing process in the radar device 2) may be executed between the execution of the first instruction information generation process and the second instruction information generation process. In other words, the security inspection system 1 according to this embodiment may operate such that the processing of the radar device 2 interrupts the processing (operation) of the central processing unit 402.

[0100] Furthermore, although Figure 5 describes the generation of first and second instruction information, in this embodiment, it is sufficient if at least one of the first and second instruction information is generated.

[0101] As described above, in this embodiment, part information relating to the body parts of the person being inspected P is acquired based on the image captured by the optical sensor (information recognized by the sensor), and first or second instruction information is generated based on the acquired part information. If first instruction information is generated, radar data based on reflected waves received by the transmit / receive radar module (i.e., a part of the multiple antennas provided in the radar device 2) set based on the part information is collected. If second instruction information is generated, a security inspection is performed on an area encompassing a part of the person being inspected P (the part to be inspected) set based on the part information.

[0102] In this embodiment, by generating first or second instruction information based on part information as described above, security checks can be performed efficiently (i.e., efficient security checks can be achieved).

[0103] In this embodiment, for example, skeletal information representing the skeleton of the subject P can be acquired based on an captured image, and part information including the position of the subject P's body parts on the image can be acquired based on the acquired skeletal information. In this case, the position of the subject P's body parts on the image included in the part information is represented by camera coordinate values ​​(first coordinate values) defined in the image. In this case, the central processing unit 402 converts the camera coordinate values ​​representing the position of the subject P's body parts on the image into global coordinate values ​​(second coordinate values) representing the position of the subject P's body parts in real space, and generates first and second instruction information based on these global coordinate values.

[0104] Specifically, when the central processing unit 402 generates the first instruction information, it sets up a transmitting and receiving radar module that transmits radio waves to a region encompassing the location in real space where the part to be inspected, represented by global coordinate values, exists, and receives reflected waves from that region.

[0105] On the other hand, when the central processing unit 402 generates the second instruction information, it sets the region that includes the location in real space where the part to be inspected, represented by global coordinate values, exists as the region in which the security inspection is performed (i.e., the analysis region).

[0106] Now, referring to Figure 15, we will explain the overview of the efficient security testing achieved by the above-described configuration.

[0107] First, in this embodiment, the radar device 2 is instructed to operate the transmit / receive radar module (operating radar module) based on the first instruction information described above, so it is not necessary to operate all the transmit radar module Tx and receive radar module Rx provided in the radar device 2. With this configuration, the time required for radar sensing processing in the radar device 2 during the sensing phase can be shortened, and the amount of radar data collected by the execution of said radar sensing processing (i.e., the amount of radar data used to generate radar images) can be reduced, thereby enabling efficient security inspection.

[0108] Furthermore, in this embodiment, since the analysis area (that is, the area encompassing a portion of the inspected person P within the analyzable area corresponding to the index information assigned to the activated transmitting / receiving radar module) is instructed to the radar image generation unit 404 based on the second instruction information described above, there is no need to generate a radar image that includes the entire analyzable area. With this configuration, the radar image generation time in the radar image generation phase can be shortened, thereby enabling efficient security inspection.

[0109] Furthermore, in this embodiment, a radar image including the subject P is generated based on the collected radar data, and the generated radar image is input to a pre-prepared statistical model (AI) to obtain the results of the security inspection for the subject P output from the statistical model (i.e., the security inspection is performed using the statistical model). In this embodiment, for example, as shown in Figure 16, radar images of each part of the subject P to be inspected are input to the statistical model, and the statistical model outputs the results of the security inspection that take into account the parts to be inspected. With this configuration, it is possible to suppress the change in the results of the security inspection due to the body shape and posture of the subject P (individual differences such as height differences, build and gait), thereby improving the accuracy of the security inspection.

[0110] In other words, in this embodiment, by utilizing body part information relating to the body parts of the person being inspected P, an efficient and effective security inspection system 1 (body inspection of the person being inspected P) can be realized through a three-pronged approach of "sensing," "radar image generation," and "security inspection (for example, recognition of whether or not the person being inspected P is possessing dangerous materials)."

[0111] In this embodiment, the security inspection is performed using a statistical model from among several pre-prepared statistical models that corresponds to at least one of the index information assigned to the inspection target area and the operating transmit / receive radar module. In this embodiment, since security inspections can be performed considering the inspection target area or the operating transmit / receive radar module, it is possible to obtain highly accurate security inspection results.

[0112] Furthermore, security inspections may be performed using a statistical model in which at least one of the above-mentioned inspection target area and index information is input along with the radar image. Even with such a configuration, it is possible to obtain highly accurate security inspection results.

[0113] Furthermore, in this embodiment, the results of the security inspection described above are output by the output processing unit 406, which includes, for example, a display processing unit or an alarm processing unit. The display processing unit displays text or a mark indicating that the inspected person P is in possession of a dangerous object when the security inspection results indicate that the inspected person P is in possession of a dangerous object. On the other hand, the alarm processing unit issues an alarm when the security inspection results indicate that the object is in possession of a dangerous object. With this configuration, it becomes possible to easily grasp the results of the security inspection.

[0114] In this embodiment, it has been explained that radar data based on reflected waves received by the receiving radar module (Rx in the receiving radar module) is collected when the transmitting / receiving radar module set in the first instruction information is activated. However, the data acquisition unit 403 may also be configured to collect radar data based on reflected waves received by all transmitting / receiving radar modules (Rx in the receiving radar module) by, for example, activating all transmitting / receiving radar modules, and then extract radar data based on reflected waves received by the transmitting / receiving radar module set in the first instruction information from the collected radar data. In such a configuration, the time required for radar sensing processing in the radar device 2 described above cannot be shortened, but the amount of radar data used to generate a radar image can be reduced.

[0115] Furthermore, although this embodiment describes the optical sensor provided in the optical sensor device 3 as a camera (imaging device), the optical sensor may also be, for example, a LiDAR (Light Detection and Ranging) that measures the distance to the subject P by irradiating light. In such a configuration, an image (distance image) generated based on the distance measured by the LiDAR is output from the optical sensor device 3 as imaging information, and body part information can be acquired based on the distance image. Although this description assumes the optical sensor is a LiDAR, the optical sensor may be configured to capture an image capable of acquiring body part information.

[0116] Furthermore, although this embodiment has been described primarily as a security inspection of the person being inspected, this embodiment can also be applied to security inspections of objects that pass through the radar device 2 (multiple panels) while concealing hazardous materials.

[0117] By the way, although this embodiment describes a configuration that performs security inspections using a statistical model, the security inspection system 1 according to this embodiment may also have a function (hereinafter referred to as the learning function) for learning the statistical model in order to generate the statistical model.

[0118] The following describes a modified version of this embodiment: a security inspection system with a learning function. Since the configuration of the modified security inspection system is the same as in Figure 2, Figure 2 will be used for the explanation.

[0119] Figure 17 is a block diagram showing an example of the functional configuration of the inspection device 4 in a modified example of this embodiment. In Figure 17, the same reference numerals are used for parts that are the same as those in Figure 4, and their detailed descriptions are omitted. Here, we will describe the parts that differ from those in Figure 4.

[0120] As shown in Figure 17, the inspection device 4 includes a labeling unit 407 and a learning processing unit 408 as functional units for realizing the learning function described above. In a modified example of this embodiment, some or all of the labeling unit 407 and the learning processing unit 408 shown in Figure 17 may be implemented by software, by hardware, or by a combination of software and hardware.

[0121] The labeling unit 407 adds labels to the radar images generated by the radar image generation unit 404.

[0122] The learning processing unit 408 performs a process (learning process) to train a statistical model on radar images to which labels have been added by the labeling unit 407.

[0123] Next, with reference to the sequence chart in Figure 18, an example of the processing procedure of the security inspection system 1 when training a statistical model in a modified example of this embodiment will be described.

[0124] Figure 18 shows the processing procedure of security inspection system 1 during training, while Figure 5 above shows the processing procedure of security inspection system 1 during operation (i.e., when performing security inspections). However, the process up to the generation of radar images is the same in both training and operation.

[0125] In this case, steps S21 to S31, which correspond to steps S1 to S11 shown in Figure 5 above, are executed. Note that steps S21 to S31 are processes for training a statistical model, so they are executed using inspectors P whose possession of hazardous materials is known (i.e., inspectors P whose security inspection results are known).

[0126] Next, the labeling unit 407 performs a process (labeling process) to add a label to the radar image generated in step S31 (step S32).

[0127] The following describes the process of step S32 in detail. First, let's consider the case where a statistical model is generated that outputs the results of a security inspection by inputting, for example, a radar image along with the area to be inspected. In this case, the label attached to the radar image in step S32 includes the area to be inspected (that is, the area to be inspected is attached to the radar image as a label). Figure 19 conceptually shows a radar image to which the area to be inspected is attached as a label (i.e., training data labeled with the area to be inspected).

[0128] On the other hand, consider a case where a statistical model is generated that outputs the results of a security inspection by inputting, for example, the area to be inspected and index information assigned to the transmitting and receiving radar module operated in radar device 2 along with the radar image. In this case, the label added in step S32 above includes a combination of the area to be inspected and the index information (that is, the area to be inspected and the index information are added to the radar image as a label). Figure 20 conceptually shows a radar image to which the area to be inspected and the index information are added as labels (i.e., training data labeled with the area to be inspected and the index information).

[0129] Furthermore, in the case of generating a statistical model constructed to output the results of a security check by inputting, for example, index information assigned to the transmitting and receiving radar modules operated in radar device 2 along with the radar image, the label added in step S32 shall include the index information (i.e., the index information is added to the radar image as a label).

[0130] Returning to Figure 18, the learning processing unit 408 performs a learning process (for example, AI learning) using the radar image to which a label has been added in step S33 (hereinafter referred to as the labeled radar image) (step S33).

[0131] Specifically, the learning process in step S33 includes, for example, inputting labeled radar images into a pre-prepared statistical model (the statistical model before the learning process is executed) to obtain the results of a security check output from the statistical model, and feeding back the error between the results of the security check and whether or not the person being checked P, who is known in advance as described above, is in possession of dangerous goods (i.e., the results of a known security check) to the statistical model (i.e., updating parameters such as the weight coefficients of the statistical model so that the error is reduced).

[0132] Furthermore, it is preferable that the process shown in Figure 18 described above be repeatedly performed by preparing, for example, various subjects P to be inspected. In addition, when the process shown in Figure 18 is performed, a statistical model that has learned from labeled radar images (training data) is generated. This statistical model is used for security inspections performed in the inspection unit 405 described above, and is therefore stored, for example, within the inspection unit 405.

[0133] As described above, in the modified version of this embodiment, the area to be inspected is added as a label to the radar image, and by training a statistical model using the radar image to which the label (area to be inspected) has been added, a statistical model for performing security inspections that take into account the area of ​​the person being inspected P (i.e., a statistical model that can estimate the results of a highly accurate security inspection) can be obtained.

[0134] Furthermore, in the case of a configuration in which first instruction information is generated, the label attached to the radar image described above may include index information assigned to the transmit / receive radar module (the transmit / receive radar module operated in radar device 2) set in the first instruction information. With such a configuration, a statistical model can be obtained for performing security checks that take into account the location of the operated transmit / receive radar module.

[0135] In the modified example of this embodiment, the inspection device 4 provided in the security inspection system 1 was described as having both a security inspection function (hereinafter referred to as the security inspection function) and a learning function. However, the security inspection system 1 may also be configured to include a learning device, which includes parts 401-404, 407, and 408 shown in Figure 17, in addition to the inspection device 4 having the configuration shown in Figure 4. In other words, the security inspection system 1 according to the modified example of this embodiment may be configured to have the security inspection function (a functional unit for realizing the security inspection function) and the learning function (a functional unit for realizing the learning function) in separate devices.

[0136] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents.

[0137] With regard to the embodiments described above, the following additional information is disclosed. [1] A security inspection system comprising: multiple antennas configured to transmit radio waves to a target and receive reflected waves from the target; a data acquisition unit that collects received data based on the reflected waves; and an inspection unit that performs security inspections on the target based on the collected received data, A part information acquisition unit acquires part information relating to the part of the target based on the information recognized by the sensor that acquires information about the target, A processing unit that generates first or second instruction information based on the acquired part information, It is equipped with, When the first instruction information is generated, the data acquisition unit collects received data based on reflected waves received by some of the multiple antennas set based on the first instruction information. When the second instruction information is generated, the inspection unit performs a security check on a portion of the received data set based on the second instruction information. Security inspection system. [2] The system further comprises an image generation unit that generates an image including the subject based on the collected received data, The inspection unit obtains the results of the security inspection using a statistical model corresponding to a pre-prepared area and the generated image. [1] The security inspection system described in the security inspection system. [3] The security inspection system according to [1] or [2], wherein the image generation unit generates an image corresponding to a part of the target when the second instruction information is generated. [4] The security inspection system described in [2], wherein the inspection unit uses a statistical model from among a plurality of pre-prepared statistical models that corresponds to at least one of the index information assigned to the target part and a portion of the plurality of antennas. [5] The security inspection system described in [2], wherein the inspection unit uses a statistical model into which at least one of the target area and index information assigned to a portion of the plurality of antennas is input along with the generated image. [6] The aforementioned sensor is a sensor that captures an image of the subject, The security inspection system according to any one of the following [1] to [5], wherein the part information acquisition unit acquires skeletal information representing the skeleton of the target based on the captured image, and acquires part information including the position of the part of the target on the image based on the acquired skeletal information. [7] The security inspection system described in [6], wherein the position of the target part included in the part information on the image is represented by a first coordinate value defined in the image. [8] The security inspection system described in [7], wherein the processing unit converts a first coordinate value representing the position of the target part on the image into a second coordinate value representing the position of the target part in real space, and generates the first instruction information or the second instruction information based on the second coordinate value. [9] The security inspection system according to any one of [1] to [8], wherein the processing unit generates the first instruction information specifying an antenna for transmitting radio waves corresponding to the target part and an antenna for receiving reflected waves from the part.

[10] The security inspection system according to any one of [1] to [9], wherein the processing unit generates the second instruction information which designates the region encompassing the target part as the region in which the security inspection is performed.

[11] The security inspection system according to any one of the following paragraphs [2], [4], and [5], further comprising an output processing unit that outputs the results of the security inspection obtained by the inspection unit.

[12] The security inspection system according to

[11] , wherein the output processing unit includes a display processing unit that displays the results of the security inspection or an alarm processing unit that gives an alarm based on the results of the security inspection.

[13] The results of the security inspection include whether or not the subject is in possession of the specified item. When the display processing unit obtains the result of the security inspection indicating that the subject is in possession of a predetermined object, it displays text or a mark indicating that the subject is in possession of a predetermined object. The alarm processing unit issues an alarm when it obtains the result of a security inspection indicating that the subject is in possession of a specified object.

[12] The security inspection system described in the security inspection system.

[14] A labeling unit that adds the target area as a label to the generated image, A learning processing unit that trains the statistical model using the images to which the aforementioned labels have been added. A security inspection system according to any one of the following: [2], [4], [5] and

[11] -

[13] .

[15] The security inspection system described in

[14] includes, in which the label attached to the image includes index information assigned to a portion of the plurality of antennas set based on the part information. [Explanation of Symbols]

[0138] 1...Security inspection system, 2...Radar device, 3...Optical sensor device, 4...Inspection device, 41...CPU, 42...Non-volatile memory, 43...Main memory, 44...Communication device, 401...Part information acquisition unit, 402...Central processing unit (processing unit), 403...Data acquisition unit, 404...Radar image generation unit (image generation unit), 405...Inspection unit, 406...Output processing unit, 407...Labeling unit, 408...Learning processing unit.

Claims

1. A security inspection system comprising: multiple antennas configured to transmit radio waves to a target and receive reflected waves from the target; a data acquisition unit that collects received data based on the reflected waves; and an inspection unit that performs security inspections on the target based on the collected received data, A part information acquisition unit acquires part information relating to the part of the target based on information recognized by the sensor that acquires information about the target, A processing unit that generates first or second instruction information based on the acquired part information, It is equipped with, When the first instruction information is generated, the data acquisition unit collects received data based on reflected waves received by some of the multiple antennas set based on the first instruction information. When the second instruction information is generated, the inspection unit performs a security check on a portion of the received data set based on the second instruction information. Security inspection system.

2. The system further comprises an image generation unit that generates an image including the subject based on the collected received data, The inspection unit obtains the results of the security inspection using a statistical model corresponding to a pre-prepared area and the generated image. The security inspection system according to claim 1.

3. The security inspection system according to claim 2, wherein the image generation unit generates an image corresponding to a part of the target when the second instruction information is generated.

4. The security inspection system according to claim 2, wherein the inspection unit uses a statistical model from among a plurality of pre-prepared statistical models that corresponds to at least one of the index information assigned to the target part and a portion of the plurality of antennas.

5. The security inspection system according to claim 2, wherein the inspection unit uses a statistical model into which at least one of the index information assigned to the target area and a portion of the plurality of antennas is input along with the generated image.

6. The aforementioned sensor is a sensor that captures an image of the subject, The security inspection system according to claim 1, wherein the part information acquisition unit acquires skeletal information representing the skeleton of the target based on the captured image, and acquires part information including the position of the part of the target on the image based on the acquired skeletal information.

7. The security inspection system according to claim 6, wherein the position of the target part included in the part information on the image is represented by a first coordinate value defined in the image.

8. The security inspection system according to claim 7, wherein the processing unit converts a first coordinate value representing the position of the target part on the image into a second coordinate value representing the position of the target part in real space, and generates the first instruction information or the second instruction information based on the second coordinate value.

9. The security inspection system according to claim 1, wherein the processing unit generates first instruction information specifying an antenna that transmits radio waves corresponding to the target part and an antenna that receives reflected waves from the part.

10. The security inspection system according to claim 8, wherein the processing unit generates the second instruction information which designates the region encompassing the target part as the region in which the security inspection is performed.

11. The security inspection system according to claim 2, further comprising an output processing unit that outputs the results of the security inspection obtained by the inspection unit.

12. The security inspection system according to claim 11, wherein the output processing unit includes a display processing unit that displays the results of the security inspection or an alarm processing unit that issues an alarm based on the results of the security inspection.

13. The results of the security inspection include whether or not the subject is in possession of the specified item. When the display processing unit obtains the result of the security inspection indicating that the subject is in possession of a predetermined object, it displays text or a mark indicating that the subject is in possession of a predetermined object. The alarm processing unit issues an alarm when it obtains the result of a security inspection indicating that the subject is in possession of a specified object. The security inspection system according to claim 12.

14. A labeling unit that adds the target area as a label to the generated image, A learning processing unit that trains the statistical model using the images to which the aforementioned labels have been added. The security inspection system according to claim 2, further comprising the above.

15. The security inspection system according to claim 14, wherein the label attached to the image includes index information assigned to a portion of the plurality of antennas set based on the part information.

16. The image generation unit further comprises an image generation unit that generates an image including the object based on the collected received data, The inspection unit obtains the results of the security inspection using a pre-prepared statistical model and the generated image. The statistical model is generated by a learning process using images corresponding to the target area or a portion of the multiple antennas. The security inspection system according to claim 1.

17. The part information acquisition unit acquires a plurality of part information relating to the plurality of parts of the target, The processing unit generates first or second instruction information based on the acquired plurality of part information. The security inspection system according to claim 1.

Images