Inspection method and system based on millimeter wave security inspection device, and server
The integration of a server-connected inspection system with millimeter wave security devices addresses inefficiencies in current screening methods by dynamically allocating inspection stations and managing unified data, enhancing the efficiency and flexibility of security screening processes.
Patent Information
- Application Number
- JP2022580904
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-06-28
- Filing Date
- 2021-06-24
- Publication Date
- 2025-01-20
- Estimated Expiration
- 2041-06-24
AI Technical Summary
Current security screening methods using millimeter wave devices lack the ability to unify business data retrieval, dynamically adjust the number of manual inspection stations and image evaluation stations, and efficiently manage passenger flow, leading to inefficiencies and labor intensity in airport security inspections.
A server-connected inspection system that integrates millimeter wave security devices, allowing for dynamic allocation of manual inspection stations and image judgment stations based on predefined policies, including gender and proximity criteria, and enabling unified data management and multiplexing of inspection resources.
Enhances the efficiency and flexibility of security inspections by dynamically adjusting the number of manual and image evaluation stations, reducing labor intensity and improving the handling of varying passenger flows.
Smart Images

Figure 0007617961000001 
Figure 0007617961000002 
Figure 0007617961000003
Abstract
Description
[Technical field]
[0001] This application claims priority to a Chinese patent application having application number 202010600568.2, filed on June 28, 2020, the entire contents of which are incorporated herein by reference.
[0002] The present disclosure relates to the technical field of security inspection, and in particular to an inspection method and system based on a millimeter wave security inspection device. [Background technology]
[0003] At present, most airport security inspections are still centered on methods such as "metal detector + manual inspection". Millimeter wave human body imaging technology is currently an advanced technology in the global security field, and is used in passenger security inspections at airports in the United States, the United Kingdom, the Netherlands, Australia, Japan and other countries. This device can effectively detect objects hidden in various parts of the human body under clothing without direct contact with the human body, especially non-metallic objects, and can obtain information such as the shape, size and location of the hidden objects from the image. In addition, the millimeter wave human body imaging device is harmless to the human body and has strong penetrating power, and its emission power is less than one thousandth of the electromagnetic radiation of a mobile phone, and can accurately identify the objects on the human body, effectively improving the objectivity, accuracy and validity of the inspection, reducing the labor intensity of security inspectors, and improving the efficiency of security inspection.
[0004] The operation method of the millimeter wave security inspection system also usually adopts a similar method to "metal door + manual inspection". Currently, the method of performing security inspection using products including millimeter wave security inspection devices such as Rodschwarz can be divided into the following four steps. In the first step (scanning step), the passenger is scanned by the security inspection device, and the security inspection device performs automatic dangerous object recognition (ATR), and then displays the character image and the location of the suspected object. In the second step (selection manual inspection station step), after the passenger is scanned by the security inspection device, the assigned manual inspection station number is directly displayed on the screen of the security inspection device, and the security inspection device operator manually selects and assigns the manual inspection station, and waits for the passenger to come to the selected manual inspection station position to undergo manual inspection. In the third step (image judgment step), when there is a demand for remote inspection images, the security inspection device transmits the scanned image and the information identified by the ATR together to the connected image judgment station, and the scanned image is manually inspected by the image inspection officer, and then the image judgment result (pass or warning) is submitted to the security inspection device. As the fourth step (manual inspection step), the security inspection device transmits the character image and suspect position information, as well as the image judgment result, to the manual inspection station previously selected by the operator, and the manual inspector performs manual inspection of the passenger based on the image and the position of the suspect.
[0005] However, the current security inspection method has the following problems: all business data is distributed and stored in each security inspection device and cannot be searched uniformly; after the security inspection device scans the passenger, the security inspection device operator needs to manually select and assign the manual inspection station; after the passenger flow rate increases, the manual inspectors and remote image inspectors cannot be dynamically increased; and when there are multiple security inspection devices (multiple security inspection channels) operating simultaneously, the manual inspection station and the image judgment station cannot be multiplexed. Therefore, an inspection method and apparatus based on a millimeter wave security inspection device to solve the above problems is needed. Summary of the Invention
[0006] According to a first aspect of the present disclosure, there is provided a server for use in an inspection system based on a millimeter wave security inspection device, the server being connected to a security inspection apparatus via a switch system, the server including a memory and a processor, the memory storing instructions which, when executed by the processor, cause the processor to: receiving a scanned image of an object and an ATR image determination result from the security inspection device, the ATR image determination result being obtained by performing an automatic threat identification ATR image determination on the scanned image by the security inspection device; An operational mode causes the inspection system to perform manual inspection tasks on the object and image assessment tasks on the scanned image, and the operational mode causes the inspection system to indicate whether a manual inspection station and an image assessment station are configured.
[0007] In one embodiment, the processor is further configured to specify not to perform manual inspection tasks on the object and image assessment tasks on the scanned image when the operating mode indicates that a manual inspection station and an image assessment station are not configured in the inspection system, and to store the scanned image and the ATR image assessment results.
[0008] In one embodiment, the processor further comprises: When the operation mode indicates that a manual inspection station is configured in the inspection system but an image judgment station is not configured, the operation mode determines whether or not there is a manual inspection station available in the inspection system, and when it is determined that there is a manual inspection station available in the inspection system, assigns a manual inspection task for the object, the scanned image, and the ATR image judgment result to one manual inspection station selected from the available manual inspection stations; Transmitting information of the selected manual inspection station to the security inspection device; and receiving a manual inspection result from the manual inspection station, the manual inspection result being generated by performing a manual inspection on the object using the scanned image and the ATR image assessment result in response to receiving a manual inspection task assigned by the manual inspection station.
[0009] In one embodiment, the processor further comprises: When it is determined that there is no available manual inspection station in the inspection system, a request for manual inspection of the own machine is sent to the security inspection device; assigning a manual inspection task for the target to the security inspection device upon receiving a positive acknowledgement message from the security inspection device, the positive acknowledgement message being generated by the security inspection device in response to receiving the local manual inspection request from the server when the security inspection device identifies the security inspection device as currently available; and receiving a manual inspection result from the security inspection device, the manual inspection result being generated by performing a manual inspection on the object using the scanned image and the ATR image assessment result in response to receiving a manual inspection task assigned by the security inspection device.
[0010] In one embodiment, the processor further comprises: assigning an image assessment task for the scanned image, the scanned image and the ATR image assessment result to one of the at least one image assessment station when the operational mode indicates that the inspection system is not configured with a manual inspection station but is configured with an image assessment station; and receiving a second image assessment result from an assigned image assessment station, the second image assessment result being generated by performing image assessment on the scanned image using the ATR image assessment result in response to receiving an image assessment task assigned by the image assessment station.
[0011] In one embodiment, the processor further comprises: the operational mode, when indicating that the inspection system is configured with a manual inspection station and an image assessment station, assigns an image assessment task for the scanned image, the scanned image and the ATR image assessment result to one of the at least one image assessment station; receiving a second image assessment result from an assigned image assessment station, the second image assessment result being generated by performing image assessment on the scanned image with the ATR image assessment result in response to receiving an image assessment task assigned by the image assessment station; determining whether an available manual inspection station exists in the inspection system, and when it is determined that an available manual inspection station exists in the inspection system, assigning a manual inspection task for the object, the scanned image, and the second image judgment result to a manual inspection station selected from the available manual inspection stations; Transmitting information of the selected manual inspection station to the security inspection device; and receiving a manual inspection result from the manual inspection station, the manual inspection result being generated by performing a manual inspection on the object using the scanned image and the second image assessment result in response to receiving a manual inspection task assigned by the manual inspection station.
[0012] In one embodiment, the processor further comprises: When it is determined that there is no available manual inspection station in the inspection system, a request for manual inspection of the own machine is sent to the security inspection device; assigning a manual inspection task for the object and the second image assessment result to the security inspection device upon receiving a positive acknowledgement message from the security inspection device, the positive acknowledgement message being generated when the security inspection device identifies the security inspection device as currently available in response to receiving the local manual inspection request from the server; and receiving a manual inspection result from the security inspection device, the manual inspection result being generated by performing a manual inspection on the object using the scanned image and the second image assessment result in response to receiving a manual inspection task assigned by the security inspection device.
[0013] In one embodiment, performing a manual inspection task on the object and performing an image assessment task on the scanned image are simultaneous.
[0014] In one embodiment, the processor is further configured to identify the available manual inspection stations according to a predefined policy.
[0015] In one embodiment, the predefined policy includes at least one of a user-specified manual inspection station at a manual inspection station associated with the security inspection device, whether the gender of the subject is the same as the gender of an operator of the manual inspection station, whether the manual inspection station is within a predetermined number of channels adjacent to the security inspection device, and whether the operator is idle.
[0016] In an embodiment, the processor is further configured to select an image assessment station from the at least one image assessment station according to a predefined policy.
[0017] In one embodiment, the predefined policy includes at least one of a user-specified image determination station in an image determination station associated with the security inspection device, whether the gender of the subject is the same as the gender of an operator of the image determination station, and whether the image determination station is idle.
[0018] According to a second aspect of the present disclosure, there is provided an inspection system based on a millimeter wave security inspection device, comprising: A server according to the first aspect; a switching system arranged to communicate data; and a security inspection device connected to the server via the switch system and configured to obtain a scanned image by scanning an object, and obtain an ATR image judgment result by performing automatic threat identification ATR image judgment on the scanned image, and upload the scanned image and the ATR image judgment result to the server.
[0019] In one embodiment, the inspection system further includes at least one manual inspection station connected to the security inspection device and the server via the switch system and configured to perform manual inspection on the object; However, the security inspection device further includes: In response to receiving a self-machine manual inspection request from the server, determining whether the security inspection device is currently available; sending a positive acknowledgement message to the server when the security inspection device is currently available, and sending a negative acknowledgement message to the server when the security inspection device is currently not available; The apparatus is arranged to, in response to receiving an assigned manual inspection task, perform a manual inspection on the object using the scanned image and the ATR image assessment result, and transmit the manual inspection result to the server.
[0020] In one embodiment, the inspection system comprises: at least one manual inspection station connected to the security inspection device and the server via the switch system and configured to perform manual inspection on the objects; at least one image assessment station connected to the security inspection device and the server via the switch system and configured to perform image assessment on the scanned image; However, the security inspection device further includes: In response to receiving a self-machine manual inspection request from the server, determining whether the security inspection device is currently available; sending a positive acknowledgement message to the server when the security inspection device is currently available, and sending a negative acknowledgement message to the server when the security inspection device is currently not available; In response to receiving an assigned manual inspection task, a manual inspection is performed on the object using the scanned image and a second image assessment result, and the manual inspection result is transmitted to the server, wherein the second image assessment result is generated by performing image assessment on the scanned image using the ATR image assessment result in response to receiving an assigned image assessment task by the image assessment station.
[0021] According to a third aspect of the present disclosure, there is provided a method for performing an inspection using a server used in an inspection system based on the millimeter wave security inspection device according to the first aspect, comprising: receiving, by the server, a scanned image of an object and an ATR image judgment result from the security inspection device, the ATR image judgment result being obtained by the security inspection device performing an automatic threat identification ATR image judgment on the scanned image; Performing a manual inspection task on the object and an image assessment task on the scanned image through an operational mode, the operational mode including indicating whether a manual inspection station and an image assessment station are configured in the inspection system.
[0022] In one embodiment, performing a manual inspection task on the object and an image assessment task on the scanned image by the server in an operational mode includes: The operating mode includes being identified by the server not to perform manual inspection tasks on the object and image judgment tasks on the scanned image when the inspection system is instructed that a manual inspection station and an image judgment station are not configured, and storing the scanned image and the ATR image judgment results.
[0023] In one embodiment, performing a manual inspection task on the object and an image assessment task on the scanned image by the server in an operational mode includes: when the operation mode indicates that a manual inspection station is arranged in the inspection system but an image judgment station is not arranged, the server determines whether or not there is a manual inspection station available in the inspection system, and when it is determined that there is a manual inspection station available in the inspection system, assigns the manual inspection task for the object, the scanned image, and the ATR image judgment result to one manual inspection station selected from the available manual inspection stations; transmitting information of the selected manual inspection station to the security inspection device; receiving a manual inspection result from the manual inspection station, the manual inspection result being generated by performing a manual inspection on the object using the scanned image and the ATR image assessment result in response to receiving a manual inspection task assigned by the manual inspection station.
[0024] In one embodiment, performing a manual inspection task on the object and an image assessment task on the scanned image by the server in an operational mode includes: When the server determines that there is no available manual inspection station in the inspection system, the server transmits a manual inspection request to the security inspection device; the server assigns a manual inspection task for the target to the security inspection device upon receiving a positive acknowledgement message from the security inspection device, the positive acknowledgement message being generated by the security inspection device in response to receiving the local manual inspection request from the server when the security inspection device identifies the security inspection device as currently available; Receiving a manual inspection result from the security inspection device, the manual inspection result being generated by performing a manual inspection on the object using the scanned image and the ATR image assessment result in response to receiving a manual inspection task assigned by the security inspection device.
[0025] In one embodiment, performing a manual inspection task on the object and an image assessment task on the scanned image by the server in an operational mode includes: assigning an image assessment task for the scanned image, the scanned image, and the ATR image assessment result to one of the at least one image assessment station when the operational mode indicates that the inspection system is not configured with a manual inspection station but is configured with an image assessment station; and receiving a second image assessment result from an assigned image assessment station, the second image assessment result being generated by performing image assessment on the scanned image using the ATR image assessment result in response to receiving an image assessment task assigned by the image assessment station.
[0026] In one embodiment, performing a manual inspection task on the object and an image assessment task on the scanned image by the server in an operational mode includes: assigning an image assessment task for the scanned image, the scanned image, and the ATR image assessment result to one of the at least one image assessment station when the operational mode indicates that the inspection system is configured with a manual inspection station and an image assessment station; receiving a second image determination result from an assigned image determination station, identifying whether an available manual inspection station exists in the inspection system, and when it is identified that an available manual inspection station exists in the inspection system, assigning a manual inspection task for the object, the scanned image, and the second image determination result to one manual inspection station selected from the available manual inspection stations, wherein the second image determination result is generated by performing image determination on the scanned image using the ATR image determination result in response to receiving the assigned image determination task by the image determination station; transmitting information of the selected manual inspection station to the security inspection device; receiving a manual inspection result from the manual inspection station, the manual inspection result having been generated by performing a manual inspection on the object using the scanned image and the second image assessment result in response to receiving a manual inspection task assigned by the manual inspection station.
[0027] In one embodiment, performing a manual inspection task on the object and an image assessment task on the scanned image by the server in an operational mode includes: sending a request for manual inspection of the security inspection device when it is determined that there is no available manual inspection station in the inspection system; assigning a manual inspection task for the object and the second image assessment result to the security inspection device when a positive confirmation response message is received from the security inspection device, the positive confirmation response message being generated when the security inspection device is identified as currently available in response to receiving the local manual inspection request from the server; and receiving a manual inspection result from the security inspection device, the manual inspection result being generated by performing a manual inspection on the object using the scanned image and the second image assessment result in response to receiving a manual inspection task assigned by the security inspection device.
[0028] In one embodiment, performing a manual inspection task on the object and performing an image assessment task on the scanned image are simultaneous.
[0029] In one embodiment, the available manual inspection stations are specified by a predefined policy.
[0030] In one embodiment, the predefined policy includes at least one of a user-specified manual inspection station at a manual inspection station associated with the security inspection device, whether the gender of the subject is the same as the gender of an operator of the manual inspection station, whether the manual inspection station is within a predetermined number of channels adjacent to the security inspection device, and whether the operator is idle.
[0031] In one embodiment, allocating an image assessment task for the scanned image, the scanned image and the ATR image assessment result to one of the at least one image assessment station comprises: Selecting an image assessment station from the at least one image assessment station according to a predefined policy.
[0032] In one embodiment, the predefined policy includes at least one of a user-specified image determination station in an image determination station associated with the security inspection device, whether the gender of the subject is the same as the gender of an operator of the image determination station, and whether the image determination station is idle.
[0033] The above and other objects, features, and advantages of the present disclosure will become more apparent from the following description of embodiments of the present disclosure with reference to the drawings. [Brief description of the drawings]
[0034] [Figure 1] FIG. 1 shows a schematic diagram of an inspection system based on a millimeter wave security inspection device according to the prior art. [Diagram 2] FIG. 2 shows a schematic diagram of an inspection system based on another millimeter wave security inspection device according to the prior art. [Diagram 3] FIG. 3 shows a schematic diagram of an inspection system based on a millimeter wave security inspection device according to an embodiment of the present disclosure. [Figure 4] FIG. 4 illustrates a block diagram of an inspection system based on a millimeter wave security inspection device according to an embodiment of the present disclosure. [Diagram 5] FIG. 5 illustrates a flow chart of a method for performing inspection using an inspection system based on a millimeter wave security inspection device according to an embodiment of the present disclosure. [Figure 6] FIG. 6 shows a flowchart of a method for performing inspection using an inspection system based on a millimeter wave security inspection device according to a first embodiment of the present disclosure. [Figure 7] FIG. 7 shows a flowchart of a method for performing inspection using an inspection system based on a millimeter wave security inspection device according to a second embodiment of the present disclosure. [Figure 8]FIG. 8 shows a flowchart of a method for performing inspection using an inspection system based on a millimeter wave security inspection device according to a third embodiment of the present disclosure. [Figure 9] FIG. 9 shows a flowchart of a method for performing inspection using an inspection system based on a millimeter wave security inspection device according to a fourth embodiment of the present disclosure. [Figure 10] FIG. 10 illustrates a schematic diagram of a computer system according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0035] The drawings do not show every circuit or structure of an embodiment, and the same reference numbers represent the same or similar components or features throughout all drawings.
[0036] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. However, it should be understood that these descriptions are merely illustrative and do not limit the scope of the present disclosure. In the following description, descriptions of known structures and techniques will be omitted so as not to unnecessarily confuse the concept of the present disclosure.
[0037] The terms used herein are merely for the purpose of describing specific embodiments and are not intended to limit the present disclosure. The terms "a", "one", "the", and the like used herein should also include the meaning of "plurality" and "multiple kinds" unless the context clearly indicates otherwise. Additionally, the terms "comprise", "include", and the like used herein refer to the presence of a feature, step, operation, and / or component, but do not exclude the presence or addition of one or more other features, steps, operations, or components.
[0038] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art unless otherwise defined. However, the terms used herein should not be interpreted in an ideal or stereotypical manner, but should be interpreted as meanings consistent with the context of this specification.
[0039] At present, the operation mode of the millimeter wave security inspection system also generally adopts a similar mode to "metal door + manual inspection" (as shown in Figures 1 and 2), where the passenger completes the scan with the millimeter wave security inspection device, the security inspection device uses the automatic identification algorithm to detect dangerous objects, and then displays them directly on the screen of the security inspection device in the form of a scanned original map or character map (based on privacy considerations), and the passenger then comes to the stationary security inspector's position for manual inspection. If there is a need for privacy but still needs to see the original map, a stationary computer is placed in an environment isolated from the security inspection site and remotely connected to the device side to display the scanned image.
[0040] FIG. 3 shows a schematic diagram of an inspection system based on a millimeter wave security inspection device according to an embodiment of the present disclosure. The inspection system includes a background server system 310, a security inspection channel 320, a remote image judgment room 330, and a switch system 340. The background service system 310 includes at least one server, for example, servers 3101, 3102, and 3103. The security inspection channel 320 includes at least one security inspection device (for example, security inspection devices 320a and 320b) and at least one manual inspection station (for example, manual inspection stations 3201, 3202, 3203, and 3204). The remote image judgment room 330 includes at least one image judgment station, for example, image judgment stations 3301, 3302, and 3303. The switch system 340 includes a master switch (for example, master switch 3401) and a plurality of slave switches (for example, slave switches 3402, 3403, 3404, and 3405). The security inspection devices 320a and 320b, the manual inspection stations 3201, 3202, 3203 and 3204 and the image judgment stations 3301, 3302 and 3303 are connected to the background service system 310 through the switch system 340. It should be noted that the number of servers, security inspection devices, image judgment stations and switches is not limited to the number shown in the figure, and can be set by those skilled in the art according to actual needs. It should also be noted that the manual inspection station and the image judgment station do not need to exist in the inspection system, that is, the security inspection channel 320 may only include the security inspection device, and the remote image judgment room 330 does not need to exist.
[0041] Hereinafter, the inspection system will be described with reference to FIG. 4, taking one server and one security inspection device as an example. FIG. 4 shows a block diagram of an inspection system 400 based on a millimeter wave security inspection device according to an embodiment of the present disclosure. The inspection system 400 includes a security inspection device 410, a server 420, and a switch system 430. The security inspection device 410 obtains a scanned image by scanning an object (e.g., a person, an object, etc.), and obtains an ATR image judgment result by performing an automatic threat recognition (ATR) image judgment on the scanned image, and is arranged to upload the scanned image and the ATR image judgment result to the server 420. The server 420 is connected to the security inspection device 410 through the switch system 430, and is arranged to receive the scanned image and the ATR image judgment result from the security inspection device 410, and to perform a manual inspection task on the object and an image judgment task on the scanned image according to an operation mode, where the operation mode is arranged to instruct the inspection system 400 whether a manual inspection station and an image judgment station are arranged. The execution of the manual inspection task on the object and the execution of the image judgment task on the scanned image are performed simultaneously. The operation modes are classified into four types of operation modes, namely, a first operation mode in which neither a manual inspection station nor an image judgment station is arranged in the inspection system 400, a second operation mode in which the inspection system 400 is arranged with a manual inspection station but not with an image judgment station, a third operation mode in which the inspection system 400 is arranged with no manual inspection station but with an image judgment station, and a fourth operation mode in which the inspection system 400 is arranged with a manual inspection station and an image judgment station. Hereinafter, the operation of the server and the security inspection device will be described for each of the four different operation modes.
[0042] In one embodiment, the server 420 is further configured to specify not to perform manual inspection tasks on the object and image assessment tasks on the scanned image when the operational mode indicates that the manual inspection station and the image assessment station are not configured for the inspection system 400, i.e., when the inspection system 400 is in the first operational mode, and to store the scanned image and the ATR image assessment result, which may indicate the presence of a suspect in the scanned image or may indicate the absence of a suspect in the scanned image.
[0043] In one embodiment, the inspection system 400 further includes at least one manual inspection station 440 connected to the security inspection device 410 and the server 420 via the switch system 430, and the server 420 is further configured to: determine whether or not there is an available manual inspection station in the inspection system 400 when the operation mode indicates that a manual inspection station is configured but an image determination station is not configured in the inspection system 400, i.e., when the inspection system 400 is in a second operation mode, assign a manual inspection task, the scanned image, and the ATR image determination result for the object to one manual inspection station selected from the available manual inspection stations, send information of the selected manual inspection station to the security inspection device 410, and receive the manual inspection result from the manual inspection station 440, where the manual inspection result is generated by performing a manual inspection on the object using the scanned image and the ATR image determination result in response to receiving the assigned manual inspection task by the manual inspection station 440. The manual inspection result may instruct the subject to carry the suspected item, or may instruct the subject not to carry the suspected item. It should be noted that when the security inspection device 410 receives the information of the assigned manual inspection station, the operator of the security inspection device 410 can guide the subject to go to the assigned manual inspection station to wait for the manual inspection.
[0044] When the inspection system 400 is in the second operation mode, the server 420 is further configured to identify an available manual inspection station according to a predefined policy. The predefined policy includes at least one of: a manual inspection station designated by a user in a manual inspection station associated with the security inspection device 410; whether the gender of the subject is the same as the gender of the operator of the manual inspection station; whether the manual inspection station is within a predetermined number (e.g., one or two) of channels adjacent to the security inspection device; and whether the operator is idle. For example, an available manual inspection station must satisfy at least one of the following conditions: the manual inspection station is one of manual inspection stations #1, #2, #3 designated by a user in manual inspection stations #1-#10 associated with the security inspection device 410; the gender of the subject is the same as the gender of the operator of the manual inspection station; the manual inspection station is within a predetermined number (e.g., one or two) of channels adjacent to the security inspection device; and the operator is idle. It should be noted that there may be manual inspection stations that match more than one predefined policy, in which case one manual inspection station may be selected randomly, or the manual inspection station closest to the security inspection device 410 may be selected.It should be noted that there may be no manual inspection station that matches the predefined policy, i.e., there is no currently available manual inspection station, and in this case, the manual inspection station may be cyclically searched for until a manual inspection station that matches the predefined policy is found, or a manual inspection may be performed using the security inspection device 410. In such a case, when the inspection system 400 is in the second operation mode, the server 420 may further transmit a manual inspection request to the security inspection device 410 when it is determined that no manual inspection station is available in the inspection system 400, and when a positive confirmation response message is received from the security inspection device 410, the server 420 may perform a manual inspection. assigning a manual inspection task for the object to the security inspection device 410, where the positive acknowledgement message is generated by the security inspection device 410 in response to receiving a manual inspection request for itself from the server 420 when the security inspection device 410 is identified as currently available (e.g., an operator of the security inspection device allows the security inspection device to be used); and receiving manual inspection results from the security inspection device 410, where the manual inspection results are generated by performing a manual inspection on the object using the scanned image and the ATR image judgment results in response to receiving the assigned manual inspection task by the security inspection device 410. The security inspection device 410 is further configured to receive a manual inspection request from the server 420, determine whether the security inspection device 410 is currently available, and when the security inspection device 410 is currently available, send a positive acknowledgement message to the server 420, and when the security inspection device 410 is not currently available, send a negative acknowledgement message to the server 420, and in response to receiving an assigned manual inspection task, perform a manual inspection on the object based on the scanned image and the ATR image judgment result, and send the manual inspection result to the server 420.
[0045] In one embodiment, the inspection system 400 further includes at least one image determination station 450 connected to the security inspection device 410 and the server 420 via the switch system 430, and the server 420 is further configured to assign an image determination task for the scanned image, the scanned image and the ATR image determination result to one of the at least one image determination stations 450 when the operation mode indicates that the inspection system 400 is not configured with a manual inspection station but is configured with an image determination station, i.e., when the inspection system 400 is in a third operation mode, and to receive a second image determination result from the assigned image determination station, the second image determination result being generated by performing an image determination on the scanned image with the ATR image determination result in response to receiving the assigned image determination task by the image determination station 450. The image determination station 450 is configured to obtain a second image determination result by performing an image determination on the scanned image with the ATR image determination result in response to receiving the assigned image determination task, and to transmit the second image determination result to the server 420.
[0046] In one embodiment, the inspection system 400 further includes at least one manual inspection station 440 and at least one image assessment station 450 connected to the security inspection device 410 and the server 420 via the switch system 430, and the server 420 further configures, when the operation mode indicates that the manual inspection station is disposed and the image assessment station is disposed in the inspection system 400, i.e., when the inspection system 400 is in a fourth operation mode, to assign an image assessment task for the scanned image, the scanned image and the ATR image assessment result to one of the at least one image assessment stations 450, and receive a second image assessment result from the assigned image assessment station, the second image assessment result being in response to receiving the assigned image assessment task by the image assessment station 450. and determining whether there is an available manual inspection station in the inspection system 400, and when it is determined that there is an available manual inspection station in the inspection system 400, assigning a manual inspection task for the object, the scanned image, and the second image determination result to a selected one of the available manual inspection stations 440, transmitting information of the selected manual inspection station 440 to the security inspection device 410, and receiving the manual inspection result from the manual inspection station 440, wherein the manual inspection result is generated by performing a manual inspection on the object using the scanned image and the second image determination result in response to receiving the manual inspection task assigned by the manual inspection station 440. The image judgment station 450 is arranged to, in response to receiving an assigned image judgment task, obtain a second image judgment result by performing image judgment on the scanned image using the ATR image judgment result, and transmit the second image judgment result to the server 420, and the manual inspection station 440 is arranged to, in response to receiving an assigned manual inspection task, perform manual inspection on the object using the scanned image and the second image judgment result, and transmit the manual inspection result to the server 420.It should be noted that when the security inspection device 410 receives the information of the assigned manual inspection station, the operator of the security inspection device 410 can guide the subject to go to the assigned manual inspection station to wait for manual inspection.
[0047] When the inspection system 400 is in the fourth operation mode, the server 420 is further configured to identify the available manual inspection station according to a predefined policy. The predefined policy includes at least one of: a manual inspection station designated by a user in a manual inspection station associated with the security inspection device 410; whether the gender of the subject is the same as the gender of the operator of the manual inspection station; whether the manual inspection station is within a predetermined number (e.g., one or two) of channels adjacent to the security inspection device; and whether the operator is idle. For example, the available manual inspection station must satisfy at least one of the following conditions: the manual inspection station is one of manual inspection stations #1, #2, #3 designated by a user in manual inspection stations #1 to #10 associated with the security inspection device 410; the gender of the subject is the same as the gender of the operator of the manual inspection station; the manual inspection station is within a predetermined number (e.g., one or two) of channels adjacent to the security inspection device; and the operator is idle. It should be noted that there may be manual inspection stations that match more than one predefined policy, in which case one manual inspection station may be selected randomly, or the manual inspection station closest to the security inspection device may be selected.It should be noted that there may be no manual inspection station that matches the predefined policy, i.e., no manual inspection station is currently available, and in this case, a manual inspection station may be cyclically searched for until a manual inspection station that matches the predefined policy is available, or a manual inspection may be performed using the security inspection device 410. In such a case, when the inspection system 400 is in the fourth operation mode, the server 420 may further send a manual inspection request to the security inspection device 410 when it is determined that no manual inspection station is available in the inspection system 400, and may receive a positive confirmation response from the security inspection device 410. When the positive confirmation response message is received, a manual inspection task and a second image assessment result for the object are assigned to the security inspection device 410, where the positive confirmation response message is generated by the security inspection device 410 in response to receiving a manual inspection request for its own device from the server 420 when the security inspection device 410 is identified as currently available, and receiving a manual inspection result from the security inspection device 410, where the manual inspection result is generated by performing a manual inspection on the object using the scanned image and the second image assessment result in response to receiving the assigned manual inspection task by the security inspection device 410. The security inspection device 410 is further configured to receive a manual inspection request from the server 420, determine whether the security inspection device 410 is currently available, and send a positive acknowledgement message to the server 420 when the security inspection device 410 is currently available (e.g., an operator of the security inspection device allows the security inspection device to be used), and send a negative acknowledgement message to the server 420 when the security inspection device 410 is not currently available, and in response to receiving an assigned manual inspection task, perform a manual inspection on the object using the scanned image and the second image assessment result, and send the manual inspection result to the server 420.
[0048] When the inspection system 400 is in the third or fourth operation mode, the server 420 is further configured to select one image determination station from the at least one image determination station 450 according to a predefined policy. The predefined policy includes at least one of the following: an image determination station designated by a user in the image determination station 450 associated with the security inspection device 410, whether the gender of the target is the same as the gender of the operator of the image determination station, and whether the image determination station 450 is idle. For example, the selected image determination station must satisfy at least one of the following conditions: the image determination station is one of the image determination stations #1, #2, #3 designated by a user in the image determination stations #1 to #10 associated with the security inspection device 410, the gender of the target is the same as the gender of the operator of the image determination station, and the image determination station is idle. It should be noted that there may be an image determination station that matches one or more predefined policies, and in such a case, one image determination station may be selected randomly. It should be noted that there may be no image determination station that matches the predefined policy, i.e., there is no image determination station currently available, and in this case, the image determination station may be searched for cyclically for a predetermined time until the predetermined time expires. If no image determination station that matches the criteria is found after the predetermined time expires, the search is not continued, but an image determination result is provided directly, which may be an ATR image determination result provided by the security inspection device 410, or an image determination result indicating the presence of a suspect in the scanned image. It should be noted that the image determination station may be timed when performing the image determination, and when the image determination expires, an image determination result is provided directly, which may be an ATR image determination result provided by the security inspection device 410, or an image determination result indicating the presence of a suspect in the scanned image.
[0049] Using the embodiments of the present disclosure, all security inspection devices, manual inspection stations and image judgment stations are connected to a background service system, which stores business data such as scanned images, image judgment results and manual inspection results, and can distribute and unify search queries on these business data. After the scanning of the object is completed, the background service system can automatically allocate the manual inspection stations and image judgment stations according to the set allocation policy, realize multiplexing of the manual inspection stations and remote image judgment stations, and dynamically adjust the number of manual inspection stations and remote image judgment stations when the flow rate of the object changes.
[0050] 5 shows a flow chart of a method 500 for performing an inspection using the millimeter wave security inspection device based inspection system 400 according to an embodiment of the present disclosure. The method 500 includes the following steps.
[0051] In step S510, a scanned image is obtained by scanning an object using the security inspection device 410, and an ATR image judgment result is obtained by performing an automatic threat recognition (ATR) image judgment on the scanned image, and the scanned image and the ATR image judgment result are uploaded to the server 420.
[0052] In step S520, the server 420 receives the scanned image and the ATR image judgment result from the security inspection device 410, and executes a manual inspection task for the object and an image judgment task for the scanned image according to an operation mode, which indicates whether a manual inspection station and an image judgment station are arranged in the inspection system 400. The operation mode is classified into four types of operation modes, namely, a first operation mode in which the inspection system 400 is not arranged with a manual inspection station and an image judgment station, a second operation mode in which the inspection system 400 is arranged with a manual inspection station but not with an image judgment station, a third operation mode in which the inspection system 400 is arranged with no manual inspection station but with an image judgment station, and a fourth operation mode in which the inspection system 400 is arranged with a manual inspection station and an image judgment station.
[0053] Using the embodiments of the present disclosure, after scanning of the object is completed, the background service system can automatically allocate manual inspection stations and image judgment stations according to a set allocation policy, realize multiplexing of manual inspection stations and remote image judgment stations, and dynamically adjust the number of manual inspection stations and remote image judgment stations when the flow rate of the object changes.
[0054] Hereinafter, the operation of the inspection method will be described in four different operation modes with reference to FIGS.
[0055] FIG. 6 shows a flow chart of a method for performing inspection using the inspection system 400 based on the millimeter wave security inspection device according to the first embodiment of the present disclosure.
[0056] In step S610, the security inspection device 410 scans the object to obtain a scanned image, and performs an automatic threat recognition (ATR) image judgment on the scanned image to obtain an ATR image judgment result. In step S620, the security inspection device 410 uploads the scanned image and the ATR image judgment result to the server 420. In step S630, the server 420 identifies an operation mode, and when the operation mode indicates that the manual inspection station and the image judgment station are not arranged in the inspection system 400, that is, when the inspection system 400 is in the first operation mode, the server 420 identifies that the manual inspection task on the object and the image judgment task on the scanned image are not performed, and stores the scanned image and the ATR image judgment result.
[0057] FIG. 7 shows a flow chart of a method for performing inspection using the inspection system 400 based on the millimeter wave security inspection device according to the second embodiment of the present disclosure.
[0058] In step S710, the security inspection device 410 scans an object to obtain a scanned image, and performs an automatic threat recognition (ATR) image judgment on the scanned image to obtain an ATR image judgment result. In step S720, the security inspection device 410 uploads the scanned image and the ATR image judgment result to the server 420. In step S730, the server 420 identifies an operation mode. When the operation mode indicates that a manual inspection station is arranged but an image judgment station is not arranged in the inspection system 400, that is, when the inspection system 400 is in the second operation mode, in step S740, the server 420 identifies whether or not there is a manual inspection station 440 available in the inspection system 400. When it is determined in step S740 that there is an available manual inspection station in the inspection system 400, in step S750, the server 420 transmits the manual inspection task, the scanned image, and the ATR image judgment result for the object to one manual inspection station 440 selected from the available manual inspection stations, and in step S760, the server 420 transmits information of the manual inspection station selected to the security inspection device 410. In step S770, in response to receiving the assigned manual inspection task by the manual inspection station 440, a manual inspection is performed on the object using the scanned image and the ATR image judgment result. In step S780, the manual inspection station 440 transmits the manual inspection result to the server 420. When it is determined in step S740 that there is no available manual inspection station in the inspection system 400, in step S790, the server 420 transmits a request for its own manual inspection to the security inspection device 410. After receiving the request for its own manual inspection from the server 420, in step S7100, the security inspection device 410 determines whether the security inspection device 410 is currently available.When it is determined in step S7100 that the security inspection device 410 is currently available, in step S7110, the security inspection device 410 sends a positive acknowledgement message to the server 420. In step S7120, the server 420 assigns a manual inspection task for the object to the security inspection device 410. In step S7130, in response to receiving the assigned manual inspection task, the security inspection device 410 performs a manual inspection on the object using the scanned image and the ATR image judgment result. In step S7140, the security inspection device 410 sends the manual inspection result to the server 420. When it is determined in step S7100 that the security inspection device 410 is not currently available, in step S7150, the security inspection device 410 sends a negative acknowledgement message to the server 420.
[0059] FIG. 8 shows a flow chart of a method for performing inspection using the inspection system 400 based on the millimeter wave security inspection device according to the third embodiment of the present disclosure.
[0060] In step S810, the security inspection device 410 scans an object to obtain a scanned image, and performs an automatic threat recognition (ATR) image judgment on the scanned image to obtain an ATR image judgment result. In step S820, the security inspection device 410 uploads the scanned image and the ATR image judgment result to the server 420. In step S830, the server 420 identifies an operation mode. When the operation mode indicates that the inspection system 400 does not have a manual inspection station but has an image judgment station, that is, when the inspection system 400 is in a third operation mode, in step S840, the server 420 assigns an image judgment task for the scanned image, the scanned image, and the ATR image judgment result to one of the at least one image judgment stations 450. In step S850, in response to receiving the assigned image judgment task by the assigned image judgment station 450, an image judgment is performed on the scanned image using the ATR image judgment result to obtain a second image judgment result. In step S860, the second image assessment result is transmitted by the assigned image assessment station 450 to the server 420.
[0061] FIG. 9 shows a flow chart of a method for performing inspection using an inspection system 400 based on a millimeter wave security inspection device according to a fourth embodiment of the present disclosure.
[0062] In step S910, the security inspection device 410 scans an object to obtain a scanned image, and performs an automatic threat recognition (ATR) image judgment on the scanned image to obtain an ATR image judgment result. In step S920, the security inspection device 410 uploads the scanned image and the ATR image judgment result to the server 420. In step S930, the server 420 identifies an operation mode. When the operation mode indicates that the manual inspection station and the image judgment station are arranged in the inspection system 400, that is, when the inspection system 400 is in the fourth operation mode, in step S940, the server 420 assigns an image judgment task for the scanned image, the scanned image, and the ATR image judgment result to one of the at least one image judgment stations 450. In step S950, in response to receiving the image judgment task assigned by the assigned image judgment station 450, an image judgment is performed on the scanned image using the ATR image judgment result to obtain a second image judgment result. In step S960, the second image judgment result is sent by the assigned image judgment station 450 to the server 420. In step S970, the server 420 determines whether there is an available manual inspection station 440 in the inspection system 400. When it is determined in step S970 that there is an available manual inspection station in the inspection system 400, in step S980, the server 420 sends the manual inspection task for the object, the scanned image, and the second image judgment result to one manual inspection station 440 selected from the available manual inspection stations, and in step S990, the server 420 sends information of the manual inspection station selected to the security inspection device 410. In step S9100, in response to receiving the assigned manual inspection task by the manual inspection station 440, a manual inspection is performed on the object according to the scanned image and the second image judgment result. In step S9110, the manual inspection station 440 sends the manual inspection result to the server 420.When it is determined in step S970 that there is no available manual inspection station in the inspection system 400, in step S9120, the server 420 transmits a request for its own manual inspection to the security inspection device 410. After receiving the request for its own manual inspection from the server 420, in step S9130, the security inspection device 410 determines whether the security inspection device 410 is currently available. When it is determined in step S9130 that the security inspection device 410 is currently available, in step S9140, the security inspection device 410 transmits a positive acknowledgement message to the server 420. In step S9150, the server 420 assigns a manual inspection task for the object and a second image judgment result to the security inspection device 410. In step S9160, in response to receiving the assigned manual inspection task, the security inspection device 410 performs a manual inspection on the object using the scanned image and the second image judgment result. In step S9170, the security inspection device 410 transmits the manual inspection result to the server 420. When it is determined in step S9130 that the security inspection device 410 is not currently available, a negative acknowledgement message is sent by the security inspection device 410 to the server 420 in step S9180.
[0063] It should be noted that in the embodiment of the present disclosure, the information transmission between the security inspection device, the server, the manual inspection station and the image judgment station is all performed through a switch system, but the present disclosure is not limited thereto, and the information transmission may be realized through other transmission mechanisms.
[0064] Using the embodiments of the present disclosure, all security inspection devices, manual inspection stations, and image determination stations are connected to a background service system, which stores business data such as scanned images, image determination results, and manual inspection results, and can distribute and unify search queries for these business data. After the scanning of the object is completed, the background service system can automatically allocate the manual inspection stations and image determination stations according to the set allocation policy, realize multiplexing of the manual inspection stations and remote image determination stations, and dynamically adjust the number of manual inspection stations and remote image determination stations when the flow rate of the object changes.
[0065] 10 shows a schematic diagram of a computer system according to an embodiment of the present disclosure. The system 1000 includes a processor 1010, such as a digital signal processor (DSP). The processor 1010 may be a single device or multiple devices for performing different operations of the processes described herein. The system 1000 includes an input / output (I / O) device 1030 for receiving signals from and sending signals to other entities.
[0066] The system 1000 also includes memory 1020, which may take the form of non-volatile or volatile memory, such as Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory, etc. The memory 1020 stores computer-readable instructions that, when executed by the processor 1010, cause the processor to perform the operations described herein.
[0067] The drawings show several block diagrams and / or flow charts. It should be understood that some of the blocks in the block diagrams and / or flow charts, or combinations thereof, can be implemented by computer program instructions that can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the instructions, when executed by the processor, create an apparatus that implements the functions / operations described in the block diagrams and / or flow charts.
[0068] Thus, the disclosed technology may be realized in the form of hardware and / or software (including firmware, microcode, etc.). The disclosed technology may also take the form of a computer program product on a computer-readable medium having instructions stored thereon, which may be available for use by or in combination with an instruction execution system (e.g., one or more processors). In the context of the present disclosure, a computer-readable medium may be any medium capable of storing, transferring, propagating, or transmitting instructions. For example, a computer-readable medium may include, but is not limited to, an electric, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. Specific examples of computer-readable media include magnetic storage devices, such as magnetic tape or hard disk drives (HDDs); optical storage devices, such as optical disks (CD-ROMs); memory devices, such as random access memory (RAM) or flash memory; and / or wired / wireless communication links.
[0069] The above detailed description uses diagrams, flow charts, and / or examples to describe many embodiments of inspection methods and systems based on millimeter wave security inspection devices, servers, and computer systems. When such diagrams, flow charts, and / or examples include one or more functions and / or operations, it should be understood by those skilled in the art that each function and / or operation in such diagrams, flow charts, or examples can be realized alone and / or jointly by various structures, hardware, software, firmware, or substantially any combination thereof. In one embodiment, some parts of the subject matter of the embodiments of the present disclosure can be realized in an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), or other integrated format. However, those skilled in the art should recognize that some aspects of the embodiments disclosed herein may be implemented in an integrated circuit, as one or more computer programs running on one or more computers (e.g., one or more programs running on one or more computer systems), as one or more programs running on one or more processors (e.g., one or more programs running on one or more microprocessors), as firmware, or as substantially any combination of the above, and that those skilled in the art, based on the present disclosure, may equally be implemented in whole or in part as having the ability to design circuitry and / or write software and / or firmware code. Additionally, those skilled in the art should recognize that the mechanisms of the subject matter of the present disclosure may be distributed as program products in various forms, and that the exemplary embodiments of the subject matter of the present disclosure apply to all of the exemplary embodiments of the subject matter of the present disclosure, regardless of the specific type of signal bearer medium for actually performing the distribution.Examples of signal bearer media include, but are not limited to, recordable media, such as floppy disks, hard disk drives, compact disks (CDs), digital versatile disks (DVDs), digital video tape, computer memory, and the like; and transmission-type media, such as digital and / or analog communications media (e.g., fiber optic cables, wave guides, wired communications links, wireless communications links, and the like).
Claims
1. 1. An inspection system based on a millimeter wave security inspection device, comprising: a background service system including a server for use in an inspection system based on at least one millimeter wave security inspection device; a switching system arranged to communicate data; a security inspection device connected to the server via the switch system, configured to perform scanning on an object to obtain a scanned image, perform automatic target recognition (ATR) image judgment on the scanned image to obtain an ATR image judgment result, and upload the scanned image and the ATR image judgment result to the server; The server is connected to the security inspection device via a switch system, the server includes a memory and a processor, the memory stores instructions, and the instructions, when executed by the processor, cause the processor to: receiving a scanned image of an object and an ATR image judgment result from the security inspection device, the ATR image judgment result being obtained by performing an automatic hazard identification ATR image judgment on the scanned image by the security inspection device; performing a manual inspection task on the object and an image assessment task on the scanned image through an operational mode, the operational mode indicating whether a manual inspection station and an image assessment station are configured on the inspection system; performing a manual inspection task on the object and performing an image assessment task on the scanned image simultaneously; The processor further comprises: When the operation mode indicates that a manual inspection station is arranged in the inspection system but an image judgment station is not arranged, the operation mode determines whether or not there is a manual inspection station available in the inspection system, and when it is determined that there is a manual inspection station available in the inspection system, assigns a manual inspection task for the object, the scanned image, and the ATR image judgment result to one manual inspection station selected from the available manual inspection stations; Transmitting information of the selected manual inspection station to the security inspection device; receiving a manual inspection result from the manual inspection station, the manual inspection result being generated by performing a manual inspection on the object using the scanned image and the ATR image determination result in response to receiving a manual inspection task assigned by the manual inspection station; All security inspection devices, manual inspection stations and image judgment stations are connected to the background service system, and the background service system can store business data of scanned images, image judgment results and manual inspection results, and perform distribution and unified search queries on these business data; After the scanning of the object is completed, the background service system can automatically allocate the manual inspection station and the image judgment station according to the setting allocation policy, realize the multiplexing of the manual inspection station and the remote image judgment station, and dynamically adjust the number of the manual inspection station and the remote image judgment station when the flow rate of the object changes. Inspection system.
2. The processor further comprises: When it is determined that there is no available manual inspection station in the inspection system, a request for manual inspection of the own machine is sent to the security inspection device; assigning a manual inspection task for the target to the security inspection device upon receiving a positive acknowledgement message from the security inspection device, the positive acknowledgement message being generated by the security inspection device in response to receiving the local manual inspection request from the server when the security inspection device identifies the security inspection device as currently available; receiving a manual inspection result from the security inspection device, the manual inspection result being generated by performing a manual inspection on the object using the scanned image and the ATR image determination result in response to receiving a manual inspection task assigned by the security inspection device; The inspection system of claim 1 .
3. 1. An inspection system based on a millimeter wave security inspection device, comprising: a background service system including a server for use in an inspection system based on at least one millimeter wave security inspection device; a switching system arranged to communicate data; a security inspection device connected to the server via the switch system, configured to perform scanning on an object to obtain a scanned image, perform automatic target recognition (ATR) image judgment on the scanned image to obtain an ATR image judgment result, and upload the scanned image and the ATR image judgment result to the server; The server is connected to the security inspection device via a switch system, the server includes a memory and a processor, the memory stores instructions, and the instructions, when executed by the processor, cause the processor to: receiving a scanned image of an object and an ATR image judgment result from the security inspection device, the ATR image judgment result being obtained by performing an automatic hazard identification ATR image judgment on the scanned image by the security inspection device; performing a manual inspection task on the object and an image assessment task on the scanned image through an operational mode, the operational mode indicating whether a manual inspection station and an image assessment station are configured on the inspection system; performing a manual inspection task on the object and performing an image assessment task on the scanned image simultaneously; The processor further comprises: When the operation mode indicates that the inspection system is configured with a manual inspection station and an image assessment station, the operation mode assigns an image assessment task for the scanned image, the scanned image, and the ATR image assessment result to one of the at least one image assessment station; receiving a second image assessment result from an assigned image assessment station, the second image assessment result being generated by performing image assessment on the scanned image with the ATR image assessment result in response to receiving an image assessment task assigned by the image assessment station; determining whether an available manual inspection station exists in the inspection system, and when it is determined that an available manual inspection station exists in the inspection system, assigning a manual inspection task for the object, the scanned image, and the second image determination result to a manual inspection station selected from the available manual inspection stations; Transmitting information of the selected manual inspection station to the security inspection device; receiving a manual inspection result from the manual inspection station, the manual inspection result being generated by performing a manual inspection on the object with the scanned image and the second image assessment result in response to receiving a manual inspection task assigned by the manual inspection station; All security inspection devices, manual inspection stations and image judgment stations are connected to the background service system, and the background service system can store business data of scanned images, image judgment results and manual inspection results, and perform distribution and unified search queries on these business data; After the scanning of the object is completed, the background service system can automatically allocate the manual inspection station and the image judgment station according to the setting allocation policy, realize the multiplexing of the manual inspection station and the remote image judgment station, and dynamically adjust the number of the manual inspection station and the remote image judgment station when the flow rate of the object changes. Inspection system.
4. The processor further comprises: When it is determined that there is no available manual inspection station in the inspection system, a request for manual inspection of the own machine is sent to the security inspection device; assigning a manual inspection task for the object and the second image assessment result to the security inspection device upon receiving a positive acknowledgement message from the security inspection device, the positive acknowledgement message being generated when the security inspection device identifies the security inspection device as currently available in response to receiving the local manual inspection request from the server; receiving a manual inspection result from the security inspection device, the manual inspection result being generated by performing a manual inspection on the object using the scanned image and the second image assessment result in response to receiving a manual inspection task assigned by the security inspection device; The inspection system of claim 3 .
5. at least one manual inspection station connected to the security inspection device and the server via the switch system and configured to perform manual inspection on the object; However, the security inspection device further includes: In response to receiving a self-machine manual inspection request from the server, determining whether the security inspection device is currently available; sending a positive acknowledgement message to the server when the security inspection device is currently available, and sending a negative acknowledgement message to the server when the security inspection device is currently not available; configured to, in response to receiving an assigned manual inspection task, perform a manual inspection on the object using the scanned image and the ATR image assessment result, and transmit the manual inspection result to the server.
4. The inspection system according to claim 1 or 3.
6. at least one manual inspection station connected to the security inspection device and the server via the switch system and configured to perform manual inspection on the objects; at least one image assessment station connected to the security inspection device and the server via the switch system and configured to perform image assessment on the scanned image; However, the security inspection device further includes: In response to receiving a self-machine manual inspection request from the server, determining whether the security inspection device is currently available; sending a positive acknowledgement message to the server when the security inspection device is currently available, and sending a negative acknowledgement message to the server when the security inspection device is currently not available; in response to receiving an assigned manual inspection task, performing a manual inspection on the object using the scanned image and a second image assessment result, and transmitting the manual inspection result to the server, wherein the second image assessment result is generated by performing image assessment on the scanned image using the ATR image assessment result in response to receiving an assigned image assessment task by the image assessment station.
4. The inspection system according to claim 1 or 3.
7. A method for performing an inspection using a server used in an inspection system based on the millimeter wave security inspection device according to claim 1, comprising: The inspection system includes a background service system and a switch system, the background service system including at least one server; receiving a scanned image of an object and an ATR image judgment result from the security inspection device by the server, the ATR image judgment result being obtained by performing an automatic hazard identification ATR image judgment on the scanned image by the security inspection device; performing a manual inspection task on the object and an image assessment task on the scanned image through an operational mode, the operational mode indicating whether the inspection system is configured with a manual inspection station and an image assessment station; performing a manual inspection task on the object and performing an image assessment task on the scanned image simultaneously; performing, by the server in an operational mode, a manual inspection task on the object and an image assessment task on the scanned image, When the operation mode indicates that a manual inspection station is arranged in the inspection system but an image judgment station is not arranged, the server determines whether or not there is a manual inspection station available in the inspection system, and when it is determined that there is a manual inspection station available in the inspection system, assigns the manual inspection task for the object, the scanned image, and the ATR image judgment result to one manual inspection station selected from the available manual inspection stations. transmitting information of the selected manual inspection station to the security inspection device; receiving a manual inspection result from the manual inspection station, the manual inspection result being generated by performing a manual inspection on the object using the scanned image and the ATR image assessment result in response to receiving a manual inspection task assigned by the manual inspection station; All security inspection devices, manual inspection stations and image judgment stations are connected to the background service system, and the background service system can store business data of scanned images, image judgment results and manual inspection results, and perform distribution and unified search queries on these business data; After the scanning of the object is completed, the background service system can automatically allocate the manual inspection station and the image judgment station according to the setting allocation policy, realize the multiplexing of the manual inspection station and the remote image judgment station, and dynamically adjust the number of the manual inspection station and the remote image judgment station when the flow rate of the object changes. Testing method.
8. performing, by the server in an operational mode, a manual inspection task on the object and an image assessment task on the scanned image, When the server determines that there is no available manual inspection station in the inspection system, the server transmits a manual inspection request to the security inspection device; the server assigns a manual inspection task for the target to the security inspection device upon receiving a positive acknowledgement message from the security inspection device, the positive acknowledgement message being generated by the security inspection device in response to receiving the local manual inspection request from the server when the security inspection device identifies the security inspection device as currently available; receiving a manual inspection result from the security inspection device, the manual inspection result being generated by performing a manual inspection on the object using the scanned image and the ATR image assessment result in response to receiving a manual inspection task assigned by the security inspection device. The inspection method according to claim 7.
9. A method for performing an inspection using a server used in an inspection system based on the millimeter wave security inspection device according to claim 3, comprising: The inspection system includes a background service system and a switch system, the background service system including at least one server; receiving a scanned image of an object and an ATR image judgment result from the security inspection device by the server, the ATR image judgment result being obtained by performing an automatic hazard identification ATR image judgment on the scanned image by the security inspection device; performing a manual inspection task on the object and an image assessment task on the scanned image through an operational mode, the operational mode indicating whether the inspection system is configured with a manual inspection station and an image assessment station; performing a manual inspection task on the object and performing an image assessment task on the scanned image simultaneously; performing, by the server in an operational mode, a manual inspection task on the object and an image assessment task on the scanned image, assigning an image assessment task for the scanned image, the scanned image, and the ATR image assessment result to one of the at least one image assessment stations when the operating mode indicates that the inspection system is configured with a manual inspection station and an image assessment station; receiving a second image determination result from an assigned image determination station, determining whether an available manual inspection station exists in the inspection system, and when it is determined that an available manual inspection station exists in the inspection system, assigning a manual inspection task for the object, the scanned image, and the second image determination result to one manual inspection station selected from the available manual inspection stations, wherein the second image determination result is generated by performing image determination on the scanned image using the ATR image determination result in response to receiving the assigned image determination task by the image determination station; transmitting information of the selected manual inspection station to the security inspection device; receiving a manual inspection result from the manual inspection station, the manual inspection result having been generated by performing a manual inspection on the object using the scanned image and the second image assessment result in response to receiving a manual inspection task assigned by the manual inspection station; All security inspection devices, manual inspection stations and image judgment stations are connected to the background service system, and the background service system can store business data of scanned images, image judgment results and manual inspection results, and perform distribution and unified search queries on these business data; After the scanning of the object is completed, the background service system can automatically allocate the manual inspection station and the image judgment station according to the setting allocation policy, realize the multiplexing of the manual inspection station and the remote image judgment station, and dynamically adjust the number of the manual inspection station and the remote image judgment station when the flow rate of the object changes. Testing method.
10. performing, by the server in an operational mode, a manual inspection task on the object and an image assessment task on the scanned image, sending a request for manual inspection of the security inspection device when it is determined that there is no available manual inspection station in the inspection system; assigning a manual inspection task for the object and the second image assessment result to the security inspection device when a positive confirmation response message is received from the security inspection device, the positive confirmation response message being generated when the security inspection device is identified as currently available in response to receiving the local manual inspection request from the server; and receiving a manual inspection result from the security inspection device, the manual inspection result being generated by performing a manual inspection on the object using the scanned image and the second image assessment result in response to receiving a manual inspection task assigned by the security inspection device. The inspection method according to claim 9.
11. the available manual inspection stations are specified by a predefined policy; The inspection method according to claim 7 or 9.
12. The predefined policy may include: a user-specified manual inspection station at a manual inspection station associated with the security inspection device, at least one of whether the gender of the subject is the same as the gender of an operator of the manual inspection station, whether the manual inspection station is within a predetermined number of channels adjacent to the security inspection device, and whether the operator is idle. The inspection method according to claim 11.
13. Assigning an image assessment task for the scanned image, the scanned image and the ATR image assessment result to one of the at least one image assessment station includes: selecting an image assessment station from the at least one image assessment station according to a predefined policy. The inspection method according to claim 11.
14. The predefined policy may include: at least one of: a user-specified image determination station in an image determination station associated with the security inspection device; whether the gender of the subject is the same as the gender of an operator of the image determination station; and whether the image determination station is idle; The inspection method according to claim 13.
Citation Information
Patent Citations
A system and method for improving controlled physical examinations
JP2010530977A
Method and system for use in performing security screening
US20150186732A1