Security check method and system
By combining the detection results of millimeter-wave security scanners and metal detector gates, and utilizing the magnetic field interference characteristics of metal detector gates to correct the detection results of millimeter-wave security scanners, the blind spots and insufficient accuracy of millimeter-wave security scanners in detecting prohibited metal items are solved, thus improving the accuracy of detection.
Patent Information
- Application Number
- CN202511133715.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-08-13
- Publication Date
- 2025-11-07
- Estimated Expiration
- 2045-08-13
AI Technical Summary
Millimeter-wave security scanners have blind spots and insufficient accuracy when detecting prohibited items made of metal, and they are particularly difficult to identify very small prohibited items or those hidden in the mouth or other enclosed areas.
By combining the detection results of millimeter-wave security scanners and metal detector gates, and utilizing the magnetic field interference characteristics of metal detector gates, the detection results of millimeter-wave security scanners are corrected to determine target category information and improve detection accuracy.
This improves the accuracy of millimeter-wave security scanners in detecting prohibited metal items and enhances the overall accuracy of detecting prohibited items.
Smart Images

Figure CN120908893A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the security inspection technical field, in particular to a security inspection method and system. BACKGROUND
[0002] For public places with dense flow of people and places with high security requirements, in order to ensure public safety, it is usually necessary to conduct security checks on personnel entering these places to check whether they carry prohibited articles, especially prohibited articles of metal material. In related technologies, personnel can be checked for security by a millimeter wave security inspection instrument.
[0003] The millimeter wave security inspection instrument scans the surface of the human body with millimeter waves to generate an image to display the articles hidden under the clothes. Due to factors such as array form and target posture, the millimeter wave security inspection instrument may have detection blind spots and incomplete target display problems, and millimeter waves cannot penetrate the skin. For very small or hidden in the mouth and other package areas of prohibited articles, the millimeter wave security inspection instrument may be difficult to identify, resulting in insufficient accuracy of the millimeter wave security inspection instrument in detecting prohibited articles. SUMMARY
[0004] The purpose of the embodiments of the present application is to provide a security inspection method and system to improve the accuracy of the millimeter wave security inspection instrument in detecting prohibited articles. The specific technical solutions are as follows:
[0005] In a first aspect, the embodiments of the present application provide a security inspection method, which comprises:
[0006] According to the millimeter wave scanning image of the target personnel passing through the millimeter wave security inspection instrument, a first detection result of the target personnel is determined, wherein the first detection result includes first position information of a detected article carried by the target personnel on the millimeter wave scanning image and first category information of the detected article;
[0007] According to the correspondence between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument, and the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door, a target defense zone corresponding to the first position information in the detection area of the metal detection door is determined, wherein the detection area of the metal detection door can be divided into multiple defense zones;
[0008] A second detection result corresponding to the detected article in the target defense zone is obtained, wherein the second detection result includes at least one of the metal strength information corresponding to the detected article in the target defense zone and the second category information of the detected article;
[0009] The first category information of the detected article is corrected using the second detection result to determine the target category information of the detected article;
[0010] determine whether the detected item belongs to prohibited articles according to the target category information.
[0011] Optionally, the step of determining the target defense area corresponding to the first position information in the detection area of the metal detection door according to the correspondence between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument and the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door comprises:
[0012] determining the second position information corresponding to the first position information in the detection area of the millimeter wave security inspection instrument based on the correspondence between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument;
[0013] determining the third position information corresponding to the second position information in the detection area of the metal detection door according to the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door;
[0014] determining the target defense area corresponding to the first position information in the detection area of the metal detection door according to the position of the third position information in the detection area of the metal detection door;
[0015] or
[0016] the step of determining the target defense area corresponding to the first position information in the detection area of the metal detection door according to the correspondence between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument and the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door comprises:
[0017] determining the fourth position information corresponding to a preset position point in the detection area of the metal detection door in the millimeter wave scanning image according to the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door and the correspondence between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument;
[0018] determining an image area matching the detection area of the metal detection door in the millimeter wave scanning image based on the fourth position information;
[0019] determining the target defense area corresponding to the first position information in the detection area of the metal detection door according to the position of the first position information in the image area.
[0020] Optionally, the method further comprises:
[0021] acquiring a human body detection image of the target person passing through the metal detection door collected by an image collection device;
[0022] determine a matching relationship between the human body detection image and the millimeter wave scanning image according to a similarity between a body part feature included in the human body detection image and a body part feature included in the millimeter wave scanning image;
[0023] determine a corresponding relationship between the human body detection image and a detection region of the metal detection door based on a positional relationship between the image acquisition device and the metal detection door;
[0024] determine a positional corresponding relationship between a detection region of the millimeter wave security inspection instrument and a detection region of the metal detection door according to the corresponding relationship between the millimeter wave scanning image and the detection region of the millimeter wave security inspection instrument, the corresponding relationship between the human body detection image and the detection region of the metal detection door, and the matching relationship.
[0025] Optionally, the step of correcting the first category information of the detected article by using the second detection result to determine the target category information of the detected article comprises:
[0026] determining an article material attention coefficient based on the second category information of the detected article in the second detection result;
[0027] correcting the first category information of the detected article by using the article material attention coefficient to determine the target category information of the detected article;
[0028] or
[0029] determining a second adjustment parameter corresponding to the target defense zone to adjust the second detection result, and correcting the first category information of the detected article by using the adjusted second detection result to determine the target category information of the detected article;
[0030] or
[0031] determining a first adjustment parameter corresponding to the first category information of the detected article to adjust the first category information of the detected article, and correcting the adjusted first category information by using the second detection result to determine the target category information of the detected article;
[0032] or
[0033] determining a first adjustment parameter corresponding to the first category information of the detected article, and determining a second adjustment parameter corresponding to the target defense zone;
[0034] adjusting the first category information of the detected article by using the first adjustment parameter, and adjusting the second detection result by using the second adjustment parameter;
[0035] The second detection result is adjusted to correct the first category information, and target category information of the detected object is determined.
[0036] Optionally, the second adjustment parameter includes a sensitivity corresponding to the target defense area, and the step of determining the second adjustment parameter corresponding to the target defense area comprises:
[0037] The sensitivity corresponding to the target defense area is set as a first sensitivity;
[0038] The method further comprises:
[0039] The sensitivity corresponding to the non-target defense area is set as a second sensitivity, wherein the first sensitivity is greater than the second sensitivity.
[0040] Optionally, the first adjustment parameter includes an object material attention coefficient and / or a category adjustment parameter, and the step of determining the first adjustment parameter corresponding to the first category information of the detected object comprises:
[0041] The category adjustment parameter is determined based on second category information of the detected object in the second detection result and / or object category information included in a pre-set millimeter wave white list, wherein the category adjustment parameter represents a degree of attention to object categories in a current security check scene;
[0042] and / or,
[0043] The object material attention coefficient is determined based on second category information of the detected object in the second detection result, wherein the object material attention coefficient represents a degree of attention to metal objects of different materials.
[0044] Optionally, the first adjustment parameter includes an object material attention coefficient and a category adjustment parameter, the second adjustment parameter includes a sensitivity corresponding to the target defense area, the first category information includes a first confidence degree of the detected object belonging to an object category, and the second detection result includes a metal strength value corresponding to the detected object in the target defense area.
[0045] The step of determining the first adjustment parameter corresponding to the first category information of the detected object, determining the second adjustment parameter corresponding to the target defense area, adjusting the first category information of the detected object by using the first adjustment parameter, adjusting the second detection result by using the second adjustment parameter, and correcting the adjusted first category information by using the adjusted second detection result to determine target category information of the detected object comprises:
[0046] The comprehensive confidence degree P of the detected object belonging to the object category is calculated according to the following formulafin (c), as the target category information of the detected article:
[0047] P tin (c) = M0 x a(c) x P mmw (c) + b(m) x A metal (m);
[0048] Wherein, c is the number of the article category, a(c) is the category adjustment parameter corresponding to the article category c, P mmw (c) is the first confidence degree that the detected article belongs to the article category c, M0 is the article material attention coefficient corresponding to the detected article, m is the number of the target defense zone corresponding to the detection position of the detected article, b(m) is the sensitivity corresponding to the target defense zone m, A metal (m) is the metal strength value corresponding to the target defense zone m.
[0049] Optionally, the step of acquiring the second detection result corresponding to the detected article in the target defense zone comprises:
[0050] In a case where the first detection result represents that the category of the detected article is a suspicious category, or in a case where the security level requirement of the current security check scene is a target level and the first detection result represents that the category of the detected article is a safe category, the second detection result corresponding to the detected article in the target defense zone is acquired.
[0051] In a second aspect, an embodiment of the present application provides a security check system, the system comprising: a millimeter wave security check instrument, a metal detection door, and a processing device, wherein: the millimeter wave security check instrument and the metal detection door are respectively used for detecting a target person, the millimeter wave security check instrument and the metal detection door are integrated into one physical device, or the millimeter wave security check instrument and the metal detection door are two independent physical devices.
[0052] The processing device is configured to execute the method of any one of the first aspect.
[0053] Optionally, the millimeter wave security check instrument and the metal detection door are integrated into one physical device.
[0054] The processing device is further configured to, in a case where the first detection result meets a preset acquisition condition, control the metal detection door to start working, so as to acquire the second detection result corresponding to the detected article in the target defense zone; or,
[0055] The processing device is further configured to control the metal detection door to continuously work, and in a case where the first detection result meets a preset acquisition condition, acquire the second detection result corresponding to the detected article in the target defense zone.
[0056] The preset acquisition condition is used to define a condition for triggering acquisition of the second detection result.
[0057] Optionally, the millimeter wave security inspection instrument and the metal detection door are two independent physical devices, and the system further comprises a first passage gate.
[0058] The processing device is further configured to, in a case where the first detection result does not satisfy a preset acquisition condition and the first detection result indicates that the detected article is not of a dangerous category, control the first passage gate to release a target person passing through the millimeter wave security inspection instrument; and in a case where the first detection result satisfies the preset acquisition condition, control the first passage gate to enable the target person passing through the millimeter wave security inspection instrument to enter a detection area of the metal detection door.
[0059] The preset acquisition condition is used to define a condition for triggering acquisition of the second detection result.
[0060] Optionally, the system further comprises a second passage gate.
[0061] The processing device is further configured to, in a case where it is determined that the target person carries contraband, control the second passage gate to enable the target person passing through the metal detection door to enter a manual security inspection area; or, in a case where it is determined that the target person does not carry contraband, control the second passage gate to release the target person passing through the metal detection door.
[0062] In a third aspect, an embodiment of the present application provides a processing device, comprising:
[0063] A memory for storing a computer program.
[0064] A processor for executing the program stored in the memory, so as to implement any of the methods described above.
[0065] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium, which stores a computer program. The computer program is executed by a processor to implement any of the methods described above.
[0066] In a fifth aspect, an embodiment of the present application provides a computer program product comprising instructions which, when executed on a computer, cause the computer to carry out any of the methods described above.
[0067] The embodiments of the present application have the following beneficial effects:
[0068] In the technical scheme provided in the embodiments of the present application, the processing device can determine a first detection result of the target person according to a millimeter wave scanning image of the target person passing through the millimeter wave security inspection instrument, wherein the first detection result comprises first position information of a detected article carried by the target person on the millimeter wave scanning image and first category information of the detected article; determine a target defense zone corresponding to the first position information in the detection area of the metal detection door according to a corresponding relationship between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument and a position corresponding relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door, wherein the detection area of the metal detection door can be divided into a plurality of defense zones; obtain a second detection result corresponding to the detected article in the target defense zone, wherein the second detection result comprises at least one of the metal strength information corresponding to the detected article in the target defense zone and the second category information of the detected article; correct the first category information of the detected article by using the second detection result to determine target category information of the detected article; and determine whether the detected article belongs to contraband according to the target category information.
[0069] Since any metal material article will interfere with the magnetic field between the metal detection doors when passing through the metal detection door, the metal detection door can more accurately detect the metal material article relative to the millimeter wave security inspection instrument. The second detection result obtained by detecting the detected article by the metal detection door corrects the first category information of the detected article obtained by detecting the detected article by the millimeter wave security inspection instrument, and the obtained target category information can more accurately reflect whether the detected article belongs to each metal category, and then the processing device can more accurately determine whether the detected article is a metal category contraband, thereby improving the accuracy of the millimeter wave security inspection instrument in detecting the metal category contraband, and improving the accuracy of the millimeter wave security inspection instrument in detecting the contraband.
[0070] Of course, implementing any product or method of the present application does not necessarily require all the advantages described above. BRIEF DESCRIPTION OF DRAWINGS
[0071] In order to more clearly illustrate the technical schemes in the embodiments of the present application or the prior art, the drawings needed in the embodiments or the prior art description will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application, and other embodiments can also be obtained by those skilled in the art according to these drawings.
[0072] Figure 1 A flowchart of the security inspection method provided in the embodiments of the present application;
[0073] Figure 2 A defense zone division schematic diagram of the metal detection door based on the embodiments shown in the drawings; Figure 1
[0074] Figure 3 A flowchart of one specific implementation of S102 provided by an embodiment of the present application;
[0075] Figure 4 A flowchart of another specific implementation of S102 provided by an embodiment of the present application;
[0076] Figure 5 A schematic diagram of the correspondence between the second position of the target person and the defense zone provided by an embodiment of the present application; Figure 2
[0077] A schematic diagram of a security check process provided by an embodiment of the present application; Figure 6
[0078] A schematic diagram of a security check system provided by an embodiment of the present application; Figure 7
[0079] A schematic diagram of a security check device provided by an embodiment of the present application; Figure 8
[0080] A schematic diagram of a processing device provided by an embodiment of the present application. Figure 9 DETAILED DESCRIPTION
[0081] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art based on the present application belong to the scope of protection of the present application.
[0082] In order to improve the accuracy of the millimeter wave security inspection instrument in detecting contraband, an embodiment of the present application provides a security check method, system, device, processing device, computer readable storage medium and computer program product. First, the security check method provided by an embodiment of the present application will be introduced.
[0083] The security check method provided by an embodiment of the present application is applied to a processing device, which can be a background processor of a millimeter wave security inspection instrument or a metal detection door, a processor in a security check system, a server, etc., which is not specifically limited here. In order to make the writing clear, the following are all called processing devices. Moreover, the millimeter wave security inspection instrument and the metal detection door in the present application can be integrated into one physical device, or can be two independent physical devices, which are not specifically limited here.
[0084] As shown in Figure 1 , a security check method includes the following steps S101-S105.
[0085] S101, determine a first detection result of the target person according to a millimeter wave scanning image of the target person passing through the millimeter wave security inspection instrument.
[0086] The first detection result includes first position information of a detected article carried by the target person on the millimeter wave scanning image and first category information of the detected article.
[0087] S102, determine a target defense zone corresponding to the first position information in a detection area of the metal detection door according to a correspondence relationship between the millimeter wave scanning image and a detection area of the millimeter wave security inspection instrument and a position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door.
[0088] The detection area of the metal detection door can be divided into multiple defense zones.
[0089] S103, obtain a second detection result corresponding to the detected article in the target defense zone.
[0090] The second detection result includes at least one of metal strength information corresponding to the detected article in the target defense zone and second category information of the detected article.
[0091] S104, correct the first category information of the detected article by using the second detection result to determine target category information of the detected article.
[0092] S105, determine whether the detected article belongs to contraband according to the target category information.
[0093] In the technical scheme provided by the embodiments of the present application, the processing device can determine a first detection result of a target person according to a millimeter wave scanning image of the target person passing through a millimeter wave security inspection instrument, wherein the first detection result includes first position information of a detected article carried by the target person on the millimeter wave scanning image and first category information of the detected article; a target defense zone corresponding to the first position information in a detection area of a metal detection door is determined according to a correspondence relationship between the millimeter wave scanning image and a detection area of the millimeter wave security inspection instrument and a position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door, wherein the detection area of the metal detection door can be divided into multiple defense zones; a second detection result corresponding to the detected article in the target defense zone is obtained, wherein the second detection result includes at least one of metal strength information corresponding to the detected article in the target defense zone and second category information of the detected article; the first category information of the detected article is corrected by using the second detection result to determine target category information of the detected article; and whether the detected article belongs to contraband is determined according to the target category information.
[0094] Since any metal material object will interfere with the magnetic field between the metal detection door when passing through the metal detection door, the metal detection door can more accurately detect the metal material object relative to the millimeter wave security inspection instrument. The second detection result obtained by detecting the detected object by the metal detection door corrects the first category information obtained by detecting the detected object by the millimeter wave security inspection instrument, and the obtained target category information can more accurately reflect whether the detected object belongs to each metal category, and then the processing device can more accurately determine whether the detected object is a metal category of contraband, thereby improving the accuracy of the millimeter wave security inspection instrument in detecting the metal category of contraband, and improving the accuracy of the millimeter wave security inspection instrument in detecting the contraband.
[0095] In order to improve the accuracy of the millimeter wave security inspection instrument in detecting the contraband, in addition to using the millimeter wave security inspection instrument to detect the target person to obtain the first detection result, the second detection result can also be obtained by using the metal detection door to detect the target person, and the first detection result is corrected by using the second detection result to accurately determine whether the detected object carried by the target person is contraband.
[0096] The security inspection area is provided with a millimeter wave security inspection instrument, and when the target person passes through the millimeter wave security inspection instrument, the millimeter wave security inspection instrument can scan the target person to obtain a millimeter wave scan image of the target person, and the processing device can obtain the millimeter wave scan image. For example, the processing device can receive the millimeter wave signal returned by the millimeter wave security inspection instrument for scanning the target person, and generate a millimeter wave scan image according to the millimeter wave signal; for another example, the processing device can receive the millimeter wave scan image sent by the electronic device for generating the millimeter wave scan image of the target person to obtain the millimeter wave scan image of the target person, and the like.
[0097] After obtaining the millimeter wave scan image, the processing device can perform the above step S101, that is, determining the first detection result of the target person according to the millimeter wave scan image of the target person passing through the millimeter wave security inspection instrument. Among them, the processing device can detect the millimeter wave scan image in multiple ways, for example, the processing device can detect the millimeter wave scan image by using a pre-trained first recognition network model to obtain the first detection result of the target person; the processing device can also detect the millimeter wave scan image by using an image detection algorithm to obtain the first detection result of the target person, and the like.
[0098] Among them, the first detection result can include first position information of the detected object carried by the target person on the millimeter wave scan image, and first category information of the detected object.
[0099] The first position information of the detected article on the millimeter wave scanning image can be represented by the position information of the detection box of the detected article in the image, and can also be represented by the coordinate range of the detected article in the image coordinate system of the millimeter wave scanning image.
[0100] In addition, when the first position information of the detected article is represented by the position information of the detection box of the detected article in the image, the position information of the detection box in the image can be represented by the vertex coordinates of one vertex of the detection box, the width of the detection box, and the height of the detection box, for example, the position information of the detection box can be represented as (x, y, w, h), wherein x and y are respectively the horizontal coordinate and the vertical coordinate in a fixed plane coordinate system in the detection area of the millimeter wave security inspection instrument, w represents the width of the detection box, and h represents the height of the detection box; the position information of the detection box in the image can also be represented by the vertex coordinates of the four vertices of the detection box, and the like, which is not limited here.
[0101] The first category information of the detected article can include a first confidence degree that the detected article belongs to each article category. The first confidence degree can be represented by a first confidence matrix. The article categories to which the detected article belongs can include article category information included in a preset prohibited article, such as knives and lighters, and can also include article category information included in a preset millimeter wave whitelist. The article categories included in the whitelist are non-prohibited articles suspected to be prohibited articles, or custom specified type articles, such as belts and metal accessories.
[0102] The article categories can be preset and represented by category identifiers such as digital numbers. For example, different article categories can correspond to digital numbers 0, 1, 2, and the like in turn.
[0103] After determining the first detection result of the target person, the processing device can perform the above step S102, that is, according to the correspondence relationship between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument, and the position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door, the target defense zone corresponding to the first position information in the detection area of the metal detection door is determined.
[0104] In order to improve the accuracy of detecting the prohibited articles of the metal category, the security inspection area is also provided with a metal detection door. The detection area of the metal detection door can be divided into a plurality of defense zones. The number and size of the defense zones can be set according to actual needs. After determining the defense zone corresponding to the detection area of the metal detection door, the defense zone corresponding to the detection area of the metal detection door can be numbered, for example, in the defense zone corresponding to the detection area of the metal detection door as shown in Figure 2 The detection area of the metal detection door corresponds to 15 defense zones numbered 1, 2, 3, 4, …, 13, 14, and 15.
[0105] The position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door can be pre-set or obtained through image matching.
[0106] In an implementation manner, according to the sizes of the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door, when the sizes of the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door are the same, the position correspondence between the areas at the same positions in the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door can be directly established; when the sizes of the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door are different, a target detection area with the same size as the detection area of the device with smaller size and corresponding to the position can be segmented in the detection area of the device with larger size, and the positions in the target detection area are corresponded to the positions in the detection area of the device with smaller size, to obtain the position correspondence between the areas at the same positions in the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door.
[0107] In the case that the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door is pre-set, the security inspection personnel can correct the posture of the target person passing through the millimeter wave security inspection instrument and the metal detection door, so that the target person passes through the millimeter wave security inspection instrument and the metal detection door according to the standard posture, to ensure that the subsequent prohibited article detection can be correctly performed by using the pre-set position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door.
[0108] In an implementation manner, the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door can be obtained through image matching. Specifically, the processing apparatus can acquire a human body detection image of the target person passing through the metal detection door collected by the image collection device, and match the human body detection image with the millimeter wave scanning image to determine the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door.
[0109] For the sake of clear writing, the specific manner of determining the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door through image matching will be described below.
[0110] After determining the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door, the processing apparatus can determine a target defense zone corresponding to the first position information in the detection area of the metal detection door based on the correspondence.
[0111] Since the first position information of the detected item carried by the target person on the millimeter wave scanning image indicates the image position of the detected item in the millimeter wave scanning image, and the correspondence relationship between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument indicates the correspondence relationship between each image position in the millimeter wave scanning image and the physical position of the detection area, the processing device can determine the corresponding physical position of the first position information in the detection area of the millimeter wave security inspection instrument according to the correspondence relationship between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument. Since the position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door indicates the correspondence relationship between each physical position in the detection area of the millimeter wave security inspection instrument and each physical position in the detection area of the metal detection door, the processing device can determine the corresponding physical position of the first position information in the detection area of the metal detection door according to the corresponding physical position of the first position information in the detection area of the millimeter wave security inspection instrument and the position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door. Then the processing device can determine the corresponding target security zone of the first position information in the detection area of the metal detection door according to the security zone division of the detection area of the metal detection door, wherein the target security zone can represent the security zone where the detected item carried by the target person is located when the target person passes through the metal detection door.
[0112] For example, the processing device can determine the corresponding target security zone of the first position information in the detection area of the metal detection door as the security zone numbered 7 in the detection area of the metal detection door according to the correspondence relationship between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument and the position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door. Figure 2
[0113] When the target person passes through the metal detection door, the metal detection door can detect the target person, and the processing device can obtain the metal detection door detection result of the target person. For example, the processing device can obtain the metal detection signal obtained by the metal detection door detecting the target person, reconstruct the metal detection signal to obtain metal detection data, detect the metal detection data by using the trained second recognition network model, and obtain the metal detection door detection result.
[0114] Since the detection area of the metal detection door corresponds to multiple security zones, the metal detection door detection result includes second detection results corresponding to the detected items in each security zone, wherein the metal detection door detection result includes at least one of the metal strength information of each detected item carried by the target person and the second category information of the detected item; and the second detection result corresponding to the detected item in each security zone includes at least one of the metal strength information of the detected item in the security zone and the second category information of the detected item.
[0115] The metal strength information includes a metal amount strength of the detected object, and the metal amount strength of the detected object is positively correlated with the electromagnetic response strength. According to the metal strength information, the processing device can determine whether the detected object contains a metal object, and distinguish the size, shape and position of the metal object. The second category information can include a second confidence degree that the detected object belongs to different metal materials, and the second confidence degree can be represented by a second confidence degree matrix.
[0116] In a case where it is determined that the first position information of the detected object on the millimeter wave scanning image corresponds to a target defense zone in the detection area of the metal detection door, the processing device can obtain a second detection result corresponding to the detected object in the target defense zone, wherein the second detection result includes at least one of metal strength information corresponding to the detected object in the target defense zone and second category information of the detected object.
[0117] It should be noted that the order in which the processing device obtains the first detection result and the second detection result is not limited in the embodiments of the present application. The processing device can obtain the first detection result and the second detection result simultaneously, or can obtain the first detection result first and then obtain the second detection result. For example, the processing device can obtain the first detection result first, and then obtain the second detection result in a case where the first detection result meets a preset acquisition condition. The processing device can also obtain the second detection result first and then obtain the first detection result, which is reasonable and is not limited herein.
[0118] The preset acquisition condition is used to define a condition for triggering the acquisition of the second detection result. The preset acquisition condition can be reasonably configured according to actual detection requirements. For example, the preset acquisition condition can include that the first detection result represents that the category of the detected object is a suspicious category, or that the security level of the current security inspection scene is a target level and the first detection result represents that the category of the detected object is a safe category, which is reasonable and is not limited herein.
[0119] After obtaining the second detection result corresponding to the detected object in the target defense zone, the processing device can perform the step S104 described above, that is, correct the first category information of the detected object by using the second detection result, and determine the target category information of the detected object.
[0120] The target category information includes a comprehensive confidence degree that the detected object belongs to each category of objects.
[0121] In one implementation manner, in a case where the first detection result is represented by a first confidence degree, the second detection result includes second category information of the detected object, and the second category information is represented by a second confidence degree, the first confidence degree and the second confidence degree can be weighted and superimposed to obtain the target category information of the detected object.
[0122] In an implementation, in a case where the first detection result is represented by a first confidence, and the second detection result includes metal strength information of the detected object and the metal strength information is represented by a metal strength value, the first confidence and the metal strength value can be weighted and superimposed to obtain target category information of the detected object.
[0123] Since any metal material object will interfere with the magnetic field between the metal detection doors when passing through the metal detection doors, the metal detection doors can accurately detect the metal material object, and thus the processing device corrects the first category information according to the second detection result, that is, corrects the confidence level of the detected object belonging to each metal category.
[0124] Further, the processing device can determine whether the detected object belongs to contraband according to the target category information, that is, perform the above step S105.
[0125] The object category list can be set in advance, in which the object category information included in the contraband and the object category information included in the millimeter wave white list are marked, and the set object category list is stored in the processing device.
[0126] The processing device can determine whether the detected object is contraband in the object category list according to the target category information when determining the target category information of the detected object.
[0127] In an implementation, in a case where the confidence that the object category of the detected object belongs to the object category included in the contraband is greater than a first preset threshold in the target category information, the processing device can determine that the detected object is contraband.
[0128] Correspondingly, in a case where the confidence that the object category of the detected object belongs to the object category included in the contraband is not greater than the first preset threshold in the target category information, the processing device can determine that the detected object is not contraband; or, in a case where the confidence that the object category of the detected object belongs to the object category included in the millimeter wave white list is greater than a second preset threshold in the target category information, the processing device can determine that the detected object is not contraband. The first preset threshold and the second preset threshold can be set according to actual inspection requirements, for example, the first preset threshold is 60%, 70%, etc., and the second preset threshold is 70%, 80%, etc., which are all reasonable and are not limited here.
[0129] In an implementation manner, the processing apparatus can determine a maximum confidence in the comprehensive confidence of each article category corresponding to the detected article, take the article category corresponding to the maximum confidence as the article category to which the detected article belongs, and determine that the detected article is contraband in a case where the determined article category to which the detected article belongs is an article category included in the contraband. In a case where the determined article category to which the detected article belongs is not an article category included in the contraband, the processing apparatus determines that the detected article is not contraband.
[0130] In a case where the detected article is determined to be contraband, the processing apparatus can output preset alarm information so as to prompt a staff to recheck the target person; correspondingly, in a case where the detected article is not contraband, the processing apparatus can output detection pass information to prompt the staff that the target person does not carry contraband and can be released.
[0131] It can be seen that, in the embodiment, since any article made of metal will interfere with the magnetic field between the metal detection doors when passing through the metal detection doors, the metal detection doors can more accurately detect the article made of metal relative to the millimeter wave security inspection instrument. The second detection result obtained by detecting the detected article by the metal detection doors corrects the first category information obtained by detecting the detected article by the millimeter wave security inspection instrument, and the obtained target category information can more accurately reflect whether the detected article belongs to each metal category, and then the processing apparatus can more accurately determine whether the detected article is metal category contraband, thereby improving the accuracy of detecting metal category contraband by the millimeter wave security inspection instrument and improving the accuracy of detecting contraband by the millimeter wave security inspection instrument.
[0132] As an implementation manner of the embodiment of the present application, the security inspection method provided by the embodiment of the present application can further include:
[0133] acquire a human body detection image of the target person passing through the metal detection door collected by an image collection device; determine a matching relationship between the human body detection image and the millimeter wave scanning image according to a similarity between body part features included in the human body detection image and body part features included in the millimeter wave scanning image; determine a corresponding relationship between the human body detection image and a detection region of the metal detection door based on a positional relationship between the image collection device and the metal detection door; and determine a positional corresponding relationship between the detection region of the millimeter wave security inspection instrument and the detection region of the metal detection door according to a corresponding relationship between the millimeter wave scanning image and the detection region of the millimeter wave security inspection instrument, the corresponding relationship between the human body detection image and the detection region of the metal detection door, and the matching relationship.
[0134] The state of the target person passing through the millimeter wave security inspection instrument and the metal detection door can be different, for example, the target person passes through the middle region of the detection region of the millimeter wave security inspection instrument, and passes through the left half region of the detection region of the metal detection door, and the state of the target person passing through the millimeter wave security inspection instrument and the metal detection door is different.
[0135] In this case, in order to accurately and quickly determine the target defense area corresponding to the detection region of the metal detection door according to the first position information of the detected article carried by the target person in the millimeter wave scan image, the human body detection image of the target person passing through the metal detection door can be matched with the millimeter wave scan image to establish the position correspondence relationship between the detection region of the millimeter wave security inspection instrument and the detection region of the metal detection door for the target person.
[0136] In order to obtain the human body detection image of the target person passing through the metal detection door, an image acquisition device can be arranged at a position corresponding to the metal detection door, for example, an image acquisition device is arranged at the entrance of the metal detection door, and the like. And according to the installation position of the image acquisition device and the position of the metal detection door, the positional relationship between the image acquisition device and the metal detection door is determined.
[0137] The above-mentioned image acquisition device can acquire images of the detection region of the metal detection door, and the image acquisition device can acquire the human body detection image of the target person passing through the metal detection door when the target person passes through the metal detection door.
[0138] The processing device can acquire the human body detection image of the target person passing through the metal detection door acquired by the image acquisition device, and match the human body detection image with the millimeter wave scan image when the target person passes through the millimeter wave security inspection instrument.
[0139] The processing device can respectively identify the body part features of the target person in the human body detection image and the millimeter wave scan image, for example, identify the hand, foot and head and other body part features of the target person, to respectively determine the positions of each body part feature in the human body detection image and the millimeter wave scan image.
[0140] The processing device can determine the body part feature with the greatest similarity between the body part features included in the human body detection image and the body part features included in the millimeter wave scan image as the same body part feature according to the similarity between the body part features included in the human body detection image and the body part features included in the millimeter wave scan image, and the position of the human body detection image corresponding to the same body part feature and the position of the millimeter wave scan image are taken as the matching position, thereby establishing the matching relationship between the human body detection image and the millimeter wave scan image according to the body part features.
[0141] The processing apparatus can determine a conversion relationship between an image coordinate system of the image acquisition device and a world coordinate system in which the detection region of the metal detection door is located based on a positional relationship between the image acquisition device and the metal detection door and device parameters of the image acquisition device, and then determine a corresponding relationship between the image position of the human body detection image and the physical position of the detection region of the metal detection door according to the conversion relationship, to obtain the corresponding relationship between the human body detection image and the detection region of the metal detection door.
[0142] Since the corresponding relationship between the millimeter wave scanning image and the detection region of the millimeter wave security inspection instrument represents the corresponding relationship between each image position in the millimeter wave scanning image and the physical position of the detection region of the millimeter wave security inspection instrument, and the matching relationship between the human body detection image and the millimeter wave scanning image represents the matching relationship between the image position of the body part feature in the human body detection image and the image position of the body part feature in the millimeter wave scanning image, the processing apparatus can determine the corresponding relationship between the image position of the body part feature in the human body detection image and the physical position of the body part feature in the detection region of the millimeter wave security inspection instrument, i.e., obtain the corresponding relationship between the human body detection image and the detection region of the millimeter wave security inspection instrument, according to the corresponding relationship between the millimeter wave scanning image and the detection region of the millimeter wave security inspection instrument and the matching relationship between the human body detection image and the millimeter wave scanning image.
[0143] Since the corresponding relationship between the human body detection image and the detection region of the metal detection door represents the corresponding relationship between the image position of the human body detection image and the physical position of the detection region of the metal detection door, the processing apparatus can determine the physical positions in the detection region of the millimeter wave security inspection instrument and the physical positions in the detection region of the metal detection door to which the image position of the human body detection image corresponds respectively, and establish a corresponding relationship between the physical positions in the detection region of the millimeter wave security inspection instrument and the physical positions in the detection region of the metal detection door corresponding to the same image position of the human body detection image, to determine the positional corresponding relationship between the detection region of the millimeter wave security inspection instrument and the detection region of the metal detection door, according to the corresponding relationship between the human body detection image and the detection region of the millimeter wave security inspection instrument and the corresponding relationship between the human body detection image and the detection region of the metal detection door.
[0144] It can be seen that, in the embodiments of the present application, the processing apparatus can match the human body detection image and the millimeter wave scanning image of the target person passing through the metal detection door by the image acquisition device, so as to quickly and accurately determine the positional corresponding relationship between the detection region of the millimeter wave security inspection instrument and the detection region of the metal detection door, to improve the accuracy of the contraband detection in the subsequent contraband detection process using the positional corresponding relationship between the detection region of the millimeter wave security inspection instrument and the detection region of the metal detection door.
[0145] As an implementation manner of the embodiments of the present application, as Figure 3As shown, the step S102, i.e., determining the target defense area corresponding to the first position information in the detection area of the metal detection door according to the correspondence between the millimeter wave scanning image and the detection area of the millimeter wave security instrument and the position correspondence between the detection area of the millimeter wave security instrument and the detection area of the metal detection door, can include:
[0146] S301, determining the second position information corresponding to the first position information in the detection area of the millimeter wave security instrument based on the correspondence between the millimeter wave scanning image and the detection area of the millimeter wave security instrument.
[0147] The millimeter wave scanning image is generated according to the millimeter wave signal returned by the millimeter wave security instrument when scanning the detection area of the millimeter wave security instrument, so the image area of the millimeter wave scanning image corresponds to the detection area of the millimeter wave security instrument, and there is a correspondence between each image position of the millimeter wave scanning image and each physical position in the detection area of the millimeter wave security instrument.
[0148] Since the first position information of the detected article carried by the target personnel on the millimeter wave scanning image represents the image position of the detected article in the millimeter wave scanning image, and the correspondence between the millimeter wave scanning image and the detection area of the millimeter wave security instrument represents the correspondence between each image position of the millimeter wave scanning image and the physical position of the detection area of the millimeter wave security instrument, the processing device can determine the second position information corresponding to the first position information in the detection area of the millimeter wave security instrument according to the correspondence between the image area of the millimeter wave scanning image and the detection area of the millimeter wave security instrument, wherein the second position information is the physical position of the detected article carried by the target personnel in the detection area of the millimeter wave security instrument when passing through the millimeter wave security instrument.
[0149] S302, determining the third position information corresponding to the second position information in the detection area of the metal detection door according to the position correspondence between the detection area of the millimeter wave security instrument and the detection area of the metal detection door.
[0150] As described above, the position correspondence between the detection area of the millimeter wave security instrument and the detection area of the metal detection door represents the correspondence between the physical position in the detection area of the millimeter wave security instrument and the physical position in the detection area of the metal detection door, and the second position information represents the physical position of the detected article carried by the target personnel in the detection area of the millimeter wave security instrument when passing through the millimeter wave security instrument, so the processing device can determine the physical position corresponding to the second position information in the detection area of the metal detection door according to the position correspondence between the detection area of the millimeter wave security instrument and the detection area of the metal detection door, i.e., obtain the third position information corresponding to the second position information in the detection area of the metal detection door.
[0151] The third position information is determined according to a position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door, and is a physical position of the detected article carried by the target person in the detection area of the metal detection door when the target person passes through the metal detection door. Since the second position information represents the corresponding position information of the first position information in the detection area of the millimeter wave security inspection instrument, and the third position information represents the corresponding position information of the second position information in the detection area of the metal detection door, the third position information represents the corresponding position information of the first position information in the detection area of the metal detection door.
[0152] In S303, a target defense zone corresponding to the first position information in the detection area of the metal detection door is determined according to the position of the third position information in the detection area of the metal detection door.
[0153] Since the detection area of the metal detection door is divided into a plurality of defense zones, each physical position in the detection area of the metal detection door corresponds to a defense zone, and the processing device can determine the target defense zone corresponding to the third position information in the detection area of the metal detection door according to the position of the third position information in the detection area of the metal detection door and the division of the defense zones of the detection area of the metal detection door. Since the third position information represents the corresponding position information of the first position information in the detection area of the metal detection door, the target defense zone corresponding to the third position information in the detection area of the metal detection door is the target defense zone corresponding to the first position information in the detection area of the metal detection door.
[0154] It can be seen that in the embodiments of the present application, the processing device can determine the second position information corresponding to the first position information in the detection area of the millimeter wave security inspection instrument based on the correspondence relationship between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument, determine the third position information corresponding to the second position information in the detection area of the metal detection door according to the position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door, and determine the target defense zone corresponding to the first position information in the detection area of the metal detection door according to the position of the third position information in the detection area of the metal detection door, so as to quickly and accurately determine the target defense zone corresponding to the first position information in the detection area of the metal detection door. Furthermore, the second detection result of the detected article corresponding to the target defense zone is directly obtained, and the first detection result is corrected by using the second detection result, so as to improve the detection efficiency and accuracy of the detected article.
[0155] As an implementation manner of the embodiments of the present application, as shown in Figure 4As shown, the step S102, i.e., determining the target defense zone corresponding to the first position information in the detection area of the metal detection door according to the correspondence between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument and the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door, can include:
[0156] S401, determining the fourth position information corresponding to a preset position point in the millimeter wave scanning image in the detection area of the metal detection door according to the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door and the correspondence between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument.
[0157] The preset position point is a position point with a landmark in the detection area of the metal detection door and the processing device can determine the position of the detection area of the metal detection door according to the preset position point. The preset position point can be set according to actual detection requirements and can be a region vertex of the detection area of the metal detection door, for example, a left upper vertex, a right lower vertex, etc. of the detection area of the metal detection door; can be a region midpoint of the detection area of the metal detection door; and can also be an intersection of a center line and a boundary of the detection area of the metal detection door, for example, an intersection of a center line in the vertical direction and an upper boundary of the detection area of the metal detection door, an intersection of a center line in the horizontal direction and a left boundary of the detection area of the metal detection door, etc. All of them are reasonable and are not limited here.
[0158] In addition, the preset position point can be one or multiple, which are all reasonable and are not limited here.
[0159] Since the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door represents the correspondence between the physical position in the detection area of the millimeter wave security inspection instrument and the physical position in the detection area of the metal detection door, the processing device can determine the physical position of the preset position point in the detection area of the metal detection door in the detection area of the millimeter wave security inspection instrument according to the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door.
[0160] Since the correspondence between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument represents the correspondence between each image position in the millimeter wave scanning image and the physical position of the detection area of the millimeter wave security inspection instrument, the processing device can determine the image position corresponding to the preset position point in the millimeter wave scanning image, i.e., determine the fourth position information corresponding to the preset position point in the millimeter wave scanning image, according to the correspondence between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument and the physical position of the preset position point in the detection area of the millimeter wave security inspection instrument.
[0161] S402, in the millimeter wave scanning image, based on the fourth position information, determine the image region matched with the detection region of the metal detection door.
[0162] Since the preset position point is a position point with a landmark in the detection region of the metal detection door and the processing device can determine the position of the detection region of the metal detection door according to the preset position point, in the case that the fourth position information corresponding to the preset position point in the millimeter wave scanning image is determined, the processing device can determine the image position relationship between the preset position point and the detection region of the metal detection door according to the scaling ratio between the detection region of the millimeter wave security inspection instrument and the image region of the millimeter wave scanning image, and the physical position relationship between the preset position point and the detection region of the metal detection door; and according to the fourth position information corresponding to the preset position point in the millimeter wave scanning image and the image position relationship between the preset position point and the detection region of the metal detection door, determine the image region in the millimeter wave scanning image which satisfies the above image position relationship between the fourth position information corresponding to the preset position point in the millimeter wave scanning image, that is, obtain the image region matched with the detection region of the metal detection door.
[0163] The image region in the millimeter wave scanning image matched with the detection region of the metal detection door is the image region in the millimeter wave scanning image corresponding to the detection region of the metal detection door after the detection region of the metal detection door is scaled in proportion according to the scaling ratio between the detection region of the millimeter wave security inspection instrument and the image region of the millimeter wave scanning image.
[0164] In an implementation manner, the processing device can determine the fourth position information corresponding to the preset position point in the millimeter wave scanning image in the detection region of the metal detection door according to the position correspondence relationship between the detection region of the millimeter wave security inspection instrument and the detection region of the metal detection door and the correspondence relationship between the millimeter wave scanning image and the detection region of the millimeter wave security inspection instrument. The processing device can scale the detection region of the metal detection door in proportion according to the scaling ratio between the detection region of the millimeter wave security inspection instrument and the image region of the millimeter wave scanning image, determine the size of the detection region of the metal detection door after the scaling in proportion, and determine the image region in the millimeter wave scanning image with the fourth position information as a reference, which has the same size as the detection region of the metal detection door after the scaling in proportion according to the scaling ratio between the detection region of the millimeter wave security inspection instrument and the image region of the millimeter wave scanning image.
[0165] For example, when the preset position point is the midpoint of the detection area of the metal detection door, the processing device can determine the midpoint of the detection area of the metal detection door as the fourth position information of the millimeter wave scan image, determine the size of the detection area of the metal detection door after scaling according to the fourth position information as the center, and crop an image region with the above size in the millimeter wave scan image. For example, the processing device can determine an image region with the same length Lx and width Ly as the detection area of the metal detection door in the millimeter wave scan image according to the distance between the fourth position point O (0, 0) as the center and each boundary of the detection area of the metal detection door, to obtain an image region matching the detection area of the metal detection door in the millimeter wave scan image.
[0166] S403, determining a target defense area corresponding to the first position information in the detection area of the metal detection door according to the position of the first position information in the image region.
[0167] The processing device can determine the target defense area corresponding to the first position information in the detection area of the metal detection door according to the position of the first position information of the detected object carried by the target person in the image region matching the metal detection door, that is, the defense area where the detected object passes through the metal detection door.
[0168] In an implementation manner, the detection area of the metal detection door is divided into multiple defense areas, and the image region corresponding to the detection area of the metal detection door in the millimeter wave scan image can also be divided into multiple defense areas. The multiple defense areas of the detection area of the metal detection door correspond to the multiple defense areas of the image region corresponding to the detection area of the metal detection door in the millimeter wave scan image respectively. According to the position of the first position information in the image region, the defense area corresponding to the first position information in the image region can be determined, and then according to the correspondence between the defense areas of the detection area of the metal detection door and the defense areas of the image region, the target defense area corresponding to the first position information in the detection area of the metal detection door can be determined.
[0169] In another implementation manner, since the image region matches the detection area of the metal detection door, the actual area position of the detection area of the metal detection door corresponding to the first position information can be determined according to the correspondence between the detection area of the metal detection door and the image region and the position of the first position information in the image region, and then the target defense area corresponding to the first position information in the detection area of the metal detection door can be determined according to the correspondence between the actual area position of the detection area and the defense area.
[0170] It can be seen that, in the embodiment of the application, the processing device can determine the fourth position information corresponding to the preset position point in the detection area of the metal detection door in the millimeter wave scan image according to the position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door and the correspondence between the millimeter wave scan image and the detection area of the millimeter wave security inspection instrument; in the millimeter wave scan image, the image area matching the detection area of the metal detection door is determined based on the fourth position information; and the target defense area corresponding to the first position information in the detection area of the metal detection door is quickly and accurately determined according to the position of the first position information in the image area. Further, the second detection result of the detected object corresponding to the target defense area is directly obtained, and the first detection result is corrected using the second detection result, thereby improving the detection efficiency and accuracy of the detected object.
[0171] As an implementation manner of the embodiment of the application, the step S104, i.e., the step of correcting the first category information of the detected object using the second detection result to determine the target category information of the detected object, can include the following four manners:
[0172] Manner one: determining an object material attention coefficient based on the second category information of the detected object in the second detection result; correcting the first category information of the detected object using the object material attention coefficient to determine the target category information of the detected object. The object material attention coefficient reflects the degree of attention to different objects in the security inspection process, and affects the judgment result of whether the related object is determined as contraband. The attention coefficient corresponding to different objects can be reasonably set according to the security inspection requirement.
[0173] Exemplarily, in the case that the second detection result includes the second category information of the detected object, the processing device can determine the object material attention coefficient according to the second category information. The object material attention coefficient represents the degree of attention to metal objects of different materials.
[0174] The object material can affect the accuracy of the judgment result of the contraband, and different metal materials can also affect the accuracy of the judgment result of the contraband. For example, objects of metal materials such as gold and silver are usually jewelry, and the target person can wear jewelry of metal materials such as gold or silver on the body. These jewelry usually do not belong to contraband, and the attention degree to objects of such metal materials can be appropriately reduced during security inspection. For objects of metal materials such as steel and iron, these objects are usually contraband such as knives, and the attention degree to objects of such metal materials can be appropriately increased during security inspection.
[0175] Therefore, the processing device can determine the object material attention coefficient of the detected object according to the second category information of the detected object.
[0176] For each security area, in the case that the second category information includes a second confidence degree of the detected item belonging to different metal materials, the processing device can determine a maximum confidence degree in the second confidence degrees of the detected item in the security area, determine the metal material corresponding to the maximum confidence degree as the material of the detected item, and determine the material attention coefficient of the material.
[0177] The material attention coefficient of the material of the item can be set according to the actual detection requirement of the current security inspection scene. In the case that the contraband in the current security inspection scene is mainly of a certain material, a higher material attention coefficient can be set for the material, and a lower material attention coefficient can be set for other materials. For example, in the case that the current security inspection scene is a railway station, a higher material attention coefficient can be set for materials such as iron or steel, and a lower material attention coefficient can be set for other materials such as gold.
[0178] After determining the material attention coefficient of the detected item, the processing device can correct the first category information of the detected item by using the material attention coefficient of the detected item to obtain target category information of the detected item.
[0179] In an implementation manner, in the case that the first category information is represented by first confidence degrees of the detected item belonging to each material category, and the target category information is represented by a comprehensive confidence degree of the detected item belonging to each material category, after determining the material attention coefficient of the detected item, the processing device can calculate a product of the material attention coefficient and the first confidence degree to obtain the comprehensive confidence degree.
[0180] In an implementation manner, in the case that the first category information is represented by first confidence degrees of the detected item belonging to each material category, and the target category information is represented by a comprehensive confidence degree of the detected item belonging to each material category, after determining the material attention coefficient of the detected item, the processing device can adjust the confidence degree of the material type belonging to the material in the first confidence degree by using the material attention coefficient to obtain the comprehensive confidence degree.
[0181] Manner two: determining a second adjustment parameter corresponding to the target security area to adjust the second detection result, and correcting the first category information of the detected item by using the adjusted second detection result to determine target category information of the detected item.
[0182] The second adjustment parameter can include a sensitivity corresponding to a security area, an adjustment weight, and the like, and can also include other parameters for adjusting the detection capability of a security area, which are all reasonable and are not limited here.
[0183] According to the body shape of the person, the part of the human body where the contraband is likely to be hidden, the passing habit of the person, and the division rules of the metal detection door, the likelihood of detecting contraband in each zone of the metal detection door is different. For the zone with a high likelihood of detecting contraband, the second adjustment parameter of the zone can be appropriately increased, and for the zone with a low likelihood of detecting contraband, the second adjustment parameter of the zone can be appropriately decreased.
[0184] The processing device can determine the second adjustment parameter of each zone corresponding to the detection area of the metal detection door according to the preset region of interest of the human body, the position correspondence between the preset region of interest and the detection area of the metal detection door, wherein the preset region of interest can be determined according to the body part of the detected person.
[0185] Because some parts of the human body are blocked by limbs, such as the armpit, head, or crotch, these parts are prone to hide contraband, and the detection accuracy of the millimeter wave security inspection instrument for these parts is low.
[0186] When detecting these parts, the attention of the metal detection door to these parts can also be appropriately increased, so that the contraband hidden in these parts is more likely to be detected. That is, these parts can be used as a preset region of interest, and the corresponding zone of the preset region of interest can be determined according to the human body structure, the passing habit of the person, and the division of the metal detection door. When determining the second adjustment parameter of each zone of the metal detection door, for the zone corresponding to the preset region of interest, the second adjustment parameter of these zones can be determined as a larger second adjustment parameter; for other zones not corresponding to the preset region of interest, the second adjustment parameter of these zones can be determined as a smaller second adjustment parameter. Further, the processing device can use the determined second adjustment parameter to adjust the first confidence degree corresponding to the detected object.
[0187] The processing device can determine the second adjustment parameter corresponding to the target zone, and adjust the second detection result by using the second adjustment parameter corresponding to the target zone.
[0188] In an implementation manner, when the second adjustment parameter includes the sensitivity corresponding to the target zone, the processing device can set the sensitivity corresponding to the target zone as a first sensitivity, and set the sensitivity corresponding to the non-target zone as a second sensitivity. The first sensitivity is greater than the second sensitivity.
[0189] In an implementation manner, the processing device can determine the preset region of interest of the target person in the detection area of the millimeter wave security inspection instrument according to the body information of the target person in the millimeter wave scanning image. The body information of the target person can include height, shoulder width, arm span, and the like. The preset region of interest can be the head, armpit, crotch, foot, and the like.
[0190] According to the position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door, a preset region of interest is determined to correspond to a guard area in the detection area of the metal detection door, a second adjustment parameter of the guard area corresponding to the preset region of interest is set as a larger second adjustment parameter, a second adjustment parameter of a guard area other than the guard area corresponding to the preset region of interest is set as a smaller second adjustment parameter, the sensitivity of each guard area of the metal detection door is adjusted by combining the millimeter wave scan image human body information and the metal detection door guard area information, and a second adjustment parameter matrix corresponding to each guard area is obtained.
[0191] For example, as shown in FIG. 5, the detection area surrounded by the rectangular frame 501 corresponds to a second position of the armpit of the target person. The area surrounded by the rectangular frame 501 corresponds to four guard areas, i.e., guard area 4, guard area 5, guard area 7, and guard area 8. The processing device can set a larger second adjustment parameter for these four guard areas. Figure 5
[0192] After determining the second adjustment parameter corresponding to the target guard area, the processing device can adjust the second detection result by using the second adjustment parameter corresponding to the target guard area.
[0193] In an implementation manner, in a case where the second adjustment parameter is sensitivity, the second detection result is represented by metal strength information of the detected article, and the processing device can calculate a product of the sensitivity of the target guard area and the metal strength information of the detected article corresponding to the target guard area, to obtain adjusted metal strength information of the detected article corresponding to the target guard area, i.e., an adjusted second detection result.
[0194] For example, the second adjustment parameter is sensitivity, and the target guard area is the guard area 5 as shown in FIG. 5. The sensitivity of the guard area 5 is β(5), and the metal strength information of the detected article corresponding to the guard area 5 is A(5). The processing device calculates the product β(5)×A(5) of the sensitivity of the guard area 5 and the metal strength information of the detected article corresponding to the guard area 5, to obtain the adjusted metal strength information of the detected article corresponding to the target guard area, i.e., the adjusted second detection result. metal metal Figure 2
[0195] In an implementation manner, in a case where the second adjustment parameter is the article material attention coefficient, the article material attention coefficient can be determined based on the second category information of the detected article in the second detection result, and the second detection result is adjusted by using the article material attention coefficient, to obtain an adjusted second detection result.
[0196] In an implementation, in a case where the second adjustment parameter is a category adjustment parameter corresponding to first category information of the detected item, the second detection result can be adjusted by using the category adjustment parameter, and the first category information can be corrected by using the adjusted second detection result to determine target category information of the detected item.
[0197] The processing apparatus can correct the first category information of the detected item by using the adjusted second detection result to determine target category information of the detected item.
[0198] In an implementation, in a case where the first category information is represented by a first confidence degree of the detected item belonging to each item category, and the adjusted second detection information is the metal strength information of the detected item corresponding to the adjusted target defense zone, the first confidence degree and the metal strength information of the detected item corresponding to the adjusted target defense zone can be weighted and summed to obtain the target category information of the detected item.
[0199] The subsequent control device can perform step S103 to adjust the first confidence degree by using the updated metal strength value to obtain a comprehensive confidence degree.
[0200] Method three: determining a first adjustment parameter corresponding to the first category information of the detected item to adjust the first category information of the detected item, and correcting the adjusted first category information by using the second detection result to determine target category information of the detected item.
[0201] The processing apparatus can determine a first adjustment parameter corresponding to the first category information of the detected item, and adjust the first category information of the detected item by using the first adjustment parameter corresponding to the first category information, and then correct the detection result of the millimeter wave security inspection instrument by using the detection result of the metal detection door again to ensure the accuracy and reliability of the joint output detection result.
[0202] To further improve the accuracy of the contraband detection result, the processing apparatus can also adjust the first category information by using the first adjustment parameter to improve the accuracy of the first category information. The first adjustment parameter can be determined based on the attention degree of the current security inspection scene to each item category. For an item category with a high attention degree in the current security inspection scene, such as a contraband category, a higher first adjustment parameter can be set. For an item category with a low attention degree in the current security inspection scene, a lower first adjustment parameter can be set. The first adjustment parameter can include an item material attention coefficient and / or a category adjustment parameter, wherein the category adjustment parameter represents the attention degree of the current security inspection scene to the item category, and the category adjustment parameter can be represented in the form of a matrix. For example, for Nc kinds of item categories numbered 1, 2, …, Nc, these item categories correspond to category adjustment parameters a1, a2, …, aNc, respectively.Nc The category adjustment parameters can be represented in matrix form as follows:
[0203] [α1, α2, …, α Nc ].
[0204] The processing device can obtain a first adjustment parameter corresponding to each category of the article under the current security check scene set by the security personnel. Based on the obtained first adjustment parameter, the first category information corresponding to the detected article is adjusted.
[0205] In an implementation manner, in a case where the first category information is represented by a first confidence degree of the detected article belonging to each category of the article, and the first adjustment parameter includes a category adjustment parameter, the processing device can calculate a product of the category adjustment parameter and the first confidence degree to obtain the adjusted first category information.
[0206] In an implementation manner, in a case where the first category information is represented by a first confidence degree of the detected article belonging to each category of the article, and the first adjustment parameter includes a category adjustment parameter and an article material attention coefficient, the processing device can obtain a confidence degree adjustment parameter matrix according to the article material attention coefficient and the category adjustment parameter, and calculate a product of the confidence degree adjustment parameter matrix and the first confidence degree to obtain the adjusted first category information.
[0207] The subsequent processing device can further correct the adjusted first category information by using the second detection result to determine the target category information of the detected article.
[0208] In an implementation manner, in a case where the first category information is represented by a first confidence degree of the detected article belonging to each category of the article, and the second detection result is represented by the metal strength information of the detected article, a weighted sum value of the second detection result and the adjusted first category information can be calculated to obtain the adjusted first category information.
[0209] Manner four: determining a first adjustment parameter corresponding to the first category information of the detected article, and determining a second adjustment parameter corresponding to the target security area; adjusting the first category information of the detected article by using the first adjustment parameter, and adjusting the second detection result by using the second adjustment parameter; further correcting the adjusted first category information by using the adjusted second detection result to determine the target category information of the detected article.
[0210] The processing device can determine a first adjustment parameter corresponding to the first category information of the detected article, and determine a second adjustment parameter corresponding to the target defense zone; adjust the first category information of the detected article by using the first adjustment parameter, and adjust the second detection result by using the second adjustment parameter; and correct the adjusted first category information again by using the adjusted second detection result, to determine the target category information of the detected article. By separately correcting the detection results of the millimeter wave security inspection instrument and the metal detection door, and then jointly determining the category information of the detected article based on the two corrected detection results, the accuracy and reliability of the final detection result are further improved.
[0211] The first adjustment parameter corresponding to the first category information of the detected article is determined, and the second adjustment parameter corresponding to the target defense zone is determined; the first category information of the detected article is adjusted by using the first adjustment parameter, and the second detection result is adjusted by using the second adjustment parameter; which has been introduced in the foregoing, and can be implemented by referring to one or more of the above-described manners, which will not be described here.
[0212] In an implementation manner, in a case where the first category information is represented by a first confidence degree that the detected article belongs to each article category, and the second detection result is represented by metal strength information of the detected article, a weighted sum value of the adjusted second detection result and the adjusted first category information can be calculated to determine the target category information of the detected article.
[0213] It can be seen that, in the embodiments of the present application, the first category information of the detected article can be corrected by using the second detection result to determine the target category information of the detected article in multiple ways, which has high scene adaptability, and can improve the accuracy of the contraband detection result according to the needs of different security inspection scenes.
[0214] As an implementation manner of the embodiments of the present application, the second adjustment parameter includes a sensitivity corresponding to the target defense zone. Correspondingly, the step of determining the second adjustment parameter corresponding to the target defense zone can include:
[0215] The sensitivity corresponding to the target defense zone is set as a first sensitivity.
[0216] The security inspection method provided in the embodiments of the present application can further include: setting a sensitivity corresponding to a non-target defense zone as a second sensitivity. The first sensitivity is greater than the second sensitivity.
[0217] Since the target defense zone is the defense zone where the detected object is located, in order to improve the accuracy of the detection result of the detected object, the processing apparatus can set the sensitivity corresponding to the target defense zone as the first sensitivity and set the sensitivity corresponding to the non-target defense zone as the second sensitivity when the second adjustment parameter is the sensitivity corresponding to the target defense zone. The first sensitivity is greater than the second sensitivity.
[0218] It can be seen that, in the embodiments of the present application, the processing apparatus can improve the sensitivity of the target defense zone corresponding to the detected object in the detection area of the metal detection door, reduce the missed detection probability of the target defense zone to contraband, and thus improve the accuracy of the millimeter wave security inspection instrument in detecting contraband.
[0219] As an implementation manner of the embodiments of the present application, the first adjustment parameter includes an object material attention coefficient and / or a category adjustment parameter. Correspondingly, the step of determining the first adjustment parameter corresponding to the first category information of the detected object can include:
[0220] determining the category adjustment parameter based on the second category information of the detected object in the second detection result and / or the object category information included in the pre-set millimeter wave white list, wherein the category adjustment parameter represents the attention degree of the current security inspection scene to the object category;
[0221] and / or,
[0222] determining the object material attention coefficient based on the second category information of the detected object in the second detection result, wherein the object material attention coefficient represents the attention degree to metal objects of different materials.
[0223] The first adjustment parameter can include an object material attention coefficient and / or a category adjustment parameter.
[0224] The processing apparatus can determine the category adjustment parameter based on the second category information of the detected object in the second detection result and / or the object category information included in the pre-set millimeter wave white list, wherein the category adjustment parameter represents the attention degree of the current security inspection scene to the object category.
[0225] In an implementation manner, the processing apparatus can determine the category adjustment parameter based on the second category information of the detected object in the second detection result and / or the object category information included in the pre-set millimeter wave white list when the second detection result is obtained. That is, the processing apparatus can reduce the attention degree to the object category belonging to the object category included in the pre-set millimeter wave white list according to the second category information of the detected object, and improve the attention degree to the object category other than the object category.
[0226] The processing device can determine the material attention coefficient of the item based on the second category information of the item detected in the second detection result, wherein the material attention coefficient represents the degree of attention to metal items of different materials.
[0227] In one implementation, the processing device detects the second category information of the item in the second detection result, and can determine the item material attention coefficient based on the detected second category information. The implementation method for determining the item material attention coefficient has been explained above and will not be repeated here.
[0228] As one embodiment of this application, the first adjustment parameter includes an item material attention coefficient and a category adjustment parameter, the second adjustment parameter includes the sensitivity corresponding to the target defense zone, the first category information includes a first confidence level that the detected item belongs to the item category, and the second detection result includes the metal strength value corresponding to the detected item in the target defense zone.
[0229] The steps described above—determining the first adjustment parameter corresponding to the first category information of the detected item, and determining the second adjustment parameter corresponding to the target defense zone; adjusting the first category information of the detected item using the first adjustment parameter, and adjusting the second detection result using the second adjustment parameter; and further correcting the adjusted first category information using the adjusted second detection result to determine the target category information of the detected item—may include:
[0230] The overall confidence level P of the detected item belonging to the item category is calculated using the following formula. fin (c) , as target category information for the detected items:
[0231] P fin (c)=M0×α(c)×P mmw (c)+β(m)×A metal (m);
[0232] Where c is the item category number, α(c) is the category adjustment parameter corresponding to item category c, and P mmw (c) represents the first confidence level that the detected item belongs to item category c, M0 is the material attention coefficient corresponding to the detected item, m is the target zone number corresponding to the detection location of the detected item, β(m) is the sensitivity corresponding to target zone m, and A metal (m) represents the metal strength value corresponding to the target defense zone m.
[0233] Confidence P of detecting items belonging to different item categories mmw (The probabilities of all samples are between 0 and 1, and the total confidence level is 1), then the first confidence matrix is P.mmw [P1, P2, ……, P Nc ], wherein 1-Nc respectively correspond to different sample category numbers, i.e. c belongs to [1, 2, ……, Nc]. M0x a is a confidence adjustment parameter matrix, [M0a1, M0a2, …… M0a Nc ] belongs to [1, 2, ……, M], wherein M is the number of defense zones of the detection area of the metal detection door.
[0234] The above formula adjusts the first confidence that the detected item belongs to the item category c by using the category adjustment parameter and the item material attention coefficient, to obtain an adjusted first confidence, and adjusts the metal strength value corresponding to the target defense zone m by using the sensitivity corresponding to the target defense zone m, to obtain an adjusted metal strength value, and then corrects the adjusted first confidence by using the adjusted metal strength value, so that the comprehensive confidence of the item category can be obtained.
[0235] For each detected item in the first detection result, the first detection result is corrected by using the above formula and the second detection result, so that the comprehensive confidence P fin (c) of the detected item belonging to the item category is obtained as the target category information of the detected item.
[0236] It can be seen that in the embodiments of the present application, the processing device uses the item material attention coefficient, the category adjustment parameter, the defense zone sensitivity, the metal strength value corresponding to the target defense zone, and the first confidence to calculate the comprehensive confidence. The obtained comprehensive confidence can accurately reflect whether the detected item belongs to the metal material item which is more concerned in the current security scene, whether the detected item belongs to the prohibited item category which is highly concerned in the current security scene, and whether the detected item in the preset interesting region belongs to the metal item. In this way, based on the comprehensive confidence, it can be more accurately determined whether the detected item is a prohibited item of the metal category, further improving the accuracy of the millimeter wave security instrument in detecting the prohibited item of the metal category, and further improving the accuracy of the millimeter wave security instrument in detecting the prohibited item.
[0237] The technical solution provided in the embodiments of the present application can complementarily fuse the information detected by the two detectors, i.e., the millimeter wave security inspection instrument and the metal detection door. For example, the shape and position information of the object in the millimeter wave scanning image generated by the millimeter wave security inspection instrument and the metal material and size detected by the metal detection door can be fused. In this way, the accuracy of the millimeter wave security inspection instrument in detecting contraband can be improved. For the problems of the detection blind area of the millimeter wave security inspection instrument, incomplete target display, and the fact that millimeter waves cannot penetrate the skin, which lead to the difficulty in identifying very small or concealed contraband in the mouth and other package areas, the metal detection door can more accurately detect the contraband in these cases according to the magnetic field characteristics of the metal detection door. The millimeter wave security inspection instrument has higher comprehensiveness in detection than the metal detection door, and can detect objects other than metal objects. The present solution fuses the millimeter wave security inspection instrument and the metal detection door, effectively improves the accuracy of detecting contraband, and effectively improves the detection effect of the active millimeter wave security inspection instrument in the dead angle area and the case of incomplete target.
[0238] As an implementation manner of the embodiments of the present application, the step S103, i.e., the step of obtaining the second detection result corresponding to the detected object in the target defense area, can include:
[0239] In a case where the first detection result represents that the category of the detected object is a suspicious category, or in a case where the security level requirement of the current security inspection scene is a target level and the first detection result represents that the category of the detected object is a safe category, the second detection result corresponding to the detected object in the target defense area is obtained.
[0240] After obtaining the first detection result, in a case where the first detection result represents that the category of the detected object is a suspicious category, the processing apparatus can obtain the second detection result corresponding to the detected object in the target defense area, so as to correct the first detection result by using the second detection result, and determine whether the detected object is contraband.
[0241] For some scenes with high security level requirements, such as museums, exhibition halls, or airports, even if the first detection result represents that the category of the detected object is a safe category, the second detection result obtained by the metal detection door in detecting the detected object still needs to be obtained, and the double detection results of the millimeter wave security inspection instrument and the metal detection door are combined to determine whether the detected object is contraband.
[0242] Based on this, the security level requirements of the security inspection scenario can be classified in advance. According to the security requirements from high to low, multiple security levels can be divided. After obtaining the first detection result, the processing device can obtain the second detection result corresponding to the detected item in the target security zone if the security level requirement of the current security inspection scenario is the target level and the first detection result indicates that the category of the detected item is a safe category. This allows the processing device to use the second detection result to correct the first detection result and further determine whether the detected item is a contraband.
[0243] The target level mentioned above should be set reasonably according to the actual testing needs. For example, it can be the highest safety level corresponding to the safety level requirement, or it can be any safety level other than the lowest safety level among the various safety levels corresponding to the safety level requirement. All of these are reasonable and no specific limitation is made here.
[0244] As can be seen, in this embodiment of the application, when the first detection result indicates that the category of the detected item is suspicious, or when the security level requirement of the current security inspection scenario is the target level and the first detection result indicates that the category of the detected item is safe, a second detection result corresponding to the detected item in the target area is obtained. In this way, the processing device can continue to obtain the second detection result corresponding to the detected item in the target area under the above circumstances, and use the second detection result to correct the first detection result, thereby improving the accuracy of detecting contraband.
[0245] The following is combined Figure 6 The security check flowchart shown illustrates the security check methods with examples.
[0246] Figure 6 In this process, the target personnel pass through the active millimeter-wave security scanner at the entrance, and the processing device can obtain the initial inspection result of the millimeter-wave security scanner inspection of the target personnel, that is, the first inspection result.
[0247] The detected items may belong to one of the following categories: hazardous, suspicious, or safe.
[0248] Based on the initial inspection results, the processing device can determine the category of the detected item as dangerous if the first confidence level of the detected item being a prohibited item is greater than the preset confidence threshold of the millimeter-wave security scanner; if the first confidence level of the detected item being a category included in the millimeter-wave whitelist is greater than the preset confidence threshold, the processing device can determine the category of the detected item as safe if the first detection result indicates that the detected item belongs to neither a dangerous nor a safe category; and if the first detection result indicates that the detected item belongs to neither a dangerous nor a safe category, the processing device can determine the category of the detected item as suspicious.
[0249] The pre-set confidence threshold can be set according to the security level requirement of the current scene. In the case that the security level requirement of the current scene is high, a lower pre-set confidence threshold can be set to reduce the missed detection rate; in the case that the security level requirement of the current scene is low, a higher pre-set confidence threshold can be set to reduce the false detection rate and avoid affecting the security efficiency due to false detection. For example, the pre-set confidence threshold can be set to 90%.
[0250] In an implementation manner, the materials of some article categories can be similar to the contraband, and are easy to be misdetected as the contraband. In order to reduce the false detection rate, a millimeter wave white list of article categories can also be set, and the article categories similar to the materials of the contraband are added to the millimeter wave white list of article categories.
[0251] In the case that the first detection result (i.e., the preliminary detection result) represents that the detected article belongs to the dangerous category, the millimeter wave security inspection instrument can directly issue a warning to prompt the security personnel that the target person carries the contraband. In this case, the security personnel can directly guide the target person to enter the manual security inspection area, and manually inspect the target person. After the manual inspection excludes the contraband and the suspicious article that is easy to cause the millimeter wave security inspection instrument to misdetect, the security personnel guides the target person to pass through the channel 3 between the manual security inspection area and the entrance of the millimeter wave security inspection instrument again, and then the target person is re-inspected by the millimeter wave security inspection instrument.
[0252] In the case that the first detection result represents that the detected article belongs to the suspicious category, the processing device can determine that the first detection result corresponding to the target person meets a pre-set acquisition condition, and needs to be detected by the metal detection door again.
[0253] In the case that the first detection result represents that the detected article belongs to the safe category, the processing device can further determine whether the security level requirement of the current security inspection scene is a target level. The target level represents that the security level requirement of the current security inspection scene is high, and the target person needs to be detected by the metal detection door again in all cases except that the first detection result represents that the detected article belongs to the dangerous category.
[0254] In the case that the security level requirement of the current security inspection scene is the target level and the first detection result represents that the category of the detected article is the safe category, the processing device can determine that the first detection result corresponding to the target person meets the pre-set acquisition condition, and needs to be detected by the metal detection door again.
[0255] In situations where the current security level requirement is not the target level (i.e., the security level requirement is low) and the first detection result indicates that the detected item belongs to the safe category, or when the millimeter-wave device does not detect a large item, the processing device can determine that the first detection result for the target person does not meet the preset detection conditions. Therefore, it is unnecessary to use a metal detector gate to check the target person. The processing device can then allow the target person to exit through channel 1, achieving rapid security checks and improving throughput efficiency.
[0256] If the first detection result corresponding to the target person meets the preset acquisition conditions, the target person needs to pass through a metal detector gate for security screening. The processing device can acquire the metal detector gate detection result obtained from the metal detector gate detection of the target person. The processing device executes subsequent steps S102-S105, using the second detection result of the detected item to correct the first category information, thereby obtaining the target category information of the detected item. Based on the target category information, it determines whether the detected item carried by the target person is a prohibited item, that is, it performs data fusion decision to determine whether the target person is carrying prohibited items.
[0257] If the items carried by the target person are found to be prohibited, the processing device determines the target person's final detection result as a final danger. Security personnel can guide the target person to the manual security check area for a manual search. After the manual search eliminates the target person from carrying prohibited items and suspicious items that could easily cause false detections by the millimeter-wave security scanner, security personnel will guide the target person through passage 3 between the manual security check area and the millimeter-wave security scanner entrance for a second search. Before the second search, any suspicious items must be removed from the person, and the above detection process must be repeated.
[0258] If the items carried by the target personnel are not contraband, the processing device determines that the target personnel's final test result is safe and allows the target personnel to leave through channel 2 from the exit.
[0259] As can be seen, the two preset fusion detection conditions are set according to the security level requirements of the current scenario. Under higher security requirements, all target personnel are detected as much as possible to improve the accuracy of security checks and thus ensure the safety of people and items in the current scenario. Under lower security requirements, metal detectors are used for fusion detection only when target personnel are carrying suspicious items, to improve the efficiency of security checks and avoid congestion at the entrance of the current scenario.
[0260] In accordance with the above-described security inspection method, this application also provides a security inspection system.
[0261] like Figure 7As shown in the figure, a security inspection system includes a millimeter wave security inspection device 701, a metal detection door 702, and a processing device (not shown in the figure). Wherein:
[0262] The millimeter wave security inspection device 701 and the metal detection door 702 are respectively used for detecting target personnel. The millimeter wave security inspection device 701 and the metal detection door 702 are integrated into one physical device, or the millimeter wave security inspection device 701 and the metal detection door 702 are two independent physical devices.
[0263] The processing device is used for executing the security inspection method provided by the embodiments of the present application.
[0264] A security inspection system includes a millimeter wave security inspection device 701, a metal detection door 702, and a processing device, wherein the millimeter wave security inspection device 701 and the metal detection door 702 are integrated into one physical device.
[0265] A security inspection system includes a millimeter wave security inspection device 701, a metal detection door 702, and a processing device, wherein the millimeter wave security inspection device 701 and the metal detection door 702 are integrated into two independent physical devices.
[0266] In the technical scheme provided by the embodiments of the present application, the processing device can determine a first detection result of the target personnel according to a millimeter wave scanning image of the target personnel passing through the millimeter wave security inspection device, wherein the first detection result includes first position information of a detected item carried by the target personnel on the millimeter wave scanning image and first category information of the detected item; determine a target defense zone corresponding to the first position information in the detection area of the metal detection door according to a corresponding relationship between the millimeter wave scanning image and the detection area of the millimeter wave security inspection device, and a position corresponding relationship between the detection area of the millimeter wave security inspection device and the detection area of the metal detection door, wherein the detection area of the metal detection door can be divided into multiple defense zones; obtain a second detection result corresponding to the detected item in the target defense zone, wherein the second detection result includes at least one of metal strength information corresponding to the detected item in the target defense zone and second category information of the detected item; correct the first category information of the detected item by using the second detection result to determine target category information of the detected item; and determine whether the detected item belongs to contraband according to the target category information.
[0267] Since the metal material object will interfere with the magnetic field between the metal detection doors when passing through the metal detection doors, the metal detection doors can detect the metal material object more accurately than the millimeter wave security inspection instrument. The second detection result obtained by detecting the detected object by the metal detection door corrects the first category information obtained by detecting the detected object by the millimeter wave security inspection instrument, and the obtained target category information can more accurately reflect whether the detected object belongs to each metal category, and then the processing device can more accurately determine whether the detected object is a metal category of contraband, thereby improving the accuracy of the millimeter wave security inspection instrument in detecting the metal category of contraband, and improving the accuracy of the millimeter wave security inspection instrument in detecting the contraband.
[0268] As an embodiment of the present application, the millimeter wave security inspection instrument and the metal detection door are integrated into one physical device.
[0269] The processing device is further configured to control the metal detection door to start working to obtain the second detection result of the detected object in the target defense area if the first detection result meets a preset acquisition condition; or,
[0270] The processing device is further configured to control the metal detection door to work continuously, and obtain the second detection result of the detected object in the target defense area if the first detection result meets a preset acquisition condition; wherein the preset acquisition condition is used to define a condition for triggering the acquisition of the second detection result.
[0271] The millimeter wave security inspection instrument and the metal detection door can be integrated into one physical device, in which case the millimeter wave security inspection instrument is continuously working, and the metal detection door can start working only if the first detection result of the target person detected by the millimeter wave security inspection instrument meets a preset acquisition condition, or can work continuously.
[0272] In the case where the metal detection door is not continuously working, the millimeter wave security inspection instrument of the physical device can detect the target person when the target person passes through the physical device to obtain the first detection result of the target person.
[0273] The processing device analyzes the first detection result, and controls the metal detection door to start detecting the target person to obtain the second detection result of the target person if the first detection result meets a preset acquisition condition.
[0274] The preset acquisition condition is used to define a condition for triggering acquisition of the second detection result, and can be reasonably configured according to actual detection requirements. For example, the preset acquisition condition can include that the first detection result indicates that the category of the detected article is a suspicious category, or that the security level requirement of the current security inspection scene is a target level and the first detection result indicates that the category of the detected article is a safe category, and the like, which are all reasonable and are not limited here.
[0275] The processing apparatus can determine first position information of the detected article carried by the target person on the millimeter wave scan image, determine a target defense zone corresponding to the first position information in the detection region of the metal detection door according to a correspondence relationship between the millimeter wave scan image and the detection region of the millimeter wave security inspection instrument and a position correspondence relationship between the detection region of the millimeter wave security inspection instrument and the detection region of the metal detection door, acquire a second detection result corresponding to the detected article in the target defense zone, and determine whether the detected article is contraband according to the first detection result and the second detection result.
[0276] In the case that the metal detection door is not continuously working, the millimeter wave security inspection instrument of the physical device can detect the target person when the target person passes through the physical device to obtain a first detection result of the target person, and the metal detection door starts to detect the target person to obtain a second detection result of the target person.
[0277] The processing apparatus can analyze the first detection result, and in the case that the first detection result meets a preset acquisition condition, determine first position information of the detected article carried by the target person on the millimeter wave scan image, determine a target defense zone corresponding to the first position information in the detection region of the metal detection door according to a correspondence relationship between the millimeter wave scan image and the detection region of the millimeter wave security inspection instrument and a position correspondence relationship between the detection region of the millimeter wave security inspection instrument and the detection region of the metal detection door, acquire a second detection result corresponding to the detected article in the target defense zone, and determine whether the detected article is contraband according to the first detection result and the second detection result.
[0278] It can be seen that, in the embodiments of the present application, the millimeter wave security inspection instrument and the metal detection door can be integrated into one physical device, and the processing apparatus controls the metal detection door to start working to acquire the second detection result corresponding to the detected article in the target defense zone in the case that the first detection result meets the preset acquisition condition, or controls the metal detection door to continuously work and acquires the second detection result corresponding to the detected article in the target defense zone in the case that the first detection result meets the preset acquisition condition. The working mode of the metal detection door in the physical device can be flexibly set according to actual detection requirements to adapt to various application scenarios and improve the efficiency of contraband detection.
[0279] As an implementation form of the embodiment of the present application, the millimeter wave security inspection instrument and the metal detection door are two independent physical devices, as shown in Figure 7 The security inspection system provided by the embodiment of the present application can further include a first passage gate 703.
[0280] The processing device is further configured to, in a case where the first detection result does not satisfy a preset acquisition condition and the first detection result indicates that the detected article is not of a dangerous category, control the first passage gate to release the target person passing through the millimeter wave security inspection instrument; and in a case where the first detection result satisfies the preset acquisition condition, control the first passage gate to enable the target person passing through the millimeter wave security inspection instrument to enter a detection area of the metal detection door; wherein the preset acquisition condition is used to define a condition for triggering acquisition of a second detection result.
[0281] The millimeter wave security inspection instrument and the metal detection door are two independent physical devices. The processing device, in a case where the first detection result does not satisfy a preset acquisition condition and the first detection result indicates that the detected article is not of a dangerous category, controls the first passage gate 703 to release the target person passing through the millimeter wave security inspection instrument 701; and in a case where the first detection result satisfies the preset acquisition condition, controls the first passage gate 703 to enable the target person passing through the millimeter wave security inspection instrument 701 to enter a detection area of the metal detection door 702, and performs the security inspection method described in any of the method embodiments to detect whether the detected article carried by the target person is contraband; wherein the preset acquisition condition is used to define a condition for triggering acquisition of a second detection result.
[0282] It can be seen that, in the embodiment of the present application, the first passage gate can be arranged in the security inspection system, so as to divert the personnel according to the first detection result, and improve the security inspection efficiency and the accuracy of the security inspection result.
[0283] As an implementation form of the embodiment of the present application, as shown in Figure 7 The security inspection system provided by the embodiment of the present application can further include a second passage gate 704.
[0284] The processing device is further configured to, in a case where it is determined that the target person carries contraband, control the second passage gate to enable the target person passing through the metal detection door to enter a manual security inspection area; or, in a case where it is determined that the target person does not carry contraband, control the second passage gate to release the target person passing through the metal detection door.
[0285] The processing device can, in a case where it is determined that the target person carries contraband, control the second passage gate 704 to enable the target person passing through the metal detection door 702 to enter a manual security inspection area; or, in a case where it is determined that the target person does not carry contraband, control the second passage gate 704 to release the target person passing through the metal detection door 702.
[0286] It can be seen that, in the embodiment of the present application, the second channel gate can be arranged in the security inspection system, so as to divert the personnel according to the detection result of the articles carried by each personnel, improve the passing efficiency, and improve the security inspection efficiency and the accuracy of the security inspection result.
[0287] In an implementation manner, as shown in Figure 7 The entrance of the millimeter wave security inspection instrument 701 can also be provided with a rotating gate, and matched with a snapshot camera (not shown in Figure 7 ) to ensure that one person passes through each time, and avoid errors in the detection result caused by multiple target personnel passing through the millimeter wave security inspection instrument at the same time.
[0288] In an implementation manner, an image acquisition device (optical camera) (not shown in Figure 7 ) can be installed at the entrance of the metal detection door 702. The image acquisition device is used to shoot the body image of the target personnel when passing through the metal detection door. The body posture information of the target personnel in the body image can be matched with the body posture information of the target personnel in the millimeter wave scanning image, the region where the same body part of the target personnel is located is determined as the corresponding region, and thus the position correspondence relationship between the detection region of the millimeter wave security inspection instrument and the detection region of the metal detection door is obtained.
[0289] In an implementation manner, a snapshot camera is installed at the entrance of the millimeter wave security inspection instrument 701 and the metal detection door 702. The personnel needs to swipe the face before passing through the door, and then pass through the door, so as to match and verify the information of the target personnel through the snapshot camera at the entrance of the millimeter wave security inspection instrument 701 and the metal detection door 702, and ensure that the same target personnel is detected.
[0290] In addition, based on the security inspection system provided in the embodiment of the present application, a first inspection personnel and a re-inspection personnel can be arranged at the entrance of the millimeter wave security inspection door and the manual security inspection area respectively, so as to efficiently utilize the security inspection system provided in the embodiment of the present application, and improve the security inspection efficiency.
[0291] Corresponding to the security inspection method, the embodiment of the present application further provides a security inspection device.
[0292] As shown in Figure 8 , a security inspection device, the device comprises:
[0293] The acquisition module 801 is configured to determine a first detection result of a target personnel according to a millimeter wave scanning image of the target personnel passing through a millimeter wave security inspection instrument, wherein the first detection result comprises first position information of a detected article carried by the target personnel on the millimeter wave scanning image and first category information of the detected article.
[0294] The first determining module 802 is configured to determine a target defense area corresponding to the first position information in a detection area of the metal detection door according to a correspondence between the millimeter wave scanning image and a detection area of the millimeter wave security inspection instrument and a position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door, wherein the detection area of the metal detection door can be divided into a plurality of defense areas.
[0295] The second determining module 803 is configured to obtain a second detection result corresponding to the detected article in the target defense area, wherein the second detection result includes at least one of metal intensity information corresponding to the detected article in the target defense area and second category information of the detected article.
[0296] The correcting module 804 is configured to correct the first category information of the detected article by using the second detection result to determine target category information of the detected article.
[0297] The third determining module 805 is configured to determine whether the detected article belongs to contraband according to the target category information.
[0298] In the technical scheme provided by the embodiments of the present application, the processing device can determine a first detection result of a target person according to a millimeter wave scanning image of the target person passing through a millimeter wave security inspection instrument, wherein the first detection result includes first position information of a detected article carried by the target person on the millimeter wave scanning image and first category information of the detected article; determine a target defense area corresponding to the first position information in a detection area of a metal detection door according to a correspondence between the millimeter wave scanning image and a detection area of the millimeter wave security inspection instrument and a position correspondence between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door, wherein the detection area of the metal detection door can be divided into a plurality of defense areas; obtain a second detection result corresponding to the detected article in the target defense area, wherein the second detection result includes at least one of metal intensity information corresponding to the detected article in the target defense area and second category information of the detected article; correct the first category information of the detected article by using the second detection result to determine target category information of the detected article; and determine whether the detected article belongs to contraband according to the target category information.
[0299] Since the metal material object will interfere with the magnetic field between the metal detection doors when passing through the metal detection doors, the metal detection doors can detect the metal material object more accurately than the millimeter wave security inspection instrument. The second detection result obtained by detecting the detected object by using the metal detection door corrects the first category information obtained by detecting the detected object by the millimeter wave security inspection instrument, and the obtained target category information can more accurately reflect whether the detected object belongs to each metal category, so that the processing device can more accurately determine whether the detected object is a metal category of contraband, thereby improving the accuracy of detecting the metal category of contraband by the millimeter wave security inspection instrument, and improving the accuracy of detecting the contraband by the millimeter wave security inspection instrument.
[0300] As an embodiment of the present application, the first determination module 802 can be specifically used for:
[0301] determining second position information corresponding to the first position information in a detection region of the metal detection door based on a correspondence relationship between the millimeter wave scanning image and the detection region of the millimeter wave security inspection instrument;
[0302] determining third position information corresponding to the second position information in the detection region of the metal detection door according to a position correspondence relationship between the detection region of the millimeter wave security inspection instrument and the detection region of the metal detection door;
[0303] determining a target defense zone corresponding to the first position information in the detection region of the metal detection door according to a position of the third position information in the detection region of the metal detection door;
[0304] or
[0305] determining fourth position information corresponding to a preset position point in the detection region of the metal detection door in the millimeter wave scanning image according to the position correspondence relationship between the detection region of the millimeter wave security inspection instrument and the detection region of the metal detection door and the correspondence relationship between the millimeter wave scanning image and the detection region of the millimeter wave security inspection instrument;
[0306] determining an image region matching the detection region of the metal detection door in the millimeter wave scanning image based on the fourth position information;
[0307] determining a target defense zone corresponding to the first position information in the detection region of the metal detection door according to a position of the first position information in the image region.
[0308] As an embodiment of the present application, the present application further provides a security inspection device, which further comprises:
[0309] The human body image acquisition module is configured to acquire a human body detection image of the target person passing through the metal detection door collected by the image collection device.
[0310] The matching relationship determination module is configured to determine a matching relationship between the human body detection image and the millimeter wave scanning image according to a similarity between body part features included in the human body detection image and body part features included in the millimeter wave scanning image.
[0311] The first corresponding relationship determination module is configured to determine a corresponding relationship between the human body detection image and the detection region of the metal detection door based on a positional relationship between the image collection device and the metal detection door.
[0312] The second corresponding relationship determination module is configured to determine a positional corresponding relationship between the detection region of the millimeter wave security inspection instrument and the detection region of the metal detection door according to a corresponding relationship between the millimeter wave scanning image and the detection region of the millimeter wave security inspection instrument, the corresponding relationship between the human body detection image and the detection region of the metal detection door, and the matching relationship.
[0313] As an implementation manner of the embodiment of the present application, the correction module 804 is specifically configured to:
[0314] determine an article material attention coefficient based on second category information of the detected article in the second detection result;
[0315] correct the first category information of the detected article by using the article material attention coefficient to determine target category information of the detected article;
[0316] or
[0317] determine a second adjustment parameter corresponding to the target defense area to adjust the second detection result, and correct the first category information of the detected article by using the adjusted second detection result to determine target category information of the detected article;
[0318] or
[0319] determine a first adjustment parameter corresponding to the first category information of the detected article to adjust the first category information of the detected article, and correct the adjusted first category information by using the second detection result to determine target category information of the detected article;
[0320] or
[0321] determine a first adjustment parameter corresponding to the first category information of the detected article, and determine a second adjustment parameter corresponding to the target defense area;
[0322] adjust the first category information of the detected object by using the first adjustment parameter, and adjust the second detection result by using the second adjustment parameter;
[0323] correct the adjusted first category information again by using the adjusted second detection result, to determine target category information of the detected object.
[0324] As an implementation form of the embodiment of the present application, the second adjustment parameter comprises a sensitivity corresponding to the target defense zone, and the correction module 804 is specifically configured to:
[0325] set the sensitivity corresponding to the target defense zone as a first sensitivity;
[0326] The embodiment of the present application also provides a security inspection device, which further comprises:
[0327] a setting module configured to set a sensitivity corresponding to a non-target defense zone as a second sensitivity, wherein the first sensitivity is greater than the second sensitivity.
[0328] As an implementation form of the embodiment of the present application, the correction module 804 is specifically configured to:
[0329] determine the category adjustment parameter based on second category information of the detected object in the second detection result and / or object category information included in a pre-set millimeter wave white list, wherein the category adjustment parameter represents a degree of attention to object categories in a current security inspection scene; and / or, determine the object material attention coefficient based on the second category information of the detected object in the second detection result, wherein the object material attention coefficient represents a degree of attention to metal objects of different materials.
[0330] As an implementation form of the embodiment of the present application, the first adjustment parameter comprises an object material attention coefficient and a category adjustment parameter, the second adjustment parameter comprises a sensitivity corresponding to the target defense zone, the first category information comprises a first confidence degree of the detected object belonging to an object category, and the second detection result comprises a metal strength value corresponding to the detected object in the target defense zone; and the correction module 804 is specifically configured to:
[0331] calculate a comprehensive confidence degree P of the detected object belonging to the object category according to the following formula fin (c), as the target category information of the detected object:
[0332] P fin (c)=M0×α(c)×P mmw (c)+β(m)×A metal (m);
[0333] wherein c is a number of the article category, a(c) is a category adjustment parameter corresponding to the article category c, P mmw (c) is a first confidence degree that the detected article belongs to the article category c, M0 is an article material attention coefficient corresponding to the detected article, m is a number of a target defense zone corresponding to a detection position of the detected article, β(m) is a sensitivity corresponding to the target defense zone m, A metal (m) is a metal strength value corresponding to the target defense zone m.
[0334] As an implementation manner of the embodiment of the present application, the second determination module 803 is specifically configured to:
[0335] In a case where the first detection result represents that the category of the detected article is a suspicious category, or in a case where the security level requirement of the current security inspection scene is a target level and the first detection result represents that the category of the detected article is a safe category, a second detection result corresponding to the detected article in the target defense zone is acquired.
[0336] In the technical solution provided by the embodiment of the present application, the operations of acquiring, storing, using, processing, transmitting, providing and disclosing the personal information of the target person are all performed after the authorization of the target person is obtained.
[0337] It should be noted that the security inspection data in the embodiment of the present application is from a public data set.
[0338] The embodiment of the present application further provides a processing device, as shown in Figure 9 The processing device comprises:
[0339] The memory 901 is configured to store a computer program.
[0340] The processor 902 is configured to execute the program stored in the memory 901, and implement the security inspection method in any of the above embodiments.
[0341] The control device can further comprise a communication bus and / or a communication interface, and the processor 902, the communication interface and the memory 901 can complete mutual communication through the communication bus.
[0342] The communication bus mentioned in the control device can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc. For the convenience of representation, only one thick line is shown in the figure, but it does not mean that there is only one bus or only one type of bus.
[0343] The communication interface is configured to communicate between the control device and other devices.
[0344] The memory can include a random access memory (RAM) and can also include a non-volatile memory (NVM), such as at least one disk memory. Optionally, the memory can also be at least one storage device located away from the aforementioned processor.
[0345] The aforementioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc. It can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component.
[0346] In another embodiment provided in the present application, a computer readable storage medium is provided, and the computer readable storage medium stores a computer program. The computer program is executed by a processor to implement the steps of any of the aforementioned security inspection methods.
[0347] In another embodiment provided in the present application, a computer program product containing instructions is provided, and when the computer program product is executed on a computer, the computer is caused to execute any of the aforementioned security inspection methods.
[0348] In the embodiments described above, all or some of the steps can be implemented by software, hardware or firmware, or any combination thereof. When implemented by software, all or some of the steps can be implemented in the form of one or more computer programs. The computer program can be stored in any computer readable medium, and loaded into the computer system for execution. The computer readable medium includes: a computer storage medium and a computer communication medium. The computer storage medium includes: volatile media (such as random access memory (RAM) and others) and non-volatile media (such as read-only memory (ROM), floppy disks, CD-ROMs, optical disks, hard disks, etc.). The computer communication medium includes: computer networks and other media.
[0349] It should be noted that, in this document, the terms such as first and second are used only to distinguish one entity or operation from another, and do not necessarily require or imply any actual such relationship or order between these entities or operations. In addition, the terms "comprise", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or other elements inherent to such a process, method, article or device. Without more limitations, the element defined by the statement "comprises a" does not exclude the presence of additional identical elements in the process, method, article or device that includes the element.
[0350] Each of the embodiments in the specification is described in a related manner, and the same or similar parts between each of the embodiments can be referred to each other. Each of the embodiments focuses on the difference from other embodiments. In particular, for system, device, processing device, computer readable storage medium and computer program product embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the part of the method embodiment.
[0351] The above merely provides the preferred embodiment of the present application, and not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. A security method, characterized by, The method comprises: determining a first detection result of the target person according to a millimeter wave scanning image of the target person passing through a millimeter wave security inspection instrument, wherein the first detection result comprises first position information of a detected article carried by the target person on the millimeter wave scanning image and first category information of the detected article; determining a target defense zone corresponding to the first position information in a detection area of a metal detection door according to a correspondence relationship between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument and a position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door, wherein the detection area of the metal detection door can be divided into multiple defense zones; obtaining a second detection result corresponding to the detected article in the target defense zone, wherein the second detection result comprises at least one of metal strength information corresponding to the detected article in the target defense zone and second category information of the detected article; correcting the first category information of the detected article by using the second detection result to determine target category information of the detected article; determining whether the detected article belongs to contraband according to the target category information.
2. The method of claim 1, wherein, The step of determining the target defense zone corresponding to the first position information in the detection area of the metal detection door according to the correspondence relationship between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument and the position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door comprises: determining second position information corresponding to the first position information in the detection area of the millimeter wave security inspection instrument based on the correspondence relationship between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument; determining third position information corresponding to the second position information in the detection area of the metal detection door according to the position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door; determining the target defense zone corresponding to the first position information in the detection area of the metal detection door according to the position of the third position information in the detection area of the metal detection door; or The step of determining the target defense zone corresponding to the first position information in the detection area of the metal detection door according to the correspondence relationship between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument and the position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door comprises: determining fourth position information corresponding to a preset position point in the detection area of the metal detection door in the millimeter wave scanning image according to the position correspondence relationship between the detection area of the millimeter wave security inspection instrument and the detection area of the metal detection door and the correspondence relationship between the millimeter wave scanning image and the detection area of the millimeter wave security inspection instrument; determining an image area matching the detection area of the metal detection door in the millimeter wave scanning image based on the fourth position information. According to the position of the first position information in the image region, a corresponding target defense zone of the first position information in a detection region of the metal detection door is determined.
3. The method of claim 2, wherein, The method further comprises: acquiring a human body detection image of the target personnel passing through the metal detection door collected by an image collection device; determining a matching relationship between the human body detection image and the millimeter wave scanning image according to a similarity between body part features included in the human body detection image and body part features included in the millimeter wave scanning image; determining a corresponding relationship between the human body detection image and a detection region of the metal detection door based on a positional relationship between the image collection device and the metal detection door; determining a positional corresponding relationship between the detection region of the millimeter wave security inspection instrument and the detection region of the metal detection door according to the corresponding relationship between the millimeter wave scanning image and the detection region of the millimeter wave security inspection instrument, the corresponding relationship between the human body detection image and the detection region of the metal detection door, and the matching relationship.
4. The method of claim 1, wherein, The step of correcting the first category information of the detected article by using the second detection result to determine the target category information of the detected article comprises: determining an article material attention coefficient based on the second category information of the detected article in the second detection result; correcting the first category information of the detected article by using the article material attention coefficient to determine the target category information of the detected article; or determining a second adjustment parameter corresponding to the target defense zone to adjust the second detection result, and correcting the first category information of the detected article by using the adjusted second detection result to determine the target category information of the detected article; or determining a first adjustment parameter corresponding to the first category information of the detected article to adjust the first category information of the detected article, and correcting the adjusted first category information by using the second detection result to determine the target category information of the detected article; or determining a first adjustment parameter corresponding to the first category information of the detected article, and determining a second adjustment parameter corresponding to the target defense zone; adjusting the first category information of the detected article by using the first adjustment parameter, and adjusting the second detection result by using the second adjustment parameter; correcting the adjusted first category information by using the adjusted second detection result to determine the target category information of the detected article.
5. The method of claim 4, wherein, The second adjustment parameter comprises a sensitivity corresponding to the target defense zone, and the step of determining the second adjustment parameter corresponding to the target defense zone comprises: setting the sensitivity corresponding to the target defense zone as a first sensitivity; The method further comprises: setting a sensitivity corresponding to a non-target defense zone as a second sensitivity, wherein the first sensitivity is greater than the second sensitivity.
6. The method of claim 4, wherein, The first adjustment parameter comprises an article material attention coefficient and / or a category adjustment parameter, and the step of determining the first adjustment parameter corresponding to the first category information of the detected article comprises: determine the category adjustment parameter based on the second category information of the detected item in the second detection result and / or the item category information included in the pre-set millimeter wave white list, wherein the category adjustment parameter represents the degree of attention to the item category in the current security check scene; and / or, determine the item material attention coefficient based on the second category information of the detected item in the second detection result, wherein the item material attention coefficient represents the degree of attention to the metal item of different materials.
7. The method of claim 4, wherein, The first adjustment parameter includes an item material attention coefficient and a category adjustment parameter, the second adjustment parameter includes a sensitivity corresponding to the target defense zone, the first category information includes a first confidence degree that the detected item belongs to an item category, and the second detection result includes a metal strength value corresponding to the detected item in the target defense zone. The method comprises the steps of: determining the first adjustment parameter corresponding to the first category information of the detected item and determining the second adjustment parameter corresponding to the target defense zone; adjusting the first category information of the detected item by using the first adjustment parameter and adjusting the second detection result by using the second adjustment parameter; The step of determining the target category information of the detected item by further correcting the adjusted first category information by using the adjusted second detection result comprises the steps of: The comprehensive confidence P that the detected item belongs to the item category is calculated according to the following formula fin (c) as the target category information of the detected item: P fin (c) = M0x a(c) x P mmw (c) + β(m) x A metal (m); wherein c is a number of the article category, a(c) is a category adjustment parameter corresponding to the article category c, P mmw (c) is a first confidence that the detected article belongs to the article category c, M0 is an article material attention coefficient corresponding to the detected article, m is a number of a target defense zone corresponding to a detection position of the detected article, β(m) is a sensitivity corresponding to the target defense zone m, A metal (m) is a metal strength value corresponding to the target defense zone m.
8. The method according to any one of claims 1 to 7, characterized in that, The step of obtaining the second detection result corresponding to the detected item in the target defense zone comprises the steps of: In a case where the first detection result represents that the category of the detected item is a suspicious category, or in a case where the security level requirement of the current security check scene is a target level and the first detection result represents that the category of the detected item is a safe category, the second detection result corresponding to the detected item in the target defense zone is obtained.
9. A security system, characterized by The system comprises a millimeter wave security inspection instrument, a metal detection door, and a processing device, wherein: the millimeter wave security inspection instrument and the metal detection door are respectively used to detect a target person, the millimeter wave security inspection instrument and the metal detection door are integrated into one physical device, or the millimeter wave security inspection instrument and the metal detection door are two independent physical devices; The processing device is configured to perform the method of any one of claims 1-8.
10. The system of claim 9, wherein, The millimeter wave security inspection instrument and the metal detection door are integrated into one physical device. The processing device is further configured to control the metal detection door to start working to obtain the second detection result corresponding to the detected item in the target defense zone in a case where the first detection result meets a pre-set obtaining condition; or, The processing device is further configured to control the metal detection door to continuously work, and obtain the second detection result corresponding to the detected item in the target defense zone in a case where the first detection result meets a pre-set obtaining condition. The pre-set obtaining condition is used to define a condition for triggering the obtaining of the second detection result.
11. The system of claim 9, wherein, The millimeter wave security inspection instrument and the metal detection door are two independent physical devices, and the system further comprises a first channel gate. The processing device is further configured to, in a case where the first detection result does not satisfy a preset acquisition condition and the first detection result indicates that the detected article is not of a dangerous category, control the first channel gate to release a target person passing through the millimeter-wave security inspection instrument. In a case where the first detection result satisfies the preset acquisition condition, control the first channel gate to enable the target person passing through the millimeter-wave security inspection instrument to enter a detection area of the metal detection door. The preset acquisition condition is used to define a condition for triggering acquisition of a second detection result.
12. The system according to any of claims 9-11, characterized in that, The system further comprises a second channel gate. The processing device is further configured to, in a case where it is determined that the target person carries contraband, control the second channel gate to enable the target person passing through the metal detection door to enter a manual security inspection area; or, in a case where it is determined that the target person does not carry contraband, control the second channel gate to release the target person passing through the metal detection door.
Citation Information
Patent Citations
Millimeter wave security check cabin system and security check method
CN110297281A
Millimeter wave imaging safety inspection equipment
CN111323845A
Advancing millimeter wave active and passive composite imaging method
CN111880178A
Plane millimeter wave human body security check device and method capable of achieving rapid scanning
CN113552647A
Improved metal-detector means for locating the presence of metallic objects
CN113646665A