Millimeter wave human body security inspection system and method
By setting up a display device and an audio device in the millimeter-wave human security check system, and displaying and guiding designated postures to the person being inspected, the problem of low traffic efficiency in the prior art is solved and the traffic efficiency of the security check system is improved.
Patent Information
- Application Number
- CN202011178188.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-10-28
- Publication Date
- 2025-03-28
- Estimated Expiration
- 2040-10-28
AI Technical Summary
The existing millimeter-wave human security inspection system requires the inspected person to maintain a specific posture during the inspection, resulting in low traffic efficiency and the inspected person needs to adjust his standing posture, which increases the inspection time.
By setting a first display device at the entrance of the inspection channel, the person being inspected displays the desired designated posture information, and a second display device is set up in the inspection channel to display information related to the designated posture, and providing voice guidance with the audio device to help the person being inspected to correctly position the position.
By displaying the specified posture information and voice guidance in advance, the time for the person being inspected to adjust the standing posture in the inspection channel is reduced, and the efficiency of security inspection is improved.
Smart Images

Figure CN114415252B_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present disclosure generally relate to the field of security inspection, and more particularly to a millimeter wave human body security inspection system and method capable of improving the security inspection pass rate. Background Art
[0002] In order to ensure public safety, security inspections in important public places are a necessary measure. Currently, the most widely used imaging security inspection technologies are mainly X-ray imaging technology and millimeter wave imaging technology. Millimeter wave detection imaging technology has many advantages, such as it is non-ionizing radiation and will not cause harm to the human body during use, it can penetrate human clothing and identify various types of metal and non-metallic contraband. In recent years, with the development of millimeter wave technology and the reduction of device costs, millimeter wave imaging has begun to be widely used in the field of human security inspection.
[0003] Although the millimeter wave security scanner has a series of advantages over the metal detector, there are still problems such as the inspected person needs to be scanned while standing still, which leads to low efficiency. In actual security inspection, the conventional active millimeter wave imaging system requires the inspected person to stand in front of the security scanner for a certain period of time or turn in a specific posture. Although it can ensure a high recognition rate, it requires the inspected person to constantly adjust his posture and stay in the inspection channel for a long time, which limits the pass rate. Summary of the invention
[0004] The present disclosure is proposed to overcome at least one of the above and other problems and drawbacks of the prior art.
[0005] According to one aspect of the present disclosure, a millimeter wave body security inspection method is proposed, comprising: before a person being inspected enters an inspection channel defined by a millimeter wave body security scanner, displaying to the person being inspected information related to a specified posture that is expected to be taken when undergoing a scanning inspection by the millimeter wave body security scanner through a first display device; guiding the person being inspected to enter the inspection channel and stand at a specified standing position in the inspection channel in a posture that is substantially consistent with the specified posture; the millimeter wave body security scanner scans the person being inspected to obtain millimeter wave scanning data of the person being inspected; and a workstation reconstructs a millimeter wave scanning image of the person being inspected, confirms the standing posture, and identifies suspected items based on the millimeter wave scanning data.
[0006] In some embodiments, the first display device is disposed at the top of the millimeter wave body security scanner so that the inspected person can see the information displayed by the first display device before entering the inspection channel.
[0007] In some embodiments, at least one of a designated posture video, designated posture prompt text, and a designated posture picture is displayed to the person being examined via the first display device.
[0008] In some embodiments, the method further includes displaying information related to the designated posture to the inspected person standing at a designated standing position via a second display device in the inspection channel.
[0009] In some embodiments, a second display device displays an image of a puppet in a specified posture, and the method further includes: acquiring a visible light image of the person being inspected standing in the specified standing position in the said posture, and displaying the visible light image on the second display device to guide the person being inspected to adjust his standing posture according to the comparison between the visible light image and the image of the puppet in the specified posture.
[0010] In some embodiments, the method further includes: guiding the person being examined to view the information displayed on the first display device and / or guiding the person being examined to stand at a designated standing position in a posture substantially consistent with the designated posture by voice prompts through an audio device.
[0011] In some embodiments, whether the standing posture of the person being examined meets the requirement of the specified posture is determined based on the reconstructed millimeter wave scanning image.
[0012] In some embodiments, the method further includes: after determining that the standing posture of the inspected person meets the requirements of the specified posture, guiding the inspected person to leave the inspection channel; and while the inspected person leaves the inspection channel, analyzing the reconstructed millimeter wave scanning image to identify whether the inspected person is carrying any suspicious items.
[0013] In some embodiments, the method further includes: performing millimeter wave scanning image reconstruction, posture confirmation, and suspicious object identification of the inspected person by a graphics processor at the workstation.
[0014] In some embodiments, the method further comprises:
[0015] Acquire a first scan data set of the front side and a second scan data set of the back side of the person to be examined, wherein the column direction of the first scan data set and the second scan data set coincides with the height direction of the person to be examined;
[0016] superimposing the first scan data set along the row direction of the first scan data set to obtain a column of first superimposed data represented by Y1, and superimposing the second scan data set along the row direction of the second scan data set to obtain a column of second superimposed data represented by Y2;
[0017] The first superimposed data Y1 and the second superimposed data Y2 are cross-correlated according to the following formula:
[0018] ,
[0019] wherein t is a height corresponding to the first superimposed data Y1 or the second superimposed data Y2; and
[0020] Pick The maximum corresponding The value of is used as the height difference between the first scanning data set and the second scanning data set, and the first scanning data set and the second scanning data set are registered based on the height difference to reconstruct the millimeter wave scanning image of the person being examined.
[0021] According to an embodiment of another aspect of the present disclosure, a millimeter wave human body security inspection system is provided, comprising: a millimeter wave human body security inspection instrument, which defines an inspection channel and is configured to scan and inspect a person being inspected standing at a designated standing position in the inspection channel to obtain millimeter wave scanning data of the person being inspected; a first display device, which is set at a position that the person being inspected can see before entering the inspection channel and is configured to display to the person being inspected information related to a designated posture that is expected to be taken when undergoing a scanning inspection by the millimeter wave human body security inspection instrument; and a workstation, which is configured to perform millimeter wave scanning image reconstruction, standing posture confirmation, and suspected object identification of the person being inspected based on the millimeter wave scanning data.
[0022] In some embodiments, the first display device is disposed at the top of the millimeter wave human body security detector to face the inspected person who will enter the inspection channel.
[0023] In some embodiments, the first display device is respectively disposed at two opposite tops of the millimeter wave body security detector in the direction of passage of the inspected person.
[0024] In some embodiments, the first display device is configured to display at least one of a designated posture video, designated posture prompt text, and a designated posture picture to the person being examined.
[0025] In some embodiments, the millimeter wave human body security inspection system further includes a second display device, which is disposed in the inspection channel to display information related to the designated posture to the inspected person standing at a designated standing position.
[0026] In some embodiments, the millimeter wave human body security inspection system further includes a visible light imaging device, which is configured to obtain a visible light image of the inspected person standing in the specified standing position with the said standing posture, and the second display device is configured to display the specified posture puppet image and the said visible light image to guide the inspected person to adjust his standing posture according to the comparison between the visible light image and the specified posture puppet image.
[0027] In some embodiments, the millimeter wave body security inspection system also includes an audio device, which is configured to guide the inspected person to watch the information displayed on the first display device and / or guide the inspected person to stand at a designated standing position in a posture substantially consistent with the designated posture through voice prompts.
[0028] In some embodiments, the workstation is configured to determine whether the standing posture of the person being examined meets the requirement of the specified posture based on the reconstructed millimeter wave scanning image.
[0029] In some embodiments, the millimeter wave body security inspection system is configured to guide the inspected person to leave the inspection channel with at least one of voice prompts and visual prompts after determining that the inspected person's standing posture meets the requirements of the specified posture; and the workstation is configured to analyze the reconstructed millimeter wave scanning image to identify whether the inspected person is carrying suspicious items at the same time as the inspected person leaves the inspection channel.
[0030] In some embodiments, the workstation includes a graphics processor configured to perform millimeter wave scanning image reconstruction, posture confirmation, and suspicious object identification of the inspected person.
[0031] In some embodiments, the millimeter wave body security detector includes:
[0032] a first millimeter wave scanning unit and a second millimeter wave scanning unit located at opposite sides of the inspection passage along a horizontal direction perpendicular to the direction in which the inspected person passes through the inspection passage, the first millimeter wave scanning unit and the second millimeter wave scanning unit being configured to respectively perform millimeter wave scanning on the front and back of the inspected person standing at the designated standing position in a posture consistent with the designated posture, so as to obtain a first scanning data set of the front side and a second scanning data set of the back side of the inspected person, wherein the column direction of the first scanning data set and the second scanning data set coincide with the height direction of the inspected person; and
[0033] The workstation is further configured to:
[0034] superimposing the first scan data set along the row direction of the first scan data set to obtain a column of first superimposed data represented by Y1, and superimposing the second scan data set along the row direction of the second scan data set to obtain a column of second superimposed data represented by Y2;
[0035] The first superimposed data Y1 and the second superimposed data Y2 are cross-correlated according to the following formula:
[0036] ,
[0037] Wherein t is the height corresponding to the first superimposed data Y1 or the second superimposed data Y2;
[0038] Pick The maximum corresponding The value of is used as the height difference between the first scanning data set and the second scanning data set, and the first scanning data set and the second scanning data set are registered based on the height difference to reconstruct the millimeter wave scanning image of the person being examined.
[0039] Other objects and advantages of the present disclosure will be apparent from the following detailed description of the present disclosure with reference to the accompanying drawings, and will help to have a comprehensive understanding of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] The features and advantages of the present disclosure can be more clearly understood by referring to the accompanying drawings, which are schematic and should not be construed as limiting the present disclosure in any way. In the accompanying drawings:
[0041] Figure 1 A perspective view showing the structure of a millimeter wave human body security detector according to an exemplary embodiment of the present disclosure;
[0042] Figure 2 A block diagram showing the arrangement of a millimeter wave human body security inspection system according to an exemplary embodiment of the present disclosure;
[0043] Figure 3 A schematic diagram showing the distribution of human body security inspection time according to an exemplary embodiment of the present disclosure;
[0044] Figure 4 A flowchart showing a millimeter wave human body security inspection method according to an embodiment of the present disclosure;
[0045] Figure 5 A flowchart showing a millimeter wave human body security inspection method according to a specific example of the present disclosure; and
[0046] Figure 6 The flowchart is a method for registering scan data according to a specific example of the present disclosure. DETAILED DESCRIPTION
[0047] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.
[0048] In addition, in the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may be implemented without these specific details. In other cases, well-known structures and devices are embodied in a schematic manner to simplify the drawings.
[0049] Figure 1 Schematically illustrating a human body imaging device for security inspection according to an exemplary embodiment of the present disclosure, Figure 2The figure schematically shows the arrangement of a human body security inspection system according to an exemplary embodiment of the present disclosure, the security inspection system comprising Figure 1 The human body imaging device shown in FIG. The human body imaging device is, for example, a millimeter wave human body security detector 100, which is used to scan and inspect the body of the inspected person to obtain a millimeter wave human body image or corresponding millimeter wave scanning data. Figure 3 As shown, the scanning time is T1, which depends on the specific operation of different types of millimeter wave body security detectors, for example, it can be about 2 seconds. For example, the millimeter wave body security detector can be based on passive or passive millimeter wave imaging technology, by collecting the millimeter wave radiation of the target itself or by collecting the millimeter waves reflected or scattered by the target to achieve imaging. Exemplarily, the millimeter wave body security detector may include a millimeter wave transceiver, such as a millimeter wave antenna array for transmitting and receiving millimeter wave signals and a millimeter wave transceiver associated with the millimeter wave antenna array.
[0050] Millimeter wave human body security detectors can be divided into cylindrical scanning systems, plane scanning systems and area array scanning systems. In the illustrated embodiment, the millimeter wave human body security detector 100 is in the form of a security gate, which defines an inspection channel 101, and the inspected person stands at a designated standing position in the inspection channel 101 in a suitable posture to receive a security check. For example, the millimeter wave human body security detector may include a linear array plane up and down scanning type security gate, a linear array plane left and right scanning type security gate, a folded line array up and down scanning security gate, or a linear array turntable rotating security gate, an arc or cylindrical scanning security gate, and accordingly, the millimeter wave human body security detector may have different forms of scanning surfaces for scanning the body of the inspected person, such as the plane array scanning surface 110 illustrated in the figure.
[0051] In such Figure 1 In the illustrated embodiment, the millimeter wave body scanner in the form of a security gate includes a first millimeter wave scanning unit and a second millimeter wave scanning unit arranged relatively to each other, such as a millimeter wave transceiver or a detector array, which are located on opposite sides of the inspection channel along a horizontal direction perpendicular to the direction in which the inspected person passes through the inspection channel 101, and are used to perform millimeter wave scanning on the front and back of the inspected person who is standing at a designated standing position in the inspection channel 101 in a posture consistent with the designated posture, so as to obtain a first scanning data set of the front side and a second scanning data set of the back side of the inspected person. The first scanning data set and the second scanning data set can be, for example, in the form of two-dimensional data matrices, respectively, whose column direction coincides with the height direction of the inspected person.
[0052] The security inspection system also includes a workstation 200, such as an operation terminal set in a central control room or an operation console, which can be implemented by a computer, for example. The workstation can reconstruct the millimeter wave scanning image of the inspected person based on the obtained millimeter wave scanning data, confirm the standing posture of the inspected person, analyze the millimeter wave scanning image to identify whether the inspected person is carrying suspicious items or prohibited items, etc. The workstation 200 itself has a processor 210, such as a central processing unit (CPU), which is used to perform routine operations of the workstation; the millimeter wave scanning image, standing posture confirmation results and / or suspicious object identification results can be displayed on the display 230 of the workstation 200 itself. Figure 3 As shown, the image reconstruction time is T2, and the image analysis time is T3, which depends on the data processing performance of the workstation. Exemplarily, a graphics card including a GPU (graphics processor) 220 can be used to accelerate the scanning image reconstruction and / or image analysis.
[0053] In some examples, image analysis includes posture confirmation, suspect identification, etc., that is, it can be confirmed based on the reconstructed millimeter wave scanning image whether the posture of the inspected person when receiving the scanning inspection meets the requirements of the specified posture. In other examples, as an alternative or supplement, it can also be judged based on the visible light image of the inspected person (for example, obtained by a separately set imaging device such as a camera) whether the standing posture of the inspected person when receiving the inspection meets the requirements of the specified posture. It can be judged in a variety of ways, such as manual or automatic mode, based on the image of the inspected person to determine whether his standing posture is correct or meets the requirements of the specified posture. For example, it can be judged whether the difference (such as the graphic boundary difference) between the puppet image corresponding to the specified posture and the image of the inspected person (such as the millimeter wave scanning image or the visible light image) is within a predetermined threshold range. In the manual mode, the operator can manually judge whether the standing posture of the inspected person meets the requirements of the specified posture based on the standing posture of the inspected person at the specified standing position itself, or based on the image of the inspected person's standing posture, such as based on the display of these images on the display 230. As an alternative or supplement, it can also be judged in an automatic mode, for example, with the help of a processor, whether the standing posture of the inspected person meets the requirements of the specified posture. As an alternative or supplement, before the millimeter wave body security detector scans the body of the inspected person in a standing posture, it can be determined whether the standing posture of the inspected person meets the requirements of the specified posture.
[0054] In actual security inspections, millimeter wave imaging systems usually require the inspected person to accept security inspections in a specific posture. Different inspected persons have different understandings of the correct standing posture and need different amounts of time to assume the correct standing posture, resulting in the inspected person having to spend a considerable amount of time Tx before the formal scan (see Figure 3) to adjust their standing posture. The security inspection system according to the embodiment of the present disclosure also includes a first display device 120, which is set at a position that the inspected person can see before entering the inspection channel 101, and displays to the inspected person information related to the specified posture that is expected to be taken when undergoing a scanning inspection by the millimeter-wave body security scanner. Therefore, when the inspected person is queuing, waiting for inspection, or when other inspected persons are being inspected, he can watch the information displayed on the first display device 120, understand and learn the correct scanning standing posture in advance, and after entering the inspection channel 101 and standing in the designated standing position, he can immediately take a posture that is basically consistent with or consistent with the designated standing posture, thereby reducing the probability of the inspected person's standing posture being wrong and greatly shortening the standing posture adjustment time Tx.
[0055] The first display device can be set at any suitable position that the inspected person can see before entering the inspection channel 101. In the illustrated embodiment, the first display device 120 is set at the top of the millimeter wave body security detector 100, above the entrance of the inspection channel 101, so as to face the inspected person who will enter the inspection channel. Alternatively, the first display device can also be set on the side frame of the security door. In some examples, in the direction of passage of the inspected person, the first display device is respectively arranged at two opposite tops of the millimeter wave body security detector, and the inspected person can see the information related to the specified posture displayed on the first display device before entering the security channel from either side of the security detector, so that the same millimeter wave body security detector can realize forward and reverse inspection and passage, improve the flexibility of the arrangement and operation of the security detector, and improve the security inspection efficiency.
[0056] The first display device can display information related to the designated posture to the person being examined in various ways, such as playing a designated posture video or animation, displaying designated posture prompt text or designated posture pictures, etc. For example, these information can be displayed in different areas 121, 122, and 123 of the first display device. The first display device can include a display screen, such as an LCD or LED display, and can also include various graphics, image indicators / indicators, etc.
[0057] like Figure 1As shown, the security inspection system may also include a second display device 130, which may be arranged in the inspection channel, such as being located on the scanning surface 110, to display information related to the designated posture to the inspected person standing at the designated standing position, such as a puppet image of the designated posture, so that the inspected person can further clarify the requirements of the designated posture. In some examples, a visible light imaging device (not shown) may also be provided, such as a camera, which is used to obtain a visible light image of the inspected person standing at a designated standing position in the inspection channel 101 in a standing posture, and the visible light image may be displayed or projected on the second display device 130, so as to guide the inspected person to adjust his standing posture according to the comparison between the visible light image and the puppet image of the designated posture, so that the standing posture that meets the requirements of the designated posture can be quickly set, further shortening the standing posture adjustment time. In addition, the obtained visible light image may also be transmitted to a workstation or an operator terminal, so that the operator can confirm whether the standing posture of the inspected person meets the requirements of the scanning inspection based on the visible light image or based on both the visible light image and the reconstructed millimeter wave scanning image.
[0058] In some embodiments, the millimeter wave human body security inspection system may further include an audio device 300, such as a speaker, which is used to guide the inspected person to watch the information displayed by the first display device 120 in the form of voice prompts, and / or guide the inspected person to stand at a designated standing position in the inspection channel in a standing posture that is substantially consistent with the designated posture, thereby further shortening the standing posture adjustment time. In addition, the audio device 300 communicates with the workstation or the operator terminal, and can play prompt information to the inspected person with the help of the audio device 300 as needed, such as guiding the inspected person to watch the information displayed by the first display device 120, reminding the inspected person to enter the inspection channel as soon as possible, guiding the inspected person to take a suitable standing posture and scanning precautions in the inspection channel, reminding the scanning to be completed, guiding the inspected person to leave the inspection channel as soon as possible, and guiding the inspected person to the hand inspection station 400 to accept subsequent further inspections when necessary, etc., so as to shorten the time spent by the inspected person in receiving security inspections as much as possible.
[0059] In some embodiments, Figure 1 As shown, the millimeter wave human body security inspection system can also have a trigger device 140, which is, for example, set at the entrance of the security door or the entrance of the inspection channel 101. When the inspected person enters the inspection channel, the trigger device is triggered or activated, which can prompt the audio device 300 to play a voice prompt and / or prompt the second display device 130 to display information related to the specified posture, and guide the inspected person's standing posture, such as guiding the inspected person to watch the information displayed by the second display device 130, so that the inspected person stands at the designated standing position in the inspection channel with a standing posture that is basically consistent with the specified posture, thereby further shortening the standing posture adjustment time. As an example, the trigger device can be an infrared beam switch or a similar form.
[0060] If the inspected person's standing posture is wrong or does not meet the requirements of the specified posture, the security inspection system guides the inspected person to adjust his standing posture (such as with the help of the above-mentioned display device and / or audio device), and re-performs millimeter wave scanning, image reconstruction and standing posture confirmation. According to an embodiment of the present disclosure, after determining that the inspected person's standing posture meets the requirements of the specified posture, the security inspection system guides the inspected person to leave the inspection channel, for example, with at least one of voice prompts and visual prompts, and the workstation analyzes the reconstructed millimeter wave scanning image to identify whether the inspected person is carrying suspicious items at the same time as the inspected person leaves the inspection channel, that is, the inspected person walks out of the inspection channel and the workstation performs image analysis to identify suspicious items at the same time, so that the inspected person does not need to wait for the suspicious object identification time in the inspection channel, and further reduces the inspected person's stay time in the inspection channel, and the next inspected person can enter the inspection channel and stand properly, thereby improving the traffic efficiency of the entire security inspection system.
[0061] "Image reconstruction" is to reconstruct the acquired binary scan data into a visual image. In some cases, when the scanning units on both sides of the security scanner respectively acquire the scan data of the front and back of the inspected person, the heights of the inspected person corresponding to the front and back scan data may be inconsistent. The front and back scan data can be aligned for further analysis. In some embodiments of the present disclosure, in addition to utilizing a graphics card including a GPU (graphics processor) to accelerate scan image reconstruction and / or image analysis, the following data alignment method is also provided to further accelerate image reconstruction.
[0062] Exemplarily, at the workstation, the scan data is subjected to registration processing. Figure 6 As shown, the following operations can be performed by the workstation or its GPU:
[0063] First, the first scan data set is superimposed along the row direction of the first scan data set of the front side of the inspected person to obtain a column of first superimposed data Y1, and the second scan data set is superimposed along the row direction of the second scan data set of the back side of the inspected person to obtain a column of second superimposed data Y2; for example, such superimposition may be superimposition of data of the same row in each scan data set, and the column of superimposed data formed is a one-dimensional data column;
[0064] Then, a cross-correlation operation, such as a convolution operation, is performed on the obtained first superimposed data Y1 and second superimposed data Y2 according to the following formula:
[0065] ,
[0066] Where t is the height corresponding to the first superimposed data Y1 or the second superimposed data Y2, may represent a height difference between scan data in the first scan data set and corresponding scan data in the second scan data set;
[0067] Pick The maximum corresponding The value of is used as the height difference between the first scanning data set and the second scanning data set, and the first scanning data set and the second scanning data set are registered based on the height difference to reconstruct the millimeter wave scanning image of the person being examined.
[0068] By adopting this simple and feasible registration method, the scanning data of the front and back of the person being examined can be quickly registered, further shortening the image reconstruction time.
[0069] The embodiments of the present disclosure also provide a human body security inspection method, which can be based on millimeter wave human body scanning, for example, can be implemented by the above-mentioned human body security inspection system, which can reduce the time that the inspected person stays in the inspection channel and improve traffic efficiency. Figure 4 and 5 The flowchart of the millimeter wave human body security inspection method according to the exemplary embodiment of the present disclosure is respectively illustrated. The method mainly includes the following steps:
[0070] S10: before the inspected person enters the inspection channel defined by the millimeter wave body scanner, for example, by means of a first display device, information related to a designated posture that the inspected person is expected to take when being scanned by the millimeter wave body scanner is displayed to the inspected person;
[0071] S11: guiding the person to be inspected to enter the inspection passage and stand at a designated standing position in the inspection passage in a posture substantially consistent with the designated posture.
[0072] S12: The millimeter wave body security detector scans the inspected person to obtain millimeter wave scanning data of the inspected person;
[0073] S13: The workstation performs a variety of operations based on the millimeter wave scanning data, such as reconstructing the millimeter wave scanning image of the inspected person, confirming whether the standing posture of the inspected person when being scanned meets the requirements of the specified posture, and identifying whether the inspected person is carrying suspicious items; these operations can be accelerated by, for example, a graphics processing unit (GPU) at the workstation.
[0074] In order to further shorten the image reconstruction time, Figure 6 As shown, the following data registration operations can be performed by the workstation or its GPU:
[0075] Superimpose the first scan data set along the row direction of the first scan data set on the front of the inspected person to obtain a column of first superimposed data Y1, and superimpose the second scan data set along the row direction of the second scan data set on the back of the inspected person to obtain a column of second superimposed data Y2;
[0076] A cross-correlation operation, such as a convolution operation, is performed on the first superimposed data Y1 and the second superimposed data Y2 obtained according to the following formula:
[0077] ,
[0078] Where t is the height corresponding to the first superimposed data Y1 or the second superimposed data Y2, may represent a height difference between scan data in the first scan data set and corresponding scan data in the second scan data set;
[0079] Pick The maximum corresponding The value of is used as the height difference between the first scanning data set and the second scanning data set, and the first scanning data set and the second scanning data set are registered based on the height difference to reconstruct the millimeter wave scanning image of the person being examined.
[0080] When it is determined that the person being inspected is suspected of carrying prohibited items, the result can be displayed to the operator and an alarm can be issued if necessary to guide the person being inspected suspected of carrying prohibited items to undergo further inspection, such as manual inspection at a manual inspection station; when it is determined that the person being inspected is not carrying prohibited items, the person being inspected can be allowed to pass, and then the security check of the next person being inspected can be continued.
[0081] The first display device can be set on the millimeter wave body scanner, at the top of the device, above the entrance to the inspection channel, so that the inspected person can see the information displayed on the first display device before entering the inspection channel. The first display device can show the inspected person a video of a designated posture, a designated posture prompt text, a designated posture picture, etc. Thus, the inspected person can watch the information displayed on the first display device while queuing, waiting for inspection, or when other inspected persons are being inspected, and understand and learn the correct scanning posture in advance. After entering the inspection channel and standing at the designated standing position, the person can immediately adopt a posture that is basically consistent with or in line with the designated posture, thereby reducing the probability of the inspected person making an error in his or her standing posture and greatly shortening the posture adjustment time.
[0082] Furthermore, when the person under inspection is located in the inspection channel, information related to the specified posture can also be displayed to the person under inspection standing at the specified standing position through the second display device. For example, the second display device can display an image of a puppet in a specified posture, and can also obtain a visible light image of the person under inspection standing at the specified standing position, and display the visible light image on the second display device to guide the person under inspection to adjust his or her standing posture based on the comparison between the visible light image and the puppet image in the specified posture. In some examples, as an aid, the person under inspection can also be guided to view the information displayed by the first display device in the form of voice prompts, and / or guide the person under inspection to stand at the specified standing position in a posture that is substantially consistent with the specified posture.
[0083] As described above, it can be determined whether the standing posture of the inspected person meets the requirements of the specified posture based on the reconstructed millimeter wave scanning image, based on the separately acquired visible light image of the standing posture of the inspected person, or both. In some embodiments of the present disclosure, after determining that the standing posture of the inspected person meets the requirements of the specified posture, the inspected person is guided to leave the inspection channel; and while the inspected person leaves the inspection channel, the reconstructed millimeter wave scanning image is analyzed to identify whether the inspected person is carrying a suspicious object, so that the inspected person does not need to wait for the suspicious object identification time in the inspection channel, reducing the inspected person's stay time in the inspection channel, and improving the traffic efficiency of the entire security inspection system.
[0084] While embodiments of the present disclosure have been shown and described, it will be appreciated by those skilled in the art that changes may be made to these embodiments without departing from the principles and spirit of the disclosure, the scope of which is defined by the appended claims and their equivalents.
Claims
1. A millimeter wave human body security inspection method, comprising: Before the inspected person enters the inspection channel defined by the millimeter wave body security scanner, the first display device is used to display information related to the designated posture that the inspected person is expected to take when being scanned by the millimeter wave body security scanner; Instructing the inspected person to enter the inspection passage and stand at a designated standing position in the inspection passage in a posture substantially consistent with the designated posture; The millimeter wave body scanner performs a scanning inspection on the inspected person to obtain millimeter wave scanning data of the inspected person, including obtaining a first scanning data set of the front side and a second scanning data set of the back side of the inspected person, wherein the column direction of the first scanning data set and the second scanning data set coincides with the height direction of the inspected person; as well as The workstation reconstructs the millimeter wave scanning image of the inspected person, confirms the standing posture, and identifies the suspected object based on the millimeter wave scanning data. The millimeter wave human body security inspection method further includes: superimposing the first scan data set along the row direction of the first scan data set to obtain a column of first superimposed data represented by Y1, and superimposing the second scan data set along the row direction of the second scan data set to obtain a column of second superimposed data represented by Y2; The first superimposed data Y1 and the second superimposed data Y2 are cross-correlated according to the following formula: , wherein t is a height corresponding to the first superimposed data Y1 or the second superimposed data Y2; and Pick The maximum corresponding The value of is used as the height difference between the first scanning data set and the second scanning data set, and the first scanning data set and the second scanning data set are registered based on the height difference to reconstruct the millimeter wave scanning image of the examined person.
2. The millimeter wave human body security inspection method according to claim 1, wherein the first display device is arranged at the top of the millimeter wave human body security inspection device so that the inspected person can see the information displayed by the first display device before entering the inspection channel.
3. The millimeter wave human body security inspection method according to claim 1, wherein at least one of a designated posture video, designated posture prompt text and a designated posture picture is displayed to the inspected person through a first display device.
4. The millimeter wave human body security inspection method according to any one of claims 1 to 3, further comprising: In the inspection channel, information related to the designated posture is displayed to the inspected person standing at the designated standing position through the second display device.
5. The millimeter wave human body security inspection method according to claim 4, wherein the second display device displays the image of the puppet in the specified posture, and the millimeter wave human body security inspection method further comprises: A visible light image of the person under inspection standing at the designated standing position in the standing posture is acquired, and the visible light image is displayed on the second display device to guide the person under inspection to adjust his standing posture according to the comparison between the visible light image and the image of the puppet in the designated posture.
6. The millimeter wave human body security inspection method according to any one of claims 1 to 3 and 5, further comprising: The audio device is used to guide the person under examination to watch the information displayed on the first display device and / or guide the person under examination to stand at a designated standing position in a posture substantially consistent with the designated posture by voice prompts.
7. The millimeter wave human body security inspection method according to any one of claims 1-3 and 5, wherein whether the standing posture of the inspected person meets the requirement of the specified posture is determined based on the reconstructed millimeter wave scanning image.
8. The millimeter wave human body security inspection method according to any one of claims 1 to 3 and 5, further comprising: After determining that the standing posture of the person under inspection meets the requirements of the specified posture, guiding the person under inspection to leave the inspection channel; as well as When the inspected person leaves the inspection channel, the reconstructed millimeter wave scanning image is analyzed to identify whether the inspected person is carrying any suspicious items.
9. The millimeter wave human body security inspection method according to any one of claims 1 to 3 and 5, further comprising: At the workstation, a graphics processing unit (GPU) is used to reconstruct the millimeter wave scanning image of the person being inspected, confirm his / her standing posture, and identify suspected objects.
10. A millimeter wave human body security inspection system, comprising: A millimeter wave human body security detector (100), the millimeter wave human body security detector defining an inspection channel (101) and configured to scan and inspect an inspected person standing at a designated standing position in the inspection channel to obtain millimeter wave scanning data of the inspected person; A first display device (120), the first display device being arranged at a position visible to the inspected person before entering the inspection channel, and being configured to display to the inspected person information related to a designated posture that is expected to be taken when being scanned by the millimeter wave body scanner; and A workstation (200) is configured to reconstruct a millimeter wave scanning image of the inspected person, confirm his / her standing posture, and identify suspected objects based on the millimeter wave scanning data. Among them, millimeter wave body security detectors include: a first millimeter wave scanning unit and a second millimeter wave scanning unit located at opposite sides of the inspection passage along a horizontal direction perpendicular to the direction in which the inspected person passes through the inspection passage, the first millimeter wave scanning unit and the second millimeter wave scanning unit being configured to respectively perform millimeter wave scanning on the front and back of the inspected person standing at the designated standing position in a posture consistent with the designated posture, so as to obtain a first scanning data set of the front side and a second scanning data set of the back side of the inspected person, wherein the column direction of the first scanning data set and the second scanning data set coincide with the height direction of the inspected person; and The workstation is further configured to: superimposing the first scan data set along the row direction of the first scan data set to obtain a column of first superimposed data represented by Y1, and superimposing the second scan data set along the row direction of the second scan data set to obtain a column of second superimposed data represented by Y2; The first superimposed data Y1 and the second superimposed data Y2 are cross-correlated according to the following formula: , Wherein t is the height corresponding to the first superimposed data Y1 or the second superimposed data Y2; Pick The maximum corresponding The value of is used as the height difference between the first scanning data set and the second scanning data set, and the first scanning data set and the second scanning data set are registered based on the height difference to reconstruct the millimeter wave scanning image of the examined person. 11 . The millimeter wave human body security inspection system according to claim 10 , wherein the first display device is arranged at the top of the millimeter wave human body security inspection instrument to face the inspected person who will enter the inspection channel. 12 . The millimeter wave human body security inspection system according to claim 11 , wherein the first display device is respectively provided at two opposite tops of the millimeter wave human body security inspection device in the passing direction of the inspected person.
13. The millimeter wave human body security inspection system according to claim 10, wherein the first display device is configured to display at least one of a designated posture video, designated posture prompt text, and a designated posture picture to the inspected person.
14. The millimeter wave human body security inspection system according to any one of claims 10 to 13, further comprising: A second display device (130) is arranged in the inspection channel to display information related to the designated posture to the inspected person standing at the designated standing position.
15. The millimeter wave human body security inspection system according to claim 14, further comprising: a visible light imaging device configured to acquire a visible light image of a person under inspection standing at a designated standing position in the standing posture, The second display device is configured to display the puppet image in the designated posture and the visible light image to guide the person being examined to adjust his standing posture according to the comparison between the visible light image and the puppet image in the designated posture.
16. The millimeter wave human body security inspection system according to any one of claims 10-13 and 15, further comprising: An audio device (300) is configured to guide the person being examined to watch the information displayed on the first display device and / or guide the person being examined to stand at a designated standing position in a posture substantially consistent with the designated posture by using voice prompts.
17. The millimeter wave human body security inspection system according to any one of claims 10-13 and 15, wherein the workstation is configured to determine whether the standing posture of the inspected person meets the requirement of the specified posture based on the reconstructed millimeter wave scanning image.
18. The millimeter wave human body security inspection system according to any one of claims 10-13 and 15, wherein: The millimeter wave human body security inspection system is configured to guide the inspected person to leave the inspection channel by at least one of voice prompt and visual prompt after determining that the standing posture of the inspected person meets the requirements of the specified posture; and The workstation is configured to analyze the reconstructed millimeter wave scanning image to identify whether the inspected person is carrying any suspicious items while the inspected person is leaving the inspection channel.
19. The millimeter wave human body security inspection system according to any one of claims 10-13 and 15, wherein: The workstation includes a graphics processing unit (GPU) configured to perform millimeter wave scanning image reconstruction, standing posture confirmation, and suspicious object identification of the inspected person.
Citation Information
Patent Citations
Guiding method, inspection method and inspection system
CN108324296A
Millimeter wave security checking system and method
CN109709617A