Security image association system, method and storage medium

Abstract

The embodiment of the present disclosure provides a security check image association system and method and a storage medium, and relates to the technical field of image processing. The security check image association system comprises a scanning device, an image acquisition device and a processing device. The second image acquired by the image acquisition device in the scanning and detection process of the to-be-detected article is taken as the image association range of the to-be-detected article. The target image in the image association range is associated with the first image of the to-be-detected article, so that the target image corresponding to the to-be-detected article can be efficiently and accurately identified, the influence of environmental factors on the detection accuracy is reduced, and the accuracy of the association between the to-be-detected article and the target image is improved.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of image processing, and in particular to a security check image association system and method and a storage medium. BACKGROUND

[0002] A security check machine is a device for security checking of an object to be checked in a subway, an airport or other security check scene. When a scanning device identifies that the object to be checked includes contraband, it is usually necessary to determine the corresponding object to be checked. Therefore, accurate association of a first image of the object to be checked collected by the scanning device and a target image of the object to be checked is crucial for accurate tracing by a security check personnel.

[0003] In the related art, when performing image association, time is usually used as a condition for association, that is, according to the acquisition time of the first image corresponding to the scanning device, a target image of the object to be checked is determined in an image (for example, a visible light image) collected within a time period corresponding to the acquisition time through database query. In actual scenarios, due to various factors such as the placement position of the object to be checked and the speed of the conveyor belt, the accuracy of the association of the first image and the target image of the object to be checked is not high. SUMMARY

[0004] The purpose of the embodiments of the present disclosure is to provide a security check image association system and method and a storage medium.

[0005] To solve the above technical problems, the embodiments of the present disclosure are implemented through the following aspects.

[0006] According to a first aspect of the embodiments of the present disclosure, a security check image association system is provided, comprising:

[0007] a scanning device comprising a ray source and a detector, configured to scan and detect an object to be checked and output strip data of the object to be checked, the strip data being capable of being spliced to form a first image of the object to be checked;

[0008] an image collection device arranged in a scanning channel where the scanning device is located, configured to start collecting a second image of the object to be checked when the scanning device starts scanning the object to be checked, and end collecting the second image of the object to be checked when the scanning device ends scanning the object to be checked;

[0009] a processing device configured to: take the second image collected by the image collection device during the scanning and detection of the object to be checked as an image association range of the object to be checked, and associate a target image within the image association range with the first image of the object to be checked.

[0010] According to a second aspect of the embodiments of the present disclosure, a security check image association method is provided, comprising:

[0011] a second image captured by the image capturing device during the scanning and detecting process of the to-be-inspected item as an image association range of the to-be-inspected item;

[0012] associating a target image in the image association range with the first image of the to-be-inspected item;

[0013] The first image is formed by splicing strip data output by a scanning device during the scanning and detecting process of the to-be-inspected item, and the second image is an image of the to-be-inspected item captured by the image capturing device between a first time when the scanning device starts to scan the to-be-inspected item and a second time when the scanning device ends to scan the to-be-inspected item.

[0014] According to a third aspect of the embodiments of the present disclosure, a readable storage medium is provided, which stores programs or instructions, and the programs or instructions are executed by a processor to implement the steps of the security inspection image association method according to the second aspect.

[0015] One of the above technical solutions has the following advantages or beneficial effects: the second image captured by the image capturing device during the scanning and detecting process of the to-be-inspected item is taken as an image association range of the to-be-inspected item, and the target image in the image association range is associated with the first image of the to-be-inspected item, which can efficiently and accurately identify the target image corresponding to the to-be-inspected item, reduce the influence of environmental factors on the detection accuracy, and improve the accuracy of the association between the to-be-inspected item and the target image.

[0016] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure.

[0017] Other features and advantages of the present disclosure will be described in detail in the following specific embodiments section. BRIEF DESCRIPTION OF DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description are only some embodiments described in the present disclosure, and those skilled in the art can also obtain other drawings according to these drawings without any creative labor.

[0019] Figure 1 Fig. 1 shows a schematic diagram of a security inspection machine according to an embodiment of the present disclosure, wherein, Figure 1 Fig. 1(a) shows a side view of a security inspection machine according to an embodiment of the present disclosure; Figure 1 Fig. 1(b) shows a top view of a security inspection machine according to an embodiment of the present disclosure;

[0020] Figure 2 a block diagram of a security inspection image correlation system provided by an embodiment of the present disclosure is shown;

[0021] Figure 3 a strip data schematic diagram of different speed of the inspected article provided by an embodiment of the present disclosure is shown;

[0022] Figure 4 a schematic diagram of determining strip data of the inspected article provided by an embodiment of the present disclosure is shown, wherein, Figure 4 in (a), a schematic diagram of determining strip data of the inspected article provided by an embodiment of the present disclosure is shown; Figure 4 in (b), another schematic diagram of determining strip data of the inspected article provided by an embodiment of the present disclosure is shown;

[0023] Figure 5 a block diagram of another security inspection image correlation system provided by an embodiment of the present disclosure is shown;

[0024] Figure 6 another schematic diagram of determining strip data of the inspected article provided by an embodiment of the present disclosure is shown;

[0025] Figure 7 a flowchart of a method of image processing provided by an embodiment of the present disclosure is shown;

[0026] Figure 8 another flowchart of a method of image processing provided by an embodiment of the present disclosure is shown;

[0027] Figure 9 another flowchart of a method of image processing provided by an embodiment of the present disclosure is shown;

[0028] Figure 10 another flowchart of a method of image processing provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0029] In order to make the person skilled in the art better understand the technical solutions in the present disclosure, the technical solutions in the embodiments of the present disclosure will be described clearly and completely below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by the person skilled in the art without creative labor should be within the protection scope of the present disclosure.

[0030] First, the terms in the present application are explained.

[0031] Security inspection machine: an electronic device for completing luggage inspection by sending the inspected luggage into the scanning channel of the scanning device through the conveyor belt.

[0032] Scanning device: A device installed in the collection area of ​​the security inspection machine to collect the first image of the item to be tested.

[0033] Image acquisition device: A device for acquiring a second image (e.g., a visible light image) of an object to be tested.

[0034] Processing device: A device that receives strip data acquired by the scanning device and a second image acquired by the image acquisition device, and processes the strip data and the second image. It can communicate with the scanning device and the image acquisition device via wired or wireless means.

[0035] The security inspection image association system can be integrated with the security inspection machine as part of the machine, or it can be partially or entirely set up separately. For example, the processing device can be a separate computer that communicates with the scanning device and image acquisition device set up on the security inspection machine to execute the corresponding security inspection image association method.

[0036] Figure 1 This diagram illustrates a security inspection machine according to an embodiment of the present disclosure, wherein... Figure 1 Image (a) shows a side view of a security inspection machine provided in an embodiment of this disclosure; Figure 1 Image (b) shows a top view of a security inspection machine provided in an embodiment of this disclosure. Figure 1 As shown, the security inspection machine includes a scanning channel 100, a conveyor belt 101, and a system of equipment set at preset positions within the scanning channel 100. Figure 1 (a) and Figure 1 (b) The scanning device 201 and image acquisition device 202 (at the top of the scanning channel 100) Figure 1 (a) and Figure 1 (b) Processing device 203 (not shown), wherein the acquisition direction of scanning device 201 and image acquisition device 202 is perpendicular to conveyor belt 101. In some embodiments, image acquisition device 202 may be located on the scanning surface of the X-ray source of scanning device 201, that is, the plane formed by scanning device 201 and image acquisition device 202 perpendicularly downward is perpendicular to the moving direction of conveyor belt, so that the first image and the second image of the item to be inspected can be a top view of the item to be inspected.

[0037] It is understandable that the image acquisition device 202 can also be set on the side inside the scanning area 100, so that the second image of the item to be inspected can be a side view of the item to be inspected.

[0038] In some alternative embodiments, multiple image acquisition devices 202 may be provided, so that the acquired second image of the item to be inspected may include a top view and a side view of the item to be inspected, forming a set of second images.

[0039] Figure 2 A block diagram of a security image correlation system is shown, and the security image correlation system is provided by an embodiment of the present disclosure, as shown in Figure 2 The security image correlation system 200 includes:

[0040] The scanning device 201 includes a ray source and a detector, and is configured to scan and detect an object to be inspected, and output strip data of the object to be inspected.

[0041] The strip data can be spliced to form a first image of the object to be inspected.

[0042] The image acquisition device 202 is arranged in a scanning channel where the scanning device 201 is arranged, and is configured to start acquiring a second image of the object to be inspected when the scanning device 201 starts scanning the object to be inspected, and end acquiring the second image of the object to be inspected when the scanning device ends scanning the object to be inspected.

[0043] The processing device 203 is configured to: take the second image acquired by the image acquisition device during the scanning and detection of the object to be inspected as an image correlation range of the object to be inspected, and correlate a target image in the image correlation range with the first image of the object to be inspected.

[0044] In some embodiments, the scanning device 201 can be an X-ray scanning device, the ray source can emit X-rays from a beam hole, the detector can detect data of the X-ray scanning to form strip data, and the processing device 203 can splice the strip data received from the scanning device 201 to form a first image (X-ray image) of the object to be inspected.

[0045] Figure 3 A sequence diagram of X-ray images of the object to be inspected at different speeds is shown, and the sequence diagram is provided by an embodiment of the present disclosure, as shown in Figure 3 The object to be inspected 3, the object to be inspected 2, and the object to be inspected 1 are respectively a plurality of strip data output by the scanning device 201 when the object to be inspected passes through a scanning area at low speed, medium speed, and high speed. Figure 3 As can be seen from the above, when the conveying belt 101 runs at low speed, a larger number of strips are generated, and when the conveying belt 101 runs at high speed, a smaller number of strips are generated, but a plurality of strip data generated in different moving speeds can be spliced to form a first image (for example, an X-ray image) of the object to be inspected.

[0046] The image acquisition device 202 can be arranged in the scanning channel where the scanning device 201 is arranged, and synchronously acquires a second image of the object to be inspected with the scanning and detection process of the object to be inspected by the scanning device 201. The second image acquired in the scanning and detection process of the object to be inspected by the scanning device 201 can be a plurality of images. It can be understood that the plurality of second images are snapshot images of the object to be inspected moving through the scanning channel with the conveying belt 101.

[0047] For example, if the scanning device 201 starts to scan the to-be-inspected item at time t1 and ends to scan the to-be-inspected item at time t2, the second images collected by the image collection device 202 from time t1 to time t2 can be regarded as the image correlation range of the to-be-inspected item. For example, if the image collection device 202 collects N second images from time t1 to time t2, the processing device 203 can regard the N second images as the image correlation range of the to-be-inspected item, determine the target image from the N second images, and correlate the target image with the first image of the to-be-inspected item.

[0048] In some embodiments, the target image can be determined from a second image at a preset position in a queue composed of multiple second images in the image correlation range and arranged in time sequence, so as to correlate the target image with the first image of the to-be-inspected item. The preset position may, for example, be the middle position of the queue, or a second image at a position before or after the middle position, or a second image at another position, without limitation in the present disclosure.

[0049] By using the technical solution described above, the target image corresponding to the to-be-inspected item can be efficiently and accurately identified, the influence of environmental factors on the detection accuracy can be reduced, and the accuracy of the correlation between the to-be-inspected item and the target image can be improved.

[0050] The first time t1 at which the scanning device 201 starts to scan the to-be-inspected item and the second time t2 at which the scanning device 201 ends to scan the to-be-inspected item can be determined in various possible ways.

[0051] In some embodiments, the processing device 203 can be configured to, during the movement of the to-be-inspected item in the scanning channel, if it is determined that the received strip data changes from blank area data to non-blank area data, take the first non-blank area data in the change process as the starting strip data of the to-be-inspected item. The processing device 203 can take the time at which the starting strip data of the to-be-inspected item is received as the first time t1 at which the scanning device 201 starts to scan the to-be-inspected item, and can send a start collection instruction to the image collection device 202 at the same time when the first non-blank area data is determined.

[0052] In some embodiments, the processing device 203 can be configured to, during the movement of the to-be-inspected item in the scanning channel, if it is determined that the received strip data changes from non-blank area data to blank area data, take the last non-blank area data in the change process as the ending strip data of the to-be-inspected item. The processing device 203 can take the time at which the next strip data after the ending strip data of the to-be-inspected item is received as the second time t2 at which the scanning device 201 ends to scan the to-be-inspected item, and can send an end collection instruction to the image collection device 202 at the same time when the last non-blank area data is determined.

[0053] Figure 4 This diagram illustrates a method for determining stripe data of an item to be inspected, according to an embodiment of this disclosure. Figure 4 (a) shows a schematic diagram of determining strip data of an article to be inspected according to an embodiment of the present disclosure; Figure 4 Figure (b) shows a schematic diagram of another method for determining strip data of an article to be inspected, provided by an embodiment of this disclosure. Figure 4 In (a), the processing device 203 can sequentially receive multiple strip data such as 01-08. Strip data 01-03 are blank area strip data output when the preceding blank area of ​​the item 1 passes through the scanning area of ​​the scanning device 201 along the conveyor belt. Strip data 04-08 are non-blank area strip data output when the item 1 passes through the scanning area of ​​the scanning device 201. When the processing device 203 receives strip data 04, it can compare the pixel values ​​of strip data 04 and strip data 03. If the first deviation of the pixel values ​​exceeds a preset first threshold, strip data 04 is treated as non-blank area data, thereby determining that a change from blank area data to non-blank area data has occurred between the received strip data 03 and strip data 04. Taking the blank area strip data as white (pixel value close to 255) and the non-blank area strip data as black (pixel value close to 0) as an example, the first deviation can be the difference between the pixel value of strip data 03 and the pixel value of the corresponding strip data 04. If the first deviation exceeds the first threshold, it is determined that a change from blank area data to non-blank area data has occurred.

[0054] After determining that a change from blank area data to non-blank area data has occurred between the received strip data 03 and strip data 04, the first non-blank area data in the change process, i.e. strip data 04, is taken as the starting strip data of the item to be inspected. At the same time as determining that strip data 04 is the starting strip data of the item to be inspected, a start acquisition command can be sent to the image acquisition device 202.

[0055] exist Figure 4 In step (b), the processing device 203 sequentially receives multiple strip data from 01 to 10. When the processing device 203 receives strip data 10, it can compare the pixel values ​​of strip data 10 and strip data 09. If the second deviation of the pixel values ​​exceeds a preset second threshold, strip data 10 is treated as blank area data, thereby determining that a change from non-blank area data to blank area data has occurred between the received strip data 09 and strip data 10. Taking the blank area strip data as white (pixel value close to 255) and the non-blank area strip data as black (pixel value close to 0) as an example, the second deviation can be the difference between the pixel value of strip data 10 and the corresponding pixel value of strip data 09.

[0056] The processing device 203 can take the last non-blank area data in the change process (i.e., the strip data 9) as the end strip data of the to-be-inspected item, and send an end collection instruction to the image collection device upon receiving the strip data 10 and determining that the last non-blank area data is the strip data 9.

[0057] It should be noted that when comparing the pixel values of the strip data, the deviation of the pixel values can be determined in various possible ways to determine that the strip area changes from non-blank area data to blank area data or from blank area data to non-blank area data, for example, the deviation of the average pixel value of the strip data exceeds a preset threshold, or the number of pixel points with a deviation of the corresponding pixel value exceeding a preset threshold exceeds a preset number threshold, and the present disclosure does not limit this.

[0058] In some embodiments, the processing device 203 is further configured to: take the second image collected by the image collection device between receiving the start collection instruction and the end collection instruction as the image association range of the to-be-inspected item.

[0059] In some embodiments, the processing device 203 is further configured to: in a case where the scanning device 201 outputs the strip data of the to-be-inspected item, determine data identifiers for the strip data of the to-be-inspected item, and establish a corresponding relationship between the strip data and the second images according to the generation order of the strip data of the to-be-inspected item and the generation order of the second images, or establish a corresponding relationship between the data identifiers of the strip data and the second images.

[0060] The processing device 203 is specifically configured to: send the data identifier of the start strip data of the to-be-inspected item to the image collection device as the start collection instruction; and send the data identifier of the end strip data of the to-be-inspected item to the image collection device as the end collection instruction.

[0061] In some embodiments, the data identifier can be further divided into a start identifier, an intermediate identifier, and an end identifier, so as to Figure 4 Taking the example of (b), the data identifier of the strip data 04 corresponding to the to-be-inspected item 1 can be a start identifier The data identifier of the strip data 09 corresponding to the to-be-inspected item 1 can be an end identifier The data identifiers of the strip data 05-08 corresponding to the to-be-inspected item 1 can be intermediate identifiers , , , The data identifier of the strip data 10 corresponding to the to-be-inspected item 2 can be an end identifier The superscript k of the data identifier is the data identifier of the kth to-be-inspected item, and the superscript n can be the strip data number n of the uniform coding of the strip data output by the scanning device 201.

[0062] Of course, the form of the data identifier is not limited to the above embodiment, and can also be other forms of data identifier, as long as the serial number of the corresponding to-be-inspected item can be clearly represented, and the strip data is the starting strip data, the intermediate strip data or the ending strip data of the to-be-inspected item, and the uniform number of each strip data.

[0063] In some possible implementations, the period of the image acquisition device 202 acquiring the second image can be the same as the period of the scanning device 201 outputting the strip data, so that the image acquisition device 202 can acquire the second image at the same time as the scanning device 201 outputs the strip data. Figure 4 For example, in case (b), when the processing device 203 receives the strip data 04 and takes the strip data 04 as the starting strip data of the to-be-inspected item, the processing device 203 sends a start acquisition instruction to the image acquisition device 202, and the image acquisition device 202 can start acquiring the second image of the to-be-inspected item upon receiving the start acquisition instruction sent by the processing device 203. The processing device 203 can establish a corresponding relationship between the first second image acquired by the image acquisition device 202 and the strip data 04. When the scanning device 201 outputs the strip data 05, the image acquisition device 202 can acquire the second second image, and the processing device 203 can establish a corresponding relationship between the second second image acquired by the image acquisition device 202 and the strip data 05. Similarly, the image acquisition device 202 can acquire the third to sixth second images when the scanning device 201 outputs the strip data 05-09, and the processing device 203 can establish a corresponding relationship between the third to sixth second images acquired by the image acquisition device 202 and the strip data 06-09. When the scanning device 201 outputs the strip data 10, the processing device 203 can determine that the strip data 09 is the ending strip data, and sends an end acquisition instruction to the image acquisition device 202, so that the image acquisition device 202 ends the acquisition of the second image.

[0064] In another possible implementation, the period of the image acquisition device 202 acquiring the second image can be greater than the period of the scanning device 201 outputting the strip data. For example, the scanning device 201 outputs one strip data, and the image acquisition device 202 can acquire two second images, so as to form a one-to-many corresponding relationship between the strip data and the second image, that is, one strip data corresponds to multiple second images.

[0065] The period of the image acquisition device 202 acquiring the second image can also be less than the period of the scanning device 201 outputting the strip data. For example, the scanning device 201 outputs two strip data, and the image acquisition device 202 can acquire one second image, so that a many-to-one correspondence relationship between the strip data and the second image can be formed, i.e., a plurality of strip data corresponds to one second image.

[0066] In some embodiments, when the correspondence relationship is generated, the correspondence relationship between each strip data and each second image can be established according to the generation order of the strip data of the to-be-inspected item and the generation order of the second image.

[0067] For example, the correspondence relationship between each strip data and each second image can be, for example, that the strip data and the corresponding second image are stored in a preset storage structure. In the case of a one-to-one correspondence relationship between the strip data and the second image, one strip data and one second image can be stored in the preset storage structure; in the case of a one-to-many correspondence relationship between the strip data and the second image, one strip data and a plurality of corresponding second images sorted in time sequence can be stored in the preset storage structure; in the case of a many-to-one correspondence relationship between the strip data and the second image, a plurality of strip data sorted in time sequence and the corresponding second image can be stored in the preset storage structure.

[0068] In another embodiment, when the correspondence relationship is generated, the correspondence relationship between each strip data and each second image can be established according to the generation order of the strip data of the to-be-inspected item and the generation order of the second image, or the data identifier of each strip data and each second image.

[0069] The data identifier of the strip data and the second image can be established in a correspondence relationship, and the data identifier of the strip data and the corresponding second image can be saved in a preset data structure (such as a linked list or a queue). In the case of a one-to-one correspondence relationship between the strip data and the second image, the data identifier of one strip data and one second image can be stored in the preset storage structure; in the case of a one-to-many correspondence relationship between the strip data and the second image, the data identifier of one strip data and a plurality of corresponding second images sorted in time sequence can be stored in the preset storage structure; in the case of a many-to-one correspondence relationship between the strip data and the second image, the data identifier of a plurality of strip data sorted in time sequence and the corresponding second image can be stored in the preset storage structure.

[0070] It should be noted that since multiple image acquisition devices 202 can be provided, second images of different perspectives of the to-be-inspected item at a certain moment can be obtained, and the second images of different perspectives can be saved as a group of second images corresponding to the strip data. The corresponding relationship between the strip data and the group of second images of different perspectives also belongs to the above-mentioned one-to-one corresponding relationship.

[0071] After determining the strip data of each to-be-inspected item and saving the corresponding relationship between the strip data and the second image or the corresponding relationship between the data identifier of the strip data and the second image, the processing device 203 is further configured to:

[0072] For the strip data belonging to the same to-be-inspected item, the target image is determined from the image association range according to the data identifier of the strip data and the corresponding relationship between the strip data and the second image, or the target image is determined from the image association range according to the data identifier of the strip data and the corresponding relationship between the data identifier of the strip data and the second image.

[0073] The processing device 203 is specifically configured to:

[0074] For the strip data belonging to the same to-be-inspected item, the target data identifier is determined according to the data identifier of the starting strip data of the to-be-inspected item and the data identifier of the ending strip data of the to-be-inspected item.

[0075] The target image is determined from the image association range according to the strip data corresponding to the target data identifier and the corresponding relationship between the strip data and the second image; or

[0076] The target image is determined from the image association range according to the target data identifier and the corresponding relationship between the data identifier of the strip data and the second image.

[0077] In some embodiments, for the strip data belonging to the same to-be-inspected item, the following formula one can be used to determine the target data identifier according to the data identifier of the starting strip data of the to-be-inspected item and the data identifier of the ending strip data of the to-be-inspected item.

[0078] (Formula One)

[0079] Wherein, is the target data identifier of the i-th to-be-inspected item, is the strip data number in the data identifier of the starting strip data corresponding to the i-th to-be-inspected item, is the strip data number in the data identifier of the ending strip data corresponding to the i-th to-be-inspected item, is a rounding up function.

[0080] For example,Figure 5 In the middle (b), the to-be-inspected item 1 is taken as an example, The strip data number 4 corresponding to the starting strip data of the to-be-inspected item 1, The strip data number 9 corresponding to the ending strip data of the to-be-inspected item 1, The target data identifier 7 of the to-be-inspected item 1, that is, the corresponding strip data is strip data 07.

[0081] In some embodiments, after the target data identifier is determined, the target image can be determined from the image association range by using the corresponding strip data of the target data identifier and the corresponding relationship between the strip data and the second image; or the target image can be determined from the image association range by using the target data identifier and the corresponding relationship between the data identifier of the strip data and the second image.

[0082] For example, after the target data identifier 7 of the to-be-inspected item 1 is determined, the corresponding target image can be determined from the corresponding relationship between the strip data and the second image saved in the preset storage structure by using the corresponding strip data 07. Alternatively, after the target data identifier 7 of the to-be-inspected item 1 is determined, the corresponding target image can be determined from the corresponding relationship between the data identifier of the strip data and the second image saved in the preset storage structure by using the target data identifier 7.

[0083] It should be noted that in the case of one-to-one or one-to-many between the strip data (data identifier of the strip data) and the second image, one target image (or a group of target images with different perspectives) can be uniquely determined from the corresponding relationship, and in the case of one-to-many between the strip data (data identifier of the strip data) and the second image, one second image (or a group of target images with different perspectives) can be selected from the multiple second images (or multiple groups of target images with different perspectives) corresponding to the strip data as the target image.

[0084] In some embodiments, after the target image in the image association range is associated with the first image of the to-be-inspected item, the association relationship between the target image and the first image of the to-be-inspected item can be saved.

[0085] In some embodiments, after the target image in the image association range is associated with the first image of the to-be-inspected item, the association relationship between the target image and the first image of the to-be-inspected item can be saved.

[0086] By using the above technical solutions, the target image corresponding to the to-be-inspected item can be efficiently and accurately identified, the influence of environmental factors on the detection accuracy is reduced, and the accuracy of the association between the to-be-inspected item and the target image is improved.

[0087] Figure 5A block diagram of another security image correlation system provided by an embodiment of the present disclosure is shown in FIG. 2. As shown in FIG. 2, the security image correlation system 200 can further include a position detection sensor 204. Figure 6 The position detection sensor 204 can be arranged upstream of the radiation source along the moving direction of the object to be inspected in the scanning channel, and the position detection sensor 204 is arranged at a distance less than a distance threshold from the scanning plane of the radiation source, and the position detection sensor 204 is configured to detect the moving position of the object to be inspected in the scanning channel.

[0088] In some embodiments, the position detection sensor 204 can be arranged upstream of the radiation source along the moving direction of the object to be inspected in the scanning channel, and the position detection sensor 204 is arranged at a distance less than a distance threshold from the scanning plane of the radiation source, and the position detection sensor 204 is configured to detect the moving position of the object to be inspected in the scanning channel.

[0089] In some possible implementations, the position detection sensor 204 can be a laser radar arranged at the top of the scanning area, and the laser radar is configured to determine whether the object to be inspected passes through the detection area of the laser radar by detecting the distance change between the top of the scanning area and the lower part. In the case where the object to be inspected does not pass through the detection area of the laser radar, the distance detected by the laser radar is the distance between the top of the scanning area and the conveyor belt, and in the case where the object to be inspected passes through the detection area of the laser radar, the distance detected by the laser radar is the distance between the top of the scanning area and the top of the object to be inspected, i.e., the distance detected by the laser radar changes when the object to be inspected passes through the detection area of the laser radar.

[0090] In some embodiments, the position detection sensor 204 can generate a first trigger signal in the case where the object to be inspected is detected for the first time, and the processing device 203 can send a start acquisition instruction to the image acquisition device 202 in the case where the first trigger signal sent by the position detection sensor 204 is received.

[0091] The position detection sensor 204 can generate a second trigger signal in the case where the object to be inspected is no longer detected after the first trigger signal is generated, and the processing device 203 can send an end acquisition instruction to the image acquisition device 202 in the case where the second trigger signal sent by the position detection sensor 204 is received.

[0092] The position detection sensor 204 can send a trigger signal to the processing device 203 (e.g., a periodic trigger signal can be sent at a preset period) after the first trigger signal is generated until the object to be inspected is no longer detected. The processing device 203 sends an end acquisition instruction to the image acquisition device 202 once no trigger signal sent by the position detection sensor 204 is received after the first trigger signal sent by the position detection sensor 204 is received.

[0093] With the technical solution, the second image can be collected earlier than the scanning device starts to output the strip data, so that the delay caused by the image collection device collecting the second image after the scanning device outputs the strip data of the object to be inspected can be avoided, and the accuracy of the association between the object to be inspected and the target image is further improved.

[0094] When the security image association is performed, there can also be scenes such as a security channel being blocked, the object to be inspected being too long, or the objects to be inspected being closely arranged. In some embodiments, the processing device 203 is specifically configured to:

[0095] When it is determined that the cumulative amount of the strip data exceeds the threshold value, it is determined that the scanning detection of the previous object to be inspected ends, the scanning detection of the next object to be inspected starts, the first strip data after the threshold value is determined as the starting strip data of the next object to be inspected, and the second image collected after the threshold value is determined as the second image corresponding to the next object to be inspected.

[0096] Figure 6 Another schematic diagram for determining the strip data of the object to be inspected provided by the embodiments of the present disclosure is shown in FIG. 4. Figure 7 As shown in FIG. 4, the object to be inspected 1 is an overlong object. When the processing device 203 receives the strip data 10, if the cumulative amount of the strip data (04-10, a total of 7) is greater than or equal to the threshold value (for example, 7), it is determined that the scanning detection of the object to be inspected 1-1 ends, the scanning detection of the next object to be inspected 1-2 starts, the first strip data 11 after the threshold value is determined as the starting strip data of the next object to be inspected 1-2, and the previous strip data 10 of the first strip data 11 after the threshold value is determined as the ending strip data of the object to be inspected 1-1. In this way, the starting strip data of the object to be inspected 1-2 can be determined as the strip data 11, the ending strip data of the object to be inspected 1-2 can be determined as the strip data 18, the starting strip data of the object to be inspected 1-3 can be determined as the strip data 19, and the ending strip data of the object to be inspected 1-3 can be determined as the strip data 20.

[0097] After the starting strip data and the ending strip data corresponding to the object to be inspected 1-1, the object to be inspected 1-2, and the object to be inspected 1-3 are determined, the target data identifiers of the strip data corresponding to the object to be inspected 1-1, the object to be inspected 1-2, and the object to be inspected 1-3 can be determined as 7, 15, and 20 respectively according to Formula One. Then, the target images corresponding to the object to be inspected 1-1, the object to be inspected 1-2, and the object to be inspected 1-3 can be determined from the image association range by using the corresponding strip data of the target data identifier and the corresponding relationship between the strip data and the second image, or by using the target data identifier and the corresponding relationship between the data identifier of the strip data and the second image.

[0098] With the technical solution, for the abnormal situation of the super-long object to be inspected or the closely arranged objects to be inspected, the super-long object to be inspected or the closely arranged objects to be inspected can be segmented into sub-objects to be inspected, and the target images corresponding to the sub-objects to be inspected are acquired respectively, so that the target images corresponding to different parts of the super-long object to be inspected or the target images corresponding to different objects to be inspected in the closely arranged objects to be inspected are acquired, and the compatibility of the security inspection image correlation system in the security inspection image correlation is further improved.

[0099] Figure 7 A flowchart of an image processing method provided by an embodiment of the present disclosure is shown, which can be executed by a processing device in a security inspection image correlation system, as shown in Figure 8 The method can include the following steps.

[0100] In step S101, a second image acquired by the image acquisition device in the scanning detection process of the object to be inspected is taken as an image correlation range of the object to be inspected.

[0101] In step S102, a target image in the image correlation range is correlated with a first image of the object to be inspected.

[0102] The first image is formed by splicing the strip data output by the scanning device in the scanning detection process of the object to be inspected, and the second image is an image of the object to be inspected acquired by the image acquisition device between a first time when the scanning device starts to scan the object to be inspected and a second time when the scanning device ends to scan the object to be inspected.

[0103] The above detailed steps have been described in detail in the embodiment of the first aspect, and will not be expanded here.

[0104] With the technical solution, the target image corresponding to the object to be inspected can be efficiently and accurately identified, the influence of environmental factors on the detection accuracy is reduced, and the accuracy of the correlation between the object to be inspected and the target image is improved.

[0105] Figure 8 Another flowchart of the image processing method provided by an embodiment of the present disclosure is shown, as shown in Figure 9 The method can include the following steps.

[0106] In step S103, in the case that the strip data of the object to be inspected output by the scanning device is received, the data identifier of the strip data of the object to be inspected is determined, and the corresponding relationship between each strip data and each second image is established according to the generation order of the strip data of the object to be inspected and the generation order of the second image, or the corresponding relationship between the data identifier of each strip data and each second image is established.

[0107] In step S104, for the strip data belonging to the same to-be-inspected item, the target image is determined from the image association range according to the data identifier of the strip data and the correspondence between the strip data and the second image, or according to the data identifier of the strip data and the correspondence between the data identifier of the strip data and the second image.

[0108] Specifically, for the strip data belonging to the same to-be-inspected item, the target data identifier is determined according to the data identifier of the starting strip data of the to-be-inspected item and the data identifier of the ending strip data of the to-be-inspected item.

[0109] The target image is determined from the image association range by using the strip data corresponding to the target data identifier and the correspondence between the strip data and the second image, or

[0110] The target image is determined from the image association range by using the target data identifier and the correspondence between the data identifier of the strip data and the second image.

[0111] In some embodiments, the image acquisition device starts to acquire the second image of the to-be-inspected item upon receiving the start acquisition instruction sent by the processing device, and ends to acquire the second image of the to-be-inspected item upon receiving the end acquisition instruction sent by the processing device.

[0112] In some embodiments, step S101 specifically includes: regarding the second image acquired by the image acquisition device between the start acquisition instruction and the end acquisition instruction as the image association range of the to-be-inspected item.

[0113] The above detailed steps have been described in detail in the embodiments of the first aspect, and will not be expanded here.

[0114] By using the above technical solution, the target image corresponding to the to-be-inspected item can be efficiently and accurately identified, the influence of environmental factors on detection accuracy is reduced, and the accuracy of the association between the to-be-inspected item and the target image is improved.

[0115] Figure 9 Another flowchart of the method for image processing provided by the embodiments of the present disclosure is shown in FIG. 6. Figure 10 As shown in FIG. 6, the method can further include the following steps.

[0116] In step S105, if the cumulative generation amount of the strip data exceeds the threshold value, it is determined that the scanning detection of the previous to-be-inspected item ends, the scanning detection of the next to-be-inspected item starts, the first strip data after exceeding the threshold value is determined as the starting strip data of the next to-be-inspected item, and the second image acquired after exceeding the threshold value is determined as the second image corresponding to the next to-be-inspected item.

[0117] The above detailed steps have been described in detail in the embodiments of the first aspect, and will not be repeated here.

[0118] With the technical solution, for abnormal situations such as an ultra-long object to be inspected or closely arranged objects to be inspected, the ultra-long object to be inspected or the closely arranged objects to be inspected can be segmented into sub-objects to be inspected, and the target images corresponding to the sub-objects to be inspected are acquired, so that the target images corresponding to different parts of the ultra-long object to be inspected or the target images corresponding to different objects to be inspected in the closely arranged objects to be inspected are acquired, and the compatibility of the security inspection image association system in association of security inspection images for abnormal scenes is further improved.

[0119] Figure 10 Another flowchart of the image processing method provided by the embodiments of the present disclosure is shown in FIG. 6. ​ As shown in FIG. 6, the method can include the following steps.

[0120] In step S201, the strip data output by the scanning device is acquired.

[0121] In step S202, it is determined whether the first deviation of the strip data exceeds the first threshold value. If the first deviation of the strip data does not exceed the first threshold value, the strip data output by the scanning device is continuously acquired.

[0122] In step S203, if the first deviation of the strip data exceeds the first threshold value, the starting strip data of the object to be inspected is determined, and a start collecting instruction is sent to the image collecting device.

[0123] In step S204, the strip data and the second image collected by the image collecting device are received.

[0124] In step S205, a corresponding relationship between each strip data and each second image is established, or a corresponding relationship between the data identifier of each strip data and each second image is established.

[0125] In step S206, it is determined whether the second deviation of the strip data exceeds the second threshold value. If the second deviation of the strip data does not exceed the second threshold value, and the cumulative generation amount of the strip data does not exceed the threshold value, the strip data and the second image are continuously received.

[0126] In step S207, if the first deviation of the strip data exceeds the second threshold value, or if the first deviation of the strip data does not exceed the second threshold value but the cumulative generation amount of the strip data exceeds the threshold value, the target data identifier is determined according to the data identifier of the starting strip data of the object to be inspected and the data identifier of the ending strip data of the object to be inspected.

[0127] In step S208, a target image is determined from the image association range using the target data identifier, and the first image formed by splicing the strip data and the target image are stored and / or displayed in association.

[0128] The above detailed steps have been described in detail in the embodiments of the first aspect, and will not be described here.

[0129] With the above technical solution, the target image corresponding to the to-be-inspected item can be efficiently and accurately identified, the influence of environmental factors on the detection accuracy is reduced, and the accuracy of the association between the to-be-inspected item and the target image is improved.

[0130] The embodiments of the present disclosure also provide a readable storage medium, which stores a program or instructions, and the program or instructions are executed by a processor to implement the method disclosed in the embodiments of the second aspect and achieve the functions and beneficial effects of the methods described in the foregoing method embodiments, which will not be described here.

[0131] The readable storage medium includes a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0132] Further, the embodiments of the present disclosure also provide a computer program product, which includes a computer program stored on a non-transitory computer readable storage medium, and the computer program includes program instructions, and when the program instructions are executed by a computer, the following processes are implemented: the method disclosed in the embodiments of the first aspect and the functions and beneficial effects of the methods described in the foregoing method embodiments, which will not be described here.

[0133] The embodiments of the present disclosure provide a computer program product, which includes a computer program, and when the computer program is executed by a processor, each process of the method disclosed in the embodiments of the first aspect or the second aspect is implemented, and the same technical effects can be achieved, and to avoid repetition, which will not be described here.

[0134] In summary, the above only describes the preferred embodiments of the present disclosure, and does not limit the protection scope of the present disclosure. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present disclosure shall be included in the protection scope of the present disclosure.

[0135] The systems, modules or units described in the above embodiments can be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer can be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0136] Computer readable media includes permanent and non-permanent, removable and non-removable media, which can be implemented by any method or technology to store information. The information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can store information accessible by a computing device. According to the definition herein, computer readable media does not include transitory computer readable media, such as modulated data signals and carrier waves.

[0137] It should also be noted that the terms "comprising", "including", or any other variant thereof are intended to cover non-exclusive inclusion, so that processes, methods, articles or devices including a series of elements not only include those elements, but also include other elements not explicitly listed or inherent to such processes, methods, articles or devices. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article or device including the element.

[0138] Each of the embodiments in the specification is described in a progressive manner, and the same or similar parts between each of the embodiments can be referred to each other. Each of the embodiments focuses on the difference from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant part can be referred to the part of the method embodiment.

Claims

1. A security image association system, characterized by, The application relates to a scanning device, a processing device and an image acquisition device. The scanning device comprises a ray source and a detector, is used for scanning and detecting an object to be detected, and outputs strip data of the object to be detected, wherein the strip data can be spliced to form a first image of the object to be detected. The processing device is used for: If it is determined that the received strip data changes from blank area data to non-blank area data, the first non-blank area data in the changing process is taken as starting strip data of the object to be detected; and simultaneously with the determination of the starting strip data of the object to be detected, a starting acquisition instruction is sent to the image acquisition device; If it is determined that the received strip data changes from non-blank area data to blank area data, the last non-blank area data in the changing process is taken as ending strip data of the object to be detected; and simultaneously with the determination of the ending strip data of the object to be detected, an ending acquisition instruction is sent to the image acquisition device; The image acquisition device is arranged in a scanning channel where the scanning device is arranged, is used for starting to acquire a second image of the object to be detected according to an image acquisition period when the starting acquisition instruction sent by the processing device is received, and is used for ending to acquire the second image of the object to be detected when the ending acquisition instruction sent by the processing device is received. The processing device is further used for taking the second image acquired by the image acquisition device in the scanning and detecting process of the object to be detected as an image correlation range of the object to be detected, and correlating a target image selected in the image correlation range with the first image of the object to be detected.

2. The system of claim 1, wherein, When the strip data of the object to be detected output by the scanning device is received, a corresponding relationship between each strip data and each second image is established according to the generation sequence of the strip data of the object to be detected and the generation sequence of the second image.

3. The system of claim 2, wherein, The processing device is further used for determining data identification for the strip data of the object to be detected when the strip data of the object to be detected output by the scanning device is received, and establishing a corresponding relationship between the data identification of each strip data and each second image according to the generation sequence of the strip data of the object to be detected and the generation sequence of the second image.

4. The system of claim 3, wherein, The processing device is specifically used for determining the target image in the image correlation range according to the data identification of the strip data and the corresponding relationship between the strip data and the second image, or according to the data identification of the strip data and the corresponding relationship between the data identification of the strip data and the second image, for the strip data belonging to the same object to be detected. The processing device is specifically used for determining a target data identification according to the data identification of the starting strip data of the object to be detected and the data identification of the ending strip data of the object to be detected, for the strip data belonging to the same object to be detected; the target image is determined in the image correlation range according to the strip data corresponding to the target data identification and the corresponding relationship between the strip data and the second image; or The target data is identified, and a corresponding relationship between data identification of the strip data and the second image is identified, and the target image is determined from the image correlation range.

5. The system of claim 1, wherein, The image acquisition device is located on a scanning surface of the ray source.

6. The system of claim 1, wherein, The processing device is further configured to: determine the second image acquired by the image acquisition device between the start acquisition instruction and the end acquisition instruction as the image correlation range of the object to be inspected.

7. The system of claim 1, wherein, A position detection sensor is arranged upstream of the ray source along a moving direction of the object to be inspected in the scanning channel, and a distance between the position detection sensor and a position of the scanning surface of the ray source is less than a distance threshold. The position detection sensor is configured to detect a moving position of the object to be inspected in the scanning channel.

8. The system of claim 1, wherein, The processing device is specifically configured to: in a case where it is determined that the cumulative amount of the strip data exceeds the threshold, determine that scanning detection of a previous object to be inspected ends and scanning detection of a next object to be inspected starts, and determine first strip data after the threshold is exceeded as starting strip data of the next object to be inspected, and simultaneously determine a second image acquired after the threshold is exceeded as a second image corresponding to the next object to be inspected.

9. The system of claim 1, wherein, The processing device is specifically configured to: send the data identification of the starting strip data of the object to be inspected to the image acquisition device as the start acquisition instruction after the data identification is determined. The processing device is specifically configured to: send the data identification of the ending strip data of the object to be inspected to the image acquisition device as the end acquisition instruction after the data identification is determined.

10. A method of associating security images, the method comprising: The method comprises: If it is determined that the received strip data changes from blank area data to non-blank area data during movement of the object to be inspected in the scanning channel, the first non-blank area data in the change process is determined as starting strip data of the object to be inspected, and a start acquisition instruction is sent to the image acquisition device when the first non-blank area data is determined, so that the image acquisition device starts to acquire a second image of the object to be inspected according to an image acquisition period when the start acquisition instruction is received; the strip data is output by a scanning device, the scanning device comprises a ray source and a detector, and is configured to scan and detect the object to be inspected, and the strip data can be spliced to form a first image of the object to be inspected; the image acquisition device is arranged in a scanning channel where the scanning device is located; If it is determined that the received strip data changes from non-blank area data to blank area data, the last non-blank area data in the change process is determined as ending strip data of the object to be inspected, and an end acquisition instruction is sent to the image acquisition device when the last non-blank area data is determined, so that the image acquisition device stops acquiring the second image of the object to be inspected when the end acquisition instruction is received; The second image acquired by the image acquisition device during scanning and detection of the object to be inspected is determined as an image correlation range of the object to be inspected, and a target image selected from the image correlation range is correlated with the first image of the object to be inspected. According to a generation order of the strip data of the object to be detected and a generation order of the second images, a correspondence between the strip data and the second images is established.

11. A readable storage medium, characterized by, The program or instruction is stored on the readable storage medium, and when executed by the processor, the program or instruction implements the steps of the security image association method according to claim 10.

Images