Security check image association system and method and storage medium

Abstract

The embodiment of the invention provides a security check image association system and method and a storage medium, and relates to the technical field of image processing. The security check image association system comprises a scanning device, an image acquisition device and a processing device. A second image acquired by the image acquisition device in a scanning detection process of a to-be-detected article is used as an image association range of the to-be-detected article; and associating the target image in the image association range with the first image of the to-be-detected article, so that the target image corresponding to the to-be-detected article can be efficiently and accurately identified, the influence of environmental factors on detection accuracy is reduced, and the accuracy of association between the to-be-detected article and the target image is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of image processing technology, and in particular to a security inspection image correlation system, method and storage medium. Background Art

[0002] Security inspection machines are devices used to inspect items to be inspected in subways, airports or other security inspection scenarios. When the scanning device identifies that the items to be inspected include prohibited items, it is usually necessary to determine the corresponding items to be inspected. Therefore, it is crucial for security personnel to accurately trace back the first image of the items to be inspected captured by the scanning device with the target image of the items to be inspected.

[0003] In the related art, when performing image association, time is usually used as the association condition, that is, according to the acquisition time of the first image corresponding to the scanning device, the target image of the object to be inspected is determined by querying the database in the images (such as visible light images) collected within a period of time corresponding to the acquisition time. In actual scenarios, due to the influence of various factors such as the placement position of the object to be inspected and the speed of the conveyor belt, the accuracy of associating the first image of the object to be inspected with the target image is not high. Summary of the invention

[0004] The purpose of the embodiments of the present disclosure is to provide a security inspection image association system, method and storage medium.

[0005] To solve the above technical problems, the embodiments of the present disclosure are implemented through the following aspects.

[0006] According to a first aspect of an embodiment of the present disclosure, a security inspection image association system is provided, including: A scanning device, including a ray source and a detector, for scanning and detecting the object to be inspected, and outputting strip data of the object to be inspected, wherein the strip data can be spliced ​​to form a first image of the object to be inspected; An image acquisition device, arranged in the scanning channel where the scanning device is located, and used to start acquiring the second image of the object to be inspected when the scanning device starts scanning the object to be inspected; and to stop acquiring the second image of the object to be inspected when the scanning device stops scanning the object to be inspected; The processing device is used to: use the second image acquired by the image acquisition device during the scanning and detection process of the object to be inspected as the image association range of the object to be inspected, and associate the target image within the image association range with the first image of the object to be inspected.

[0007] According to a second aspect of an embodiment of the present disclosure, a security inspection image association method is provided, the method comprising: Using the second image acquired by the image acquisition device during the scanning and detection process of the object to be inspected as the image association range of the object to be inspected; Associating the target image within the image association range with the first image of the object to be inspected; Among them, the first image is formed by splicing strip data output by the scanning device during the scanning and detection process of the object to be inspected, and the second image is an image of the object to be inspected acquired by the image acquisition device between the first moment when the scanning device starts scanning the object to be inspected and the second moment when the scanning device ends scanning the object to be inspected.

[0008] According to a third aspect of an embodiment of the present disclosure, a readable storage medium is provided, wherein the readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the security inspection image association method as described in the second aspect are implemented.

[0009] One of the above technical solutions has the following advantages or beneficial effects: by using the second image captured by the image acquisition device during the scanning and detection process of the object to be inspected as the image association range of the object to be inspected; and associating the target image within the image association range with the first image of the object to be inspected, the target image corresponding to the object to be inspected can be efficiently and accurately identified, reducing the impact of environmental factors on detection accuracy, and improving the accuracy of the association between the object to be inspected and the target image.

[0010] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

[0011] Other features and advantages of the present disclosure will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0013] Figure 1 A schematic diagram of a security inspection machine provided by an embodiment of the present disclosure is shown, wherein: Figure 1 (a) shows a side view of a security inspection machine provided by an embodiment of the present disclosure; Figure 1 (b) shows a top view of a security inspection machine provided by an embodiment of the present disclosure; Figure 2 A block diagram of a security inspection image association system provided by an embodiment of the present disclosure is shown; Figure 3 A schematic diagram showing strip data of an object to be inspected at different speeds provided by an embodiment of the present disclosure; Figure 4 A schematic diagram of determining strip data of an object to be inspected provided by an embodiment of the present disclosure is shown, wherein: Figure 4 (a) shows a schematic diagram of determining strip data of an object to be inspected provided by an embodiment of the present disclosure; Figure 4 (b) shows another schematic diagram of determining strip data of an object to be inspected provided by an embodiment of the present disclosure; Figure 5 A block diagram of another security inspection image association system provided by an embodiment of the present disclosure is shown; Figure 6 Another schematic diagram of determining strip data of an object to be inspected provided by an embodiment of the present disclosure is shown; Figure 7 A schematic diagram showing a flow chart of an image processing method provided by an embodiment of the present disclosure; Figure 8 Another schematic diagram showing a flow chart of an image processing method provided by an embodiment of the present disclosure; Fig. 9 Another schematic flow chart of the image processing method provided by the embodiment of the present disclosure is shown; Fig.10 Another flowchart diagram of the image processing method provided by the embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0014] In order to enable those skilled in the art to better understand the technical solutions in the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present disclosure.

[0015] First, the terms used in this application are explained.

[0016] Security inspection machine: An electronic device that uses a conveyor belt to transport the checked luggage into the scanning channel where the scanning device is located to complete the luggage inspection.

[0017] Scanning device: a device set in the collection area of ​​the security inspection machine for collecting the first image of the object to be tested.

[0018] Image acquisition device: a device for acquiring a second image (such as a visible light image) of the object to be tested.

[0019] Processing device: a device that receives the strip data collected by the scanning device and the second image collected by the image acquisition device and processes the strip data and the second image, and can communicate with the scanning device and the image acquisition device in a wired or wireless manner.

[0020] The security inspection image association system can be integrated with the security inspection machine as a part of the security inspection machine, or part or all of the security inspection image association system can be separately set up. For example, the processing device can be a separately set up computer, which executes the corresponding security inspection image association method by communicating with the scanning device and the image acquisition device set up on the security inspection machine.

[0021] Figure 1 A schematic diagram of a security inspection machine provided by an embodiment of the present disclosure is shown, wherein: Figure 1 (a) shows a side view of a security inspection machine provided by an embodiment of the present disclosure; Figure 1 (b) shows a top view of a security inspection machine provided by an embodiment of the present disclosure. Figure 1 As shown, the security inspection machine includes a scanning channel 100, a conveyor belt 101, and a preset position of the scanning channel 100 ( Figure 1 (a) and Figure 1 (b) is the top of the scanning channel 100) and the scanning device 201 and the image acquisition device 202 ( Figure 1 (a) and Figure 1 In (b), the processing device 203 is not shown), wherein the acquisition direction of the scanning device 201 and the image acquisition device 202 is perpendicular to the conveyor belt 101. In some embodiments, the image acquisition device 202 can be located on the scanning surface of the radiation source of the scanning device 201, that is, the plane formed by the scanning device 201 and the image acquisition device 202 vertically downward is perpendicular to the moving direction of the conveyor belt, so that the first image and the second image of the object to be inspected can be obtained as a top view of the object to be inspected.

[0022] It is understandable that the image acquisition device 202 may also be disposed on the side of the scanning area 100 , so that the acquired second image of the object to be inspected may be a side view of the object to be inspected.

[0023] In some optional embodiments, a plurality of image acquisition devices 202 may be provided, so that the acquired second image of the object to be inspected may include a top view and a side view of the object to be inspected, forming a set of second images.

[0024] Figure 2 A block diagram of a security inspection image association system provided by an embodiment of the present disclosure is shown as follows: Figure 2 As shown, the security inspection image association system 200 includes: The scanning device 201 includes a ray source and a detector, and is used to scan and detect the object to be inspected, and output strip data of the object to be inspected.

[0025] The strip data may be spliced ​​to form a first image of the object to be inspected.

[0026] The image acquisition device 202 is arranged in the scanning channel where the scanning device 201 is located, and is used to start acquiring the second image of the object to be inspected when the scanning device 201 starts scanning the object to be inspected; and to end acquiring the second image of the object to be inspected when the scanning device ends scanning the object to be inspected.

[0027] The processing device 203 is used to: use the second image acquired by the image acquisition device during the scanning and detection process of the object to be inspected as the image association range of the object to be inspected, and associate the target image in the image association range with the first image of the object to be inspected.

[0028] In some embodiments, the scanning device 201 can be an X-ray scanning device, the ray source can emit X-rays from the beam slit, the detector can detect the X-ray scanning data to form strip data, and the processing device 203 can splice the strip data received from the scanning device 201 to form a first image (X-ray image) of the object to be inspected.

[0029] Figure 3 A schematic diagram of a sequence of X-ray images of an object to be inspected at different speeds provided by an embodiment of the present disclosure is shown. Figure 3 As shown, the scanned object 3, the scanned object 2, and the scanned object 1 are multiple strips of data outputted after being scanned and detected by the scanning device 201 when the scanned object 3, the scanned object 2, and the scanned object 1 pass through the scanning area at low speed, medium speed, and high speed, respectively. Figure 3 It can be seen that when the conveyor belt 101 runs at a low speed, a larger number of strips are generated, and when the conveyor belt 101 runs at a high speed, a smaller number of strips are generated. However, the multiple strip data generated at different moving speeds can be spliced ​​to form a first image of the object to be inspected (for example, an X-ray image).

[0030] The image acquisition device 202 can be arranged in the scanning channel where the scanning device 201 is located, and synchronously acquires a second image of the object to be inspected during the scanning and detection process of the object to be inspected by the scanning device 201. There can be multiple second images acquired during the scanning and detection process of the object to be inspected by the scanning device 201. It can be understood that the multiple second images are snapshot images of the object to be inspected moving through the scanning channel with the conveyor belt 101.

[0031] For example, the time when the scanning device 201 starts scanning the object to be inspected is t1, and the time when the scanning device ends scanning the object to be inspected is t2, then the second image captured by the image acquisition device 202 from t1 to t2 can be used as the image association range of the object to be inspected. For example, if the image acquisition device 202 captures N second images from t1 to t2, the processing device 203 can use the N second images as the image association range of the object to be inspected, determine the target image from the N second images, and associate the target image with the first image of the object to be inspected.

[0032] In some embodiments, a second image at a preset position in a queue composed of multiple second images arranged in time order within the image association range can be used as the target image, so as to associate the target image with the first image of the object to be inspected. The preset position can be, for example, the middle position of the queue, or the second image at the position before or after the middle position, or of course, the second image at other positions, which is not limited in the present disclosure.

[0033] By adopting the above technical solution, the target image corresponding to the object to be inspected can be identified efficiently and accurately, the influence of environmental factors on the detection accuracy can be reduced, and the accuracy of the association between the object to be inspected and the target image can be improved.

[0034] The first time t1 at which the scanning device 201 starts scanning the object to be inspected and the second time t2 at which the scanning device 201 ends scanning the object to be inspected may be determined in a variety of possible ways.

[0035] In some embodiments, the processing device 203 can be used to: during the movement of the object to be inspected in the scanning channel, if it is determined that the received strip data changes from blank area data to non-blank area data, then the first non-blank area data in the change process is used as the starting strip data of the object to be inspected. The processing device 203 can use the time of receiving the starting strip data of the object to be inspected as the first time t1 when the scanning device 201 starts scanning the object to be inspected, and can send a start acquisition instruction to the image acquisition device 202 at the same time as determining the first non-blank area data.

[0036] During the movement of the object to be inspected in the scanning channel, if it is determined that the received strip data changes from non-blank area data to blank area data, the last non-blank area data in the change process is used as the end strip data of the object to be inspected, and the processing device 203 can use the time of the next strip data after receiving the end strip data of the object to be inspected as the second time t2 when the scanning device 201 ends scanning the object to be inspected. The processing device 203 can send an end acquisition instruction to the image acquisition device 202 while determining the last non-blank area data.

[0037] Figure 4 A schematic diagram of determining strip data of an object to be inspected provided by an embodiment of the present disclosure is shown, wherein: Figure 4 (a) shows a schematic diagram of determining strip data of an object to be inspected provided by an embodiment of the present disclosure; Figure 4 (b) shows another schematic diagram of determining the strip data of the object to be inspected provided by the embodiment of the present disclosure. Figure 4 In (a), the processing device 203 may sequentially receive multiple strip data such as 01-08, wherein the strip data 01-03 is the blank area strip data output when the blank area before the object to be inspected 1 passes through the scanning area of ​​the scanning device 201 along the conveyor belt, and the strip data 04-08 is the non-blank area strip data output when the object to be inspected 1 passes through the scanning area of ​​the scanning device 201. When the processing device 203 receives the strip data 04, it can compare the pixel values ​​of the strip data 04 with the strip data 03, and when the first deviation of the pixel value exceeds the preset first threshold, take the strip data 04 as the non-blank area data, thereby determining that a change from blank area data to non-blank area data has occurred between the received strip data 03 and the received strip data 04. Taking the case where the blank area strip data is white (pixel value is close to 255) and the non-blank area strip data is black (pixel value is close to 0) as an example, the first deviation can be the difference between the pixel value of strip data 03 and the corresponding pixel value of strip data 04. When the first deviation exceeds the first threshold, it is determined that a change has occurred from blank area data to non-blank area data.

[0038] After determining that a change from blank area data to non-blank area data has occurred between the received strip data 03 and the received strip data 04, the first non-blank area data in the change process, i.e., strip data 04, is used as the starting strip data of the object to be inspected, and while determining that strip data 04 is the starting strip data of the object to be inspected, a start acquisition instruction can be sent to the image acquisition device 202.

[0039] exist Figure 4 In (b), the processing device 203 receives multiple strip data such as 01-10 in sequence. When the processing device 203 receives the strip data 10, it can compare the pixel values ​​of the strip data 10 and the strip data 09. When the second deviation of the pixel value exceeds the preset second threshold, the strip data 10 is used as the blank area data, thereby determining that a change from non-blank area data to blank area data has occurred between the received strip data 09 and the strip data 10. Taking the blank area strip data as white (pixel value close to 255) and the non-blank area strip data as black (pixel value close to 0) as an example, the second deviation can be the difference between the pixel value of the strip data 10 and the corresponding pixel value of the strip data 09.

[0040] The processing device 203 can use the last non-blank area data (i.e., strip data 9) in the change process as the end strip data of the object to be inspected, and when receiving strip data 10 and determining that the last non-blank area data is strip data 9, send an end acquisition instruction to the image acquisition device.

[0041] It should be noted that when comparing the pixel values ​​of the strip data, a variety of possible methods can be used to determine the deviation of the pixel values ​​to determine whether the strip area has changed from non-blank area data to blank area data, or from blank area data to non-blank area data. For example, it can be judged by whether the deviation value of the average pixel value of the strip data exceeds a preset threshold, or it can be judged by whether the number of pixel points in the strip data whose corresponding pixel value deviation value exceeds the preset threshold exceeds a preset number threshold. The present disclosure does not impose any restrictions on this.

[0042] In some embodiments, the processing device 203 is further configured to: use the second image captured by the image capture device between receiving the start capture instruction and the end capture instruction as the image association range of the object to be inspected.

[0043] In some embodiments, the processing device 203 is also used to: upon receiving the strip data of the item to be inspected output by the scanning device 201, determine a data identifier for the strip data of the item to be inspected, and establish a correspondence between each strip data and each second image according to the generation order of the strip data of the item to be inspected and the generation order of the second image, or establish a correspondence between the data identifier of each strip data and each second image.

[0044] The processing device 203 is specifically used to: after determining the data identifier of the starting strip data of the object to be inspected, send it to the image acquisition device as the start acquisition instruction; after determining the data identifier of the ending strip data of the object to be inspected, send it to the image acquisition device as the end acquisition instruction.

[0045] In some embodiments, the data identifier can be further divided into a start identifier, a middle identifier, and an end identifier. Figure 4 For example, in (b), the data identifier of the strip data 04 corresponding to the object to be inspected 1 can be the starting identifier , the data identifier of the strip data 09 corresponding to the object to be inspected 1 can be the end identifier , the data identifiers of the strip data 05-08 corresponding to the item to be inspected 1 can be the intermediate identifiers , , , The data identifier of the strip data 10 corresponding to the object to be inspected 2 can be That is, the subscript k of the data identifier is the data identifier of the kth object to be inspected, and the superscript n may be the strip data number n of the uniformly coded strip data output by the scanning device 201 .

[0046] Of course, the form of data identification is not limited to the above-mentioned embodiments, and may also be other forms of data identification, as long as it can clearly represent the serial number of the corresponding item to be inspected, the strip data belongs to the starting strip data, middle strip data or ending strip data of the item to be inspected, and each strip data has a unified number.

[0047] In some possible implementations, the period at which the image acquisition device 202 acquires the second image may be the same as the period at which the scanning device 201 outputs the strip data. Figure 4 Taking (b) as an example, when the processing device 203 receives the strip data 04 and uses the strip data 04 as the starting strip data of the object to be inspected, it sends a start acquisition instruction to the image acquisition device. The image acquisition device 202 can start to acquire the second image of the object to be inspected when receiving the start acquisition instruction sent by the processing device 203. The processing device 203 can establish a corresponding relationship between the first second image acquired by the image acquisition device 202 and the strip data 04. When the scanning device 201 outputs the strip data 05, the image acquisition device 202 can acquire the second second image, and the processing device 203 can establish a corresponding relationship between the second second image acquired by the image acquisition device 202 and the strip data 05. By analogy, the image acquisition device 202 can respectively acquire the 3rd to 6th second images when the scanning device 201 outputs the strip data 05-09, and the processing device 203 can establish a corresponding relationship between the 3rd to 6th second images acquired by the image acquisition device 202 and the strip data 06-09. When the scanning device 201 outputs the strip data 10, the processing device 203 can determine that the strip data 09 is the end strip data, and send an end acquisition instruction to the image acquisition device 202, so that the image acquisition device 202 ends the acquisition of the second image.

[0048] In another possible implementation, the period at which the image acquisition device 202 acquires the second image may be greater than the period at which the scanning device 201 outputs the strip data. For example, the scanning device 201 outputs one strip data, and the image acquisition device 202 may acquire two second images, thereby forming a one-to-many correspondence between the strip data and the second images, that is, one strip data corresponds to multiple second images.

[0049] The period at which the image acquisition device 202 acquires the second image may also be smaller than the period at which the scanning device 201 outputs the strip data. For example, the scanning device 201 outputs two strip data, and the image acquisition device 202 may acquire one second image, thereby forming a many-to-one correspondence between the strip data and the second image, that is, multiple strip data correspond to one second image.

[0050] In some embodiments, when generating the corresponding relationship, the corresponding relationship between each stripe data and each second image may be established according to the generation order of the stripe data of the object to be inspected and the generation order of the second image.

[0051] For example, the correspondence between each strip of data and each second image may be, for example, that the strip of data and the corresponding second image are stored in a preset storage structure. In the case where the strip of data and the second image are in a one-to-one correspondence, one strip of data and one second image may be stored in a preset storage structure; in the case where the strip of data and the second image are in a one-to-many correspondence, one strip of data and a plurality of corresponding second images arranged in chronological order may be stored in a preset storage structure; in the case where the strip of data and the second image are in a many-to-one correspondence, a plurality of strip of data arranged in chronological order and the corresponding second image may be stored in a preset storage structure.

[0052] In another embodiment, when generating the corresponding relationship, the generation order of the strip data of the object to be inspected and the generation order of the second image may be followed, or the corresponding relationship between the data identifier of each strip data and each second image may be established.

[0053] A corresponding relationship may be established between the data identifier of the strip data and the second image, and the data identifier of the strip data and the corresponding second image may be stored in a preset data structure (such as a linked list or a queue). In the case where the strip data and the second image are in a one-to-one corresponding relationship, a data identifier of a strip data and a second image may be stored in a preset storage structure in correspondence; in the case where the strip data and the second image are in a one-to-many corresponding relationship, a data identifier of a strip data and a plurality of corresponding second images arranged in chronological order may be stored in a preset storage structure; in the case where the strip data and the second image are in a many-to-one corresponding relationship, the data identifiers corresponding to a plurality of strip data arranged in chronological order and the corresponding second images may be stored in a preset storage structure.

[0054] It should be noted that, since multiple image acquisition devices 202 can be set up to obtain second images of the inspected object at different perspectives at a certain moment, the second images at different perspectives can be saved as a group of second images corresponding to the strip data. The correspondence between the strip data and a group of second images at different perspectives also belongs to the above-mentioned one-to-one correspondence.

[0055] After determining the strip data of each object to be inspected and saving the corresponding relationship between the strip data and the second image, or the corresponding relationship between the data identifier of the strip data and the second image, the processing device 203 is further used to: For the strip data belonging to the same item to be inspected, the target image is determined from the image association range according to the data identifier of the strip data and the correspondence between the strip data and the second image, or the target image is determined from the image association range according to the data identifier of the strip data and the correspondence between the data identifier of the strip data and the second image.

[0056] The processing device 203 is specifically used for: For the strip data belonging to the same object to be inspected, the target data identifier is determined according to the data identifier of the starting strip data of the object to be inspected and the data identifier of the ending strip data of the object to be inspected; Determine the target image within the image association range by using the strip data corresponding to the target data identifier and the corresponding relationship between the strip data and the second image; or The target image is determined from within the image association range by using the target data identifier and the corresponding relationship between the data identifier of the strip data and the second image.

[0057] In some embodiments, for the strip data belonging to the same object to be inspected, the following formula can be used to determine the target data identifier according to the data identifier of the starting strip data of the object to be inspected and the data identifier of the ending strip data of the object to be inspected.

[0058] (Formula 1) in, is the target data identifier of the i-th item to be inspected, is the stripe data number in the data identifier of the starting stripe data corresponding to the i-th item to be inspected, is the stripe data number in the data identifier of the end stripe data corresponding to the i-th item to be inspected, is the ceiling function.

[0059] For example, Figure 4 Take the item 1 in (b) as an example. The strip data number 4 corresponds to the starting strip data of the object 1 to be inspected. The stripe data code 9 corresponding to the end stripe data of the object to be inspected 1, The target data identifier 7 of the object to be inspected 1, that is, the corresponding stripe data is stripe data 07.

[0060] In some embodiments, after determining the target data identifier, the target image can be determined from the image association range by using the strip data corresponding to the target data identifier and the correspondence between the strip data and the second image; the target image can also be determined from the image association range by using the target data identifier and the correspondence between the data identifier of the strip data and the second image.

[0061] For example, after determining the target data identifier 7 of the object to be inspected 1, the corresponding target image can be determined from the corresponding relationship between the strip data and the second image stored in the preset storage structure using the corresponding strip data as 07. Alternatively, after determining the target data identifier 7 of the object to be inspected 1, the target data identifier 7 can be used to determine the corresponding target image from the corresponding relationship between the data identifier of the strip data and the second image stored in the preset storage structure.

[0062] It should be noted that, when the relationship between the strip data (the data identifier of the strip data) and the second image is one-to-one or many-to-one, a corresponding target image (or a group of target images with different perspectives) can be uniquely determined directly from the corresponding relationship; when the relationship between the strip data (the data identifier of the strip data) and the second image is one-to-many, one second image (or a group of target images with different perspectives) can be arbitrarily selected from multiple second images (or multiple groups of target images with different perspectives) corresponding to the strip data as the target image.

[0063] In some embodiments, after the target image within the image association range is associated with the first image of the object to be inspected, the association relationship between the target image and the first image of the object to be inspected may also be saved.

[0064] In some embodiments, after the target image within the image association range is associated with the first image of the object to be inspected, the target image and the first image of the object to be inspected may also be associated and displayed.

[0065] By adopting the above technical solution, the target image corresponding to the object to be inspected can be identified efficiently and accurately, the influence of environmental factors on the detection accuracy can be reduced, and the accuracy of the association between the object to be inspected and the target image can be improved.

[0066] Figure 5 A block diagram of another security inspection image association system provided by an embodiment of the present disclosure is shown. Figure 5 As shown, the security inspection image association system 200 may further include a position detection sensor 204 .

[0067] In some embodiments, a position detection sensor 204 may be arranged upstream of the radiation source along the moving direction of the object to be inspected in the scanning channel, wherein the position of the position detection sensor 204 and the scanning surface of the radiation source are less than a distance threshold, and the position detection sensor 204 is used to detect the moving position of the object to be inspected in the scanning channel. For example, if the moving direction of the object to be inspected in the scanning channel is from left to right, the position detection sensor may be arranged on the left side of the scanning surface of the radiation source within a range less than the distance threshold.

[0068] In some possible implementations, the position detection sensor 204 may be a laser radar disposed at the top of the scanning area, and determines whether an object to be inspected has passed through the detection area of ​​the laser radar by detecting the change in the distance between the top and the bottom of the scanning area. When no object to be inspected passes through the detection area of ​​the laser radar, the distance detected by the laser radar is the distance between the top of the scanning area and the conveyor belt, and when an object to be inspected passes through the detection area of ​​the laser radar, the distance detected by the laser radar is the distance between the top of the scanning area and the top of the object to be inspected, that is, when an object to be inspected passes through the detection area of ​​the laser radar, the distance detected by the laser radar will change.

[0069] In some embodiments, the position detection sensor 204 may generate a first trigger signal when the object to be inspected is detected for the first time, and the processing device 203 may send a start acquisition instruction to the image acquisition device 202 upon receiving the first trigger signal sent by the position detection sensor 204 .

[0070] After generating the first trigger signal, the position detection sensor 204 may generate a second trigger signal when no longer detecting the object to be inspected. The processing device 203 may send an end acquisition instruction to the image acquisition device 202 when receiving the second trigger signal sent by the position detection sensor 204 .

[0071] After generating the first trigger signal, the position detection sensor 204 may continue to send a trigger signal to the processing device 203 (for example, a periodic trigger signal may be sent at a preset period) until the object to be detected is no longer detected. After receiving the first trigger signal sent by the position detection sensor 204, the processing device 203 sends an end acquisition instruction to the image acquisition device 202 if it does not receive the trigger signal sent by the position detection sensor 204 again.

[0072] By adopting the above-mentioned technical solution, the second image can be captured before the scanning device starts to output the strip data, thereby avoiding the delay caused by the image acquisition device capturing the second image after the scanning device outputs the strip data of the object to be inspected, and further improving the accuracy of the association between the object to be inspected and the target image.

[0073] When performing security inspection image association, there may also be scenarios such as a bag being blocked in the security inspection channel, the items to be inspected being too long, or the items to be inspected being closely arranged. In some embodiments, the processing device 203 is specifically configured to: When it is determined that the cumulative amount of strip data generated exceeds the threshold, the scanning and detection of the previous object to be inspected is determined to be completed, and the scanning and detection of the next object to be inspected is started, and the first strip data after exceeding the threshold is determined as the starting strip data of the next object to be inspected, and the second image collected after exceeding the threshold is synchronously determined as the second image corresponding to the next object to be inspected. Figure 6 A schematic diagram showing another method of determining strip data of an object to be inspected provided by an embodiment of the present disclosure is shown. Figure 6 As shown, the object to be inspected 1 is an overlong object. After the processing device 203 receives the strip data 10, if it is determined that the cumulative generated amount of the strip data (04-10, 7 in total) is greater than or equal to the threshold value (for example, 7), it can be determined that the scanning and detection of the object to be inspected 1-1 is completed, and the scanning and detection of the next object to be inspected 1-2 is started, and the first strip data 11 after exceeding the threshold value is determined as the starting strip data of the next object to be inspected 1-2, and the strip data 10 before the first strip data 11 after exceeding the threshold value is determined as the ending strip data of the object to be inspected 1-1. By analogy, the starting strip data of the object to be inspected 1-2 can be determined as strip data 11, and the ending strip data can be determined as strip data 18, and the starting strip data of the object to be inspected 1-3 can be determined as strip data 19, and the ending strip data can be determined as strip data 20.

[0074] After determining the starting stripe data and the ending stripe data corresponding to the inspected items 1-1, 1-2 and 1-3, respectively, the target data identifiers of the stripe data corresponding to the inspected items 1-1, 1-2 and 1-3 can be respectively confirmed as 7, 15 and 20 according to Formula 1. Then, the stripe data corresponding to the target data identifier and the corresponding relationship between the stripe data and the second image are used to determine the target images corresponding to the inspected items 1-1, 1-2 and 1-3 from the image association range; or the target data identifier and the corresponding relationship between the data identifier of the stripe data and the second image are used to determine the target images corresponding to the inspected items 1-1, 1-2 and 1-3 from the image association range.

[0075] By adopting the above technical solution, for abnormal situations such as extra-long objects to be inspected or objects to be inspected that are closely arranged, the extra-long objects to be inspected or the objects to be inspected that are closely arranged can be divided into sub-objects to be inspected, and the target images corresponding to the sub-objects to be inspected can be obtained respectively, thereby obtaining the target images corresponding to different parts of the extra-long objects to be inspected, or the target images corresponding to different objects to be inspected among the closely arranged objects to be inspected, further improving the compatibility of the security inspection image association system with abnormal scenarios when performing security inspection image association.

[0076] Figure 7 A schematic flow chart of an image processing method provided by an embodiment of the present disclosure is shown. The method can be executed by a processing device in a security inspection image correlation system. Figure 7 As shown, the method may include the following steps.

[0077] In step S101, a second image acquired by the image acquisition device during the scanning and detection process of the object to be inspected is used as the image association range of the object to be inspected.

[0078] In step S102, the target image within the image association range is associated with the first image of the object to be inspected.

[0079] Among them, the first image is formed by splicing the strip data output by the scanning device during the scanning and detection process of the object to be inspected, and the second image is the image of the object to be inspected captured by the image acquisition device between the first moment when the scanning device starts scanning the object to be inspected and the second moment when the scanning device ends scanning the object to be inspected.

[0080] The above detailed steps have been described in detail in the embodiment of the first aspect and will not be repeated here.

[0081] By adopting the above technical solution, the target image corresponding to the object to be inspected can be identified efficiently and accurately, the influence of environmental factors on the detection accuracy can be reduced, and the accuracy of the association between the object to be inspected and the target image can be improved.

[0082] Figure 8 Another flowchart of the image processing method provided by the embodiment of the present disclosure is shown as follows: Figure 8 As shown, the method may further include the following steps.

[0083] In step S103, when the strip data of the item to be inspected output by the scanning device is received, a data identifier is determined for the strip data of the item to be inspected, and a correspondence between each strip data and each second image is established according to the generation order of the strip data of the item to be inspected and the generation order of the second image, or a correspondence between the data identifier of each strip data and each second image is established.

[0084] In step S104, for the strip data belonging to the same item to be inspected, the target image is determined from the image association range according to the data identifier of the strip data and the correspondence between the strip data and the second image, or the target image is determined from the image association range according to the data identifier of the strip data and the correspondence between the data identifier of the strip data and the second image.

[0085] Specifically, for the strip data belonging to the same object to be inspected, the target data identifier is determined according to the data identifier of the starting strip data of the object to be inspected and the data identifier of the ending strip data of the object to be inspected; Determine the target image within the image association range by using the strip data corresponding to the target data identifier and the corresponding relationship between the strip data and the second image; or The target image is determined from within the image association range by using the target data identifier and the corresponding relationship between the data identifier of the strip data and the second image.

[0086] In some embodiments, the image acquisition device starts acquiring the second image of the object to be inspected upon receiving a start acquisition instruction sent by the processing device, and ends acquiring the second image of the object to be inspected upon receiving an end acquisition instruction sent by the processing device.

[0087] In some embodiments, step S101 specifically includes: taking the second image captured by the image acquisition device between receiving the start acquisition instruction and the end acquisition instruction as the image association range of the object to be inspected.

[0088] The above detailed steps have been described in detail in the embodiment of the first aspect and will not be repeated here.

[0089] By adopting the above technical solution, the target image corresponding to the object to be inspected can be identified efficiently and accurately, the influence of environmental factors on the detection accuracy can be reduced, and the accuracy of the association between the object to be inspected and the target image can be improved.

[0090] Fig. 9 Another flowchart of the image processing method provided by the embodiment of the present disclosure is shown as follows: Fig. 9 As shown, the method may further include the following steps.

[0091] In step S105, when it is determined that the cumulative amount of strip data generated exceeds the threshold, it is determined that the scanning and detection of the previous object to be inspected is completed and the scanning and detection of the next object to be inspected is started, and the first strip data after exceeding the threshold is determined as the starting strip data of the next object to be inspected, and the second image collected after exceeding the threshold is synchronously determined as the second image corresponding to the next object to be inspected.

[0092] The above detailed steps have been described in detail in the embodiment of the first aspect and will not be repeated here.

[0093] By adopting the above technical solution, for abnormal situations such as extra-long objects to be inspected or objects to be inspected that are closely arranged, the extra-long objects to be inspected or the objects to be inspected that are closely arranged can be divided into sub-objects to be inspected, and the target images corresponding to the sub-objects to be inspected can be obtained respectively, thereby obtaining the target images corresponding to different parts of the extra-long objects to be inspected, or the target images corresponding to different objects to be inspected among the closely arranged objects to be inspected, further improving the compatibility of the security inspection image association system with abnormal scenarios when performing security inspection image association.

[0094] Fig.10 Another flowchart of the image processing method provided by the embodiment of the present disclosure is shown as follows: Fig.10 As shown, the method may include the following steps.

[0095] In step S201, stripe data outputted by scanning and detection by a scanning device is obtained.

[0096] In step S202, it is determined whether the first deviation of the stripe data exceeds a first threshold. If the first deviation of the stripe data does not exceed the first threshold, the stripe data output by the scanning device is continuously acquired.

[0097] In step S203, when the first deviation of the strip data exceeds the first threshold, the starting strip data of the object to be inspected is determined, and a start acquisition instruction is sent to the image acquisition device.

[0098] In step S204, the strip data and the second image captured by the image capture device are received.

[0099] In step S205, a correspondence relationship between each strip of data and each second image is established, or a correspondence relationship between a data identifier of each strip of data and each second image is established.

[0100] In step S206, it is determined whether the second deviation of the stripe data exceeds the second threshold. If the second deviation of the stripe data does not exceed the second threshold and the accumulated amount of the stripe data does not exceed the threshold, the stripe data and the second image are continuously received.

[0101] In step S207, when the first deviation of the strip data exceeds the second threshold, or when the first deviation of the strip data does not exceed the second threshold but the cumulative generation of the strip data exceeds the threshold, the target data identifier is determined according to the data identifier of the starting strip data of the object to be inspected and the data identifier of the ending strip data of the object to be inspected.

[0102] In step S208, the target data identifier is used to determine the target image from the image association range, and the first image formed by splicing the strip data and the target image are associated and stored and / or displayed.

[0103] The above detailed steps have been described in detail in the embodiment of the first aspect and will not be repeated here.

[0104] By adopting the above technical solution, the target image corresponding to the object to be inspected can be identified efficiently and accurately, the influence of environmental factors on the detection accuracy can be reduced, and the accuracy of the association between the object to be inspected and the target image can be improved.

[0105] The embodiments of the present disclosure also propose a readable storage medium, which stores programs or instructions. When the programs or instructions are executed by a processor, the methods disclosed in the embodiments shown in the second aspect are implemented and the functions and beneficial effects of the methods described in the previous method embodiments are realized, which will not be repeated here.

[0106] The readable storage medium includes a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0107] Furthermore, the embodiments of the present disclosure also provide a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the following process is implemented: the method disclosed in the embodiment shown in the first aspect and the functions and beneficial effects of the various methods described in the previous method embodiments are implemented, which will not be repeated here.

[0108] An embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the various processes of the method disclosed in the embodiment shown in the first aspect or the second aspect, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0109] In short, the above is only a preferred embodiment of the present disclosure and does not limit the protection scope of the present disclosure. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

[0110] The systems, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0111] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0112] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0113] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

Claims

1. A security inspection image association system, characterized in that: include: A scanning device, including a ray source and a detector, for scanning and detecting the object to be inspected, and outputting strip data of the object to be inspected, wherein the strip data can be spliced ​​to form a first image of the object to be inspected; An image acquisition device, arranged in the scanning channel where the scanning device is located, and used to start acquiring the second image of the object to be inspected when the scanning device starts scanning the object to be inspected; and to stop acquiring the second image of the object to be inspected when the scanning device stops scanning the object to be inspected; The processing device is used to: use the second image acquired by the image acquisition device during the scanning and detection process of the object to be inspected as the image association range of the object to be inspected, and associate the target image within the image association range with the first image of the object to be inspected.

2. The system according to claim 1, characterized in that The processing device is also used to: upon receiving the strip data of the item to be inspected output by the scanning device, determine a data identifier for the strip data of the item to be inspected, and establish a correspondence between each strip data and each second image, or establish a correspondence between the data identifier of each strip data and each second image, according to the generation order of the strip data of the item to be inspected and the generation order of the second image.

3. The system according to claim 2, characterized in that The processing device is specifically used for: For the strip data belonging to the same item to be inspected, the target image is determined from the image association range according to the data identifier of the strip data and the correspondence between the strip data and the second image, or the target image is determined from the image association range according to the data identifier of the strip data and the correspondence between the data identifier of the strip data and the second image.

4. The system according to claim 3, characterized in that The processing device is specifically used for: For the strip data belonging to the same object to be inspected, the target data identifier is determined according to the data identifier of the starting strip data of the object to be inspected and the data identifier of the ending strip data of the object to be inspected; Determine the target image within the image association range by using the strip data corresponding to the target data identifier and the corresponding relationship between the strip data and the second image; or The target image is determined from within the image association range by using the target data identifier and the corresponding relationship between the data identifier of the strip data and the second image.

5. The system according to claim 1, characterized in that The image acquisition device is located on the scanning surface of the ray source.

6. The system according to claim 1, characterized in that The image acquisition device is used to start acquiring the second image of the object to be inspected when receiving a start acquisition instruction sent by the processing device, and to end acquiring the second image of the object to be inspected when receiving an end acquisition instruction sent by the processing device; The processing device is further used to: use the second image acquired by the image acquisition device between receiving the start acquisition instruction and the end acquisition instruction as the image association range of the object to be inspected.

7. The system according to claim 6, characterized in that The processing device is specifically used for: During the movement of the object to be inspected in the scanning channel, if it is determined that the received strip data changes from blank area data to non-blank area data, the first non-blank area data in the change process is used as the starting strip data of the object to be inspected; and sending a start acquisition instruction to the image acquisition device while determining the first non-blank area data; and / or, During the movement of the object to be inspected in the scanning channel, if it is determined that the received strip data changes from non-blank area data to blank area data, the last non-blank area data in the change process is used as the end strip data of the object to be inspected; and at the same time as the last non-blank area data is determined, an end acquisition instruction is sent to the image acquisition device.

8. The system according to claim 6, characterized in that A position detection sensor is arranged upstream of the radiation source along the moving direction of the object to be inspected in the scanning channel, and the position of the position detection sensor and the scanning surface of the radiation source are less than a distance threshold; The position detection sensor is used to detect the moving position of the object to be inspected in the scanning channel; The processing device is specifically used for: sending a start acquisition instruction to the image acquisition device upon receiving a first trigger signal sent by the position detection sensor, wherein the first trigger signal is generated when the position detection sensor detects the object to be inspected for the first time; In case of receiving a second trigger signal sent by the position detection sensor, an end acquisition instruction is sent to the image acquisition device, wherein the second trigger signal is generated by the position detection sensor when the position detection sensor no longer detects the object to be inspected after generating the first trigger signal; or, the processing device is specifically used for: after receiving the first trigger signal sent by the position detection sensor, once the trigger signal sent by the position detection sensor is no longer received, sending an end acquisition instruction to the image acquisition device.

9. The system according to claim 1, characterized in that The processing device is specifically used for: When it is determined that the cumulative amount of strip data generated exceeds the threshold, it is determined that the scanning and detection of the previous object to be inspected is completed and the scanning and detection of the next object to be inspected is started, and the first strip data after exceeding the threshold is determined as the starting strip data of the next object to be inspected, and the second image collected after exceeding the threshold is synchronously determined as the second image corresponding to the next object to be inspected.

10. The system according to claim 6, characterized in that The processing device is specifically used for: After determining the data identifier of the starting strip data of the object to be inspected, the data identifier is sent to the image acquisition device as the start acquisition instruction; After determining the data identifier of the end strip data of the object to be inspected, it is sent to the image acquisition device as the end acquisition instruction.

11. A security inspection image association method, characterized in that: The method comprises: Using the second image acquired by the image acquisition device during the scanning and detection process of the object to be inspected as the image association range of the object to be inspected; Associating the target image within the image association range with the first image of the object to be inspected; Among them, the first image is formed by splicing strip data output by the scanning device during the scanning and detection process of the object to be inspected, and the second image is an image of the object to be inspected acquired by the image acquisition device between the first moment when the scanning device starts scanning the object to be inspected and the second moment when the scanning device ends scanning the object to be inspected.

12. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the security inspection image association method as claimed in claim 11 are implemented.

Images