Data association method, device, electronic device and computer readable storage medium

Abstract

This invention provides a data association method, apparatus, electronic device, and computer-readable storage medium. The method includes: when luggage is detected being placed on the conveyor belt of a security checkpoint, acquiring a first user image corresponding to the user placing the luggage, and acquiring a luggage placement diagram and a luggage image; associating the first user image and the luggage image based on the luggage placement diagram to obtain first association data; when luggage is detected passing through the security checkpoint, acquiring a luggage security check diagram generated in the security checkpoint, and associating the luggage image and the first association data based on the conveyor belt's time information to obtain second association data; analyzing the luggage security check diagram based on a preset image judgment mode to obtain an item analysis result corresponding to the luggage, and associating the item analysis result with the second association data to obtain third association data. This invention associates user images, luggage, and item analysis results to achieve rapid security checks through associated data.

Description

Technical Field

[0001] The present invention relates to the technical field of station operation safety management, and in particular to a data association method, device, electronic equipment and computer-readable storage medium. Background Art

[0002] At present, in the domestic station security inspection business process, the association and binding of user information and carry-on baggage has not been realized. Therefore, if it is necessary to trace the user information through the baggage, the main security inspection method is to manually screen the video images during the baggage inspection period, which makes the security inspection efficiency low. Summary of the invention

[0003] The present invention provides a data association method, device, electronic device and computer-readable storage medium, which are used to solve the defect of low efficiency of manual security inspection in the prior art and realize rapid security inspection based on the association data of user information and his / her carry-on luggage.

[0004] The present invention provides a data association method, comprising:

[0005] When detecting that there is luggage placed on the conveyor belt of the security inspection device, collecting a first user image of the user corresponding to the user who places the luggage, collecting a luggage placement map and a luggage physical map of the luggage, and associating the first user image with the luggage physical map based on the luggage placement map to obtain first associated data;

[0006] When detecting that the luggage passes through the security inspection device, obtaining a luggage security inspection map generated by the luggage in the security inspection device, and associating the luggage security inspection map with the first associated data based on the time information of the conveyor belt to obtain second associated data;

[0007] The baggage security inspection image is analyzed based on a preset image judgment mode to obtain an analysis result of an item corresponding to the baggage, and the item analysis result is associated with the second associated data to obtain third associated data.

[0008] According to a data association method provided by the present invention, after the step of associating the item analysis result with the second associated data to obtain the third associated data, the method further includes:

[0009] After detecting that the luggage passes through the security inspection device, collecting and extracting a second user image of the user corresponding to the luggage;

[0010] Based on the first user image and the second user image, the second user image and the third associated data are associated to obtain target associated data.

[0011] According to a data association method provided by the present invention, the user image includes a user face image and a user clothing image, and the step of associating the second user image with the third associated data based on the first user image and the second user image to obtain target associated data includes:

[0012] Determining facial similarity between a first user facial image of the first user image and a second user facial image of the second user image;

[0013] If the face similarity is greater than a first preset face similarity threshold, associating the second user image with the third associated data to obtain the target associated data;

[0014] If the face similarity is greater than or equal to a second preset face similarity threshold and less than the first preset face similarity threshold, determining clothing similarity between the first user clothing image of the first user image and the second user clothing image of the second user image;

[0015] If the clothing similarity is greater than or equal to a preset clothing similarity threshold, the second user image is associated with the third associated data to obtain the target associated data.

[0016] According to a data association method provided by the present invention, the luggage placement map includes user hand edge feature points and luggage edge feature points, and the step of associating the first user image with the luggage physical map based on the luggage placement map to obtain first association data includes:

[0017] Calculating the edge distance between the edge feature point of the user's hand and the edge feature point of the luggage, and determining whether the edge distance is greater than a preset distance threshold;

[0018] If the edge distance is less than or equal to the preset distance threshold, the first user image is associated with the luggage physical image to obtain the first associated data.

[0019] According to a data association method provided by the present invention, the time information includes a first time value of the luggage entering the security inspection device and a second time value of the luggage security inspection map generated by the security inspection device, and the step of associating the luggage security inspection map with the first associated data based on the time information of the conveyor belt to obtain the second associated data includes:

[0020] Calculating a time difference between the first time value and the second time value, and determining whether the time difference is greater than a preset time value;

[0021] If the time difference is less than or equal to the preset time value, the baggage security inspection map is associated with the first associated data to obtain the second associated data.

[0022] According to a data association method provided by the present invention, the step of analyzing the baggage security inspection image based on a preset image judgment mode to obtain an analysis result of an item corresponding to the baggage includes:

[0023] If the preset image judgment mode is a manual image judgment mode, determining the items manually marked in the baggage security inspection image to obtain the item analysis result;

[0024] If the preset image judgment mode is the automatic image judgment mode, determining whether there is a target object in the baggage security inspection image, wherein the image similarity between the object image corresponding to the target object and the preset object image is less than a preset threshold;

[0025] If the target object exists in the baggage security inspection map, the target object is marked in the baggage security inspection map to obtain the object analysis result.

[0026] According to a data association method provided by the present invention, after the step of associating the second user image with the third associated data based on the first user image and the second user image to obtain target associated data, the method further includes:

[0027] The target associated data is sent to a corresponding review device so that the review device can determine whether the items marked in the target associated data are correct and obtain a corresponding review result. If the review result is that the items marked in the target associated data are incorrect, the items marked in the target associated data are corrected and the corrected final associated data is fed back.

[0028] The present invention also provides a data association device, comprising:

[0029] a collection module, configured to collect a first user image of a user who places the luggage, and a luggage placement diagram and a luggage physical diagram of the luggage, and associate the first user image with the luggage physical diagram based on the luggage placement diagram to obtain first association data when detecting that there is luggage placed on a conveyor belt of a security inspection device;

[0030] an association module, configured to acquire a baggage security inspection map generated by the baggage in the security inspection device when detecting that the baggage passes through the security inspection device, and associate the baggage security inspection map with the first association data based on the time information of the conveyor belt to obtain second association data;

[0031] The analysis module is used to analyze the baggage security inspection image based on a preset image judgment mode to obtain an analysis result of the items corresponding to the baggage, and associate the analysis result of the items with the second associated data to obtain third associated data.

[0032] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of any of the above-mentioned data association methods are implemented.

[0033] The present invention also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above-mentioned data association methods are implemented.

[0034] The present invention also provides a computer program product, which includes a computer program. When the computer program is executed by the processor, the steps of any one of the above data association methods are implemented.

[0035] The data association method, device, electronic device and computer-readable storage medium provided by the present invention, when detecting that there is luggage placed on the conveyor belt of the security inspection equipment, collect the first user image of the user corresponding to the placed luggage, and collect the luggage placement map and the luggage physical map of the luggage, and associate the first user image with the luggage physical map based on the luggage placement map to obtain the first associated data; when detecting that the luggage passes through the security inspection equipment, obtain the luggage security inspection map generated by the luggage in the security inspection equipment, and associate the luggage physical map with the first associated data based on the time information of the conveyor belt to obtain the second associated data; analyze the luggage security inspection map based on the preset image judgment mode to obtain the analysis result of the items corresponding to the luggage, and associate the item analysis result with the second associated data to obtain the third associated data. It can be seen from this that the present invention associates the user image, luggage and item analysis results. If it is necessary to trace the user information through the luggage, the associated data can be used to automatically perform a quick security check without manual participation, thereby improving the security inspection efficiency of the station. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0037] Figure 1 It is one of the flow charts of the data association method provided by the present invention;

[0038] Figure 2This is the second flow chart of the data association method provided by the present invention;

[0039] Figure 3 It is a structural schematic diagram of the data association device provided by the present invention;

[0040] Figure 4 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0041] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0042] Combine the following Figures 1 to 4 The present invention describes a data association method, device, electronic device, and computer-readable storage medium.

[0043] Specifically, the present invention provides a data association method, referring to Figure 1 , Figure 1 This is one of the flow charts of the data association method provided by the present invention.

[0044] The embodiment of the present invention provides an embodiment of the data association method. It should be noted that although a logical order is shown in the flow chart, under certain data, the steps shown or described may be completed in an order different from that shown here.

[0045] The method of the embodiment of the present invention takes an electronic device as an example of an execution subject. The data association method provided by the embodiment of the present invention includes:

[0046] Step S10, when it is detected that there is luggage placed on the conveyor belt of the security inspection device, a first user image of the user corresponding to the user who places the luggage is collected, and a luggage placement map and a luggage physical map of the luggage are collected, and the first user image is associated with the luggage physical map based on the luggage placement map to obtain first associated data.

[0047] It should be noted that the data association system in the embodiment of the present invention is one of the manifestations of electronic devices and does not limit electronic devices. The data association system is connected to the security inspection equipment of the station, that is, the data association system can obtain real-time data of the security inspection equipment and the conveyor belt connected to the security inspection equipment, wherein the real-time data of the security inspection equipment can be a luggage security inspection map, which is a luggage X-ray map generated when the luggage passes through the security inspection equipment, and the real-time data of the conveyor belt can be whether there is luggage placed in the conveyor belt, and the time when the luggage on the conveyor belt enters the security inspection equipment. The station includes but is not limited to railway stations and passenger stations.

[0048] When a user passes security check at a station, if the user carries luggage, the luggage needs to be placed on the conveyor belt of the security check equipment for security check and entry. Therefore, when the data association system detects that there is luggage placed on the conveyor belt connected to the security check equipment, it calls the corresponding camera device (camera, video camera) to collect the video data of the user corresponding to the luggage when the luggage is placed, and determines the frame with the highest definition in the video data as the first user image of the user, wherein the number of camera devices called is at least one, and the frame with the highest definition can be understood as the image with the highest definition of the user's face in the first user image, and the most typical image of the user's clothing features, which include but are not limited to hats, clothing colors and clothing patterns, that is, a user image can be divided into a user face image and a user clothing image. At the same time, the data association system needs to collect the actual luggage image of the luggage through the camera device, as well as the overall image of the user and the luggage, that is, the luggage placement map. Next, the data association system associates the first user image with the luggage physical image according to the distance between the edge feature points of the user's hand and the edge feature points of the luggage in the luggage placement map, and the preset distance threshold, to obtain first association data based on the luggage physical image, as shown in steps S101 to S102. Among them, the edge feature points of the user's hand are the edge feature points of the user's fingers, the edge feature points of the luggage are the edge feature points of the top of the luggage, and the preset distance threshold is set according to actual conditions, and this embodiment does not limit it.

[0049] It should be further explained that the data association system includes at least a terminal device and a server, the terminal device is equipped with a corresponding camera device, and includes a security inspection device (luggage X-ray machine or / and CT security inspection device), which is mainly used to collect the user image of the user when placing the luggage, the luggage security inspection map, the luggage placement map and the luggage physical map of the luggage, and send the user image, the luggage security inspection map, the luggage placement map and the luggage physical map to the server. The server is mainly used to receive the user image, the luggage security inspection map, the luggage placement map and the luggage physical map sent by the terminal device, and associate the user image, the luggage security inspection map, the luggage placement map and the luggage physical map.

[0050] Step S101, calculating the edge distance between the edge feature point of the user's hand and the edge feature point of the luggage, and determining whether the edge distance is greater than a preset distance threshold;

[0051] Step S102: If the edge distance is less than or equal to the preset distance threshold, the first user image is associated with the luggage physical image to obtain the first associated data.

[0052] Specifically, the data association system calculates the edge distance between the edge feature point of the user's hand and the edge feature point of the luggage, and determines whether the edge distance is greater than a preset distance threshold. If it is determined that the edge distance is less than or equal to the preset distance threshold, the data association system determines that the user is the user who placed the luggage, and associates the first user image with the luggage physical map to obtain first association data based on the luggage physical map. If it is determined that the edge distance is greater than the preset distance threshold, the data association system determines that the user is not the user who placed the luggage, and will not associate the first user image with the luggage physical map. The user image corresponding to the luggage is further determined based on the video data in the data association system, and the determined user image is associated with the luggage physical map.

[0053] Furthermore, the present embodiment may also perform the following method, specifically: the data association system determines the image distance between the edge feature point of the user's hand and the edge feature point of the luggage in the luggage placement map, converts the image distance into the real distance between the edge feature point of the user's hand and the edge feature point of the luggage according to the preset conversion rule, and determines whether the real distance is greater than the preset distance. Among them, the image distance is also the relative distance in the image plane, and the real distance is also the relative distance in the real space. The preset conversion rule is set according to the performance of the camera device, and this embodiment does not limit it. If it is determined that the real distance is less than or equal to the preset distance, the data association system determines that the user is the user who places the luggage, and associates the first user image with the luggage physical map to obtain the first association data based on the luggage physical map. If it is determined that the real distance is greater than the preset distance, the data association system determines that the user is not the user who places the luggage, and will not associate the first user image with the luggage physical map. Further, the user image corresponding to the luggage is determined according to the video data in the data association system, and the determined user image is associated with the luggage physical map.

[0054] This embodiment uses the edge distance between the edge feature points of the user's hand and the edge feature points of the luggage in the luggage placement diagram, and accurately associates the luggage with the first user image corresponding to it in combination with a preset distance threshold, thereby ensuring the accuracy of the first associated data, thereby ensuring the accuracy of the station security check. Therefore, when it is necessary to trace the user information through the luggage, the user information can be accurately found out through the associated data, thereby improving the technical defense capability of the security check.

[0055] Step S20, when it is detected that the luggage passes through the security inspection device, a luggage security inspection map generated by the luggage in the security inspection device is obtained, and the luggage security inspection map is associated with the first associated data based on the time information of the conveyor belt to obtain second associated data.

[0056] When the data association system detects that the luggage enters the security inspection device through the conveyor belt, it determines the first time value of the luggage entering the security inspection device, and obtains the luggage security inspection map generated by the luggage in the security inspection device during the luggage passing through the security inspection device, and at the same time needs to determine the second time value of the luggage security inspection map generated by the security inspection device, wherein the first time value and the second time value are the time information of the conveyor belt. Then, the data association system associates the luggage security inspection map with the first association data according to the first time value and the second time value to obtain the corresponding second association data, as shown in steps S201 to S202.

[0057] Step S201, calculating a time difference between the first time value and the second time value, and determining whether the time difference is greater than a preset time value;

[0058] Step S202: If the time difference is less than or equal to the preset time value, the baggage security inspection map is associated with the first associated data to obtain the second associated data.

[0059] Specifically, the data association system calculates the time difference between the first time value and the second time value, and determines whether the time difference is greater than the preset time value, wherein the preset time value is set according to the actual situation and is not limited in this embodiment. If it is determined that the time difference is less than or equal to the preset time value, the data association system determines that the luggage corresponds to the luggage security inspection map, and associates the luggage security inspection map with the first associated data to obtain the corresponding second associated data. If it is determined that the time difference is greater than the preset time value, the data association system determines that the luggage does not correspond to the luggage security inspection map. Therefore, it is necessary to obtain all luggage entering the security inspection device within a preset range, determine the third time values ​​of all luggage entering the security inspection device, and calculate the third time values ​​and the second time value to obtain the corresponding time differences, and associate the first associated data of the luggage corresponding to the smallest time difference among the time differences with the luggage security inspection map to obtain the corresponding second associated data.

[0060] This embodiment associates the luggage security map with the first associated data through the time difference between the first time value when the luggage enters the security inspection device and the second time value when the security inspection device generates the luggage security map, as well as the preset time value, thereby ensuring the accuracy of the second associated data and thus ensuring the accuracy of the station security inspection. Therefore, when it is necessary to trace the user information through the luggage, the user information can be accurately found through the associated data, thereby improving the technical defense capability of the security inspection.

[0061] Step S30: analyzing the baggage security inspection image based on a preset image judgment mode to obtain an analysis result of items corresponding to the baggage, and associating the analysis result of items with the second associated data to obtain third associated data.

[0062] After the data association system obtains the second associated data, it analyzes the baggage security inspection map in the second associated data through a preset image judgment mode, marks the prohibited items in the baggage security inspection map, and obtains the item analysis result corresponding to the baggage, wherein the preset image judgment mode includes but is not limited to a manual image judgment mode and an automatic image judgment mode, and a manual combined with intelligent image judgment mode. Then, the data association system associates the obtained item analysis result with the second associated data to obtain the corresponding third associated data. Specifically, as shown in steps S301 to S303.

[0063] Step S301, if the preset image judgment mode is a manual image judgment mode, determining the items manually marked in the baggage security inspection image to obtain the item analysis result;

[0064] Step S302, if the preset image judgment mode is the automatic image judgment mode, determining whether there is a target object in the baggage security inspection image, wherein the image similarity between the object image corresponding to the target object and the preset object image is less than a preset threshold;

[0065] Step S303: If the target object exists in the baggage security inspection map, the target object is marked in the baggage security inspection map to obtain the object analysis result.

[0066] Specifically, if it is determined that the preset image judgment mode is the manual image judgment mode, the data association system sends the second association data to the user terminal, and the user marks the prohibited items on the baggage security inspection image of the second association data through the user terminal, and feeds back the marking result to the data association system. After receiving the marking result sent by the user terminal, the data association system determines the items manually marked in the baggage security inspection image according to the marking result, and obtains the item analysis result of the baggage security inspection image. Further, the data association system can also send a prompt message to prompt the user to mark the prohibited items on the baggage security inspection image of the second association data directly on the screen of the security inspection device, determine the items manually marked in the baggage security inspection image, and obtain the item analysis result of the baggage security inspection image. Further, if it is determined that the preset image judgment mode is the automatic image judgment mode, that is, the intelligent image judgment mode, the data association system determines whether there is a target item in the baggage security inspection image of the second association data, wherein the image similarity between the item image corresponding to the target item and the preset item image is less than a preset threshold. If the target item exists in the baggage security inspection image, the data association system marks the target item in the baggage security inspection image to obtain the item analysis result of the baggage security inspection image. Furthermore, if it is determined that the preset image judgment mode is a manual combined with intelligent image judgment mode, the data association system first identifies whether there is a target object in the baggage security inspection image through the preset item image. If it is determined that the target object exists in the baggage security inspection image, a prompt message is sent to prompt the user to mark the target object in the baggage security inspection image.

[0067] This embodiment marks the prohibited items on the baggage security inspection image of the second associated data through a manual image judgment mode or an automatic image judgment mode, thereby accurately determining the prohibited items carried in each associated data. Therefore, when it is necessary to reversely check the user information corresponding to the prohibited items, the user information can be accurately found out through the associated data, thereby improving the technical defense capability of security inspection.

[0068] This embodiment provides a data association method. When detecting that there is luggage placed on the conveyor belt of the security inspection device, the first user image of the user corresponding to the luggage is collected, and the luggage placement map and the luggage physical map of the luggage are collected, and the first user image is associated with the luggage physical map based on the luggage placement map to obtain the first associated data; when detecting that the luggage passes through the security inspection device, the luggage security inspection map generated by the luggage in the security inspection device is obtained, and the luggage physical map and the first associated data are associated based on the time information of the conveyor belt to obtain the second associated data; the luggage security inspection map is analyzed based on the preset image judgment mode to obtain the analysis results of the items corresponding to the luggage, and the item analysis results are associated with the second associated data to obtain the third associated data. It can be seen that this embodiment associates the user image, luggage and item analysis results. If it is necessary to trace the user information through the luggage, a quick security check can be automatically performed through the associated data without manual participation, thereby improving the security inspection efficiency of the station.

[0069] Further, refer to Figure 2 , Figure 2 This is a second flow chart of the data association method provided by the present invention. After step S30, the method further includes:

[0070] Step S40, after detecting that the luggage passes through the security inspection device, collecting and extracting a second user image of the user corresponding to the luggage;

[0071] Step S50: Based on the first user image and the second user image, the second user image is associated with the third associated data to obtain target associated data.

[0072] After the data association system detects that the luggage has passed through the security inspection device, that is, when the luggage slides out of the conveyor belt from the security inspection device, it is necessary to call the camera device to capture and extract the second user image of the user corresponding to the luggage. It can be seen from the description of step S10 in the specification that a user image can be divided into a user face image part and a user clothing image part. Therefore, after the data association system captures the second user image, it is necessary to compare the first user image and the second user image through the user face image and the user clothing image, and associate the second user image with the third associated data according to the comparison result to obtain the target associated data. The specific steps are as follows: step S501 to step S504.

[0073] Furthermore, the step S50 includes:

[0074] Step S501, determining the facial similarity between the first user facial image of the first user image and the second user facial image of the second user image;

[0075] Step S502: if the face similarity is greater than a first preset face similarity threshold, the second user image is associated with the third associated data to obtain the target associated data;

[0076] Step S503, if the face similarity is greater than or equal to the second preset face similarity threshold and less than the first preset face similarity threshold, determining clothing similarity between the first user clothing image of the first user image and the second user clothing image of the second user image;

[0077] Step S504: if the clothing similarity is greater than or equal to a preset clothing similarity threshold, the second user image is associated with the third associated data to obtain the target associated data.

[0078] Specifically, the data association system determines the facial similarity of the first user face image of the first user image and the second user face image of the second user image, and compares the facial similarity with the first preset facial similarity threshold and the second preset facial similarity threshold to obtain a corresponding comparison result, and then associates the second user image with the third associated data according to the comparison result, wherein the first preset facial similarity threshold and the second preset facial similarity threshold are both set by technical personnel, and this embodiment does not limit it. Specifically as follows: If it is determined that the comparison result is that the facial similarity is greater than the first preset facial similarity threshold, the data association system determines that the user who places the luggage and the user who picks up the luggage are the same user, and associates the second user image with the third associated data to obtain the target associated data of the first user image, the luggage physical image, the luggage security inspection image, the item analysis result and the second user image. If it is determined that the comparison result is that the facial similarity is greater than or equal to the second preset facial similarity threshold and less than the first preset facial similarity threshold, the data association system further determines the clothing similarity of the first user clothing image of the first user image and the second user clothing image of the second user image. If it is determined that the clothing similarity is greater than or equal to the preset clothing similarity threshold, the data association system determines that the user who places the luggage and the user who picks up the luggage are the same user, and associates the second user image with the third associated data to obtain target associated data, wherein the preset clothing similarity threshold is set by the technician and is not limited in this embodiment. If it is determined that the clothing similarity is less than the preset clothing similarity threshold, the data association system determines that the user who places the luggage and the user who picks up the luggage are not the same user, and issues an alarm message to prompt the security personnel to re-match, and associates the compared second user image with the third associated data to obtain target associated data. If it is determined that the comparison result is that the face similarity is less than the second preset face similarity threshold, the data association system determines that the user who places the luggage and the user who picks up the luggage are not the same user, and issues an alarm message to prompt the security personnel to re-match, and associates the compared second user image with the third associated data to obtain target associated data.

[0079] This embodiment provides a data association method. After detecting that the luggage has passed through the security inspection equipment, the second user image of the user corresponding to the luggage is collected; based on the first user image and the second user image, the second user image and the third associated data are associated to obtain target associated data. It can be seen that this embodiment uses the user face image and the user clothing image of the user image to double-guarantee that the user who places the luggage and the user who picks up the luggage are the same user, thereby accurately associating the first user image, the luggage physical image, the luggage security inspection image, the item analysis results and the second user image to obtain accurate target associated data. Therefore, when it is necessary to trace the user information through the luggage, the user information can be accurately found out through the target associated data, which improves the technical defense capability of security inspection.

[0080] Furthermore, another embodiment of the data association method provided by the present invention is specifically as follows, after step S50, further comprising:

[0081] Step S60, the target associated data is sent to the corresponding review device, so that the review device determines whether the items marked in the target associated data are correct, and obtains the corresponding review result. If the review result is that the items marked in the target associated data are incorrect, the items marked in the target associated data are corrected, and the corrected final associated data is fed back.

[0082] Specifically, after the data association system obtains the target association data associated with the first user image, the luggage physical image, the luggage security inspection image, the item analysis result, and the second user image, the target association data is sent to the corresponding review device. After receiving the target association data sent by the data association system, the review device automatically reviews the items marked in the target association data to determine whether the items marked in the target association data are correct, and obtains the corresponding review result. If the review result is that the items marked in the target association data are incorrect, the review device corrects the items marked in the target association data, and replaces the items marked in the target association data with the corrected items to obtain the corrected final association data. Finally, the review device feeds back the corrected final association data to the data association system, and the data association system stores the final association data in the system platform. If the review result is that the items marked in the target association data are correct, the review device returns the confirmation instruction of the review completion to the data association system, and the data association system stores the target association data in the system platform according to the confirmation instruction.

[0083] Furthermore, in addition to the automatic review by the above-mentioned review device, a manual review can also be performed, as follows: after the review device receives the target association data sent by the data association system, it sends a corresponding prompt message to prompt the user (staff) to perform a manual check, that is, the staff judges the luggage security inspection map of the target association data to determine whether the items marked in the target association data are correct. If it is judged that the items marked in the target association data are incorrect, the staff needs to unpack and check the luggage corresponding to the target association data for prohibited items, that is, the staff uses the corresponding security inspection equipment to complete the inspection of prohibited items that are difficult to distinguish with the naked eye, and obtains the corresponding inspection results. At the same time, the staff corrects the items marked in the target association data according to the inspection results, and replaces the items marked in the target association data with the corrected marked items to obtain the corrected final association data. Finally, the staff feeds back the corrected final association data to the data association system, and the data association system stores the final association data in the system platform. If it is determined that the items marked in the target association data are correct, the staff returns a confirmation instruction to the data association system that the items marked in the target association data are correct, and the data association system stores the target association data in the system platform according to the confirmation instruction.

[0084] After obtaining the target association data, this embodiment reviews the target association data to obtain more accurate target association data. When it is necessary to trace the user information through luggage, the user information can be accurately found out through the target association data, thereby improving the technical defense capability of security inspection.

[0085] Furthermore, the data association device provided by the present invention is described below. The data association device described below and the data association method described above can be referred to in correspondence with each other.

[0086] like Figure 3 As shown, Figure 3 : is a schematic diagram of the structure of a data association device provided by the present invention, the data association device comprises:

[0087] The acquisition module 301 is used for the acquisition module, which is used to, when detecting that there is luggage placed on the conveyor belt of the security inspection device, acquire a first user image of the user corresponding to the user who places the luggage, and acquire a luggage placement map and a luggage physical map of the luggage, and associate the first user image with the luggage physical map based on the luggage placement map to obtain first association data;

[0088] an association module 302, configured to acquire a baggage security inspection map generated by the baggage in the security inspection device when detecting that the baggage passes through the security inspection device, and associate the baggage security inspection map with the first association data based on the time information of the conveyor belt to obtain second association data;

[0089] The analysis module 303 is used to analyze the baggage security inspection image based on a preset image judgment mode to obtain an analysis result of items corresponding to the baggage, and associate the analysis result of the items with the second associated data to obtain third associated data.

[0090] Furthermore, the acquisition module 301 is also used for:

[0091] After detecting that the luggage passes through the security inspection device, collecting and extracting a second user image of the user corresponding to the luggage;

[0092] Based on the first user image and the second user image, the second user image and the third associated data are associated to obtain target associated data.

[0093] Furthermore, the association module 302 is also used for:

[0094] Determining facial similarity between a first user facial image of the first user image and a second user facial image of the second user image;

[0095] If the face similarity is greater than a first preset face similarity threshold, associating the second user image with the third associated data to obtain the target associated data;

[0096] If the face similarity is greater than or equal to a second preset face similarity threshold and less than the first preset face similarity threshold, determining clothing similarity between the first user clothing image of the first user image and the second user clothing image of the second user image;

[0097] If the clothing similarity is greater than or equal to a preset clothing similarity threshold, the second user image is associated with the third associated data to obtain the target associated data.

[0098] Furthermore, the association module 302 is also used for:

[0099] The step of associating the first user image with the luggage physical map based on the luggage placement map to obtain first associated data comprises:

[0100] Calculating the edge distance between the edge feature point of the user's hand and the edge feature point of the luggage, and determining whether the edge distance is greater than a preset distance threshold;

[0101] If the edge distance is less than or equal to the preset distance threshold, the first user image is associated with the luggage physical image to obtain the first associated data.

[0102] Furthermore, the association module 302 is also used for:

[0103] Calculating a time difference between the first time value and the second time value, and determining whether the time difference is greater than a preset time value;

[0104] If the time difference is less than or equal to the preset time value, the baggage security inspection map is associated with the first associated data to obtain the second associated data.

[0105] Furthermore, the analysis module 303 is also used for:

[0106] If the preset image judgment mode is a manual image judgment mode, determining the items manually marked in the baggage security inspection image to obtain the item analysis result;

[0107] If the preset image judgment mode is the automatic image judgment mode, determining whether there is a target object in the baggage security inspection image, wherein the image similarity between the object image corresponding to the target object and the preset object image is less than a preset threshold;

[0108] If the target object exists in the baggage security inspection map, the target object is marked in the baggage security inspection map to obtain the object analysis result.

[0109] Furthermore, the data association device further comprises:

[0110] The sending module is used to send the target association data to the corresponding review device so that the review device can determine whether the items marked in the target association data are correct and obtain the corresponding review result. If the review result is that the items marked in the target association data are incorrect, the items marked in the target association data are corrected and the corrected final association data is fed back.

[0111] The specific embodiments of the data association device provided by the present invention are basically the same as the embodiments of the above-mentioned data association method, and will not be described in detail here.

[0112] Figure 4 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 4 As shown, the electronic device may include: a processor 410, a communication interface 420, a memory 430 and a communication bus 440, wherein the processor 410, the communication interface 420 and the memory 430 communicate with each other through the communication bus 440. The processor 410 may call the logic instructions in the memory 430 to execute the data association method, which includes:

[0113] When detecting that there is luggage placed on the conveyor belt of the security inspection device, collecting a first user image of the user corresponding to the user who places the luggage, collecting a luggage placement map and a luggage physical map of the luggage, and associating the first user image with the luggage physical map based on the luggage placement map to obtain first associated data;

[0114] When detecting that the luggage passes through the security inspection device, obtaining a luggage security inspection map generated by the luggage in the security inspection device, and associating the luggage security inspection map with the first associated data based on the time information of the conveyor belt to obtain second associated data;

[0115] The baggage security inspection image is analyzed based on a preset image judgment mode to obtain an analysis result of an item corresponding to the baggage, and the item analysis result is associated with the second associated data to obtain third associated data.

[0116] In addition, the logic instructions in the above-mentioned memory 430 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0117] On the other hand, the present invention further provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions, and when the program instructions are executed by a computer, the computer can execute the data association method provided by the above methods, the method comprising:

[0118] When detecting that there is luggage placed on the conveyor belt of the security inspection device, collecting a first user image of the user corresponding to the user who places the luggage, collecting a luggage placement map and a luggage physical map of the luggage, and associating the first user image with the luggage physical map based on the luggage placement map to obtain first associated data;

[0119] When detecting that the luggage passes through the security inspection device, obtaining a luggage security inspection map generated by the luggage in the security inspection device, and associating the luggage security inspection map with the first associated data based on the time information of the conveyor belt to obtain second associated data;

[0120] The baggage security inspection image is analyzed based on a preset image judgment mode to obtain an analysis result of an item corresponding to the baggage, and the item analysis result is associated with the second associated data to obtain third associated data.

[0121] In another aspect, the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the computer program is implemented to perform the above-mentioned data association method, the method comprising:

[0122] When detecting that there is luggage placed on the conveyor belt of the security inspection device, collecting a first user image of the user corresponding to the user who places the luggage, collecting a luggage placement map and a luggage physical map of the luggage, and associating the first user image with the luggage physical map based on the luggage placement map to obtain first associated data;

[0123] When detecting that the luggage passes through the security inspection device, obtaining a luggage security inspection map generated by the luggage in the security inspection device, and associating the luggage security inspection map with the first associated data based on the time information of the conveyor belt to obtain second associated data;

[0124] The baggage security inspection image is analyzed based on a preset image judgment mode to obtain an analysis result of an item corresponding to the baggage, and the item analysis result is associated with the second associated data to obtain third associated data.

[0125] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0126] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0127] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A data association method, characterized in that: include: When detecting that there is luggage placed on the conveyor belt of the security inspection device, collecting a first user image of the user corresponding to the user who places the luggage, collecting a luggage placement map and a luggage physical map of the luggage, and associating the first user image with the luggage physical map based on the luggage placement map to obtain first associated data; When detecting that the luggage passes through the security inspection device, obtaining a luggage security inspection map generated by the luggage in the security inspection device, and associating the luggage security inspection map with the first associated data based on the time information of the conveyor belt to obtain second associated data; Analyze the baggage security inspection image based on a preset image judgment mode to obtain an analysis result of an item corresponding to the baggage, and associate the analysis result of the item with the second associated data to obtain third associated data; After the step of associating the item analysis result with the second associated data to obtain third associated data, the method further includes: After detecting that the luggage passes through the security inspection device, collecting and extracting a second user image of the user corresponding to the luggage; Based on the first user image and the second user image, associating the second user image with the third associated data to obtain target associated data; The user image includes a user face image and a user clothing image. The step of associating the second user image with the third associated data based on the first user image and the second user image to obtain target associated data includes: Determining facial similarity between a first user facial image of the first user image and a second user facial image of the second user image; If the face similarity is greater than a first preset face similarity threshold, associating the second user image with the third associated data to obtain the target associated data; If the face similarity is greater than or equal to a second preset face similarity threshold and less than the first preset face similarity threshold, determining clothing similarity between the first user clothing image of the first user image and the second user clothing image of the second user image; If the clothing similarity is greater than or equal to a preset clothing similarity threshold, the second user image is associated with the third associated data to obtain the target associated data.

2. The data association method according to claim 1, characterized in that: The luggage placement map includes edge feature points of the user's hand and edge feature points of the luggage. The step of associating the first user image with the luggage physical map based on the luggage placement map to obtain first associated data comprises: Calculating the edge distance between the edge feature point of the user's hand and the edge feature point of the luggage, and determining whether the edge distance is greater than a preset distance threshold; If the edge distance is less than or equal to the preset distance threshold, the first user image is associated with the luggage physical image to obtain the first associated data.

3. The data association method according to claim 1, characterized in that: The time information includes a first time value when the luggage enters the security inspection device and a second time value when the security inspection device generates the luggage security inspection map. The step of associating the baggage security inspection map with the first associated data based on the time information of the conveyor belt to obtain the second associated data comprises: Calculating a time difference between the first time value and the second time value, and determining whether the time difference is greater than a preset time value; If the time difference is less than or equal to the preset time value, the baggage security inspection map is associated with the first associated data to obtain the second associated data.

4. The data association method according to claim 1, characterized in that: The step of analyzing the baggage security inspection image based on a preset image judgment mode to obtain an analysis result of items corresponding to the baggage includes: If the preset image judgment mode is a manual image judgment mode, determining the items manually marked in the baggage security inspection image to obtain the item analysis result; If the preset image judgment mode is the automatic image judgment mode, determining whether there is a target object in the baggage security inspection image, wherein the image similarity between the object image corresponding to the target object and the preset object image is less than a preset threshold; If the target object exists in the baggage security inspection map, the target object is marked in the baggage security inspection map to obtain the object analysis result.

5. The data association method according to any one of claims 1 to 4, characterized in that: After the step of associating the second user image with the third associated data based on the first user image and the second user image to obtain target associated data, the method further includes: The target associated data is sent to a corresponding review device so that the review device can determine whether the items marked in the target associated data are correct and obtain a corresponding review result. If the review result is that the items marked in the target associated data are incorrect, the items marked in the target associated data are corrected and the corrected final associated data is fed back.

6. A data association device, characterized in that: include: a collection module, configured to collect a first user image of a user who places the luggage, and a luggage placement diagram and a luggage physical diagram of the luggage, and associate the first user image with the luggage physical diagram based on the luggage placement diagram to obtain first association data when detecting that there is luggage placed on a conveyor belt of a security inspection device; an association module, configured to acquire a baggage security inspection map generated by the baggage in the security inspection device when detecting that the baggage passes through the security inspection device, and associate the baggage security inspection map with the first association data based on the time information of the conveyor belt to obtain second association data; an analysis module, configured to analyze the baggage security inspection image based on a preset image judgment mode, obtain an analysis result of an item corresponding to the baggage, and associate the analysis result of the item with the second associated data to obtain third associated data; The analysis module is further configured to collect and extract a second user image of a user corresponding to the luggage after detecting that the luggage passes through the security inspection device; and associate the second user image with the third associated data based on the first user image and the second user image to obtain target associated data; the user image includes a user face image and a user clothing image; The analysis module is further configured to determine the face similarity between the first user face image of the first user image and the second user face image of the second user image; if the face similarity is greater than a first preset face similarity threshold, the second user image is associated with the third associated data to obtain the target associated data; if the face similarity is greater than or equal to the second preset face similarity threshold and less than the first preset face similarity threshold, the clothing similarity between the first user clothing image of the first user image and the second user clothing image of the second user image is determined; If the clothing similarity is greater than or equal to a preset clothing similarity threshold, the second user image is associated with the third associated data to obtain the target associated data.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the steps of the data association method according to any one of claims 1 to 5 are implemented.

8. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the data association method according to any one of claims 1 to 5 are implemented.

Images