Security inspection data association method, device, computer equipment and storage medium

Abstract

The present application is applicable to the field of security inspection data association technology, and provides a security inspection data association method, device, computer equipment and storage medium. The method includes: continuously acquiring a set of position point sequences of at least one security inspection object captured by a first camera in a security inspection area; acquiring the first package placement time and first package placement station information of the target security inspection object in the human-package association event corresponding to the target security inspection object; matching the target position point sequence belonging to the target security inspection object in the position point sequence set according to the first package placement time and the first package placement station information; associating the target position point sequence with the human-package association event corresponding to the target security inspection object; marking the end position of the target position point sequence as the security inspection door passed by the target security inspection object; acquiring the door detection event of the target security inspection object in the security inspection door; associating the target position point sequence with the door detection event.

Description

Technical Field

[0001] The present application belongs to the field of security inspection technology, and in particular, relates to a security inspection data association method, device, computer equipment and storage medium. Background Art

[0002] In traditional security inspection scenarios, such as civil aviation, the personal security inspection of the security object is always the core link. For the construction of the departure security inspection data network of the security object, the data of the security inspection part is crucial. However, the security inspection process is often greatly affected by human factors, and various security inspection equipment only records for their respective security inspection objects, and lacks connection with each other. This information island phenomenon leads to the fragmentation of various types of information, which is not only not conducive to information analysis, but also leads to a series of problems such as low efficiency and high cost of information tracing. Summary of the invention

[0003] The embodiments of the present application provide a security inspection data association method, apparatus, computer equipment and storage medium, which can automatically complete the processes of obtaining, matching and associating security inspection data, and not only cover the behavior path of the security inspection object, but also record in detail its various detection events in the security inspection area.

[0004] In a first aspect, an embodiment of the present application provides a security inspection data association method, the method comprising: continuously acquiring a set of position point sequences of at least one security inspection object captured by a first camera in a security inspection area; wherein the security inspection area refers to an area where security inspection equipment is deployed so that the security inspection object completes a security inspection, the security inspection equipment comprises a security inspection machine and a security inspection door, a bag placing platform is arranged upstream of a transmission device of the security inspection machine, and the bag of the security inspection object passes through the bag placing platform and the transmission device in sequence, thereby entering the security inspection machine for security inspection; acquiring bag placing event information in a person-bag association event corresponding to a target security inspection object; wherein the bag placing event information comprises a first bag placing time and a time period of the target security inspection object on the bag placing platform; The first package placement station information, the human-package association event is an event that associates the image of the target security inspection object, the visible light image of the package of the target security inspection object, and the X-ray image of the package; according to the first package placement time and the first package placement station information, the target position point sequence belonging to the target security inspection object is matched in the position point sequence set; the target position point sequence is associated with the human-package association event corresponding to the target security inspection object; according to the position of the security inspection door passed by the target security inspection object, the end position of the target position point sequence is marked as the security inspection door; the door detection event of the target security inspection object in the security inspection door is obtained; the target position point sequence whose end position is marked as the security inspection door is associated with the door detection event.

[0005] In a possible implementation of the first aspect, after continuously acquiring a set of position point sequences of at least one security inspection object captured by a first camera in a security inspection area, the method further includes: performing position matching on the position point sequence set using a historical position information set to determine whether a first position point sequence exists in the position point sequence set; identification information of the first position point sequence indicates one of the security inspection objects in the historical position information set; and if so, using the first position point sequence to update the position information of the security inspection object indicated by the first position point sequence in the historical position information set.

[0006] In a possible implementation of the first aspect, after continuously acquiring a set of position point sequences of at least one security inspection object captured by a first camera in a security inspection area, it also includes: using a historical position information set to perform position matching on the position point sequence set, determining whether there is a second position point sequence in the position point sequence set, and the identification information of the second position point sequence does not indicate any security inspection object in the historical position information set; if not, determining whether the starting position point of the second position point sequence is at the security inspection entrance; if so, adding the identification information and position information of the security inspection object indicated by the second position point sequence to the historical position information set.

[0007] In a possible implementation of the first aspect, determining whether the starting position point of the second position point sequence is at the security check entrance includes: if not, confirming the target position information in the historical position information set, the target position information has not been updated within a preset period, and the distance between the ending position point in the target position information and the starting position point of the second position point sequence is less than a preset distance; and updating the target position information using the second position point sequence.

[0008] In a possible implementation of the first aspect, a target position point sequence belonging to a target security inspection object is matched in a position point sequence set according to a first package placement time and first package placement station information, including: determining a first stay area of ​​a package placement station indicated by the first package placement station information; screening out a position point subsequence set located in the first stay area in the position point sequence set; matching a target position point subsequence belonging to the target security inspection object in the position point subsequence set according to the first package placement time and / or the first package placement station information; and determining a position point sequence containing a target position point subsequence in the position point sequence set as a target position point sequence.

[0009] In a possible implementation manner of the first aspect, according to the first package placement time and / or the first package placement station information, a target location point subsequence belonging to the target security inspection object is matched in the location point subsequence set, including: in the location point subsequence set, a target location point subsequence whose time coincidence with the first package placement time is not less than a preset threshold is matched; and / or, in the location point subsequence set, a target location point subsequence that is closest to the package placement station indicated by the first package placement station information is matched.

[0010] In a possible implementation of the first aspect, marking the end position of the target position point sequence as a security gate includes: after waiting for a preset time, marking the end position of the target position point sequence as a security gate, and the preset time is obtained by the time difference between the security gate and the first camera uploading data in the same reporting period.

[0011] In a second aspect, an embodiment of the present application provides a security inspection data association device, the device comprising:

[0012] An acquisition module is used to continuously acquire a set of position point sequences of at least one security inspection object captured by a first camera in a security inspection area; wherein the security inspection area refers to an area where security inspection equipment is deployed to enable the security inspection object to complete a security inspection, the security inspection equipment includes a security inspection machine and a security inspection door, and a bag placing platform is arranged upstream of the transmission device of the security inspection machine. The bag of the security inspection object passes through the bag placing platform and the transmission device in sequence, and then enters the security inspection machine for security inspection.

[0013] The acquisition module is also used to obtain the package release event information in the human-package association event corresponding to the target security inspection object; wherein the package release event information includes the first package placement time of the target security inspection object on the package placement table and the first package placement table information, and the human-package association event is an event that associates the image of the target security inspection object, the visible light image of the package of the target security inspection object, and the X-ray image of the package.

[0014] The matching module is used to match the target location point sequence belonging to the target security inspection object in the location point sequence set according to the first package placement time and the first package placement platform information.

[0015] The association module is used to associate the target position point sequence with the human-package association event corresponding to the target security inspection object.

[0016] The marking module is used to mark the end position of the target position point sequence as the security gate according to the position of the security gate passed by the target security inspection object.

[0017] The acquisition module is also used to acquire the door detection event of the target security inspection object in the security inspection door.

[0018] The association module is also used to associate a target position point sequence whose end position is marked as a security door with a door detection event.

[0019] In a possible implementation of the second aspect, the matching module is further used to perform position matching on the position point sequence set using the historical position information set to determine whether a first position point sequence exists in the position point sequence set; the identification information of the first position point sequence indicates one of the security inspection objects in the historical position information set.

[0020] The updating module is used for updating the position information of the security inspection object indicated by the first position point sequence in the historical position information set by using the first position point sequence if there is a first position point sequence in the position point sequence set.

[0021] In a possible implementation of the second aspect, the matching module is further used to perform position matching on the position point sequence set using the historical position information set to determine whether a second position point sequence exists in the position point sequence set, and the identification information of the second position point sequence does not indicate any security inspection object in the historical position information set.

[0022] The processing module is used to determine whether the starting position point of the second position point sequence is at the security check entrance if the second position point sequence does not exist in the position point sequence set.

[0023] The updating module is further configured to add identification information and location information of the security inspection object indicated by the second location point sequence to the historical location information set if the starting location point of the second location point sequence is at the security inspection entrance.

[0024] In a possible implementation of the second aspect, the processing module is also used to confirm the target position information in the historical position information set if the starting position point of the second position point sequence is not at the security check entrance, the target position information has not been updated within a preset period, and the distance between the ending position point in the target position information and the starting position point of the second position point sequence is less than a preset distance.

[0025] The updating module is used to update the target position information using the second position point sequence.

[0026] In a possible implementation of the second aspect, the matching module is specifically used to determine the first staying area of ​​the package placing table indicated by the first package placing table information; filter out a position point subsequence set located in the first staying area from the position point sequence set; match a target position point subsequence belonging to the target security inspection object in the position point subsequence set according to the first package placement time and / or the first package placing table information; and determine the position point sequence containing the target position point subsequence in the position point sequence set as the target position point sequence.

[0027] In a possible implementation of the second aspect, the matching module is specifically used to match, in the set of position point subsequences, a target position point subsequence whose time coincidence with the time of placing the first package is not less than a preset threshold; and / or, in the set of position point subsequences, to match a target position point subsequence that is closest to the package placing station indicated by the first package placing station information.

[0028] In a possible implementation of the second aspect, the marking module is specifically used to mark the end position of the target position point sequence as a security gate after waiting for a preset time period, and the preset time period is obtained by the time difference between the security gate and the first camera uploading data in the same reporting period.

[0029] In a third aspect, an embodiment of the present application provides a computer device, comprising: the computer device comprises a processor and a memory and a data interface coupled to the processor; wherein the data interface is used for data communication, the memory is used for program data, and the program data, when executed by the processor, is used to implement the method provided above for application to the first aspect and any possible implementation thereof.

[0030] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program / instructions. When the computer program / instructions are executed on an electronic device, the electronic device executes the method of the first aspect and any possible implementation method thereof.

[0031] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program / instruction, which, when executed by a processor, enables an electronic device to execute the method of the above-mentioned first aspect and any possible implementation method thereof.

[0032] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here.

[0033] Compared with the prior art, the embodiment of the present application has the following beneficial effects: when a person enters a security inspection area (i.e., a security inspection area) where security inspection equipment is deployed, the person is transformed into a security inspection object, and a set of position point sequences of at least one security inspection object captured by the first camera in the security inspection area is continuously obtained to fully grasp the behavior dynamics of each security inspection object during the entire security inspection process. In the security inspection area, the security inspection object can sequentially place the package on the package placement table configured upstream of the transmission device of the security inspection machine. In the process of placing the package, the first package placement time of the target security inspection object on the package placement table and the first package placement table information are obtained to obtain the package placement event information in the person-package association event corresponding to the target security inspection object, and then according to the first package placement time and the first package placement table information, the target position point sequence belonging to the target security inspection object is matched in the position point sequence set. After the package is placed, the package passes through the transmission device and enters the security inspection machine for security inspection, thereby obtaining the visible light image of the package of the target security inspection object and the package x-ray image of the package. After that, the person-package association event including the image of the target security inspection object, the visible light image of the package of the target security inspection object, and the package x-ray image is associated with the target position point sequence. When the target security inspection object passes through the security inspection gate, the end position of the target position point sequence is marked as the security inspection gate according to the position of the security inspection gate passed by the target security inspection object; and the door detection event of the target security inspection object in the security inspection gate is obtained; so as to associate the target position point sequence whose end position is marked as the security inspection gate with the door detection event.

[0034] Through the above-mentioned security inspection data collection and association processing mechanism, the security inspection data acquisition, matching and association processes can be automatically completed without the security inspection object being aware of it. It not only covers the behavior path of the security inspection object, but also records in detail its various detection events in the security inspection area. It not only provides a richer and more detailed information basis for subsequent data in-depth analysis and tracing, but also greatly improves the efficiency of security inspection work, making the security inspection process smoother and more efficient. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0036] Figure 1 It is a schematic diagram of the architecture of an application environment provided by an embodiment of the present application;

[0037] Figure 2 It is a flowchart of a security inspection data association method provided in an embodiment of the present application;

[0038] Figure 3 It is a schematic diagram of the effect of the security inspection scene provided by the embodiment of the present application;

[0039] Figure 4 It is a schematic diagram of data flow in the environment architecture of the security inspection data association method provided by the embodiment of the present application;

[0040] Figure 5 is a structural schematic diagram of a security inspection data association device provided by another embodiment of the present application;

[0041] Figure 6 It is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0042] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0043] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0044] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0045] As used in the specification and appended claims of this application, the term "if" may be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if [described condition or event] is detected" may be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]", depending on the context.

[0046] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0047] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0048] In addition, the solution provided in the embodiment of the present application is proposed for the purpose of maintaining public safety and safeguarding the rights and interests of travelers. The relevant information involved in the implementation of the solution is obtained and used with the knowledge and consent of the security check subject.

[0049] For the construction of security inspection data network, the data of security inspection part plays a vital role. However, the existing security inspection area often adopts a decentralized approach when processing security inspection information. Various security inspection equipment only independently records the respective security inspection objects. For example, X-ray machines only record the image information of luggage and objects, and metal detectors only record the location information of metal objects on the security inspection objects, without associating this information. This information island phenomenon not only causes information fragmentation, seriously hinders the subsequent information analysis and utilization, but also directly leads to a series of problems such as low efficiency and high cost of information tracing. Therefore, it is urgent to optimize and improve the existing security inspection process and data processing methods to achieve effective association and efficient utilization of information.

[0050] Based on this, the embodiment of the present application provides a security inspection data association method, device, computer equipment and storage medium. The technical principle of the method is: when a person enters a security inspection area (i.e., a security inspection area) where security inspection equipment is deployed, he will immediately become a security inspection object, and will continuously obtain a set of position point sequences of at least one security inspection object collected by a first camera in the security inspection area, so as to fully grasp the behavior dynamics of each security inspection object in the entire security inspection process. In the security inspection area, the security inspection object can sequentially place the package on the package placement table configured upstream of the transmission device of the security inspection machine. In the process of placing the package, the first package placement time and the first package placement table information of the target security inspection object on the package placement table are obtained to obtain the package placement event information in the person-package association event corresponding to the target security inspection object, and then according to the first package placement time and the first package placement table information, the target position point sequence belonging to the target security inspection object is matched in the position point sequence set. After the package is placed, the package passes through the transmission device and enters the security inspection machine for security inspection, so as to obtain the visible light image and the package x-ray image of the target security inspection object. Afterwards, the human-package association event including the image of the target security inspection object, the visible light image of the package of the target security inspection object, and the x-ray image of the package is associated with the target position point sequence. When the target security inspection object passes through the security inspection gate, the end position of the target position point sequence is marked as the security inspection gate according to the position of the security inspection gate passed by the target security inspection object; and the door detection event of the target security inspection object in the security inspection gate is obtained; so as to associate the target position point sequence with the end position marked as the security inspection gate with the door detection event. In this way, the acquisition, matching and association of security inspection data can be automatically completed without the perception of the security inspection object, which not only covers the behavior path of the security inspection object, but also records in detail its various detection events in the security inspection area.

[0051] See also Figure 1 , Figure 1 This is a diagram of an implementation environment architecture of a security inspection data association method provided in an embodiment of the present application. Taking the security inspection area of ​​an airport as an example, the implementation environment architecture includes: a location point detection device 10, a security inspection device 20 and a computer device 30.

[0052] As an example, the location point detection device 10 can be a camera that can use pedestrian re-identification (Re-identification, Reid) technology to collect the location points of security inspection objects, that is, a Reid camera. Specifically, the corresponding feature values ​​of different people in the camera image can be calculated through a head and shoulder feature detection algorithm or a segmentation tracking algorithm. At the same time, when people are walking, the location points are tracked based on the feature values, and a monocular camera, a multi-camera camera, or a vertical camera that regularly generates multiple people and multiple pieces of location point data. The image range of the location point detection device 10 includes Figure 1 The inspection area between the security entrance and the security door shown in FIG.

[0053] Optionally, the security inspection device 20 may include an article security inspection device 21 and a security inspection door 22 as shown in FIG1 . The article security inspection device 21 may be used to obtain detection data corresponding to the bag release event information and transmit it to the computer device 30, so that the computer device 30 obtains the bag release event information; the security inspection door 22 may be used to perform metal inspection on security personnel and send the generated door detection event to the computer device 30.

[0054] Furthermore, the security inspection equipment 20 may also include a boarding pass and an automatic facial recognition device for scanning boarding pass information and facial information of the security inspection object (such as a facial image of the security inspection object), and uploading the boarding pass and facial information of the security inspection object to the computer device 30 for binding.

[0055] Exemplarily, the article security inspection equipment 21 includes: a radio frequency identification (RFID) system 211 and a security inspection machine 212 .

[0056] Optionally, main components of the RFID system 211 include an RFID tag (Tag) 2111 , an RFID reader 2112 , an RFID verifier 2113 , and a face collection device 2114 .

[0057] Among them, the RFID tag 2111 is composed of a coupling element and a processing unit. Each RFID tag 2111 has a unique electronic code and is attached to the surface of the security inspection tray provided to the security inspection object on the bag placement table to identify the security inspection tray. The RFID reader 2112 includes a reader (Reader) and an antenna (Antenna). The RFID reader 2112 is a device used to read (or write) information on the RFID tag 2111, and can be designed to be handheld or fixed. The antenna is responsible for transmitting radio frequency signals between the tag and the reader. The RFID verifier 2113 can be set at the exit of the security inspection machine 212 to verify in real time whether the security inspection tray with the RFID tag has completed the security inspection. The face collection device 2114 is used to collect the face information of the security inspection object when the security inspection object places the package on the security inspection tray.

[0058] The specific security inspection process of the RFID system 211 for packages and articles is as follows: the reader sends a radio frequency signal of a certain frequency through the antenna to generate a magnetic field around it. When the RFID tag 2111 enters the magnetic field, the induction current inside it will be activated, so that the RFID tag 2111 can send out the product information stored in the processing unit (Passive Tag, passive tag or passive tag), or actively send a signal of a certain frequency (Active Tag, active tag or active tag). After receiving this information, the reader will decode it and upload it to the computer device 30 for relevant data processing. The RFID verifier 2113 verifies whether the security inspection tray with the RFID tag 2111 has completed the security inspection at the exit of the security inspection machine 212, and uploads the verification information to the computer device 30.

[0059] In some embodiments, the security inspection machine 212 is used to scan and determine whether the luggage on the security inspection tray has passed the security inspection, and upload the security inspection image to the computer device 30. Optionally, the security inspection machine 212 can carry an analyzer, which is used to analyze the image data of the package obtained by the security inspection machine 212 (including the visible light image of the package and the X-ray image of the package).

[0060] Optionally, the security door 22 includes but is not limited to millimeter wave door, mobile phone door, metal security door and other door security inspection equipment. Among them, the millimeter wave door is a security inspection equipment that obtains information about items carried by people by scanning the human body with millimeter waves.

[0061] Optionally, when the computer device 30 binds the RFID tag and the boarding pass information, if the security inspection object requires multiple security inspection trays, the RFID tags and boarding pass information of all security inspection trays are bound at the same time. Further, when the computer device 30 binds the RFID tag and the boarding pass information, the time information is also bound.

[0062] It is understandable that the security inspection area has a security inspection entrance. For example, in a civil aviation inspection site, the security inspection entrance is used to allow the security inspection object to enter the security inspection area for package and body inspection.

[0063] It is understandable that the position of the position point detection device 10 adopts the world coordinate system. In the security inspection area, there are security inspection entrances and exits, and the bag placement channel also has a corresponding fixed position. Therefore, after the position point detection device 10 completes the world coordinate calibration, the position point sequence of the security inspection object collected, identified and reported by the position point detection device 10 can be used as a link for the precise association of the person-bag association event and the door detection event.

[0064] It should be noted that the world coordinates take a certain point in the venue as the world origin. Different positions in the venue are based on the comparison of the world origin (0,0,0) in the three-dimensional direction to obtain the position point information (x,y,z) in the x-axis, y-axis and z-axis directions.

[0065] Optionally, the position point detection device 10, taking a Reid camera as an example, can be mounted above the security inspection area, and the world coordinate position of the Reid camera can be set accordingly, and then the world coordinate range of the security inspection area where the Reid camera is located can be obtained according to the world coordinate position of the Reid camera.

[0066] Optionally, cameras with ReID capabilities are deployed in the security inspection area, and the world coordinate calibration of the security inspection site is completed by configuring the camera's world coordinate internal and external parameters. When the security inspection object enters the security inspection site, the camera will use the algorithm to identify the location point route of the security inspection object at different time points in the camera screen in real time. It is understandable that the location point data of the same person will be reported in sequence according to the recognition cycle of the device, so there will be at least one location point recognition result for a person's location point in the scene, and each location point contains at least one world coordinate location point information.

[0067] It should be noted that the computer device 30 completes the configuration of the coordinate range of the multiple bag placing stations (F1, F2, F3...Fn) and the coordinate range of the stop area in front of the multiple bag placing stations (L1, L2, L3...Ln); wherein the bag placing station information corresponds to the bag placing station one by one. The computer device 30 completes the configuration of the coordinate range (E) of the security inspection entrance, the configuration of the effective range D in front of the security inspection door S, and the configuration report of the Reid camera. The reporting period of the computer device 30 is Ti.

[0068] Generally speaking, one security inspection area corresponds to one security inspection entrance, one Reid camera, multiple bag placing tables, one set of item security inspection equipment 21 and one security inspection door 22. When there are multiple security inspection areas, the above configuration can be configured for each security inspection area separately, and the world coordinate range of each security inspection area can be configured at the same time. Multiple Reid cameras can use the same world origin when calibrating the equipment. Then, when the security inspection object enters from the entrance, the location information of the door and bag placing table of the security inspection area can be obtained through the world coordinates. It can be understood that in the same security inspection area, the location point information of the security inspection object identified by the Reid camera will be within the world coordinate range of the security inspection area.

[0069] It is understandable that the above is only an exemplary description of the structure included in the article security inspection device 21, but the specific structure of the article security inspection device 21 can be adjusted based on actual applications; for example, the article security inspection device 21 can also include a self-service baggage claim machine, which is used to scan the boarding pass of the security inspection object, read the security inspection tray RFID tag bound to the boarding pass information from the computer device 30, and distribute the security inspection tray with the corresponding RFID tag to the security inspection object. The present application embodiment does not make any limitation to this.

[0070] The security inspection data association method provided in the embodiment of the present application can be applied to computer devices 30 such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), etc. The embodiment of the present application does not impose any restrictions on the specific type of computer device 30.

[0071] The computer device 30 has a display function, for example, the display function can be realized through a graphics processing unit (GPU), a display screen, and an application processor.

[0072] It should be noted that the data involved in this application (including but not limited to data used for analysis (such as visible light images of packages, X-ray images of packages, images of security inspection objects, etc.), stored data, displayed data, etc.) are all data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards, and provide corresponding operation entrances for users or parties to choose to authorize or refuse.

[0073] The method shown in the present application is described below through specific embodiments. It should be noted that the following embodiments can exist independently or in combination with each other, and the same or similar contents will not be described repeatedly in different embodiments.

[0074] Figure 2 A flowchart of a security inspection data association method provided in an embodiment of the present application. Figure 2 , the method may include:

[0075] 201. Continuously obtain a sequence set of position points of at least one security inspection object captured by a first camera in a security inspection area.

[0076] Among them, the security inspection area refers to the area where security inspection equipment is deployed to enable the security inspection objects to complete security inspections. The security inspection equipment includes a security inspection machine and a security inspection door. A bag placing platform is arranged upstream of the transmission device of the security inspection machine. The packages of the security inspection objects pass through the bag placing platform and the transmission device in turn, and then enter the security inspection machine for security inspection.

[0077] Optionally, a network protocol (such as Hypertext Transfer Protocol (HTTP), Message Queuing Telemetry Transport (MQTT), File Transfer Protocol (FTP), Kafka, etc.) can be used to receive a sequence set of location points of at least one security inspection object reported by the first camera.

[0078] The location point sequence set may be transmitted in JSON or XML format, including but limited to the identification information of the security inspection object, the location point sequence, etc., wherein the location point sequence may include a series of timestamps and the location point information corresponding to each timestamp. It is understood that in order to further ensure the stability and security of data transmission, encryption technology may be used to protect the integrity and privacy of the data.

[0079] Optionally, the first camera may be a Reid camera.

[0080] In some embodiments, the set of location point sequences includes a location point sequence related to at least one security inspection object.

[0081] 202. Obtain the package release event information in the person-package association event corresponding to the target security inspection object, wherein the package release event information includes the first package placement time of the target security inspection object on the package placement station and the first package placement station information.

[0082] The person-package association event is an event that associates the image of the target security inspection object, the visible light image of the package of the target security inspection object, and the X-ray image of the package. The visible light image of the package can be acquired by a visible light camera installed on the security inspection machine, and the visible light camera can be installed at the entrance, exit, or inside the detection channel of the security inspection machine.

[0083] The target security inspection object is one of the at least one security inspection object.

[0084] Optionally, the parcel placement time refers to the specific time point or time period when the parcel is placed at the preset location of the parcel security inspection device. For example, for airport security inspection, the preset location of the parcel security inspection device may be Figure 1 Security inspection tray on any bag placement table shown.

[0085] As an example, the security inspected person enters the bag placement channel and queues up and places the bag at the bag placement table. At this time, the RFID reader performs person-bag association processing. After the security inspected person places the bag and leaves the bag placement table, the RFID reader obtains the bag placement table information Cn where the bag placement table is located, and generates the start bag placement time as T1 and the end bag placement time as T2 to obtain the bag placement time, and then generates the bag placement event information based on the bag placement table information Cn and the bag placement time. The RFID reader transmits the bag placement event information to the computer and device. Among them, the bag placement table information can be used to uniquely characterize the bag placement table.

[0086] 203. Match a target location point sequence belonging to the target security inspection object in the location point sequence set according to the first package placement time and the first package placement platform information.

[0087] As an example, time series can be used for matching: in the location point sequence set, based on the first package placement time, the location point subsequence contained in each location point sequence is extracted, wherein the time period corresponding to the location point subsequence is consistent with the first package placement time, and the target subsequence in the location point subsequence that matches the first package placement station information is determined, and the location point sequence including the target subsequence is determined as the target location point sequence.

[0088] Alternatively, state change tracking can be used for matching: by calculating the rate of change (speed) between position coordinates, the moving state of the security inspection object can be inferred. For example, a speed of zero may indicate a stationary state, and a speed greater than a certain threshold indicates a moving state. In general, when the security inspection object is placing a package, the rate of change of the coordinate point is almost zero. Here, it is assumed that the rate of change of the coordinate point is less than or equal to the first preset rate of change, which indicates that the security inspection object is in a stationary state. Therefore, one or more position point sequences located at the package placement station indicated by the first package placement station information in the position point sequence set can be searched first, and a position point sequence whose coordinate change rate is less than or equal to the first preset rate of change during the first package placement time can be searched from the one or more position point sequences. This position point sequence is the target position point sequence.

[0089] Alternatively, matching can be performed based on distance: determine the location point subsequence corresponding to the first package placement time in each location point sequence in the location point sequence set, determine the distance between each location point subsequence and the package placement table indicated by the first package placement table information, and the location point sequence corresponding to the location point subsequence with the smallest distance is the target location point sequence.

[0090] 204. Associate the target position point sequence with the person-package association event corresponding to the target security inspection object.

[0091] Optionally, the location point corresponding to the placement time of the first package in the target location point sequence may be associated with the person-package association event.

[0092] 205. According to the position of the security gate passed by the target security inspection object, the end position of the target position point sequence is marked as the security gate.

[0093] It is understandable that the end position of the target position point sequence changes with the position of the security inspection object. For example, when the security inspection object undergoes package inspection, the end position of the target position point sequence is the position point corresponding to the first package placement station information. When the target security inspection object passes through the security inspection gate, the end position of the target position point sequence is the position of the security inspection gate, which means that the target security inspection object is about to leave the security inspection area.

[0094] 206. Obtain a door detection event of the target security inspection object in the security inspection door.

[0095] Optionally, the door detection event is used to indicate an event in which the security door detects the security inspection object, and may specifically include information such as the detection time and the detection result.

[0096] 207. Mark the end position as a target position point sequence of the security door and associate it with the door detection event.

[0097] Optionally, once it is determined that the target security inspection object has reached or passed through the security gate, the position is immediately marked as a security gate in the target position point sequence. For example, this can be achieved by adding an additional marking field or tag in the position data, which is used to indicate that the position is a security gate.

[0098] In the above scheme, when a person enters the security inspection area (i.e., the security inspection area) where the security inspection equipment is deployed, he / she will immediately become a security inspection object, and the processing end will continuously obtain the position point sequence set of at least one security inspection object collected by the first camera in the security inspection area, so as to fully grasp the behavior dynamics of each security inspection object in the entire security inspection process. In the security inspection area, the security inspection object can sequentially place the package on the package placement table configured upstream of the transmission device of the security inspection machine. In the process of placing the package, the first package placement time and the first package placement table information of the target security inspection object on the package placement table are obtained to obtain the package placement event information in the person-package association event corresponding to the target security inspection object, and then according to the first package placement time and the first package placement table information, the target position point sequence belonging to the target security inspection object is matched in the position point sequence set. After the package is placed, the package passes through the transmission device and enters the security inspection machine for security inspection, thereby obtaining the visible light image of the package and the x-ray image of the package of the target security inspection object. After that, the person-package association event including the image of the target security inspection object, the visible light image of the package of the target security inspection object, and the x-ray image of the package is associated with the target position point sequence. When the target security inspection object passes through the security inspection gate, the end position of the target position point sequence is marked as the security inspection gate according to the position of the security inspection gate passed by the target security inspection object; and the door detection event of the target security inspection object in the security inspection gate is obtained; so as to associate the target position point sequence whose end position is marked as the security inspection gate with the door detection event.

[0099] Through the above-mentioned security inspection data collection and association processing mechanism, the security inspection data acquisition, matching and association processes can be automatically completed without the security inspection object being aware of it. It not only covers the behavior path of the security inspection object, but also records in detail its various detection events in the security inspection area. It not only provides a richer and more detailed information basis for subsequent data in-depth analysis and tracing, but also greatly improves the efficiency of security inspection work, making the security inspection process smoother and more efficient.

[0100] In one embodiment of the present application, after receiving a newly reported location point sequence set, it is possible to decide whether to update the existing location information in the historical location information set, or to newly add the identification information of the location point sequence and its corresponding location information by comparing the identification information of the existing location information in the historical location information set with the identification information of the newly reported location point sequence.

[0101] Therefore, the method provided in the embodiment of the present application further includes, after continuously acquiring a set of position point sequences of at least one security inspection object captured by a first camera in the security inspection area: performing position matching on the position point sequence set using a historical position information set to determine whether a first position point sequence exists in the position point sequence set; the identification information of the first position point sequence indicates one of the security inspection objects in the historical position information set; if so, using the first position point sequence to update the position information of the security inspection object indicated by the first position point sequence in the historical position information set.

[0102] Optionally, when there is identification information of a position point sequence in the historical position information set, the position point sequence is spliced ​​into the position information corresponding to the identification information.

[0103] In some embodiments, considering that when the first camera collects the location points of the security inspection objects at a certain moment, there are two security inspection objects that are close to each other, which causes the first camera to exchange the identification information of the two location points when marking the identification information of the two location points, the two location points can be matched and distinguished based on the data used to characterize the height of the security inspection objects in the location points and / or using the location point sequence before one of the security inspection objects. The matching and distinguishing process can be executed by the first camera or by a computer device, and the embodiments of the present application do not impose any restrictions on this.

[0104] As an example application scenario, assume that the location point is world coordinate data, where the x-axis and y-axis together represent the location of the security inspection object in the security inspection area, and the z-axis represents the height of the security inspection object. Figure 3 As shown, if two security inspection objects marked with identification information 1 and identification information 2 respectively arrive at the intersection area a of the security inspection area almost at the same time and then separate, this will cause the position points of the two collected at the intersection area a to be very close. When the actual position of the security inspection object is determined only based on these close position points, errors in the exchange of identification information may occur. In order to accurately identify the security inspection object corresponding to each position point, the computer device can use the z-axis value in the position point to match the position point in the position point sequence, so as to determine the security inspection object actually corresponding to each position point.

[0105] Considering that the height of the security inspection object may not differ much, and the interval distance between adjacent position points of the same security inspection object should be relatively stable during its movement. Therefore, matching and distinction can also be performed based on the position point sequence before each security inspection object. In another example, the position points of the two security inspection objects when they intersect are recorded as position point a1 and position point a2 respectively. The first interval distance of the security inspection object can be calculated by the position point sequence of one of the security inspection objects before the intersection. Then determine the second distance interval and the third interval distance of position point a1 and position point a2 with position point b1 respectively, where position point b1 is the position point of the security inspection object collected in the previous frame of position point a1 and position point a2. Compare the second distance interval and the third interval distance with the first interval distance respectively, and the position point (position point a1 or position point a2) corresponding to the closest distance interval and position point b1 are the position points of the same security inspection object.

[0106] In actual applications, when the location point sequence set reported by the first camera is received, each location point sequence in the location point sequence set will be processed. The location point sequence contains the identification information of the security inspection object and one or more location points sorted by time. For each location point sequence, the location point sequence is first verified using the identification information therein to ensure the validity and accuracy of the location point sequence. The verification process may include verifying the legitimacy of the identification information, checking the integrity of the location point sequence, etc. After the verification is passed, if the location information corresponding to the identification information already exists in the historical location information set, the system will update these data to reflect the latest location information. If the location information corresponding to the identification information does not exist in the historical location information set, the system will add new location information for the identification information. In this way, the location point sequence set reported by the first camera can be received and processed in real time, keeping the historical location information set updated and accurate.

[0107] In one embodiment of the present application, after continuously acquiring a set of position point sequences of at least one security inspection object captured by a first camera in a security inspection area, it is also necessary to store the position point sequences of each security inspection object into a historical position information set, and each position point sequence needs to be verified before storage to confirm the storage method of the position point sequence. If it is determined that the security inspection object indicated by the position point sequence does not exist in the historical position information set, the position point sequence can also be stored accordingly based on the starting position point of the position point sequence. Optionally, the position point sequence set is position matched using the historical position information set to determine whether there is a second position point sequence in the position point sequence set, and the identification information of the second position point sequence does not indicate any security inspection object in the historical position information set; if not, it is determined whether the starting position point of the second position point sequence is at the security inspection entrance.

[0108] If so, the identification information and location information of the security inspection object indicated by the second location point sequence are newly added to the historical location information set.

[0109] If not, the target location information is confirmed in the historical location information set and updated using the second location point sequence, wherein the target location information has not been updated within a preset period and the distance between the end location point in the target location information and the start location point of the second location point sequence is less than a preset distance.

[0110] It should be understood that when there is no identification information of the location point sequence in the historical location information set, and the starting position in the location point sequence is at the security check entrance, the identification information is added to the historical location information set, and location information corresponding to the newly added identification information is generated based on the location point sequence.

[0111] It should be understood that when there is no identification information in the historical location information set and the starting position in the second location point sequence is not at the security check entrance, the target location information is confirmed in the historical location information set and the second location point sequence is spliced ​​into the target location information; the distance between the end location point of the target location information and the starting location point of the second location point sequence is shorter than the preset distance, and the target location information is the location information that has not been updated in the current reporting cycle.

[0112] In one embodiment of the present application, the location point sequence records the movement path and stop behavior of the security inspection object within a specific time period, providing important information about its behavior pattern and activity range. By analyzing the location point sequence, it is possible to identify the security inspection object that passes through the stop area indicated by the first package placement station information during the package placement time, thereby obtaining a location point sequence consistent with the package placement event information behavior. Therefore, according to the first package placement time and the first package placement station information, the target location point sequence belonging to the target security inspection object is matched in the location point sequence set, including: determining the first stop area of ​​the package placement station indicated by the first package placement station information; filtering out the location point subsequence set located in the first stop area in the location point sequence set; matching the target location point subsequence belonging to the target security inspection object in the location point subsequence set according to the first package placement time and / or the first package placement station information; and determining the location point sequence containing the target location point subsequence in the location point sequence set as the target location point sequence.

[0113] Optionally, the packet placing station identification information can be determined by the packet placing station information, and the packet placing station association table can be queried based on the packet placing station identification information to determine the stay area corresponding to the packet placing station information. The stay area corresponds to a coordinate range, and the stay area in the packet placing station association table is in a one-to-one correspondence with the packet placing station identification information. The packet placing station association table can also include channel identification information. Similarly, the channel identification information or the packet placing station identification information is also in a one-to-one correspondence with the coordinate range. Among them, the packet placing station association table is stored in a database. For example, for multiple packet placing stations, the corresponding packet placing station identification information is (F1, F2, F3, …, Fn), the corresponding channel identification information of the packet placing station is (C1, C2, C3, …, Cn) and the coordinate range of the stay area in front of multiple packet placing stations (L1, L2, L3, …, Ln). The channel identification information, anti-packaging station identification information, and the coordinate range of the stop area can be represented in the following set form in the packaging station association table: (C1, F1, L1,), (C2, F2, L2,), (C3, F3, L3,), …, (Cn, Fn, Ln,).

[0114] Optionally, the stay area corresponding to the packet placing station indicated by the first packet placing station information is matched in the packet placing station association relationship table, and the stay area is determined as the first stay area.

[0115] In some embodiments, after receiving the information that the security inspection object has passed the bag placing station, the position point sequence reported with the identification information of the security inspection object is compared with the stay area Ln, and the position points that have been staying within the range of Ln are identified to record that it has passed the bag placing station Fn, and the time when the package enters the bag placing station is t1 and the time when the package leaves the bag placing station is t2. Then the stay time and position points of the security inspection object in the stay area are obtained.

[0116] In this embodiment, the combination of the dwell time and the package placement time can effectively identify the location point sequence related to the package placement event information, which not only improves the intelligent level of public security management, but also provides important data basis for the integration of security inspection data.

[0117] In one embodiment of the present application, a target location point subsequence belonging to a target security inspection object is matched in a location point subsequence set according to the first package placement time and / or the first package placement station information, including: in the location point subsequence set, a target location point subsequence whose time coincidence with the first package placement time is not less than a preset threshold is matched; and / or, in the location point subsequence set, a target location point subsequence that is closest to the package placement station indicated by the first package placement station information is matched.

[0118] In some embodiments, the stop area corresponding to the package placing station indicated by the first package placing station information is matched in the package placing station association table, and the stop area is determined as the first stop area. For each position point sequence in the position point sequence set, the position point sequence is matched with the first stop area. If the match is successful, the position point subsequence in the position point sequence located in the first stop area is extracted to obtain one or more position point subsequences; then, the time overlap between the stay time of each position point subsequence in the first stop area and the first package placement time is calculated, and the time overlap is not less than a preset threshold, and it is determined as the target position point subsequence.

[0119] Optionally, the time overlap refers to the similarity between the time the security inspection object stays in the stay area and the time the package is placed.

[0120] For example, the overlap time between the stay time and the package placement time is determined, and the time overlap is obtained by using the ratio between the overlap time and the package placement time. If the time overlap is greater than a preset threshold, it means that the behavior of the security inspection object is significantly related to the package placement event. The setting of this threshold can be adjusted according to the actual application scenario to avoid false alarms or missed alarms.

[0121] In one possible implementation, considering that when there is only one location point subsequence, the information is naturally regarded as the target location point subsequence, and no further judgment is required. However, if there are two or more location point subsequences, it is necessary to screen out the most suitable one from these location point subsequences as the target location point subsequence. Therefore, the preset screening rules include: if the number of location point subsequences is one, the location point subsequence is determined as the target location point subsequence; if the number of location point subsequences is at least two, the location point subsequence closest to the package placement table in the stay area among the at least two location point subsequences is determined as the target location point subsequence; and / or, the location point subsequence that first arrives at the stay area within the first package placement time among the at least two location point subsequences is determined as the target location point subsequence.

[0122] It is understandable that when there are two or more position point subsequences, further analysis is required to determine the most relevant target position point subsequence. The following is a specific analysis of the two options:

[0123] Option 1: In at least two location point subsequences, the distance from each location point subsequence to the bag placement platform in the stop area will be calculated. Then, the location point subsequence with the closest distance is selected as the target location point subsequence. The advantage of this method is that it can effectively identify the security object behavior that is closest to the bag placement event in space, which usually reflects a higher correlation.

[0124] Option 2: In practical applications, the determination of the target location point subsequence requires that the overlap degree is greater than the first preset threshold. In general, the preset threshold is set relatively high, for example, 95%. On this basis, when there are multiple location point subsequences, there may be a high overlap degree of time when two security inspection objects are in the stay area at the same time. Considering that there may be a later security inspection object standing side by side with the previous security inspection object in the stay area, that is, the two security inspection objects are at the same distance from the bag placement table. Therefore, the location point subsequence that first arrives at the stay area among at least two location point subsequences can also be used as the target location point subsequence. By comparing the timestamps of multiple location point subsequences, it is possible to identify which security inspection object enters the stay area first, and mark its location point subsequence as the target location point subsequence. The advantage of this method is that it can improve the selection efficiency while ensuring the accuracy of the target location point subsequence selection.

[0125] In one embodiment of the present application, considering that the door detection event is reported in real time in most cases, and the first camera generally uses a periodic reporting method, therefore, after receiving the door detection event and waiting for a preset time, the end position of the target position point sequence is marked as a security door, thereby avoiding mis-marking or premature marking, and improving the accuracy of the position marking. Therefore, marking the end position of the target position point sequence as a security door includes: after waiting for a preset time, marking the end position of the target position point sequence as a security door, and the preset time is obtained by the time difference between the security door and the first camera uploading data in the same reporting cycle.

[0126] Optionally, the preset time length is the time of a reporting cycle Ti of the first camera.

[0127] It should be understood that the preset duration can be adjusted according to actual scenarios and needs, and the embodiments of the present application do not impose any limitations on this.

[0128] For a better understanding, the above verification process is described as a whole. First, determine whether the identification information targetId of the location point sequence can obtain the corresponding location information in the historical location information set. If the targetId can obtain the location information, then merge the location point sequence into the location information, and update the end time and update time of the location information. If the location information cannot be obtained, determine whether the starting location point in the location point sequence is at the security check entrance. If so, add the targetId to the historical location information set, save the location point sequence at the location information of the targetId, and record the start time and update time of the location information; otherwise, obtain one or more location information closest to the starting location point of the location point sequence in the historical location information set. According to the update of the location information, update the location point sequence to the location information whose end location point is closest to the starting location point of the location point sequence, and whose update time has not been updated after the reporting period Ti, and update the update time and end time of the location information.

[0129] In one possible implementation, referring to Figure 4 , the method provided in the embodiment of the present application is combined with Figure 1 The application scenarios are described in detail below.

[0130] The RFID system obtains the information of the bag release event of the security inspection object, the security inspection machine collects the human-bag association event of the security inspection object, the security inspection door obtains the door detection event of the security inspection object, and the first camera obtains the position point sequence of the security inspection object; and transmits the above information to the computer device. The computer device generates the position information of the security inspection object based on the position point sequence of the security inspection object, and generates the package detection event based on the bag release event information and the human-bag association event, and integrates the position point sequence with the package detection event and the door detection event based on their respective association algorithms to obtain the security inspection data of the security inspection object and store it.

[0131] It should be noted that when the same security inspection object has multiple package detection events, one position point sequence can be associated with multiple package detection events.

[0132] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0133] Corresponding to the security inspection data association method described in the above embodiment, Figure 5 A structural block diagram of a security inspection data association device provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0134] Reference Figure 5The security inspection data association device includes: an acquisition module 501, a matching module 502, an association module 503, a marking module 504, an update module 505 and a processing module 506, wherein:

[0135] The acquisition module 501 is used to continuously acquire a set of position point sequences of at least one security inspection object captured by a first camera in a security inspection area; wherein the security inspection area refers to an area where security inspection equipment is deployed to enable the security inspection object to complete a security inspection, and the security inspection equipment includes a security inspection machine and a security inspection door. A bag placing platform is arranged upstream of the transmission device of the security inspection machine. The packages of the security inspection objects pass through the bag placing platform and the transmission device in sequence, and then enter the security inspection machine for security inspection.

[0136] The acquisition module 501 is also used to obtain the package release event information in the human-package association event corresponding to the target security inspection object; wherein the package release event information includes the first package placement time of the target security inspection object on the package placement table and the first package placement table information, and the human-package association event is an event that associates the image of the target security inspection object, the visible light image of the package of the target security inspection object, and the X-ray image of the package.

[0137] The matching module 502 is used to match the target location point sequence belonging to the target security inspection object in the location point sequence set according to the first package placement time and the first package placement platform information.

[0138] The association module 503 is used to associate the target position point sequence with the person-bag association event corresponding to the target security inspection object.

[0139] The marking module 504 is used to mark the end position of the target position point sequence as the security gate according to the position of the security gate passed by the target security inspection object.

[0140] The acquisition module 501 is further used to acquire a door detection event of the target security inspection object in the security inspection door.

[0141] The association module 503 is further used to associate the target position point sequence whose end position is marked as the security door with the door detection event.

[0142] In a possible implementation, the matching module 502 is further used to perform position matching on the position point sequence set using the historical position information set to determine whether a first position point sequence exists in the position point sequence set; the identification information of the first position point sequence indicates one of the security inspection objects in the historical position information set.

[0143] The updating module 505 is configured to update the location information of the security inspection object indicated by the first location point sequence in the historical location information set by using the first location point sequence if there is a first location point sequence in the location point sequence set.

[0144] In a possible implementation, the matching module 502 is further used to perform position matching on the position point sequence set using the historical position information set to determine whether there is a second position point sequence in the position point sequence set, and the identification information of the second position point sequence does not indicate any security inspection object in the historical position information set.

[0145] The processing module 506 is configured to determine whether the starting position point of the second position point sequence is at a security check entrance if the second position point sequence does not exist in the position point sequence set.

[0146] The updating module 505 is further configured to add identification information and location information of the security inspection object indicated by the second location point sequence to the historical location information set if the starting location point of the second location point sequence is at the security inspection entrance.

[0147] In one possible implementation, the processing module 506 is also used to confirm the target location information in the historical location information set if the starting location point of the second location point sequence is not at the security check entrance, the target location information has not been updated within a preset period, and the distance between the ending location point in the target location information and the starting location point of the second location point sequence is less than a preset distance.

[0148] The updating module 505 is used to update the target position information using the second position point sequence.

[0149] In a possible implementation, the matching module 502 is specifically used to determine the first stay area of ​​the package placing station indicated by the first package placing station information; filter out a position point subsequence set located in the first stay area from the position point sequence set; match a target position point subsequence belonging to the target security inspection object in the position point subsequence set according to the first package placement time and / or the first package placing station information; and determine the position point sequence that contains the target position point subsequence in the position point sequence set as the target position point sequence.

[0150] In one possible implementation, the matching module 502 is specifically used to match, in the location point subsequence set, a target location point subsequence whose time coincidence with the first package placement time is not less than a preset threshold; and / or, in the location point subsequence set, to match a target location point subsequence that is closest to the package placement station indicated by the first package placement station information.

[0151] In a possible implementation, the marking module 504 is specifically used to mark the end position of the target position point sequence as a security gate after waiting for a preset time period, and the preset time period is obtained by the time difference between the security gate and the first camera uploading data in the same reporting cycle.

[0152] It should be understood that the units recorded in the security inspection data association device and the reference Figure 2The steps in the described method correspond to each other. Therefore, the operations and features described above for the method are also applicable to the security inspection data association device and the units contained therein, and will not be repeated here. The security inspection data association device can be pre-implemented in a browser or other security application of a computer device, or can be loaded into a browser or its security application of a computer device by downloading or the like. The corresponding units in the security inspection data association device can cooperate with the units in the computer device to implement the solution of the embodiment of the present application.

[0153] The several modules or units mentioned in the above detailed description are not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0154] It should be noted that for details not disclosed in the security inspection data association device in the embodiment of the present application, please refer to the details disclosed in the above embodiments of the present application, which will not be repeated here.

[0155] Reference below Figure 6 , Figure 6 A schematic diagram of the structure of a computer device suitable for implementing the embodiments of the present application is shown. Figure 6 As shown, the computer device 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 602 or the program loaded from the storage part 608 to the random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation instructions of the computer device are also stored. The CPU 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0156] The following components are connected to the I / O interface 605: an input section 606 including a keyboard, a mouse, etc.; an output section 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 608 including a hard disk, etc.; and a communication section 609 including a network interface card such as a LAN card, a modem, etc. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the I / O interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, other storage, etc., is installed on the drive 610 as needed, so that a computer program read therefrom is installed into the storage section 608 as needed.

[0157] In particular, according to an embodiment of the present application, the above reference flow chart Figure 2 The described process can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication part 609, and / or installed from a removable medium 611. When the computer program is executed by a central processing unit (CPU) 601, the above-mentioned functions defined in the computer device of the present application are executed.

[0158] It should be noted that the computer-readable medium shown in the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or other system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction-executing computer device, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium such as a computer-readable storage medium that can send, propagate or transmit a program for use by or in conjunction with an instruction execution system, device or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0159] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operating instructions of the system, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the aforementioned module, program segment or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, the boxes represented by two connections can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operating instruction, or can be implemented with a combination of dedicated hardware and computer instructions.

[0160] The units or modules involved in the embodiments described in the present application may be implemented by software or by hardware. The units or modules described may also be arranged in a processor, for example, it may be described as follows: a processor includes an acquisition module, a merging module, and a transmission module. The names of these units or modules do not, in some cases, constitute limitations on the units or modules themselves.

[0161] As another aspect, the present application further provides a computer-readable storage medium, which may be included in the computer device described in the above embodiment, or may exist independently without being installed in the computer device. The above computer-readable storage medium stores one or more programs, and when the above programs are used by one or more processors to execute the security inspection data association method described in the present application or. For example, it can be executed Figure 2 The various steps of the security inspection data association method shown.

[0162] The present application embodiment provides a computer program product, which includes instructions. When the instructions are executed, the method described in the present application embodiment is executed. For example, Figure 2 The various steps of the security inspection data association method shown.

[0163] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the aforementioned disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present application (but not limited to) by each other to form a technical solution.

Claims

1. A security inspection data association method, characterized in that: include: Continuously acquiring a sequence set of position points of at least one security inspection object captured by a first camera in the security inspection area; The security inspection area refers to an area where security inspection equipment is deployed to enable the security inspection object to complete the security inspection. The security inspection equipment includes a security inspection machine and a security inspection door. A bag placing platform is configured upstream of the transmission device of the security inspection machine. The packages of the security inspection object pass through the bag placing platform and the transmission device in sequence, and then enter the security inspection machine for security inspection; Acquire the package placing event information in the person-package association event corresponding to the target security inspection object; wherein the package placing event information includes the first package placing time of the target security inspection object on the package placing station and the first package placing station information, and the person-package association event is an event that associates the image of the target security inspection object, the visible light image of the package of the target security inspection object, and the X-ray image of the package; According to the first package placement time and the first package placement platform information, a target location point sequence belonging to the target security inspection object is matched in the location point sequence set; Associating the target position point sequence with the person-bag association event corresponding to the target security inspection object; According to the position of the security gate passed by the target security inspection object, marking the end position of the target position point sequence as the security gate; Acquire a door detection event of the target security inspection object in the security inspection door; The end position is marked as a target position point sequence of the security door and associated with the door detection event.

2. The security inspection data association method according to claim 1, characterized in that: After continuously acquiring a set of position point sequences of at least one security inspection object captured by a first camera in the security inspection area, the method further includes: Performing position matching on the position point sequence set by using the historical position information set to determine whether a first position point sequence exists in the position point sequence set; the identification information of the first position point sequence indicates one of the security inspection objects in the historical position information set; If so, the first position point sequence is used to update the position information of the security inspection object indicated by the first position point sequence in the historical position information set.

3. The security inspection data association method according to claim 1 or 2, characterized in that: After continuously acquiring a set of position point sequences of at least one security inspection object captured by a first camera in the security inspection area, the method further includes: Performing position matching on the position point sequence set by using the historical position information set to determine whether there is a second position point sequence in the position point sequence set, wherein identification information of the second position point sequence does not indicate any security inspection object in the historical position information set; If not, determining whether the starting position point of the second position point sequence is at the security check entrance; If so, the identification information and location information of the security inspection object indicated by the second location point sequence are newly added to the historical location information set.

4. The security inspection data association method according to claim 3, characterized in that: The determining whether the starting position point of the second position point sequence is at the security check entrance comprises: If not, confirming the target location information in the historical location information set, the target location information has not been updated within a preset period, and the distance between the end location point in the target location information and the start location point of the second location point sequence is less than a preset distance; The target position information is updated using the second position point sequence.

5. The security inspection data association method according to claim 1 or 2, characterized in that: The matching of the target location point sequence belonging to the target security inspection object in the location point sequence set according to the first package placement time and the first package placement platform information includes: Determine a first stay area of ​​the packet placing station indicated by the first packet placing station information; Filtering out a subsequence set of position points located in the first stay area from the position point sequence set; According to the first package placement time and / or the first package placement platform information, matching a target location point subsequence belonging to the target security inspection object in the location point subsequence set; A position point sequence including the target position point subsequence in the position point sequence set is determined as the target position point sequence.

6. The security inspection data association method according to claim 5, characterized in that: The matching of the target location point subsequence belonging to the target security inspection object in the location point subsequence set according to the first package placement time and / or the first package placement platform information includes: In the location point subsequence set, the target location point subsequence whose time coincidence with the first package placement time is not less than a preset threshold is matched; and / or, In the position point subsequence set, the target position point subsequence closest to the packet placement station indicated by the first packet placement station information is matched and obtained.

7. The security inspection data association method according to claim 1 or 2, characterized in that: The step of marking the end position of the target position point sequence as the security gate comprises: After waiting for a preset time, the end position of the target position point sequence is marked as the security gate, and the preset time is obtained by the time difference between the security gate and the first camera uploading data in the same reporting cycle.

8. A security inspection data association device, characterized in that: include: An acquisition module, used for continuously acquiring a sequence set of position points of at least one security inspection object captured by a first camera in the security inspection area; The security inspection area refers to an area where security inspection equipment is deployed to enable the security inspection object to complete the security inspection. The security inspection equipment includes a security inspection machine and a security inspection door. A bag placing platform is configured upstream of the transmission device of the security inspection machine. The packages of the security inspection object pass through the bag placing platform and the transmission device in sequence, and then enter the security inspection machine for security inspection; The acquisition module is further used to acquire the package placing event information in the person-package association event corresponding to the target security inspection object; wherein the package placing event information includes the first package placing time of the target security inspection object on the package placing station and the first package placing station information, and the person-package association event is an event that associates the image of the target security inspection object, the visible light image of the package of the target security inspection object, and the X-ray image of the package; A matching module, configured to match a target location point sequence belonging to a target security inspection object in the location point sequence set according to the first package placement time and the first package placement platform information; An association module, used to associate the target position point sequence with a person-bag association event corresponding to a target security inspection object; A marking module, used for marking the end position of the target position point sequence as the security gate according to the position of the security gate passed by the target security inspection object; The acquisition module is further used to acquire a door detection event of the target security inspection object in the security inspection door; The association module is further used to associate a target position point sequence whose end position is marked as the security door with the door detection event.

9. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, wherein a computer program or computer instructions are stored in the computer-readable storage medium, and when the computer program or the computer instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 7.

Images