Preliminary machine inspection baggage identification system and method

Abstract

Provided in the present disclosure is a preliminary machine inspection baggage identification system. The system comprises: a baggage conveying platform, which is configured to convey baggage along a baggage conveying direction; a security inspection device, which is configured to perform detection on the baggage and generate a target security inspection result; an appearance collection device, which comprises at least a first appearance collection device and a second appearance collection device, wherein the first appearance collection device is arranged upstream of the security inspection device and is used for collecting a first appearance image of the baggage, and the second appearance collection device is arranged upstream of a baggage claim area and is used for collecting a second appearance image of the baggage; and a control apparatus, which is in communication connection with the security inspection device and the appearance collection device, wherein the control apparatus is configured to perform association matching on the target security inspection result, the first appearance image and the second appearance image, and form baggage interception prompt information on the basis of an association mapping result.

Description

Pre-screening baggage identification system and methods

[0001] This application claims priority to Chinese Patent Application No. 202411957785.1, filed on December 27, 2024, the contents of which are incorporated herein by reference. Technical Field

[0002] This disclosure relates to the field of security inspection of goods, specifically to a preliminary machine inspection baggage identification system and method. Background Technology

[0003] Baggage inspection is a core component of airports, customs, and other important entry and exit points, aiming to ensure public safety and regulate the flow of goods and passengers. Related baggage inspection systems typically employ pre-screening technology to perform X-ray scanning and identify problems in checked baggage, and further process a small number of items of interest.

[0004] Currently, marking baggage of interest primarily relies on physical means, requiring supervisors to manually mark the baggage after identification. Therefore, this method depends on the supervisor's subjective judgment, easily leading to marking errors or missed detections. Another covert marking method uses electronic tags to identify baggage of interest. When marked baggage reaches the tag's sensing location, the system triggers an alarm to notify supervisors for interception. However, electronic tag sensors are typically installed in pedestrian walkways, areas with high pedestrian and baggage density, making it difficult for staff to accurately and promptly identify specific baggage of interest during interception, increasing the risk of congestion. Summary of the Invention

[0005] This disclosure provides a pre-screening baggage identification system and method.

[0006] According to a first aspect of this disclosure, a pre-screening baggage identification system is provided, comprising: a baggage conveying platform configured to convey baggage along a baggage conveying direction; a security inspection device configured to inspect baggage and generate a target security inspection result; an appearance acquisition device, comprising at least a first appearance acquisition device and a second appearance acquisition device, wherein the first appearance acquisition device is located upstream of the security inspection device and is used to acquire a first appearance image of the baggage, and the second appearance acquisition device is located upstream of the baggage claim area and is used to acquire a second appearance image of the baggage; and a control device communicatively connected to the security inspection device and the appearance acquisition device; wherein the control device is configured to perform correlation matching on the target security inspection result, the first appearance image, and the second appearance image, and generate baggage interception prompt information based on the correlation matching result.

[0007] According to some exemplary embodiments, the appearance acquisition device includes: a camera configured to capture an image of the appearance of luggage in a luggage appearance acquisition area; and a photoelectric sensor configured to detect the arrival status of the luggage and trigger the camera to capture an image.

[0008] According to some exemplary embodiments, the appearance acquisition device is configured as an appearance acquisition box, and the appearance acquisition device further includes: a light source; a support structure, the support structure being configured to fix the light source, the camera and the photoelectric sensor inside the appearance acquisition box and / or above the luggage transport path.

[0009] According to some exemplary embodiments, during the association matching process, the control device is configured to: perform association matching between the first appearance image and the target security inspection result to generate association information, and store the association information in a time queue; and perform association matching between the association information and the second appearance image based on the time queue.

[0010] According to some exemplary embodiments, the control device is further configured to: extract a first appearance feature from the first appearance image, combine the first appearance feature with the target security check result to generate entrance portrait information, and store the entrance portrait information in a time queue, wherein the time queue is sorted according to baggage transfer time; extract a second appearance feature from the second appearance image, and calculate the corresponding entrance time window based on the baggage transfer speed, obtain target entrance portrait information matching the entrance time window from the time queue; and perform association matching between the second appearance feature and the target entrance portrait information to generate an association matching result.

[0011] According to some exemplary embodiments, in the process of generating baggage interception alert information based on the results of association matching, the control device is configured to: generate baggage arrival information based on the results of association matching; and generate interception alert information in the form of a visual prompt based on the arrival information.

[0012] According to some exemplary embodiments, the arrival information is set as differentiated information for different types of baggage.

[0013] According to some exemplary embodiments, the appearance acquisition device is configured such that, in response to the arrival of luggage, the photoelectric sensor triggers the camera to continuously take multiple photos within a preset time interval.

[0014] According to some exemplary embodiments, the appearance acquisition device further includes an analysis device configured to perform quality analysis on a series of continuously captured photographs and select a photograph of target quality as a first appearance image or a second appearance image.

[0015] According to some exemplary embodiments, the camera includes multiple cameras arranged at different locations in the baggage appearance collection area.

[0016] According to some exemplary embodiments, the light source includes multiple light sources arranged at different locations in the appearance acquisition box.

[0017] According to some exemplary embodiments, the baggage conveying platform includes a baggage entrance platform and a baggage exit platform arranged opposite to each other, the first appearance acquisition device is disposed on the baggage entrance platform, and the second appearance acquisition device is disposed on the baggage exit platform.

[0018] According to some exemplary embodiments, the baggage recognition system further includes an execution terminal, which is communicatively connected to the control device for receiving and displaying the interception prompt information.

[0019] According to some exemplary embodiments, the execution terminal is configured to display the location information and appearance image of the corresponding luggage after receiving the interception prompt information.

[0020] According to some exemplary embodiments, the analysis device is further configured to: comprehensively score multiple consecutively captured photos based on image sharpness, brightness balance, and contrast; and use photos with comprehensive scores exceeding a preset threshold as a first appearance image or a second appearance image.

[0021] According to a second aspect of this disclosure, a method for identifying baggage during pre-screening is provided, comprising: acquiring a first appearance image of baggage using a first appearance acquisition device, wherein the first appearance acquisition device is located upstream of the security inspection device along the baggage transport direction; inspecting the baggage using the security inspection device and generating a target security inspection result; acquiring a second appearance image of baggage using a second appearance acquisition device, wherein the second appearance acquisition device is located upstream of the baggage collection area along the baggage transport direction; and performing correlation matching on the target security inspection result, the first appearance image, and the second appearance image, and generating baggage interception prompt information based on the correlation matching result.

[0022] According to some exemplary embodiments, the association matching of the target security check result, the first appearance image, and the second appearance image specifically includes: extracting a first appearance feature from the first appearance image, combining the first appearance feature with the target security check result to generate entrance profile information, and placing the entrance profile information into a time queue sorted by baggage transfer time; extracting a second appearance feature from the second appearance image, calculating the corresponding entrance time window based on the baggage transfer speed, obtaining target entrance profile information matching the entrance time window from the time queue; and performing association matching between the second appearance feature and the target entrance profile information to generate an association matching result. Attached Figure Description

[0023] Figure 1 is a schematic diagram of the structure of a pre-inspection baggage identification system according to some exemplary embodiments of the present disclosure;

[0024] Figure 2 is a hardware block diagram of a pre-inspection baggage identification system according to some exemplary embodiments of the present disclosure;

[0025] Figure 3 is a hardware processing flowchart of the baggage identification system for the initial machine inspection shown in Figure 2;

[0026] Figure 4 is a flowchart of a pre-screening baggage identification method according to an exemplary embodiment of the present disclosure; and

[0027] Figure 5 schematically illustrates a block diagram of an electronic device suitable for implementing the above-described method according to an embodiment of the present disclosure. Detailed Implementation

[0028] To make the objectives, technical solutions, and advantages of this disclosure clearer, the following detailed description is provided in conjunction with specific embodiments and the accompanying drawings.

[0029] However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of this disclosure. In the following detailed description, numerous specific details are set forth to provide a thorough understanding of embodiments of this disclosure for ease of explanation. However, it will be apparent that one or more embodiments may be practiced without these specific details. Furthermore, descriptions of well-known technologies are omitted in the following description to avoid unnecessarily obscuring the concepts of this disclosure.

[0030] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. The term "comprising" as used herein indicates the presence of features, steps, or operations, but does not exclude the presence or addition of one or more other features.

[0031] When using expressions such as "at least one of A, B, and C," the expression should generally be interpreted in accordance with the meaning commonly understood by a person skilled in the art (e.g., "a system having at least one of A, B, and C" should include, but is not limited to, systems having A alone, having B alone, having C alone, having A and B, having A and C, having B and C, and / or having A, B, and C, etc.). Similarly, when using expressions such as "at least one of A, B, or C," the expression should generally be interpreted in accordance with the meaning commonly understood by a person skilled in the art (e.g., "a system having at least one of A, B, or C" should include, but is not limited to, systems having A alone, having B alone, having C alone, having A and B, having A and C, having B and C, and / or having A, B, and C, etc.).

[0032] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. The terms “comprising,” “including,” etc., as used herein indicate the presence of features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0033] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein are to be interpreted in a manner consistent with the context of this specification, and not in an idealized or overly rigid way.

[0034] Baggage inspection is a crucial step in ensuring public safety and regulating the flow of goods and passengers at airports, customs, and other important entry and exit points. Relevant baggage inspection systems typically employ preliminary machine inspection technology, using X-ray scanning and problem identification to screen out a small number of bags of interest containing prohibited or potentially risky items for further inspection and interception.

[0035] The applicant's research revealed that the relevant technology still has significant limitations in the tagging and tracking of luggage of interest.

[0036] Specifically, currently, marking baggage of interest primarily relies on physical methods, such as customs locks and straps. This method requires inspectors to manually mark baggage of interest after identification, and the effectiveness and accuracy of the marking often depend on the inspector's subjective judgment, making it prone to errors or omissions. Furthermore, during subsequent inspections, physically marked baggage typically requires manual observation and tracking by inspectors after passengers collect their luggage. This not only increases the enforcement workload of inspectors but also risks missing baggage due to unclear markings or high passenger mobility. Additionally, areas where passengers frequently collect baggage are prone to congestion due to inspection operations, impacting customs clearance efficiency and user experience.

[0037] Another marking method involves discreetly tagging baggage of interest using electronic tags. When the tagged baggage reaches the location of the electronic tag sensor, the system triggers an alarm and notifies supervisors to intercept it. However, the practical application of electronic tags also has several limitations: the sensors are usually installed in passenger passageways, areas with high pedestrian and baggage volumes, making it difficult for supervisors to identify specific baggage of interest in a timely and accurate manner. Furthermore, electronic tags lack the ability to track baggage location throughout its journey; if a tag is lost, detached, or damaged, it may result in missed, false, or inaccurate detection of baggage of interest.

[0038] Based on this, embodiments of this disclosure provide a pre-inspection baggage identification system and method. By dynamically tracking the appearance features and security inspection results of baggage throughout the entire process, the system can locate the position and status of baggage of interest in real time, so as to generate accurate interception prompts before the baggage arrives at the baggage claim area. This allows staff to efficiently intercept baggage of interest in advance, reducing the risk of missed inspections, false inspections, and congestion in the exit area.

[0039] The following explanation will use baggage arriving at the port through customs as an example. It should be noted that the pre-shipment baggage identification system disclosed herein can also be used in airports and train stations, and this disclosure does not limit the specific application scenarios of the pre-shipment baggage identification system. Within these locations, any movement and time period during which a pedestrian retrieves items but before the items undergo special inspection is within the scope of this disclosure.

[0040] This disclosure provides a pre-screening baggage identification system and method. By capturing appearance images of baggage before it enters the security screening equipment and when it is about to enter the retrieval area, it can achieve dynamic tracking of baggage throughout the entire process and improve the accuracy of identifying problematic baggage, avoiding misjudgment and missed judgment caused by relying on physical tags or electronic tags.

[0041] Figure 1 is a schematic diagram of the structure of a pre-shipment baggage inspection and identification system according to some exemplary embodiments of the present disclosure. Figure 2 is a hardware block diagram of a pre-shipment baggage inspection and identification system according to some exemplary embodiments of the present disclosure. Figure 3 is a processing flowchart of the hardware of the pre-shipment baggage inspection and identification system of Figure 2.

[0042] Referring to Figures 1, 2 and 3, the pre-inspection baggage identification system 100 according to some exemplary embodiments of the present disclosure may include a baggage conveyor platform 1, a security inspection device 2, an appearance acquisition device 3 and a baggage carousel 4.

[0043] In the embodiments of this disclosure, the baggage conveyor platform 1 serves as the basic structure for transporting baggage in the pre-inspection baggage identification system 100, providing a stable transport path and support structure for the operation of the appearance collection device 3, the security inspection device 2, and other related components. The baggage conveyor platform 1 can be positioned from the initial input point (entrance) of the baggage, passing through the security inspection device area and the appearance collection area, to the final output point (exit) of the baggage, connecting to the baggage carousel 4 in the baggage claim area.

[0044] The baggage conveyor platform 1 can transfer baggage via a conveyor belt assembly. The transmission system of the conveyor belt assembly can use a high-precision drive device to maintain a constant speed under various load conditions, avoiding speed fluctuations caused by uneven weight, size, or distribution of baggage.

[0045] In some exemplary embodiments, the support structure of the baggage conveying platform 1 can be made of high-strength materials, such as stainless steel or aluminum alloy, thereby maintaining high durability and stability in complex operating environments. Furthermore, to improve the stability of the conveying path, the baggage conveying platform 1 can also be equipped with a positioning base for the positioning and installation of the appearance acquisition device 3 and the security inspection device 2, ensuring that each device maintains consistent relative position in a fixed state.

[0046] In some exemplary embodiments, the overall structure of the baggage conveying platform 1 can be designed as a modular and scalable structure. That is, the transmission path of the baggage conveying platform 1 can be flexibly adjusted in length, width and height according to site requirements, and can support multi-segment layouts while maintaining the overall continuity of system operation.

[0047] According to embodiments of this disclosure, the baggage conveying platform 1 can be designed to include a baggage entrance platform 11, a baggage intermediate conveying path 12, and a baggage exit platform 13, so as to separate the appearance collection area and the security scan area, thereby meeting the baggage collection and inspection needs of multiple areas.

[0048] Referring again to Figures 1, 2, and 3, the security inspection device 2 is positioned in the middle area of ​​the baggage conveyor platform 1, and is connected to both the baggage entrance platform 11 and the intermediate baggage conveyor path 12. The security inspection device 2 is used to scan and analyze the items inside the baggage and generate security inspection results. These results can include both standard security inspection results and targeted security inspection results.

[0049] For example, security inspection device 2 can employ X-ray technology or non-contact imaging technology to generate multi-view imaging data of luggage through high-frequency transparent scanning, and quickly capture image information of items inside the luggage through a built-in detector array to generate high-resolution transparent images. The scanned transparent images can be analyzed in real time by the security inspection analysis module built into security inspection device 2. For example, the security inspection analysis module can integrate machine learning-based intelligent recognition algorithms and traditional image processing methods to extract and classify the features of items in the image (such as density, shape, material, etc.). Based on the extraction and classification results, the security inspection analysis module can identify prohibited items and high-risk items in the luggage, such as metal weapons, dangerous chemicals, or other controlled items, and output target security inspection results related to the features of the items, i.e., obtain the luggage of interest.

[0050] In some exemplary embodiments, the security inspection analysis module may include a risk assessment module for further analysis and evaluation. For example, the risk assessment module may assess the risk level of suspicious items in luggage based on data output by the image processing module, combined with a pre-defined risk rule base and assessment model.

[0051] In some exemplary embodiments, the security inspection device 2 may employ a dynamic scanning mode, synchronizing in real time with the conveying speed of the baggage conveyor platform 1. To improve the adaptability and stability of the system, the security inspection device 2 may also be equipped with an adjustment mechanism. For example, when the items inside the baggage are stacked or densely packed, the security inspection device 2 may automatically adjust scanning parameters, such as X-ray energy or image contrast, to ensure imaging quality in high-density areas.

[0052] It should be noted that, in this disclosure, "baggage of interest" refers to baggage that, during the baggage inspection process, is marked by security equipment or associated matching results as potentially requiring special handling. Examples include: baggage containing potentially prohibited items (such as flammable or explosive materials, controlled knives, etc.) or suspected high-risk items; baggage requiring special supervision in specific scenarios (such as baggage carrying a large number of valuables); and baggage exhibiting unusual appearance characteristics.

[0053] Correspondingly, in this disclosure, the target security inspection result generated by the security inspection device 2 can represent the identification and screening results for baggage of interest, including specific identification information for the baggage of interest. For example, characteristic information, risk level, and processing priority of risky items, so as to achieve focused processing of baggage of interest in subsequent processes.

[0054] Referring to Figure 1, unlike related technologies, the embodiments of this disclosure achieve end-to-end baggage tracking through multiple image captures of baggage appearance by the appearance acquisition device 3. The appearance acquisition device 3 may include a camera 301 and a photoelectric sensor 302. The camera 301 can be configured in the baggage appearance acquisition areas of the baggage entrance platform 11 and the baggage exit platform 13 to capture images of the baggage appearance. The photoelectric sensor 302 serves as an auxiliary detection component of the appearance acquisition device 3, used to monitor the arrival status of the baggage in real time and trigger the camera to capture images.

[0055] In some exemplary embodiments, the photoelectric sensor 302 can be positioned at a specific location on the baggage transport path, such as the middle of the baggage entrance platform 11 and the baggage exit platform 13, above the conveyor belt, or to the side. When baggage passes through the appearance acquisition area, the photoelectric sensor 302 can sense the edge position of the baggage and control the start and stop of the camera through a preset logic signal, ensuring that the camera 301 only takes pictures when the baggage has fully entered the acquisition area, thereby avoiding false or missed shots. The photoelectric sensor 302 can also dynamically adjust the shooting frequency of the camera 301 according to the baggage transport speed to ensure the synchronization and continuity of image acquisition.

[0056] In some exemplary embodiments, the appearance acquisition device 3 may be configured with multiple cameras, which are arranged at different locations in the luggage appearance acquisition area, such as the top, sides, and bottom, to acquire complete appearance information of the luggage from multiple angles. The arrangement of multiple cameras enables the appearance acquisition device 3 to obtain omnidirectional image data of the luggage. Especially when dealing with luggage with complex shapes or irregular shapes, multi-angle shooting significantly improves the completeness of the image and the accuracy of feature extraction.

[0057] Referring again to Figure 1, to ensure image acquisition quality under different lighting conditions, the appearance acquisition device 3 may further include a light source 303 and a support structure. The appearance acquisition device 3 is configured with a box structure for the appearance acquisition box to isolate natural light. The light source 303 provides stable and uniform illumination, reducing the impact of changes in ambient light on image quality. The support structure can be made of high-strength, durable materials and is used to fix the light source 303, camera 301, and photoelectric sensor 302 at appropriate locations within the appearance acquisition box and / or the baggage transport path. For example, the light source 303 and camera 301 can be fixed to the top of the appearance acquisition box using the support structure, and the photoelectric sensor 302 can be fixed to the middle of the baggage transport path within the appearance acquisition box using the support structure.

[0058] In some exemplary embodiments, the light source 303 can be arranged in a multi-point manner, and its position and angle can be adapted to luggage of different sizes and shapes to ensure that the luggage can obtain uniform and sufficient illumination in the collection area.

[0059] Referring to Figures 1 and 2, the appearance acquisition device 3 may include a first appearance acquisition device 31 and a second appearance acquisition device 32.

[0060] Referring to Figure 1, for ease of description, the baggage transport direction x is defined herein. For example, the baggage transport direction x corresponds to the transport path of the baggage transport platform 1, that is, the trajectory of the baggage. For example, the baggage transport direction x starts from the baggage entrance, passes through the first appearance acquisition device 31; then, the baggage transport direction x extends along the security check device 2; finally, the baggage transport direction x extends to the baggage carousel 4 through the second appearance acquisition device 32.

[0061] In some exemplary embodiments, the first appearance acquisition device 31 is installed on the baggage entrance platform 11, upstream of the security inspection device 2 along the baggage transport direction x; the second appearance acquisition device 32 is installed on the baggage exit platform 13, upstream of the baggage carousel 4 along the baggage transport direction x.

[0062] According to embodiments of this disclosure, a first appearance acquisition device 31 installed on the baggage entrance platform 11 can be used to acquire a first appearance image of the baggage as it enters the baggage conveying platform 1, obtaining information about the baggage's size, shape, color, and other key features. A second appearance acquisition device 32 installed on the baggage exit platform 13 can be used to acquire a second appearance image of the baggage when it is about to complete its conveying process. That is, the second appearance acquisition device 32 can also capture possible appearance changes that may occur during the transport process, such as possible displacement, appearance changes, or loss of distinctive features, to assist in the final identification and positioning of the baggage.

[0063] It should be noted that in the embodiments of this disclosure, the first appearance acquisition device 31 and the second appearance acquisition device 32 can have the same structure and achieve the same function. For example, both the first appearance acquisition device 31 and the second appearance acquisition device 32 can be equipped with a camera and a photoelectric sensor to take photos of the arriving luggage. For example, the first appearance acquisition device 31 and the second appearance acquisition device 32 can be configured as a box structure and equipped with a camera, a photoelectric sensor, a light source, and a support structure to reduce ambient light interference and improve the quality of the captured images while taking photos of the arriving luggage. The structures of the first appearance acquisition device 31 and the second appearance acquisition device 32 can also be different; for example, the positions of the light source, camera, and photoelectric sensor can be adjusted according to different needs.

[0064] Referring to Figures 2 and 3, in response to the arrival of luggage, the photoelectric sensor 302 can detect the luggage entering the collection area in real time and send a trigger signal to trigger the camera 301 to continuously take multiple photos at a fixed frequency within a preset time interval.

[0065] Multiple photos taken by a camera in succession may vary in quality due to the movement of luggage, ambient lighting, or other factors. To address this issue, the appearance acquisition device 3 can be further equipped with an appearance analysis module to perform quality analysis on the multiple photos taken. The appearance analysis module can score each photo based on a preset quality assessment algorithm, considering dimensions such as sharpness, contrast, and brightness balance. Photos with a comprehensive score exceeding a preset threshold are used as the first appearance image or the second appearance image.

[0066] Specifically, the quality assessment algorithm of the appearance analysis module can analyze changes in ambient lighting, luggage color, and material. For example, when luggage surfaces have reflective or complex textures, the appearance analysis module can identify and filter out blurry photos caused by lighting interference, ensuring that the selected target images have sufficient detail and clarity. For instance, the appearance analysis module can appropriately increase the weight of clarity in complex scenes, or prioritize images with higher brightness in low-light conditions to meet actual operational requirements.

[0067] In embodiments of this disclosure, the pre-screening baggage identification system 100 further includes a control device, which is communicatively connected to the security inspection equipment 2 and the appearance acquisition device 3. The control device is configured to perform correlation matching on the target security inspection result generated by the security inspection equipment 2, the first appearance image acquired by the appearance acquisition device 3, and the second appearance image, and generate an interception prompt message for baggage of interest based on the correlation matching result.

[0068] Specifically, a baggage recognition and matching mechanism based on time window binding can be constructed by extracting features from the first and second appearance images and analyzing the correlation between the target security inspection results and the control device, thereby realizing the dynamic tracking and positioning of baggage of interest throughout the entire process.

[0069] It should be noted that the control device can operate in centralized or stand-alone mode. For example, the control device can simultaneously control the security analysis module of the security screening equipment and the appearance analysis module of the appearance collection equipment, thereby achieving comprehensive analysis of baggage information. Through centralized control, the control device can schedule the workflow of each module with unified logic, ensuring the consistency and continuity of information collection and processing steps for baggage during transport.

[0070] On the other hand, the control device can operate independently of the security inspection analysis module and the appearance analysis module, providing greater flexibility. In this mode, the control device is primarily responsible for receiving and integrating the output results of each analysis module without directly interfering with their internal analysis processes. For example, the security inspection analysis module can operate independently, processing X-ray scan data in real time using built-in machine learning algorithms and rule bases; the appearance analysis module independently filters appearance images. After receiving these analysis results, the control device comprehensively processes them using techniques such as time window binding and feature matching to generate correlation matching results and interception prompts. Therefore, in this mode, the control device can effectively share the computational burden of each analysis module while allowing each module to be independently optimized according to different task requirements.

[0071] In the embodiments of this disclosure, during the association matching process, the control device can be configured to: perform association matching between the first appearance image and the target security inspection result, generate association information, and store the association information in a time queue; based on the time queue, perform association matching between the association information and the second appearance image. That is, to achieve sequential association matching between the first appearance image and the target security inspection result, the first appearance image, the target security inspection result, and the second appearance image.

[0072] Specifically, referring to Figure 3, the control device can extract the first appearance features of the luggage from the first appearance image, including size, shape, color, texture, and other distinctive features. These first appearance features are combined with the target security check result generated by the security inspection device 2 to generate entrance profile information. That is, the entrance profile information not only includes relevant data on appearance features but also records the timestamp of the luggage entering the luggage transport platform 1, as well as information such as risk level and marking status related to the security check conclusion. The generated entrance profile information can be stored in a time queue, which is sorted according to the luggage's transport time.

[0073] In response to the baggage being transported to the baggage exit platform 13, the second appearance image can be captured and its second appearance features extracted. Similar to the first appearance features, the second appearance features include information such as the size, color, and texture of the baggage, but may also include features reflecting changes in the appearance of the baggage that may occur during transport, such as damage, loss of distinctive features, or appearance contamination. Using the time window calculation module in the control device, the entry time window corresponding to the second appearance image can be calculated based on the baggage's transport speed and the length of the transport path. The entry time window serves as a matching condition, compared with the entry profile information in the time queue, to locate the target entry profile information that matches the entry time window.

[0074] After matching the target entrance image information, the control device can further correlate the second appearance feature with the first appearance feature in the target entrance image information. For example, based on a feature comparison algorithm, the correlation between the first and second appearance features is determined by calculating the similarity between them. If the similarity exceeds a preset threshold, the current luggage is considered to have successfully matched the target entrance image information, generating a correlation matching result. This correlation matching result may include two captured appearance images of the luggage, as well as risk warning information for the luggage generated based on the target security check results.

[0075] According to embodiments of this disclosure, by capturing a first appearance image at the baggage entrance platform and a second appearance image at the baggage exit platform, and combining this with the security inspection conclusion generated by the security inspection equipment, the interception process can be moved forward to the exit of the baggage conveyor belt, avoiding congestion in areas with high passenger concentration. Furthermore, through the intelligent analysis of the efficient appearance capture equipment and security inspection equipment combined with the control device, reliance on traditional physical marking methods can be avoided, thus reducing operating costs, decreasing the demand for disposable consumables, and avoiding the additional workload associated with consumable procurement and management.

[0076] In some exemplary embodiments, during the process of generating interception alerts for baggage of interest based on the results of association matching, the control device can also provide precise alerts and differentiated displays for baggage of interest through multi-layered data processing and information generation mechanisms. For example, the control device can generate arrival information for only baggage of interest based on the results of association matching. This arrival information includes the baggage's real-time location on the transport path, its appearance characteristics, and its security risk level. For ordinary baggage that meets the detection criteria, arrival information may not be generated. Alternatively, arrival information can be generated for both ordinary baggage and baggage of interest, but with different labels assigned to them. Furthermore, real-time location information can be dynamically calculated and updated in real time by the control device.

[0077] According to embodiments of this disclosure, the logic for generating arrival information relies on correlation matching results. After the entrance profile information of the baggage is successfully matched with the exit appearance features, the control device can determine the specific time and location of its arrival at the exit by calculating the baggage's transport progress. Furthermore, it can also combine the risk assessment results provided by the security inspection equipment to mark the priority level of baggage of interest.

[0078] Based on arrival information, the control device can further generate interception alerts and push them to customs officers in the form of visual prompts. Specifically, the graphical interface can display images of the baggage's appearance, estimated arrival time, and interception suggestions. Through this intuitive display, customs officers can quickly identify target baggage and take appropriate measures, significantly improving interception efficiency and ease of operation.

[0079] Referring again to Figure 3, the preliminary baggage inspection and identification system 100 also includes an execution terminal. The execution terminal is communicatively connected to the control device and is used to receive and display interception alerts for baggage of interest to customs officers, assisting them in efficient baggage supervision and processing. The execution terminal is configured to display the location information and appearance image of the baggage of interest upon receiving the interception alert.

[0080] It should be understood that the types of execution terminals can be diverse, such as handheld terminals, fixed displays, wearable devices, and multi-device collaborative systems. The type of execution terminal can be selected according to different scenarios and needs. For example, handheld terminals, as portable devices, are suitable for highly flexible operational scenarios. Handheld terminals can be equipped with touchscreens and mobile communication modules, enabling them to receive real-time alerts while customs officers are moving, and display the location information and appearance images of baggage of interest in a visual interface. Officers can quickly browse and take appropriate actions through the handheld terminal. Furthermore, handheld terminals can be configured with vibration or sound alerts to ensure that information about high-priority baggage promptly attracts the attention of customs officers, improving interception efficiency.

[0081] According to embodiments of this disclosure, when special baggage is about to appear on the carousel, customs officers can know the exact location and time of baggage inspection in advance through the interception prompt information received, which can improve the timeliness of early machine inspection supervision.

[0082] Based on the aforementioned pre-inspection baggage identification system, embodiments of this disclosure also provide a pre-inspection baggage identification method. It should be noted that, unless otherwise specified, the content and features described above can be combined with those described in the various embodiments below. To save space, these descriptions will not be repeated in the following embodiments. For example, the setting where the control device generates baggage arrival information based on the results of association matching, and generates interception prompts in the form of visual prompts based on the arrival information, can also be applied to the pre-inspection baggage identification method during the identification of baggage of interest.

[0083] Figure 4 is a flowchart of a pre-shipment baggage identification method according to an exemplary embodiment of the present disclosure.

[0084] As shown in Figure 4, the preliminary baggage inspection and identification method of this embodiment includes operations S410 to S440.

[0085] During operation of S410, a first appearance image of the luggage is captured by the first appearance acquisition device.

[0086] In response to luggage entering the first appearance acquisition device, the photoelectric sensor in the first appearance acquisition device can be triggered to detect the arrival status of the luggage, control the camera to start, and continuously take multiple photos of the luggage's appearance within a preset time interval. Subsequently, image analysis algorithms can be used to filter the quality of the multiple photos, selecting the photo with better clarity, brightness balance, and contrast as the first appearance image. The selected first appearance image is sent to the control device in real time.

[0087] In operation S420, the security inspection equipment is used to inspect baggage, identify baggage of interest, and generate a target security inspection result.

[0088] After luggage passes through the X-ray scanning equipment, the system analyzes the contents of the luggage based on preset algorithms and risk assessment models to determine whether there are prohibited items or other high-risk items. If luggage of interest is detected, the security equipment generates a target security result, including information such as risk level and item category, and transmits this information to the control device, which correlates it with the initial appearance image to form an entrance profile.

[0089] When operating the S430, a second appearance image of the luggage is captured by the second appearance acquisition device.

[0090] In response to luggage entering the second appearance acquisition device, the photoelectric sensor in the device is triggered to start the shooting mechanism. The camera continuously captures multi-angle photos of the luggage at a fixed frequency, and uses image analysis algorithms to select the best photo as the second appearance image. The selected second appearance image is sent to the control device for matching with the entrance image information.

[0091] In operation S440, the target security check result, the first appearance image, and the second appearance image are correlated and matched. Based on the correlation and matching results, an interception prompt message for the baggage of interest is generated. Specifically, the first appearance image and the target security check result can be correlated and matched first to generate correlation information, which is then stored in a time queue. Next, based on the time queue, the correlation information and the second appearance image are correlated and matched. This sequential correlation and matching process is implemented.

[0092] Specifically, the sequential association and matching process may include: extracting the first appearance feature of the first appearance image, combining the first appearance feature with the target security check result to generate entrance portrait information, and placing the entrance portrait information into a time queue sorted by baggage transfer time; extracting the second appearance feature of the second appearance image, calculating the corresponding entrance time window based on the baggage transfer speed, obtaining the target entrance portrait information that matches the entrance time window from the time queue; and associating and matching the second appearance feature and the target entrance portrait information to generate the association and matching result.

[0093] Once a match is successful, the uniqueness and status of the baggage can be confirmed, and an interception alert message for the baggage of interest can be generated. The interception alert message can be transmitted to the customs officer's execution terminal in a visual format, allowing the officer to quickly locate and process the problematic baggage based on the interception alert message.

[0094] According to the pre-inspection baggage identification system of this disclosure, by setting up a first appearance acquisition device and a second appearance acquisition device at different locations along the baggage transport path, the system achieves full-process tracking and multi-point feature acquisition of baggage, ensuring accurate location and identification of problematic baggage. Compared with traditional physical marking or electronic tag methods, this system can dynamically track the location of baggage without relying on physical markings, and there are no consumables incurred for marking baggage. At the same time, by moving the inspection location of special baggage to the baggage claim area, the system can optimize the staff's execution process, reduce congestion during passenger clearance, and thus improve the intelligence and efficiency of baggage supervision.

[0095] Figure 5 schematically illustrates a block diagram of an electronic device suitable for implementing the above-described method according to an embodiment of the present disclosure. The electronic device shown in Figure 5 is merely an example and should not be construed as limiting the functionality and scope of the embodiments of the present disclosure.

[0096] As shown in FIG. 5, an electronic device 500 according to an embodiment of the present disclosure includes a processor 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage portion 508 into a random access memory (RAM) 503. The processor 501 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or an associated chipset and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 501 may also include onboard memory for caching purposes. The processor 501 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0097] RAM 503 stores various programs and data required for the operation of electronic device 500. Processor 501, ROM 502, and RAM 503 are interconnected via bus 504. Processor 501 performs various operations of the method flow according to embodiments of the present disclosure by executing programs in ROM 502 and / or RAM 503. It should be noted that the programs may also be stored in one or more memories other than ROM 502 and RAM 503. Processor 501 may also perform various operations of the method flow according to embodiments of the present disclosure by executing programs stored in said one or more memories.

[0098] According to embodiments of this disclosure, the electronic device 500 may further include an input / output (I / O) interface 505, which is also connected to a bus 504. The electronic device 500 may also include one or more of the following components connected to the input / output (I / O) interface 505: an input section 506 including a keyboard, mouse, etc.; an output section 507 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 508 including a hard disk, etc.; and a communication section 509 including a network interface card such as a LAN card, modem, etc. The communication section 509 performs communication processing via a network such as the Internet. A drive 510 is also connected to the input / output (I / O) interface 505 as needed. A removable medium 511, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on the drive 510 as needed so that computer programs read from it can be installed into the storage section 508 as needed.

[0099] This disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or it may exist independently and not assembled into the device / apparatus / system. The computer-readable storage medium carries one or more programs that, when executed, implement the method according to the embodiments of this disclosure.

[0100] According to embodiments of this disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, such as including, but not limited to: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. For example, according to embodiments of this disclosure, the computer-readable storage medium may include ROM 502 and / or RAM 503 and / or one or more memories other than ROM 502 and RAM 503 described above.

[0101] Embodiments of this disclosure also include a computer program product comprising a computer program containing program code for performing the methods shown in the flowchart. When the computer program product is run on a computer system, the program code enables the computer system to implement the user interaction methods provided in the embodiments of this disclosure.

[0102] When the computer program is executed by the processor 501, it performs the functions defined in the system / apparatus of this disclosure embodiments. According to embodiments of this disclosure, the systems, apparatuses, modules, units, etc., described above can be implemented by computer program modules.

[0103] In one embodiment, the computer program may rely on a tangible storage medium such as an optical storage device or a magnetic storage device. In another embodiment, the computer program may also be transmitted and distributed in the form of signals over a network medium, and may be downloaded and installed via the communication section 509, and / or installed from a removable medium 511. The program code contained in the computer program can be transmitted using any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination thereof.

[0104] In such an embodiment, the computer program can be downloaded and installed from a network via communication section 509, and / or installed from removable medium 511. When the computer program is executed by processor 501, it performs the functions defined in the system of this disclosure embodiment. According to embodiments of this disclosure, the systems, devices, apparatuses, modules, units, etc., described above can be implemented by computer program modules.

[0105] According to embodiments of this disclosure, program code for executing the computer programs provided in embodiments of this disclosure can be written in any combination of one or more programming languages. Specifically, these computational programs can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, languages ​​such as Java, C++, Python, "C", or similar programming languages. The program code can execute entirely on the user's computing device, partially on the user's device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0106] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0107] The specific embodiments described above further illustrate the purpose, technical solutions, and beneficial effects of this disclosure. It should be understood that the above descriptions are merely specific embodiments of this disclosure and are not intended to limit this disclosure. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this disclosure should be included within the protection scope of this disclosure.

Claims

1. A pre-screening baggage identification system, comprising: A baggage conveyor platform configured to convey baggage along a baggage conveying direction; Security inspection equipment, configured to inspect baggage and generate a target security inspection result; An appearance acquisition device, comprising at least a first appearance acquisition device and a second appearance acquisition device, wherein the first appearance acquisition device is located upstream of the security inspection equipment and is used to acquire a first appearance image of the baggage, and the second appearance acquisition device is located upstream of the baggage claim area and is used to acquire a second appearance image of the baggage; and A control device, which is communicatively connected to the security inspection equipment and the appearance acquisition equipment; The control device is configured to perform correlation matching on the target security check result, the first appearance image, and the second appearance image, and generate baggage interception prompt information based on the correlation matching result.

2. The system of claim 1, wherein, The appearance acquisition device includes: A camera configured to capture an image of the appearance of luggage in a luggage appearance acquisition area; A photoelectric sensor is configured to detect the arrival status of luggage and trigger the camera to take a picture.

3. The system of claim 2, wherein, The appearance acquisition device is configured as an appearance acquisition box, and the appearance acquisition device further includes: light source; A support structure configured to secure the light source, the camera, and the photoelectric sensor inside the appearance acquisition box and / or above the luggage transport path.

4. The system of any one of claims 1-3, wherein, During the association matching process, the control device is configured to: The first appearance image and the target security inspection result are correlated and matched to generate correlation information, and the correlation information is stored in a time queue; Based on the time queue, the associated information and the second appearance image are matched and associated.

5. The system of claim 4, wherein, The control device is further configured to: Extract the first appearance feature from the first appearance image, combine the first appearance feature with the target security check result to generate entrance portrait information, and store the entrance portrait information in the time queue, wherein the time queue is sorted by baggage transfer time; Extract the second appearance features from the second appearance image, and calculate the corresponding entrance time window based on the luggage transfer speed. Obtain the target entrance image information that matches the entrance time window from the time queue. The second appearance feature is associated and matched with the target entrance image information to generate an association and matching result.

6. The system of any one of claims 1-3, wherein, In the process of generating baggage interception alert information based on the results of correlation matching, the control device is configured to: Baggage arrival information is generated based on the results of association matching; Based on the arrival information, an interception prompt message is generated in the form of a visual prompt.

7. The system of claim 6, wherein, The arrival information is set to be differentiated for different types of luggage.

8. The system of claim 2 or 3, wherein, The appearance acquisition device is configured such that, in response to the arrival of luggage, the photoelectric sensor triggers the camera to continuously take multiple photos within a preset time interval.

9. The system of claim 8, wherein, The appearance acquisition device also includes an analysis device configured to perform quality analysis on multiple consecutively captured photos and select a photo of target quality as a first appearance image or a second appearance image.

10. The system of claim 2 or 3, wherein, The cameras include multiple cameras positioned at different locations within the baggage appearance collection area.

11. The system of claim 3, wherein, The light source includes multiple light sources arranged at different positions on the appearance acquisition box.

12. The system of any one of claims 1-3, 5, 7, 9, and 11, wherein, The baggage conveying platform includes a baggage entrance platform and a baggage exit platform arranged opposite to each other. The first appearance acquisition device is installed on the baggage entrance platform, and the second appearance acquisition device is installed on the baggage exit platform.

13. The system of any one of claims 1-3, 5, 7, 9, and 11, wherein, The baggage recognition system also includes an execution terminal, which is communicatively connected to the control device and is used to receive and display the interception prompt information.

14. The system of claim 13, wherein, The execution terminal is configured to display the location information and appearance image of the corresponding luggage after receiving the interception prompt information.

15. The system of claim 9, wherein, The analytical device is further configured to: A comprehensive score is given to multiple photos taken in succession based on image sharpness, brightness balance, and contrast. Photos with a comprehensive score exceeding a preset threshold will be used as the first appearance image or the second appearance image.

16. A method for pre-screening baggage identification, comprising: A first appearance image of the luggage is captured by a first appearance acquisition device, wherein the first appearance acquisition device is located upstream of the security inspection equipment along the luggage conveying direction; The security inspection equipment is used to inspect luggage and generate the target security inspection result; A second appearance image of the luggage is captured by a second appearance acquisition device, wherein the second appearance acquisition device is located upstream of the luggage collection area along the luggage transport direction; and The target security check result, the first appearance image, and the second appearance image are correlated and matched, and baggage interception prompt information is generated based on the correlation and matching results.

17. The method of claim 16, wherein, The process of associating and matching the target security inspection result, the first appearance image, and the second appearance image specifically includes: Extract the first appearance feature from the first appearance image, combine the first appearance feature with the target security check result to generate entrance portrait information, and put the entrance portrait information into a time queue sorted by baggage transfer time; Extract the second appearance features from the second appearance image, calculate the corresponding entrance time window based on the luggage conveying speed, and obtain the target entrance image information matching the entrance time window from the time queue; and The second appearance feature and the target entrance image information are associated and matched to generate an association matching result.

Images