Sorting direction control system and method for security checked luggage

Abstract

The invention discloses a sorting direction control system for security-checked luggage, and the system comprises a sorting guide device which is provided with an entrance end trigger line and an exit end trigger line which are vertical to the transmission direction of a security check instrument in a luggage transmission area, and a manual inspection area trigger line in the transmission direction of the security check instrument; and the system controller is used for identifying the luggage in the continuous frames of luggage images, marking a detection frame, and determining a sorting guide direction according to the dynamic position of the detection frame of the current luggage and a security check result of the luggage so as to convey the current luggage to a matched luggage extraction area or a manual inspection area.

Description

Technical Field

[0001] This invention relates to the field of security inspection technology, and in particular to a sorting direction control system and method for baggage that has already undergone security inspection. Background Technology

[0002] Currently, security inspection machines are widely used in airports, train stations, subway stations, bus stations, government buildings, embassies, conference centers, exhibition centers, hotels, shopping malls, large-scale events, post offices, schools, logistics industries, and industrial inspections, mainly to detect whether passengers' items threaten public safety.

[0003] While security screening machines have brought much convenience to our lives, they also have some shortcomings. For example, in the process of coupling and linking security screening machines with baggage sorting systems, there is a lack of refined control and configuration methods for the implementation of sorting instructions, which can lead to incorrect sorting or affect the efficiency of intelligent sorting. This can increase the working hours of staff, thereby reducing the accuracy of security checks and affecting the work efficiency of staff.

[0004] Therefore, existing technologies need to provide an intelligent sorting solution that can take into account the fine-grained control of sorting instructions, thereby improving the smoothness of the linkage between security scanners and baggage sorting equipment, improving sorting efficiency and accuracy, and enabling accurate and efficient automatic sorting of normal baggage or items from suspicious baggage or items after security checks. Summary of the Invention

[0005] The purpose of this invention is to propose an intelligent sorting scheme that can take into account the fine-grained control of sorting instructions, thereby improving the smoothness of the linkage between security scanners and baggage sorting equipment, improving sorting efficiency and accuracy, and enabling accurate and efficient automatic sorting of normal baggage or items and suspicious baggage or items after security screening.

[0006] To address the aforementioned technical problems, embodiments of the present invention provide a sorting direction control system for security-checked baggage, comprising: a sorting guide device, which sets in the baggage conveying area an entrance trigger line and an exit trigger line perpendicular to the conveying direction of the security scanner, as well as a manual inspection area trigger line along the conveying direction of the security scanner; and a system controller, which identifies baggage in continuous frame baggage images and marks detection frames, and determines the sorting guide direction based on the dynamic position of the current baggage's detection frame and the security check result of the baggage, so as to transport the current baggage to a matching baggage collection area or manual inspection area.

[0007] Preferably, the system controller is further configured to determine the sorting guidance direction according to the following steps: mapping the detection box numbers of all luggage in the previous frame of the luggage image to the detection box of each piece of luggage in the current frame of the luggage image, wherein the marked detection box information is four-element information including the position coordinates of the detection box marker point and the size of the detection box; configuring appropriate sorting control instructions for the latest luggage to be controlled according to the detection box number of each piece of luggage in the current frame of the luggage image and its corresponding security inspection result, and controlling the sorting operation direction according to the sorting control instructions, wherein each instruction in the sorting control instructions includes a conveying direction speed and a changing direction speed, and the type of the sorting control instructions includes multi-stage control instructions and single-stage control instructions, and the type of the sorting control instructions is determined according to the type of the security inspection result; detecting the real-time operating position according to the dynamic position of the detection box of the latest luggage to be controlled and the relative position relationship with the trigger line group, so as to adjust the conveyor belt conveying direction of the sorting guidance device, thereby determining the multi-stage switching timing or the state of the luggage leaving the security inspection process.

[0008] Preferably, when the security check result of the latest baggage to be controlled is abnormal baggage, the sorting control instruction is a multi-stage control instruction, which includes an abnormal sorting instruction and a normal sorting instruction executed sequentially. The abnormal sorting instruction is a control instruction that sets the conveying direction speed to zero and the changing direction speed to a preset first speed threshold, and the normal sorting instruction is a control instruction that sets the conveying direction speed to a preset second speed threshold and the changing direction speed to zero.

[0009] Preferably, the system controller is further configured to control the sorting operation direction according to the following steps: controlling the sorting operation direction according to the abnormal sorting instruction; issuing the normal sorting instruction when the vertical coordinate of the marker point of the detection frame of the latest baggage to be controlled exceeds the vertical coordinate of the trigger line of the manual inspection area, so as to switch from the abnormal sorting instruction to the normal sorting instruction; controlling the sorting operation direction according to the normal sorting instruction; indicating that the baggage has arrived at the manual inspection area when the horizontal coordinate of the marker point of the detection frame of the latest baggage to be controlled exceeds the horizontal coordinate of the trigger line at the exit end.

[0010] Preferably, when the security check result of the latest baggage to be controlled is normal baggage, the sorting control instruction is a single-stage control instruction, which only includes a normal sorting instruction. The normal sorting instruction is a control instruction that sets the conveying direction speed to a preset second speed threshold and the changing direction speed to zero.

[0011] Preferably, the system controller is further configured to indicate that the baggage has arrived at the baggage claim area and delete the baggage from the system's sorting record when the horizontal coordinate of the detection frame marker point of the latest baggage to be controlled exceeds the horizontal coordinate of the exit trigger line.

[0012] Preferably, the system controller is further configured to map the detection box numbers of all luggage in the previous frame luggage image to the detection box of each piece of luggage in the current frame luggage image according to the following steps: predicting the detection box position prediction information of all luggage in the previous frame luggage image in the current frame luggage image based on the detection box information of all luggage in the previous frame luggage image and the detection box information of each piece of luggage in the current frame luggage image; calculating the degree of overlap between the detection box area defined by each detection box information in the current frame luggage image and the detection box area defined by all detection box information in the previous frame luggage image, and based on this, associating each detection box in the current frame luggage image with one of the detection boxes in the previous frame image.

[0013] Preferably, the maximum value is extracted from the overlap between the current detection box in the current frame of the luggage image and all detection box regions in the previous frame of the luggage image, so that the detection box corresponding to the maximum overlap value in the previous frame of the luggage image is associated with the current detection box in the current frame of the luggage image, and the number of the detection box corresponding to the maximum overlap value is assigned to the current detection box.

[0014] Preferably, if the overlap between the current detection box in the current frame of the luggage image and all detection box regions in the previous frame of the luggage image is zero, then the current detection box is assigned a new number.

[0015] On the other hand, embodiments of the present invention also provide a sorting direction control method for security-checked baggage. The sorting direction control method is implemented using the sorting direction control system as described above, including: setting an entrance trigger line and an exit trigger line perpendicular to the security scanner's conveying direction, as well as a manual inspection area trigger line along the security scanner's conveying direction, within the baggage conveying area of ​​the sorting guide device; identifying baggage in consecutive frame baggage images and marking detection frames; and determining the sorting guide direction based on the dynamic position of the current baggage's detection frame and the baggage's security check result, so as to transport the current baggage to a matching baggage pickup area or manual inspection area.

[0016] Compared with the prior art, one or more embodiments of the above solutions may have the following advantages or beneficial effects: This invention proposes a sorting direction control system and method for baggage that has already undergone security checks. During the sorting control process, this system and method adaptively adjust the sorting direction of baggage to be sorted by dynamically monitoring changes in the baggage detection frame information. This automatically matches the sorting direction with the baggage transport destination corresponding to the security check results. Therefore, this invention can efficiently and accurately control the automatic sorting direction of normal and suspicious baggage after security checks. This invention improves the linkage efficiency and fault tolerance between security scanners, sorting equipment, and baggage transport destinations, thereby improving the accuracy, efficiency, and anomaly response capability of the sorting action. It is also adaptable to any type of security scanner equipment.

[0017] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in the description, claims, and drawings. Attached Figure Description

[0018] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with the embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings: Figure 1 This is a schematic diagram of the overall structure of a prior art sorting system for security-checked luggage.

[0019] Figure 2 This is a schematic diagram of the system structure of a sorting direction control system for security-checked luggage, according to an embodiment of this application.

[0020] Figure 3 This is a schematic diagram showing the distribution of trigger lines in the conveying area of ​​the sorting direction control system for security-checked baggage, according to an embodiment of this application.

[0021] Figure 4 This is a schematic diagram illustrating the detection frame mapping principle of a sorting direction control system for security-checked baggage in an embodiment of this application.

[0022] Figure 5 This is a schematic diagram illustrating the steps of a sorting direction control method for security-checked baggage according to an embodiment of this application. Detailed Implementation

[0023] The embodiments of the present invention will be described in detail below with reference to the accompanying drawings and examples, so that the process of how the present invention uses technical means to solve technical problems and achieve technical effects can be fully understood and implemented accordingly. It should be noted that, as long as there is no conflict, the various embodiments and features in the various embodiments of the present invention can be combined with each other, and the resulting technical solutions are all within the protection scope of the present invention.

[0024] Furthermore, the steps illustrated in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Also, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in a different order than that shown here.

[0025] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the exemplary embodiments. Unless the context clearly indicates otherwise, the singular forms “a” and “an” as used herein are also intended to include the plural. It should also be understood that the terms “comprising” and / or “including” as used herein specify the presence of the stated features, integers, steps, operations, units, and / or components, without excluding the presence or addition of one or more other features, integers, steps, operations, units, components, and / or combinations thereof.

[0026] To address the technical problems mentioned above, this application proposes a sorting direction control system and method for security-screened baggage. During the sorting control process, this system and method monitor the real-time running position of baggage by dividing the conveying area in the sorting guide device into trigger line groups to generate control commands for controlling the sorting direction. This improves the linkage efficiency and fault tolerance between the security scanner, sorting equipment, and baggage delivery destination by forming refined control commands for different running directions, thereby enhancing the accuracy, efficiency, and anomaly response capability of the sorting action. Furthermore, the sorting direction control system described in this invention is adaptable to any type of security scanner equipment.

[0027] Figure 1 This is a schematic diagram of the overall structure of a prior art sorting system for checked baggage. It should be noted that the sorting direction control system for checked baggage provided in this embodiment of the invention is applied to the sorting system shown in Figure 1. Figure 1 As shown, the sorting system described in this embodiment of the invention includes at least: a sorting guide device, an identification camera, and a system controller. The sorting guide device is located downstream of the security scanner. The identification camera's field of view covers the exit end of the security scanner and is mainly used to capture real-time dynamic images of the security scanner transporting identified baggage from the exit to the sorting guide device. Downstream of the sorting guide device are a baggage claim area and a manual inspection area.

[0028] The sorting guide device uses technologies such as swing wheels, cross conveyors, or modular belts to controllably (e.g., under the control of a system controller) transport baggage in two directions, thereby transferring it to the baggage claim area or the manual inspection area respectively.

[0029] The security check results for each piece of luggage transported by the security scanner are transmitted to the system controller. The security check result is indicated by whether the luggage is considered suspicious. The suspicious status of luggage currently being transported and identified by the security scanner includes two categories: normal luggage and suspicious luggage (abnormal luggage).

[0030] In this invention, the system controller issues a straight-ahead command, for example, to the sorting guide device based on the security check results of the baggage being transported, causing the sorting guide device to sort the current baggage to the baggage claim area under the action of the straight-ahead command. Additionally, the system controller issues a deflection command, for example, to the sorting guide device based on the security check results of the baggage being transported, causing the sorting guide device to sort the current baggage to the manual inspection area under the action of the deflection command. Furthermore, in this embodiment of the invention, the system controller defaults to issuing a straight-ahead command to the sorting guide device.

[0031] Passengers retrieve their normal luggage from the baggage claim area. The baggage claim area can be implemented using non-powered conveyor rollers, drums, or modular conveyors. Additionally, the exit end of the baggage claim area is constructed with a slope to ensure that luggage does not linger behind the sorting equipment.

[0032] Suspicious baggage is conveyed to the manual inspection area by a sorting guide. Staff here conduct an inspection. The manual inspection area can be implemented using unpowered conveyor rollers, drums, or modular conveyors.

[0033] The recognition camera captures dynamic images of luggage being continuously transported at the exit of the security checkpoint in real time and transmits them to the system controller. The system controller then extracts luggage images from the dynamic images at corresponding times according to preset time intervals, thereby obtaining multiple frames of luggage images.

[0034] Figure 2 This is a schematic diagram of the system structure of a sorting direction control system for security-checked luggage, according to an embodiment of this application. Figure 3 This is a schematic diagram showing the trigger line distribution in the conveying area of ​​the sorting direction control system for security-checked baggage according to an embodiment of this application. The following is in conjunction with... Figure 2 and Figure 3 The specific structure and function of the sorting direction control system described in the embodiments of the present invention will be explained.

[0035] like Figure 3 As shown, in this embodiment of the invention, a baggage conveying area is also provided in the conveyor belt conveying area within the sorting guide device. The baggage conveying area is a partial area of ​​the conveyor belt conveying area within the sorting guide device, and is located in the guiding execution area of ​​the conveyor belt conveying area within the sorting guide device.

[0036] In this embodiment of the invention, a series of luggage sent out from the security scanner are transported at certain intervals to the conveyor belt of the sorting guide device for intermittent transport, so that these luggage enter the luggage transport area at intervals.

[0037] In this embodiment of the invention, a trigger wire assembly is provided in the baggage conveying area. The trigger wire assembly includes an entrance-end trigger wire perpendicular to the conveying direction of the security scanner and located at the conveying entrance of the baggage conveying area (see [link]). Figure 3 The virtual trigger line 1), the exit trigger line perpendicular to the conveying direction of the security scanner and located at the end of the baggage conveying area (see...) Figure 3 The virtual trigger line 3 in the image and the trigger line of the manual inspection area along the conveying direction of the security scanner (see image 3). Figure 3 The virtual trigger line 2 in the manual inspection area passes vertically through the entrance trigger line 1 and the exit trigger line 3. In a preferred embodiment, the extension of the manual inspection area trigger line 2 is used to separate the baggage claim area and the manual inspection area located side by side at the exit end of the sorting guide device.

[0038] In this embodiment of the invention, the transmission direction from the entrance trigger line 1 to the exit trigger line 3 is designated as the transmission direction of the security scanner (i.e., the lateral direction), and the transmission direction from the entrance trigger line 1 to the manual inspection area trigger line 2 is designated as the direction perpendicular to the transmission direction of the security scanner (i.e., the longitudinal direction).

[0039] Based on the installation location of the recognition camera, it is calibrated in advance. Taking the example of luggage entering from the entrance trigger line 1 (e.g., the left side) and leaving from the exit trigger line 3 (e.g., the right side) of the luggage conveying area and being sorted downwards abnormally, virtual trigger line 1 is the action position where luggage begins to be sorted, virtual trigger line 2 is the action position where luggage completes to be sorted, and virtual trigger line 3 is the action position where luggage enters the deflection sorting guide.

[0040] During the sorting control process, the system controller identifies each piece of luggage in consecutive frames of luggage images and marks the corresponding detection box on the identified luggage part in each frame of luggage image. Then, based on the dynamic position (change) of the detection box of the current luggage (the same piece of luggage) and the security inspection result of the luggage, the sorting guidance direction is determined so as to transport the current luggage to the matching luggage collection area or manual inspection area.

[0041] In one embodiment, the system controller is also configured to determine the sorting direction according to the following steps: (Step 1) Map the detection box numbers of all luggage in the previous frame of the luggage image to the detection box of each piece of luggage in the current frame of the luggage image; (Step 2) Based on the detection frame number of each piece of luggage in the current frame of luggage image and its corresponding security inspection result, configure appropriate sorting control instructions for the latest luggage to be controlled and control the sorting operation direction according to the sorting control instructions; (Step 3) Based on the dynamic position of the detection frame of the latest baggage to be controlled and the relative position of the trigger line group, detect the real-time running position of the latest baggage to be controlled in order to determine the timing of multi-stage switching or the status of the baggage leaving the security check process.

[0042] In this embodiment of the invention, the security inspection results of each piece of luggage identified in the luggage transport area obtained by the system controller all come from the security inspection machine.

[0043] In one embodiment, which maps the detection box numbers of all luggage in the previous frame of the luggage image to the detection box of each piece of luggage in the current frame of the luggage image, the detection box information (x, y, w, h) of each identified piece of luggage in the current frame of the luggage image is first obtained. This embodiment utilizes the detection box information marked by the system controller as four-element information. The four-element information includes the position coordinates of the detection box marker point (e.g., the upper left corner) and the size of the detection box.

[0044] In one embodiment, the system controller utilizes an image recognition model to output bounding boxes (e.g., rectangular boxes) for each identified local image region of luggage in each input frame of luggage image. Each bounding box defines only one piece of luggage. The image recognition model is a result-trained neural network model. It can be trained and tested using a neural network model based on an image database containing different types of luggage and data that labels all luggage bounding box information for each image in the database. When the image recognition model identifies all luggage in each frame of luggage image during application, it outputs the bounding box information (x, y, w, h) for each piece of luggage relative to its position in the current frame of luggage image. Here, (x, y) are the coordinates of the bounding box marker (e.g., the top-left corner) relative to the top-left corner of the corresponding image frame, and (w, h) are the width and height of the bounding box. When multiple pieces of luggage are detected in a single frame of luggage image, the image recognition model outputs the bounding box information for all luggage.

[0045] Then, the system controller will predict the bounding box positions (x+dt*v) of all the luggage in the previous frame of the luggage image based on the bounding box information (x, y, w, h) of all the luggage in the previous frame of the luggage image and the bounding box information (x, y, w, h) of each piece of luggage in the current frame of the luggage image. x y+dt*v y,w,h).

[0046] Next, the system controller will continue to calculate the degree of overlap between the detection box region defined by each detection box information in the current frame of the luggage image and the detection box region defined by all detection box information in the previous frame of the luggage image. Based on this, each detection box in the current frame of the luggage image will be associated with one of the detection boxes in the previous frame.

[0047] Each time the system controller acquires an image from the recognition camera, it obtains a frame of luggage image and records the time difference dt between the acquisition time of the current frame and the acquisition time of the previous frame. Based on the bounding box information (x, y, w, h) of all luggage in the previous frame and the conveyor belt speed v, the predicted position of all luggage in the previous frame in the current frame can be calculated and denoted as the bounding box position prediction information (x + dt * v). x y+dt*v y (w, h); and then, as Figure 4 As shown, the overlap degree (e.g., Intersection over Union (IOU)) between each detection box region in the current frame of the luggage image and the predicted detection box positions of all luggage in the previous frame of the luggage image is jointly calculated using the predicted position information of the detection boxes in the previous and current frames. In other words, for each detection box region in the current frame of the luggage image, the overlap degree between the current detection box region and the detection box regions defined by the predicted position information of all luggage in the previous frame of the luggage image is calculated, thus obtaining multiple overlap degree values ​​for each detection box region in the current frame of the luggage image. The number of overlap degree values ​​obtained for each detection box region in the current frame of the luggage image is the same as the number of luggage items identified in the previous frame of the luggage image.

[0048] In one embodiment, the maximum value of the overlap between the current detection box in the current frame of the luggage image and all detection box regions in the previous frame of the luggage image is extracted. The detection box corresponding to the maximum overlap value in the previous frame of the luggage image is then associated with the current detection box in the current frame of the luggage image, and the number of the detection box corresponding to the maximum overlap value is assigned to the current detection box. For example, as... Figure 4 As shown, the detection box pair with the largest intersection-union ratio between two baggage images is compared and associated, and the detection box ID in the current baggage image is assigned the detection box ID in the previous baggage image.

[0049] In another embodiment, if the overlap between the current detection box in the current frame of the luggage image and all detection box regions in the previous frame of the luggage image is zero, it indicates that the current detection box in the current frame of the luggage image is a newly added piece of luggage compared to the previous frame. In this case, the current detection box in the current frame of the luggage image is assigned a new number. For example, such as Figure 4 As shown, if the cross-union ratio between the detection box in the current frame of the luggage image and the predicted positions of all detection boxes in the previous frame of the luggage image in the current frame are both 0, then a new ID is assigned to the current detection box in the current frame of the luggage image.

[0050] This completes the baggage mapping operation from all identified baggage in the previous frame to all identified baggage in the current frame, and then the system controller proceeds to the second step.

[0051] In this embodiment of the invention, each sorting control instruction includes the conveying direction speed and the changing direction speed of the (security scanner). The types of sorting control instructions include multi-stage control instructions and single-stage control instructions, and the type of sorting control instruction is determined according to the type of baggage security inspection result.

[0052] Based on the detection frame number of each piece of luggage in the current frame of the luggage image and its corresponding security check result, the luggage that enters the luggage sorting area is first identified as the latest luggage to be controlled in the current frame of the luggage image. Then, appropriate sorting control instructions are configured for the latest luggage to be controlled, so that the system controller controls the sorting direction of the latest luggage to be controlled according to the configured sorting control instructions.

[0053] In the first embodiment, when the security check result of the latest baggage to be controlled is abnormal, the sorting control instruction is a multi-stage control instruction. The multi-stage control instruction includes an abnormal sorting instruction (i.e., a deflection instruction) and a normal sorting instruction (i.e., a straight-line instruction) executed sequentially. The abnormal sorting instruction is a control instruction that sets the conveying speed of the security scanner to zero and the turning speed to a preset first speed threshold, while the normal sorting instruction is a control instruction that sets the conveying speed of the security scanner to a preset second speed threshold and the turning speed to zero.

[0054] In the second embodiment, when the security check result of the latest baggage to be controlled is normal baggage, the sorting control instruction is a single-stage control instruction. The single-stage control instruction only includes a normal sorting instruction (i.e., a straight-line instruction). The normal sorting instruction is a control instruction that sets the conveying speed of the security scanner to a preset second speed threshold and the speed in the changing direction to zero.

[0055] For example, assuming the newest piece of luggage to be controlled enters the luggage conveyor area via trigger line 1 (e.g., on the left) and exits via trigger line 3 (e.g., on the right), undergoing abnormal sorting downwards, if the sorting direction control system is in normal sorting mode, when the x-coordinate of the luggage detection frame of the newest piece of luggage to be controlled first crosses virtual trigger line 1, the system controller determines the running direction of the sorting guide device (i.e., activates sorting direction control for the current luggage) based on the luggage's marking. If the newest piece of luggage to be controlled is marked as normal luggage, the system controller sends a normal sorting command, causing the sorting guide device to continue conveying to the right, and records v. x =Preset second speed threshold and v y =0; If the most recently checked baggage is marked as suspicious, the system controller sends an abnormal sorting instruction, causing the sorting guide to stop conveying to the right and begin conveying downwards, and records v. x =0 and v y =Preset first speed threshold.

[0056] After generating a sorting control instruction that corresponds to the security check result of the latest baggage to be controlled, the system control described in this embodiment of the invention is further used to detect the real-time running position of the latest baggage to be controlled based on the dynamic position of the detection frame of the latest baggage to be controlled and the relative position relationship between the trigger line group and the detection frame, so as to determine the timing of multi-stage switching or the status of the baggage leaving the security check process.

[0057] The system controller is also used to identify the dynamic changes of the detection frame information of all baggage obtained from the multi-needle baggage images, and based on this, obtain the dynamic changes of the detection frame of the latest baggage to be controlled. Then, according to the dynamic position of the detection frame of the latest baggage to be controlled and the relative position relationship with the trigger line group, the real-time running position of the latest baggage to be controlled is detected to adjust the conveyor belt conveying direction of the sorting guide device, thereby determining the timing of multi-stage switching or the status of baggage leaving the security check process, and completing the corresponding sorting direction control for the latest baggage to be controlled.

[0058] Based on the first embodiment described above, the system controller is also used to control the sorting direction according to the following steps: First, the sorting direction is controlled according to the abnormal sorting instruction. When the vertical coordinate of the marker point of the detection frame of the latest baggage to be controlled exceeds (for example, is greater than) the vertical coordinate of the trigger line of the manual inspection area, the normal sorting instruction is issued to switch from the abnormal sorting instruction to the normal sorting instruction. Control the sorting direction according to the normal sorting instructions; When the horizontal coordinate of the marker point of the detection frame of the latest baggage to be controlled exceeds (for example, is greater than) the horizontal coordinate of the exit trigger line, it indicates that the latest baggage to be controlled has arrived at the manual inspection area.

[0059] Taking the example of the newest baggage to be controlled entering from the entrance trigger line 1 (e.g., on the left) and leaving from the exit trigger line 3 (e.g., on the right) of the baggage conveying area, and then being abnormally sorted downwards, if the sorting direction control system is in an abnormal sorting state, that is, the newest baggage to be controlled is marked as abnormal baggage; when the x-coordinate of the baggage detection frame of the newest baggage to be controlled first crosses the virtual trigger line 1, the system controller first sends an abnormal sorting command, causing the sorting guide device to stop conveying to the right and start conveying downwards, and records v. x =0 and v y =A preset first speed threshold; then, when the y-coordinate of the detection frame marker of the latest baggage to be controlled in a certain frame of baggage image exceeds the y-coordinate of the trigger line of the manual inspection area, that is, when the y-coordinate of the detection frame of the latest baggage to be controlled first crosses the virtual trigger line 2, at this time, the sorting direction control system considers that the baggage sorting has been completed, the system controller sends a normal sorting instruction, causing the sorting guide device to continue to transport to the right, and records v x =Preset second speed threshold and v y =0.

[0060] Therefore, when the latest baggage to be controlled entering the baggage conveyor area is suspected baggage, the sorting guide device's conveyor belt is first controlled to transport the baggage in the longitudinal direction (i.e., the deflection direction) towards the manual inspection area, and then the sorting guide device's conveyor belt is controlled to transport the baggage in the lateral direction towards the exit end of the baggage conveyor area, so as to transport the latest baggage to be controlled to the manual inspection area.

[0061] Based on the second embodiment described above, the system controller of this embodiment is further configured to indicate that the baggage has arrived at the baggage collection area and delete the baggage from the sorting record of the sorting direction control system when the horizontal coordinate of the marker point of the detection frame of the latest baggage to be controlled that has entered the baggage conveying area exceeds (for example, is greater than) the horizontal coordinate of the end trigger line.

[0062] Taking the example of the latest baggage to be controlled entering from the entrance trigger line 1 (e.g., on the left) and leaving from the exit trigger line 3 (e.g., on the right) of the baggage conveying area, and being abnormally sorted downwards, if the sorting direction control system is in normal sorting mode, that is, the latest baggage to be controlled is marked as normal baggage; when the x-coordinate of the baggage detection frame of the latest baggage to be controlled first crosses the virtual trigger line 1, the system controller first sends a normal sorting instruction, causing the sorting guide device to continue conveying to the right, and records v x =Preset second speed threshold and v y =0; Then, when the x-coordinate of the baggage detection frame of the latest baggage to be controlled passes the virtual trigger line 2 for the first time, the system controller considers that the baggage has left the security check process and removes the baggage from the system sorting record.

[0063] Therefore, when the latest baggage to be controlled entering the baggage conveyor area is normal baggage, the conveyor belt of the sorting guide device is directly controlled to not change the conveying direction. That is, the conveyor belt of the sorting guide device is controlled to transport the baggage in the lateral direction towards the exit end of the baggage conveyor area, so as to transport the latest baggage to be controlled to the baggage collection area.

[0064] Furthermore, in this embodiment of the invention, the baggage interval distance for the security scanner is greater than the product of the conveyor belt speed of the sorting control system and the transport time to the baggage destination (baggage claim area and manual inspection area). Therefore, even after the latest baggage to be controlled has been sorted and guided to the baggage claim area or manual inspection area matching the security check results, the sorting direction for the next baggage to be controlled entering the baggage transport area can be determined and controlled.

[0065] On the other hand, based on the above-described sorting direction control system, this embodiment of the invention also provides a sorting direction control method for baggage that has already undergone security checks. This sorting direction control method is implemented using the sorting direction control system described above.

[0066] Figure 5 This is a schematic diagram illustrating the steps of a sorting direction control method for security-checked baggage, according to an embodiment of this application. Figure 5 As shown, the sorting direction control method described in this embodiment of the invention includes the following steps: Step S501: Set up entrance trigger lines and exit trigger lines perpendicular to the conveying direction of the security scanner, as well as manual inspection area trigger lines along the conveying direction of the security scanner in the baggage conveying area of ​​the sorting guide device. Step S502: Identify luggage in consecutive frame luggage images and mark detection boxes, and determine the sorting guidance direction based on the dynamic position of the detection box of the current luggage and the security inspection result of the luggage, so as to transport the current luggage to the matching luggage collection area or manual inspection area.

[0067] This invention discloses a sorting direction control system and method for security-checked baggage. During the sorting control process, the system and method adaptively adjust the sorting direction of baggage to be sorted by dynamically monitoring changes in the baggage detection frame information. This automatically matches the sorting direction with the baggage transport destination corresponding to the security check results. Therefore, this invention can efficiently and accurately control the automatic sorting direction of normal and suspicious baggage after security checks. This invention improves the linkage efficiency and fault tolerance between security scanners, sorting equipment, and baggage transport destinations, thereby improving the accuracy, efficiency, and anomaly response capability of sorting actions. It is also adaptable to any type of security scanner equipment.

[0068] The above description is merely a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

[0069] In the description of this invention, unless otherwise stated, "a plurality of" means two or more; the terms "upper," "lower," "left," "right," "inner," "outer," "front end," "rear end," "head," "tail," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing the invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the invention. Furthermore, the terms "first," "second," "third," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0070] In the description of this invention, it should be noted that, unless otherwise explicitly specified and limited, the terms "connected" and "linked" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0071] It should be understood that the embodiments disclosed herein are not limited to the specific structures, processing steps, or materials disclosed herein, but should be extended to equivalent substitutions of these features as understood by those skilled in the art. It should also be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting.

[0072] The phrase "an embodiment" or "an embodiment" used in this specification means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention. Therefore, the phrase "an embodiment" or "an embodiment" appearing in various places throughout the specification does not necessarily refer to the same embodiment.

[0073] While the embodiments disclosed in this invention are as described above, the content is merely for the purpose of facilitating understanding of the invention and is not intended to limit the invention. Any person skilled in the art to which this invention pertains may make any modifications and changes in form and detail of the implementation without departing from the spirit and scope disclosed herein; however, the scope of patent protection of this invention shall still be determined by the scope defined in the appended claims.

Claims

1. A sorting direction control system for checked baggage, characterized in that, include: The sorting guide device is equipped with entrance trigger lines and exit trigger lines perpendicular to the conveying direction of the security scanner, as well as manual inspection area trigger lines along the conveying direction of the security scanner in the baggage conveying area. The system controller identifies baggage in consecutive frame images and marks detection boxes. It determines the sorting direction based on the dynamic position of the current baggage's detection box and the baggage's security inspection result, so as to transport the current baggage to the matching baggage collection area or manual inspection area.

2. The sorting direction control system according to claim 1, characterized in that, The system controller is also used to determine the sorting guide direction according to the following steps: Map the bounding box numbers of all luggage in the previous frame of the luggage image to the bounding box of each piece of luggage in the current frame of the luggage image. The bounding box information is a four-element information including the coordinates of the bounding box marker point and the size of the bounding box. Based on the detection frame number of each piece of luggage in the current frame of luggage image and its corresponding security check result, an appropriate sorting control instruction is configured for the latest luggage to be controlled, and the sorting operation direction is controlled according to the sorting control instruction. Each instruction in the sorting control instruction includes a conveying direction speed and a changing direction speed. The type of sorting control instruction includes multi-stage control instructions and single-stage control instructions. The type of sorting control instruction is determined according to the type of security check result. Based on the dynamic position of the detection frame of the latest baggage to be controlled and the relative position of the trigger line group, the real-time running position is detected to adjust the conveyor belt conveying direction of the sorting guide device, thereby determining the timing of multi-stage switching or the status of baggage leaving the security check process.

3. The sorting direction control system according to claim 2, characterized in that, When the security check result of the latest baggage to be controlled is abnormal baggage, the sorting control instruction is a multi-stage control instruction, which includes an abnormal sorting instruction and a normal sorting instruction executed sequentially. The abnormal sorting instruction is a control instruction that sets the conveying direction speed to zero and the changing direction speed to a preset first speed threshold. The normal sorting instruction is a control instruction that sets the conveying direction speed to a preset second speed threshold and the changing direction speed to zero.

4. The sorting direction control system according to claim 3, characterized in that, The system controller is also used to control the sorting direction according to the following steps: The sorting direction is controlled according to the abnormal sorting instruction. When the vertical coordinate of the marker point of the detection frame of the latest baggage to be controlled exceeds the vertical coordinate of the trigger line of the manual inspection area, the normal sorting instruction is issued to switch from the abnormal sorting instruction to the normal sorting instruction. Control the sorting direction according to the normal sorting instructions; When the horizontal coordinate of the detection frame marker point of the latest baggage to be controlled exceeds the horizontal coordinate of the exit trigger line, it indicates that the baggage has arrived at the manual inspection area.

5. The sorting direction control system according to claim 2, characterized in that, When the security check result of the latest baggage to be controlled is normal baggage, the sorting control instruction is a single-stage control instruction, which only includes a normal sorting instruction. The normal sorting instruction is a control instruction that sets the conveying direction speed to a preset second speed threshold and the changing direction speed to zero.

6. The sorting direction control system according to claim 5, characterized in that, The system controller is also used to indicate that the baggage has arrived at the baggage claim area and delete the baggage from the system's sorting record when the horizontal coordinate of the detection frame marker point of the latest baggage to be controlled exceeds the horizontal coordinate of the exit trigger line.

7. The sorting direction control system according to any one of claims 2 to 6, characterized in that, The system controller is also configured to map the detection box numbers of all luggage in the previous frame of the luggage image to the detection box of each piece of luggage in the current frame of the luggage image according to the following steps: Based on the bounding box information of all luggage in the previous frame and the bounding box information of each piece of luggage in the current frame, predict the bounding box position information of all luggage in the previous frame in the current frame. Calculate the degree of overlap between the detection box region defined by each detection box information in the current frame of the luggage image and the detection box regions defined by all detection box information in the previous frame of the luggage image. Based on this, associate each detection box in the current frame of the luggage image with one of the detection boxes in the previous frame.

8. The sorting direction control system according to claim 7, characterized in that, Extract the maximum value of the overlap between the current detection box in the current frame of the luggage image and all detection box regions in the previous frame of the luggage image. Then, associate the detection box corresponding to the maximum overlap value in the previous frame of the luggage image with the current detection box in the current frame of the luggage image, and assign the number of the detection box corresponding to the maximum overlap value to the current detection box.

9. The sorting direction control system according to claim 7 or 8, characterized in that, If the overlap between the current detection box in the current frame of the luggage image and all detection box regions in the previous frame of the luggage image is zero, then the current detection box is assigned a new number.

10. A method for sorting direction control of baggage that has already undergone security checks, characterized in that, The sorting direction control method is implemented using the sorting direction control system as described in any one of claims 1 to 9, comprising: In the baggage conveying area of ​​the sorting guide device, entrance trigger lines and exit trigger lines perpendicular to the conveying direction of the security scanner, as well as manual inspection area trigger lines along the conveying direction of the security scanner, are set. The system identifies baggage in consecutive frame images and marks detection boxes. Based on the dynamic position of the current baggage's detection box and the baggage's security check result, it determines the sorting direction to transport the current baggage to the matching baggage claim area or manual inspection area.

Images