Sorting exception processing method, computer equipment and readable storage medium
By setting up camera devices in the logistics sorting system to process image data, detect and identify sorting anomalies, the problems of package jamming and missorting are solved, and the sorting anomaly is automated and processed in real time, thus improving sorting efficiency.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-11-27
- Publication Date
- 2026-03-31
AI Technical Summary
In existing logistics sorting systems, sorting anomalies such as package jams and missorting are difficult to detect in a timely manner, resulting in low processing efficiency.
By setting up a camera above the balance wheel device, sorting image data is acquired, and visual algorithms are used to detect sorting anomalies and identify the number of packages, generating anomaly detection information. Alarm information is then sent to staff through terminal devices to instruct them to handle the situation.
It enables automated detection and real-time processing of sorting anomalies, improving the accuracy and efficiency of anomaly detection and ensuring the timeliness and accuracy of the sorting process.
Smart Images
Figure CN121755431A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of logistics technology, and in particular to a sorting anomaly handling method, computer equipment, computer-readable storage medium, and computer program product. Background Technology
[0002] In the field of logistics sorting technology, express delivery transit centers typically use automated sorting equipment to automatically sort express parcels. On automated conveyor belts, a swing wheel device is installed. The rotation of the swing wheel uses the rotation of the swing wheel to move parcels with different flow directions to different chute slots. Different slots represent different flow directions that are about to be shipped, thereby achieving automated sorting of parcels with different flow directions and improving sorting efficiency.
[0003] However, in actual use, various sorting anomalies often occur due to factors such as the shape and size of the packages and the operating speed of the conveyor belt. For example, packages may get stuck on the swing wheel device, or packages may be incorrectly sorted into non-target compartments, resulting in inconsistent flow of packages sorted from the sorting compartments.
[0004] In the existing sorting scheme, when sorting anomalies such as package jamming or missorting occur, staff have difficulty detecting the anomalies in a timely manner and can only rely on manual inspection to detect whether sorting anomalies have occurred, resulting in low efficiency in handling sorting anomalies. Summary of the Invention
[0005] Therefore, it is necessary to provide a sorting anomaly handling method, apparatus, computer equipment, computer-readable storage medium, and computer program product that can improve the efficiency of sorting anomaly handling in response to the above-mentioned technical problems.
[0006] In a first aspect, this application provides a sorting anomaly handling method. The method is applied to a sorting system, which includes a swing wheel device, a chute device, and sorting slots, wherein the swing wheel device, the chute device, and the sorting slots are connected sequentially.
[0007] The method includes:
[0008] The sorting image data is acquired by a camera device located above the balance wheel device. The image acquisition area of the camera device includes the balance wheel device, the chute device, and the sorting slot.
[0009] The sorting image data is processed for sorting anomaly detection to obtain the first sorting anomaly detection information of the sorting system; the first sorting anomaly detection information includes package card anomaly information and chute stagnation anomaly information;
[0010] The sorting image data is processed for package recognition to obtain the number of packages corresponding to the sorting compartment.
[0011] Based on the target package quantity information and the package quantity information, the second sorting anomaly detection information of the sorting system is determined; the second sorting anomaly detection information includes package quantity anomaly information; wherein, the target package quantity information is the number of packages to be sorted corresponding to the sorting compartment determined according to the sorting work signal of the sorting system;
[0012] Based on the first sorting anomaly detection information and the second sorting anomaly detection information, the target sorting anomaly detection information of the sorting system is determined;
[0013] Based on the target sorting anomaly detection information, the target object is instructed to perform sorting anomaly handling.
[0014] In one embodiment, determining the second sorting anomaly detection information of the sorting system based on the target package quantity information and the package quantity information includes:
[0015] If the quantity of packages is inconsistent with the quantity of target packages, a target sorting compartment with an abnormal quantity of packages is identified.
[0016] The second sorting anomaly detection information is determined based on the target sorting compartment where the number of packages is abnormal.
[0017] In one embodiment, the method further includes:
[0018] If the number of packages is greater than or equal to a preset package number threshold, the target sorting compartment with an abnormal number of packages is identified.
[0019] In one embodiment, before determining the target sorting anomaly detection information of the sorting system based on the first sorting anomaly detection information and the second sorting anomaly detection information, the method further includes:
[0020] If the package card abnormality information indicates the presence of a package card, or the chute retention abnormality information indicates the presence of chute retention, then the first sorting abnormality detection information indicates the presence of a sorting abnormality.
[0021] If the package quantity anomaly information indicates that there is an abnormality in the number of packages, it is determined that the second sorting anomaly detection information indicates that there is a sorting anomaly;
[0022] The step of determining the target sorting anomaly detection information of the sorting system based on the first sorting anomaly detection information and the second sorting anomaly detection information includes:
[0023] If the first sorting anomaly detection information or the second sorting anomaly detection information indicates the existence of a sorting anomaly, then the target sorting anomaly detection information indicates the existence of a sorting anomaly.
[0024] In one embodiment, instructing the target object to perform sorting anomaly handling based on the target sorting anomaly detection information includes:
[0025] If the target sorting anomaly detection information indicates the existence of a sorting anomaly, a sorting anomaly alarm information is generated based on the target sorting anomaly detection information;
[0026] The sorting anomaly alarm information is sent to the terminal device of the target object to instruct the target object to perform sorting anomaly handling;
[0027] The system receives sorting anomaly handling feedback information returned by the terminal device and generates sorting anomaly handling record data based on the sorting anomaly handling feedback information.
[0028] In one embodiment, the sorting anomaly alarm information includes at least one of sorting anomaly type, sorting anomaly location, sorting anomaly time, and sorting anomaly image data;
[0029] The terminal device includes a wristband device or a handheld terminal;
[0030] Sending the sorting anomaly alarm information to the terminal device of the target object includes:
[0031] The sorting anomaly alarm information is sent to the terminal device, causing the terminal device to issue a prompt signal; the prompt signal includes at least one of a vibration signal and a sound signal.
[0032] In one embodiment, acquiring the sorting image data includes:
[0033] Sorting video data is collected by the camera device positioned above the balance wheel device;
[0034] The sorting video data is processed by image frame extraction to obtain the sorting image data.
[0035] Secondly, this application also provides a sorting anomaly handling device. The device is applied to a sorting system, which includes a swing wheel device, a chute device, and sorting slots, wherein the swing wheel device, the chute device, and the sorting slots are connected sequentially; the device includes:
[0036] The image acquisition module is used to acquire sorting image data. The sorting image data is acquired by a camera device set above the balance wheel device. The image acquisition area of the camera device includes the balance wheel device, the chute device, and the sorting slot.
[0037] The image detection module is used to perform sorting anomaly detection processing on the sorting image data to obtain the first sorting anomaly detection information of the sorting system; the first sorting anomaly detection information includes package card anomaly information and chute retention anomaly information;
[0038] The image recognition module is used to perform package recognition processing on the sorting image data to obtain the number of packages corresponding to the sorting compartment;
[0039] The information determination module is used to determine the second sorting anomaly detection information of the sorting system based on the target package quantity information and the package quantity information; the second sorting anomaly detection information includes package quantity anomaly information; wherein, the target package quantity information is the number of packages to be sorted corresponding to the sorting compartment determined based on the sorting work signal of the sorting system;
[0040] An anomaly determination module is used to determine the target sorting anomaly detection information of the sorting system based on the first sorting anomaly detection information and the second sorting anomaly detection information;
[0041] An anomaly handling module is used to instruct the target object to perform sorting anomaly handling based on the target sorting anomaly detection information.
[0042] Thirdly, this application also provides a computer device. The computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to perform the following steps:
[0043] The sorting image data is acquired by a camera device located above the balance wheel device. The image acquisition area of the camera device includes the balance wheel device, the chute device, and the sorting slot.
[0044] The sorting image data is processed for sorting anomaly detection to obtain the first sorting anomaly detection information of the sorting system; the first sorting anomaly detection information includes package card anomaly information and chute stagnation anomaly information;
[0045] The sorting image data is processed for package recognition to obtain the number of packages corresponding to the sorting compartment.
[0046] Based on the target package quantity information and the package quantity information, the second sorting anomaly detection information of the sorting system is determined; the second sorting anomaly detection information includes package quantity anomaly information; wherein, the target package quantity information is the number of packages to be sorted corresponding to the sorting compartment determined according to the sorting work signal of the sorting system;
[0047] Based on the first sorting anomaly detection information and the second sorting anomaly detection information, the target sorting anomaly detection information of the sorting system is determined;
[0048] Based on the target sorting anomaly detection information, the target object is instructed to perform sorting anomaly handling.
[0049] Fourthly, this application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program thereon, which, when executed by a processor, performs the following steps:
[0050] The sorting image data is acquired by a camera device located above the balance wheel device. The image acquisition area of the camera device includes the balance wheel device, the chute device, and the sorting slot.
[0051] The sorting image data is processed for sorting anomaly detection to obtain the first sorting anomaly detection information of the sorting system; the first sorting anomaly detection information includes package card anomaly information and chute stagnation anomaly information;
[0052] The sorting image data is processed for package recognition to obtain the number of packages corresponding to the sorting compartment.
[0053] Based on the target package quantity information and the package quantity information, the second sorting anomaly detection information of the sorting system is determined; the second sorting anomaly detection information includes package quantity anomaly information; wherein, the target package quantity information is the number of packages to be sorted corresponding to the sorting compartment determined according to the sorting work signal of the sorting system;
[0054] Based on the first sorting anomaly detection information and the second sorting anomaly detection information, the target sorting anomaly detection information of the sorting system is determined;
[0055] Based on the target sorting anomaly detection information, the target object is instructed to perform sorting anomaly handling.
[0056] Fifthly, this application also provides a computer program product. The computer program product includes a computer program that, when executed by a processor, performs the following steps:
[0057] The sorting image data is acquired by a camera device located above the balance wheel device. The image acquisition area of the camera device includes the balance wheel device, the chute device, and the sorting slot.
[0058] The sorting image data is processed for sorting anomaly detection to obtain the first sorting anomaly detection information of the sorting system; the first sorting anomaly detection information includes package card anomaly information and chute stagnation anomaly information;
[0059] The sorting image data is processed for package recognition to obtain the number of packages corresponding to the sorting compartment.
[0060] Based on the target package quantity information and the package quantity information, the second sorting anomaly detection information of the sorting system is determined; the second sorting anomaly detection information includes package quantity anomaly information; wherein, the target package quantity information is the number of packages to be sorted corresponding to the sorting compartment determined according to the sorting work signal of the sorting system;
[0061] Based on the first sorting anomaly detection information and the second sorting anomaly detection information, the target sorting anomaly detection information of the sorting system is determined;
[0062] Based on the target sorting anomaly detection information, the target object is instructed to perform sorting anomaly handling.
[0063] The aforementioned sorting anomaly handling method, apparatus, computer equipment, computer-readable storage medium, and computer program product acquire sorting image data. This sorting image data is collected by a camera device positioned above the swing wheel device. The image acquisition area of the camera device includes the swing wheel device, the chute device, and the sorting slots. The sorting image data undergoes sorting anomaly detection processing to obtain first sorting anomaly detection information of the sorting system. This first sorting anomaly detection information includes package card anomaly information and chute retention anomaly information. The sorting image data is then processed for package identification to obtain… The sorting grid provides information on the number of packages corresponding to each sorting grid. Based on the target package number information and the package number information, the sorting system determines second sorting anomaly detection information. The second sorting anomaly detection information includes package number anomaly information. The target package number information is the number of packages corresponding to each sorting grid determined based on the sorting operation signal of the sorting system. Based on the first sorting anomaly detection information and the second sorting anomaly detection information, the sorting system determines target sorting anomaly detection information. Based on the target sorting anomaly detection information, the target object is instructed to perform sorting anomaly processing. This solution acquires sorting image data and performs sorting anomaly detection and package recognition processing on this data. This facilitates automated detection of various sorting anomalies based on image data, such as package jamming, chute stagnation, and abnormal package quantity. It also allows for the acquisition of sorting anomalies from multiple dimensions, improving the accuracy and completeness of anomaly detection and enabling rapid discovery of anomalies, thus increasing the efficiency of anomaly detection. Furthermore, by instructing target objects to handle sorting anomalies based on the detected information, it facilitates real-time processing of sorting anomalies, further improving the efficiency of anomaly handling. Attached Figure Description
[0064] To more clearly illustrate the technical solutions in the embodiments or related technologies of this application, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0065] Figure 1 This is a flowchart illustrating a sorting exception handling method in one embodiment;
[0066] Figure 2 This is a schematic diagram of the card configuration in one embodiment;
[0067] Figure 3 This is a schematic diagram illustrating a misclassification scenario in one embodiment;
[0068] Figure 4This is a schematic diagram of the chute retention situation in one embodiment;
[0069] Figure 5 This is a structural block diagram of a sorting anomaly handling device in one embodiment;
[0070] Figure 6 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation
[0071] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0072] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.
[0073] In the field of logistics sorting technology, express delivery transit centers typically employ automated sorting equipment to automatically sort parcels. Automated conveyor belts utilize a swing wheel system to redirect parcels destined for different routes into specific chute slots, thus achieving automated sorting and improving efficiency. However, in actual use, various sorting anomalies frequently occur due to factors such as parcel shape, size, and conveyor belt speed. For example, parcels may become stuck on the swing wheel system, or they may be incorrectly sorted into non-target slots, resulting in inconsistent parcel flows. In existing sorting solutions, when parcel jamming or missorting occurs, staff often struggle to detect these anomalies promptly, relying solely on manual inspection, leading to low efficiency in handling sorting anomalies.
[0074] Based on this, this application provides a sorting anomaly handling method, a computer device, and a readable storage medium. First, the sorting anomaly handling method provided in this application will be described.
[0075] In one exemplary embodiment, such as Figure 1As shown, a sorting anomaly handling method is provided. This embodiment illustrates the application of this method to a sorting system. It is understood that this method can also be applied to terminals or servers, and can be applied to systems including terminals and servers, implemented through interaction between the terminals and servers. The terminal can be, but is not limited to, various personal computers, laptops, smartphones, tablets, etc.; the server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services.
[0076] In this embodiment, the method is applied to a sorting system, which includes a swing wheel device, a chute device, and sorting slots, wherein the swing wheel device, the chute device, and the sorting slots are connected in sequence; the method includes the following steps:
[0077] Step S101: Obtain sorting image data. The sorting image data is collected by a camera device set above the balance wheel device. The image acquisition area of the camera device includes the balance wheel device, the chute device, and the sorting slot.
[0078] Step S102: Perform sorting anomaly detection processing on the sorting image data to obtain the first sorting anomaly detection information of the sorting system; the first sorting anomaly detection information includes package card anomaly information and chute stagnation anomaly information;
[0079] Step S103: Perform package recognition processing on the sorting image data to obtain the number of packages corresponding to the sorting slots;
[0080] Step S104: Based on the target package quantity information and the package quantity information, determine the second sorting anomaly detection information of the sorting system; the second sorting anomaly detection information includes package quantity anomaly information; wherein, the target package quantity information is the number of packages to be sorted corresponding to the sorting grid determined according to the sorting work signal of the sorting system.
[0081] Step S105: Determine the target sorting anomaly detection information of the sorting system based on the first sorting anomaly detection information and the second sorting anomaly detection information;
[0082] Step S106: Instruct the target object to perform sorting anomaly handling based on the target sorting anomaly detection information.
[0083] The sorting system can be an automated sorting system that includes a swing wheel device, a chute device, and sorting slots. This system uses a swing wheel device installed on an automated belt conveyor to move packages with different flow directions to the sorting slots of different chute devices by rotating the swing wheel.
[0084] Among them, the swing wheel device can be a device used to sort packages in the sorting system. The swing wheel device rotates to get the package off the belt conveyor and onto the corresponding chute device.
[0085] The chute device can be a chute channel device that connects the swing wheel device and the sorting slot, used to guide the package to slide towards the sorting slot.
[0086] Among them, the sorting slots can be the slots at the end of the chute device, and different sorting slots represent different package flow directions.
[0087] The camera device can be a monitoring camera installed above the balance wheel device, whose image acquisition area covers the balance wheel device, the chute device and the sorting slot, and is used to monitor the entire sorting process.
[0088] Among them, the sorting image data can be image data collected by a camera device that includes the operation of the balance wheel device, the chute device, and the sorting slot.
[0089] Among them, the sorting anomaly detection processing can be a process of using visual algorithms to analyze each frame of the sorting image data and detect whether there is a sorting anomaly in the image.
[0090] The first sorting anomaly detection information can be sorting anomaly information obtained by detecting sorting image data through visual algorithms, including package card anomaly information and chute stagnation anomaly information.
[0091] Among them, the package jamming abnormality information can be an abnormality information describing whether the package is stuck on the balance wheel device.
[0092] Among them, the chute retention anomaly information can be an anomaly describing whether the sorted package is retained in the chute device or sorting slot.
[0093] Among them, package recognition processing can be a process that uses visual algorithms to analyze each frame of the sorting image data, identify and count the number of packages in each sorting compartment.
[0094] The package quantity information can be the actual number of packages sorted out by each sorting grid.
[0095] Among them, the sorting work signal can be the sorting message signal sent by the automatic sorting control system of the sorting system, which contains real-time dynamic information of sorting.
[0096] The target package quantity information can be the number of packages that need to be sorted out at each sorting grid, as determined by the sorting work signal.
[0097] The second sorting anomaly detection information can be sorting anomaly information obtained by comparing the target package quantity information and the package quantity information, including package quantity anomaly information.
[0098] Among them, abnormal package quantity information can describe whether the package was sorted into the wrong sorting compartment or whether the number of packages in the sorting compartment is abnormal.
[0099] Among them, the target sorting anomaly detection information can be the complete sorting anomaly detection information of the sorting system obtained by combining the first sorting anomaly detection information and the second sorting anomaly detection information, which may include package card anomaly information, chute retention anomaly information and package quantity anomaly information.
[0100] The target group could be the staff member responsible for handling sorting anomalies.
[0101] Optionally, the sorting system acquires sorting image data via a camera device positioned above the swing wheel assembly. The camera's image acquisition area includes the swing wheel assembly, the chute assembly, and the sorting slots. The camera monitors the entire sorting process. Real-time streaming is performed using the camera, capturing multiple frames per second as sorting image data. The sorting image data undergoes anomaly detection processing, employing visual algorithms to analyze each frame and detect package jamming or chute obstruction, thus obtaining the first sorting anomaly detection information. This first anomaly detection information includes package jamming and chute obstruction anomaly information. Package recognition processing is then performed on the sorting image data, using visual algorithms to classify packages... The system analyzes each frame of the sorting image data, identifies and counts the number of packages sorted from all sorting grids, and obtains the package quantity information corresponding to each sorting grid. It receives the sorting work signal from the sorting system and obtains the target package quantity information from it, which represents the number of packages to be sorted from each sorting grid. It compares the target package quantity information with the total package quantity information, and determines the second sorting anomaly detection information of the sorting system based on the comparison result. The second sorting anomaly detection information includes package quantity anomaly information. Based on the first and second sorting anomaly detection information, it determines the target sorting anomaly detection information of the sorting system. Finally, it instructs the target object to perform sorting anomaly processing based on the target sorting anomaly detection information.
[0102] In the above-mentioned sorting anomaly handling method, sorting image data is acquired through a camera device positioned above the swing wheel device. The image acquisition area of the camera device includes the swing wheel device, the chute device, and the sorting slots. Sorting anomaly detection processing is performed on the sorting image data to obtain first sorting anomaly detection information of the sorting system. The first sorting anomaly detection information includes package card anomaly information and chute retention anomaly information. Package identification processing is performed on the sorting image data to obtain package quantity information corresponding to the sorting slots. Based on the target package quantity information and the package quantity information, second sorting anomaly detection information of the sorting system is determined. The second sorting anomaly detection information includes package quantity anomaly information. The target package quantity information is the number of packages corresponding to the sorting slots determined based on the sorting operation signals of the sorting system. Based on the first and second sorting anomaly detection information, target sorting anomaly detection information of the sorting system is determined. Based on the target sorting anomaly detection information, the target object is instructed to undergo sorting anomaly handling. This solution acquires sorting image data and performs sorting anomaly detection and package recognition processing on this data. This facilitates automated detection of various sorting anomalies based on image data, such as package jamming, chute stagnation, and abnormal package quantity. It also allows for the acquisition of sorting anomalies from multiple dimensions, improving the accuracy and completeness of anomaly detection and enabling rapid discovery of anomalies, thus increasing the efficiency of anomaly detection. Furthermore, by instructing target objects to handle sorting anomalies based on the detected information, it facilitates real-time processing of sorting anomalies, further improving the efficiency of anomaly handling.
[0103] In an exemplary embodiment, in step S104 above, the second sorting anomaly detection information of the sorting system is determined based on the target package quantity information and the package quantity information. Specifically, this includes the following: if the package quantity information is inconsistent with the target package quantity information, a target sorting compartment with an abnormal package quantity is identified; and the second sorting anomaly detection information is determined based on the target sorting compartment with the abnormal package quantity.
[0104] The target sorting compartment can be a sorting compartment that is determined to have an abnormal number of packages, where the package quantity information of the target sorting compartment is inconsistent with the target package quantity information corresponding to the target sorting compartment.
[0105] Optionally, when determining the second sorting anomaly detection information based on the target package quantity information and the package quantity information, the sorting system compares the package quantity information with the target package quantity information. If the package quantity information and the target package quantity information are inconsistent, the sorting compartment is determined to be a target sorting compartment with a package quantity anomaly. Based on the target sorting compartment with a package quantity anomaly, the second sorting anomaly detection information is generated, which includes the package quantity anomaly information of the target sorting compartment.
[0106] For example, when the sorting system determines the second sorting anomaly detection information based on the target package quantity information and the package quantity information, it compares whether the package quantity information is consistent with the target package quantity information. If the package quantity information is inconsistent with the target package quantity information, the sorting compartment is determined to be the target sorting compartment with an abnormal package quantity. For example, if the package quantity information obtained by a sorting compartment through a visual algorithm is x, and the target package quantity information obtained by the sorting compartment from the sorting work signal is y, the system compares whether x and y are consistent. If x and y are inconsistent, the sorting compartment is determined to be the target sorting compartment with an abnormal package quantity. Based on the target sorting compartment with an abnormal package quantity, the second sorting anomaly detection information is generated. The second sorting anomaly detection information includes the package quantity anomaly information of the target sorting compartment, including the compartment number of the target sorting compartment, the abnormal package quantity, and other information.
[0107] The technical solution provided in this embodiment, by identifying the target sorting compartment where the package quantity information is inconsistent with the target package quantity information, is beneficial for accurately locating the specific sorting compartment where the package quantity abnormality occurs. Based on the target sorting compartment where the package quantity abnormality occurs, second sorting abnormality detection information is determined, thereby providing staff with clear abnormal compartment location information, facilitating staff to quickly locate and handle package quantity abnormality issues, and improving the efficiency of subsequent sorting abnormality handling.
[0108] In one exemplary embodiment, the method further includes: if the number of packages is greater than or equal to a preset number of packages threshold, determining a target sorting compartment with an abnormal number of packages.
[0109] The preset parcel quantity threshold can be a pre-set threshold used to determine whether there is an abnormal number of parcels at the sorting compartment. For example, the preset parcel quantity threshold can be 2.
[0110] Optionally, when the sorting system determines whether there is an abnormal number of packages at a sorting grid, it can also determine whether the number of packages is greater than or equal to a preset number of packages threshold. If the number of packages is greater than or equal to the preset number of packages threshold (e.g., 2), the sorting grid is determined to be the target sorting grid with an abnormal number of packages.
[0111] For example, when a sorting system determines whether a sorting grid has an abnormal number of packages, in addition to comparing the package quantity information with the target package quantity information, it can also determine whether the package quantity information of the sorting grid is greater than or equal to a preset package quantity threshold (such as 2). If the package quantity information is greater than or equal to 2, it is considered that there is an abnormal number of packages in the sorting grid, and the sorting grid is determined to be the target sorting grid with an abnormal number of packages.
[0112] The technical solution provided in this embodiment determines the target sorting compartment with abnormal package quantity when the package quantity information is greater than or equal to a preset package quantity threshold. This helps to quickly identify the abnormal situation of multiple packages in the sorting compartment by using the preset package quantity threshold, thereby improving the efficiency of package quantity abnormality detection.
[0113] In an exemplary embodiment, before determining the target sorting anomaly detection information of the sorting system based on the first sorting anomaly detection information and the second sorting anomaly detection information, step S105 further includes: determining that the first sorting anomaly detection information indicates a sorting anomaly when the package card anomaly information indicates the presence of a package card, or the chute retention anomaly information indicates the presence of a chute retention; and determining that the second sorting anomaly detection information indicates a sorting anomaly when the package quantity anomaly information indicates the presence of a package quantity anomaly. Specifically, determining the target sorting anomaly detection information of the sorting system based on the first and second sorting anomaly detection information in step S105 includes: determining that the target sorting anomaly detection information indicates a sorting anomaly when either the first or second sorting anomaly detection information indicates the presence of a sorting anomaly.
[0114] Optionally, the sorting system determines whether package carding abnormality information indicates the presence of package carding, or whether chute congestion abnormality information indicates the presence of chute congestion. If either package carding abnormality information indicates the presence of package carding or chute congestion abnormality information indicates the presence of chute congestion, the system determines that a first sorting abnormality detection information indicates the presence of a sorting abnormality. It then determines whether package quantity abnormality information indicates the presence of a package quantity abnormality. If either package quantity abnormality information indicates the presence of a package quantity abnormality, the system determines that a second sorting abnormality detection information indicates the presence of a sorting abnormality. Based on the first and second sorting abnormality detection information, the system determines a target sorting abnormality detection information. If either the first or second sorting abnormality detection information indicates the presence of a sorting abnormality, the system determines that the target sorting abnormality detection information indicates the presence of a sorting abnormality.
[0115] The technical solution provided in this embodiment determines that a sorting anomaly exists when package card anomaly information indicates the presence of package card or chute retention anomaly information indicates the presence of chute retention. It also determines that a second sorting anomaly exists when package quantity anomaly information indicates the presence of package quantity anomaly. This facilitates the separate determination of whether the first and second sorting anomaly detection information indicate the presence of a sorting anomaly. Furthermore, when either the first or second sorting anomaly detection information indicates the presence of a sorting anomaly, a target sorting anomaly detection information is determined. This allows for the integration of multiple sorting anomaly scenarios to form a unified sorting anomaly judgment result, thereby improving the accuracy of sorting anomaly detection.
[0116] In an exemplary embodiment, step S106 above, instructing the target object to perform sorting anomaly handling based on the target sorting anomaly detection information, specifically includes the following: when the target sorting anomaly detection information indicates the existence of a sorting anomaly, generating sorting anomaly alarm information based on the target sorting anomaly detection information; sending the sorting anomaly alarm information to the target object's terminal device to instruct the target object to perform sorting anomaly handling; receiving sorting anomaly handling feedback information returned by the terminal device, and generating sorting anomaly handling record data based on the sorting anomaly handling feedback information.
[0117] Among them, sorting anomaly alarm information can include information such as sorting anomaly type, sorting anomaly location, sorting anomaly time, and sorting anomaly image data.
[0118] The target device can be a device worn or used by the staff, such as an industrial wristband or a handheld terminal (e.g., a barcode scanner).
[0119] Among them, the feedback information for sorting anomaly handling can be feedback information from staff operating on the terminal device. The feedback information includes feedback information on whether the alarm was triggered correctly, information reported by scanning the package waybill number through the terminal device, and feedback information on whether the sorting anomaly handling has been completed.
[0120] Among them, the sorting anomaly handling record data can be record data generated based on the results of manual processing, and the record data is used for relevant business statistics and applications.
[0121] Optionally, the sorting system determines whether the target sorting anomaly detection information indicates the existence of a sorting anomaly. If the target sorting anomaly detection information indicates the existence of a sorting anomaly, it generates sorting anomaly alarm information based on the target sorting anomaly detection information. The sorting anomaly alarm information includes sorting anomaly type (such as package jamming, chute stagnation, or abnormal package quantity), sorting anomaly location (such as sorting line, grid number, or wheel number), sorting anomaly time, and sorting anomaly image data (such as on-site video or on-site photos). The sorting anomaly alarm information is sent to the target object's terminal device to instruct the target object to handle the sorting anomaly. The system receives sorting anomaly handling feedback information returned by the terminal device and generates sorting anomaly handling record data based on the sorting anomaly handling feedback information.
[0122] The technical solution provided in this embodiment generates a sorting anomaly alarm based on the target sorting anomaly detection information when the target sorting anomaly detection information indicates the existence of a sorting anomaly, and sends the sorting anomaly alarm to the terminal device of the target object. This facilitates the timely receipt of alarm information by staff and the handling of sorting anomalies. Furthermore, by receiving the sorting anomaly handling feedback information returned by the terminal device, sorting anomaly handling record data is generated. This facilitates real-time early warning and closed-loop management of sorting anomalies, thereby improving sorting efficiency and accuracy.
[0123] In an exemplary embodiment, the sorting anomaly alarm information includes at least one of sorting anomaly type, sorting anomaly location, sorting anomaly time, and sorting anomaly image data; the terminal device includes a wristband device or a handheld terminal; sending the sorting anomaly alarm information to the terminal device of the target object includes: sending the sorting anomaly alarm information to the terminal device, causing the terminal device to issue a prompt signal; the prompt signal includes at least one of a vibration signal and a sound signal.
[0124] Among them, sorting anomaly types can include package jams, chute stagnation, or abnormal package quantity.
[0125] The location of the sorting anomaly can include location information such as the sorting line, grid number, and balance wheel number.
[0126] Among them, the sorting anomaly time can be the specific time when the sorting anomaly is detected.
[0127] The abnormal sorting image data can include on-site video, on-site photos and other image data.
[0128] Among them, the wristband device can be an industrial wristband worn by the staff. The handheld terminal can be a handheld device such as a barcode scanner used by the staff.
[0129] The alert signal can be a signal emitted by the terminal device to remind staff, including vibration signals and / or sound signals.
[0130] Optionally, the sorting anomaly alarm information generated by the sorting system includes at least one of the following: sorting anomaly type (such as package jamming, chute stagnation, or abnormal package quantity), sorting anomaly location (such as sorting line, grid number, or wheel number), sorting anomaly time, and sorting anomaly image data (such as on-site video or on-site photos). The terminal sends the sorting anomaly alarm information to the terminal device of the target object, which includes a wristband device (such as an industrial wristband) or a handheld terminal (such as a barcode scanner). After receiving the sorting anomaly alarm information, the terminal device will issue a prompt signal, which includes a vibration signal and / or an audio signal, to remind staff to check and handle the sorting anomaly in a timely manner.
[0131] The technical solution provided in this embodiment sends alarm information to terminal devices such as wristbands or handheld terminals, causing the terminal devices to emit vibration and / or sound signals as prompts. This helps staff to promptly perceive sorting anomalies and quickly locate the anomalies, thereby improving the timeliness and accuracy of sorting anomaly handling and increasing sorting efficiency.
[0132] In an exemplary embodiment, step S101 above, obtaining sorting image data, specifically includes the following: acquiring sorting video data through a camera device positioned above the balance wheel device; and performing image frame extraction processing on the sorting video data to obtain sorting image data.
[0133] The camera device can be a surveillance camera, which is set above the balance wheel device. The image acquisition area of the camera device includes the balance wheel device, the chute device, and the sorting slot, and is used to monitor the operation of the entire sorting process.
[0134] The sorting video data can be real-time video stream data captured by a camera device. Image frame extraction processing can be a process that extracts multiple frames of images evenly per second from the sorting video data.
[0135] Optionally, the terminal collects sorting video data through a camera device installed above the balance wheel device. The camera device is used to monitor the operation of the balance wheel device, the chute device, and the sorting slots. The terminal performs image frame extraction processing on the sorting video data, extracts multiple image frames from the sorting video data, and obtains sorting image data. The sorting image data includes information about the operation of the balance wheel device, the chute device, and the sorting slots.
[0136] The technical solution provided in this embodiment acquires sorting video data by using a camera device installed above the balance wheel device, and obtains sorting image data by extracting image frames from the sorting video data. This helps to provide an accurate image data basis for subsequent sorting anomaly detection and improves the accuracy of sorting anomaly detection.
[0137] The following example illustrates the sorting anomaly handling method provided in this application. This example demonstrates the application of this method to a terminal.
[0138] In express delivery and logistics scenarios, transit centers often use automated sorting equipment to automatically sort parcels. On automated conveyor belts, the rotation of the swing wheel unit sends parcels destined for different destinations to different chute slots. This allows for automated sorting of parcels going in different directions. However, in practice, factors such as the shape and size of the parcels and the operating speed of the conveyor belt can cause parcels to get stuck on the swing wheel unit, resulting in jams and missorting. This leads to inconsistent destinations for the parcels sorted at each slot. Due to high workloads, sorted parcels cannot be removed from the slots promptly, causing packages to remain on the chute and disrupting the normal sorting operation of the swing wheel unit.
[0139] When packages get stuck or missorted, staff often don't notice. During loading or containerization, they have to use barcode scanners to scan the packages again to confirm their correct flow, severely reducing sorting efficiency. Similarly, when packages get stuck in the chute, staff often don't notice until a large number of packages are stuck or the situation significantly impacts sorting, which also severely affects efficiency.
[0140] In this embodiment, a top-mounted camera is installed on the balance wheel unit, and a visual algorithm is used to analyze the camera's view for package jamming or chute obstruction. The system is connected to the sorting information system to obtain real-time sorting dynamics, and combined with the current package sorting status in the view, automatically identifies whether packages have been missorted. Once package jamming, missorting, or chute obstruction occurs, the system quickly sends alarm information to the industrial wristbands or barcode scanners worn by on-site staff for real-time warnings, on-site intervention, and the processing results are returned to the system, completing the business loop and improving sorting efficiency.
[0141] This embodiment specifically includes the following steps:
[0142] S1. A monitoring camera needs to be installed on the balance wheel unit to monitor the operation of the balance wheel unit;
[0143] Detection of card and slide rail retention:
[0144] S2. The detection system (terminal) uses a camera to capture the stream in real time, taking N frames evenly per second, and uses visual algorithms to analyze the image of each frame to determine whether there are any packages, cards, or stuck items in the slide in the image.
[0145] For detecting misclassified packages:
[0146] S3. Utilize a camera to capture real-time streams, uniformly taking N frames per second. Use visual algorithms to analyze each frame and determine the number of packages sorted from all compartments. For example, the number of packages sorted from compartment 1 is x.
[0147] S4. Receive the sorting message from the automatic sorting system and determine the number of packages that should be sorted out at each compartment at this time. For example, the number of packages sorted out by compartment 1 is y.
[0148] S5. Compare whether x and y are consistent. If they are inconsistent, it is considered a misclassification. If x is greater than or equal to 2, it is considered a misclassification.
[0149] S6. Whenever the system detects card jams, chute jams, missorting, or other issues in S2 and S5, it generates an alarm record containing information such as alarm time, alarm reason, on-site video, on-site photos, sorting line, grid number, and balance wheel number. The system automatically pushes the alarm to the wristband or barcode scanner worn by the corresponding staff member (hereinafter referred to as wristband).
[0150] S7. After receiving an alarm, the wristband will vibrate or make an audible alert. Staff can view the scene and cause of the alarm and intervene accordingly.
[0151] S8. If a package is missorted, the package can be quickly located based on its shape in the picture and placed in the corresponding flow container bag. If the package is stuck or obstructed by the chute, the problem can be quickly located and dealt with in a timely manner to improve sorting efficiency.
[0152] S9. After manual processing, you need to check whether the alarm is correct on the wristband and scan the package tracking number with the wristband to report it.
[0153] S10. After the detection system collects the results of manual processing, it performs relevant business statistics and applications.
[0154] in, Figure 2 , Figure 3 and Figure 4 These are schematic diagrams of card situations, missorting situations, and chute stagnation situations identified in this embodiment, respectively, where the dashed boxes represent packages with detected sorting abnormalities.
[0155] The technical solution provided in this embodiment enables workers to directly receive alarm information and promptly handle anomalies in automated sorting, rather than passively dealing with them, thus significantly improving the efficiency of automated sorting. Timely intervention and mis-sorting warnings ensure the correctness of the sorting flow, eliminating the need for secondary scanning of all packages to confirm the correctness of the flow. The collected processing results allow for further optimization of the visual algorithm model, improving accuracy.
[0156] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.
[0157] Based on the same inventive concept, this application also provides a sorting anomaly handling device for implementing the sorting anomaly handling method described above. The solution provided by this device is similar to the solution described in the above method; therefore, the specific limitations in one or more of the sorting anomaly handling device embodiments provided below can be found in the limitations of the sorting anomaly handling method described above, and will not be repeated here.
[0158] In one exemplary embodiment, such as Figure 5 As shown, a sorting anomaly handling device 500 is provided. This device is applied to a sorting system, which includes a swing wheel assembly, a chute assembly, and sorting slots, wherein the swing wheel assembly, the chute assembly, and the sorting slots are connected sequentially. The sorting anomaly handling device 500 may include:
[0159] The image acquisition module 501 is used to acquire sorting image data. The sorting image data is acquired by a camera device set above the balance wheel device. The image acquisition area of the camera device includes the balance wheel device, the chute device, and the sorting slot.
[0160] Image detection module 502 is used to perform sorting anomaly detection processing on sorting image data to obtain the first sorting anomaly detection information of the sorting system; the first sorting anomaly detection information includes package card anomaly information and chute retention anomaly information;
[0161] Image recognition module 503 is used to perform package recognition processing on sorting image data to obtain the number of packages corresponding to the sorting compartments;
[0162] The information determination module 504 is used to determine the second sorting anomaly detection information of the sorting system based on the target package quantity information and the package quantity information; the second sorting anomaly detection information includes package quantity anomaly information; wherein, the target package quantity information is the number of packages to be sorted corresponding to the sorting slot determined based on the sorting work signal of the sorting system;
[0163] The anomaly determination module 505 is used to determine the target sorting anomaly detection information of the sorting system based on the first sorting anomaly detection information and the second sorting anomaly detection information;
[0164] The exception handling module 506 is used to instruct the target object to perform sorting exception handling based on the target sorting exception detection information.
[0165] In an exemplary embodiment, the information determination module 504 is further configured to determine a target sorting compartment with an abnormal number of packages when the package quantity information is inconsistent with the target package quantity information; and to determine second sorting anomaly detection information based on the target sorting compartment with the abnormal number of packages.
[0166] In an exemplary embodiment, the device 500 further includes a sorting compartment determination module, used to determine a target sorting compartment with an abnormal number of packages when the number of packages is greater than or equal to a preset number of packages threshold.
[0167] In an exemplary embodiment, the device 500 further includes: a result determination module, configured to determine that a first sorting anomaly detection information indicates a sorting anomaly when package card anomaly information indicates the presence of a package card, or chute retention anomaly information indicates the presence of a chute retention; and to determine that a second sorting anomaly detection information indicates the presence of a sorting anomaly when package quantity anomaly information indicates the presence of a package quantity anomaly; the anomaly determination module 505 is further configured to determine that a target sorting anomaly detection information indicates the presence of a sorting anomaly when the first sorting anomaly detection information or the second sorting anomaly detection information indicates the presence of a sorting anomaly.
[0168] In an exemplary embodiment, the exception handling module 506 is further configured to: generate a sorting exception alarm message based on the target sorting exception detection message when the target sorting exception detection message indicates the existence of a sorting exception; send the sorting exception alarm message to the target object's terminal device to instruct the target object to perform sorting exception handling; receive sorting exception handling feedback information returned by the terminal device; and generate sorting exception handling record data based on the sorting exception handling feedback information.
[0169] In an exemplary embodiment, the sorting anomaly alarm information includes at least one of sorting anomaly type, sorting anomaly location, sorting anomaly time, and sorting anomaly image data; the terminal device includes a wristband device or a handheld terminal; the anomaly processing module 506 is further configured to send the sorting anomaly alarm information to the terminal device, causing the terminal device to issue a prompt signal; the prompt signal includes at least one of a vibration signal and a sound signal.
[0170] In an exemplary embodiment, the image acquisition module 501 is further configured to acquire sorting video data through a camera device disposed above the balance wheel device; and to perform image frame extraction processing on the sorting video data to obtain sorting image data.
[0171] Each module in the aforementioned sorting anomaly handling device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of a computer device in hardware form or independent of it, or stored in the memory of a computer device in software form, so that the processor can call and execute the operations corresponding to each module.
[0172] In one exemplary embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 6As shown, the computer device includes a processor, memory, input / output interfaces, a communication interface, a display unit, and an input device. The processor, memory, and input / output interfaces are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interfaces. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The input / output interfaces are used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements a sorting anomaly handling method. The display unit is used to form a visually visible image and can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the computer device, or external keyboards, touchpads, or mice, etc.
[0173] Those skilled in the art will understand that Figure 6 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0174] In one exemplary embodiment, a computer device is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above-described method embodiments.
[0175] In one exemplary embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the steps in the above-described method embodiments.
[0176] In one exemplary embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above-described method embodiments.
[0177] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments described above. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.
[0178] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0179] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.
Claims
1. A sorting exception handling method characterized by, The method is applied to a sorting system, which includes a swing wheel device, a chute device, and sorting slots, wherein the swing wheel device, the chute device, and the sorting slots are connected in sequence. The method includes: The sorting image data is acquired by a camera device located above the balance wheel device. The image acquisition area of the camera device includes the balance wheel device, the chute device, and the sorting slot. The sorting image data is processed for sorting anomaly detection to obtain the first sorting anomaly detection information of the sorting system; the first sorting anomaly detection information includes package card anomaly information and chute stagnation anomaly information; The sorting image data is processed for package recognition to obtain the number of packages corresponding to the sorting compartment. Based on the target package quantity information and the package quantity information, the second sorting anomaly detection information of the sorting system is determined; the second sorting anomaly detection information includes package quantity anomaly information; wherein, the target package quantity information is the number of packages to be sorted corresponding to the sorting compartment determined according to the sorting work signal of the sorting system; Based on the first sorting anomaly detection information and the second sorting anomaly detection information, the target sorting anomaly detection information of the sorting system is determined; Based on the target sorting anomaly detection information, the target object is instructed to perform sorting anomaly handling.
2. The method of claim 1, wherein, The step of determining the second sorting anomaly detection information of the sorting system based on the target package quantity information and the package quantity information includes: If the quantity of packages is inconsistent with the quantity of target packages, a target sorting compartment with an abnormal quantity of packages is identified. The second sorting anomaly detection information is determined based on the target sorting compartment where the number of packages is abnormal.
3. The method of claim 2, wherein, The method further includes: If the number of packages is greater than or equal to a preset package number threshold, the target sorting compartment with an abnormal number of packages is identified.
4. The method of claim 1, wherein, Before determining the target sorting anomaly detection information of the sorting system based on the first sorting anomaly detection information and the second sorting anomaly detection information, the method further includes: If the package card abnormality information indicates the presence of a package card, or the chute retention abnormality information indicates the presence of chute retention, then the first sorting abnormality detection information indicates the presence of a sorting abnormality. If the package quantity anomaly information indicates that there is an abnormality in the number of packages, it is determined that the second sorting anomaly detection information indicates that there is a sorting anomaly; The step of determining the target sorting anomaly detection information of the sorting system based on the first sorting anomaly detection information and the second sorting anomaly detection information includes: If the first sorting anomaly detection information or the second sorting anomaly detection information indicates the existence of a sorting anomaly, then the target sorting anomaly detection information indicates the existence of a sorting anomaly.
5. The method of claim 1, wherein, The step of instructing the target object to perform sorting anomaly handling based on the target sorting anomaly detection information includes: If the target sorting anomaly detection information indicates the existence of a sorting anomaly, a sorting anomaly alarm information is generated based on the target sorting anomaly detection information; The sorting exception alarm information is sent to a terminal device of the target object to instruct the target object to perform sorting exception processing. The sorting exception processing feedback information returned by the terminal device is received, and sorting exception processing record data is generated according to the sorting exception processing feedback information.
6. The method of claim 5, wherein, The sorting exception alarm information includes at least one of a sorting exception type, a sorting exception position, a sorting exception time, and sorting exception image data. The terminal device includes a bracelet device or a handheld terminal. The sorting exception alarm information is sent to the terminal device, including: The sorting exception alarm information is sent to the terminal device, so that the terminal device sends a prompt signal. The prompt signal includes at least one of a vibration signal and a sound signal.
7. The method according to any one of claims 1 to 6, characterized in that, The sorting image data is obtained, including: Sorting video data is collected by the camera device arranged above the balance wheel device. The sorting video data is subjected to image frame extraction processing to obtain the sorting image data. 8.A computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer device is configured to perform the method according to any one of claims 1-7. The processor executes the computer program to implement the steps of the method of any one of claims 1 to 7.
9. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 7.
10. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 7.