A method and apparatus for detecting a sorting state of a logistics object

Abstract

The application provides a method and device for detecting the sorting state of a logistics object. The detection of whether the first sorting pocket is congested can be performed without the participation of staff, thereby reducing labor costs. In addition, since the participation of staff can be avoided, the inaccuracy of detection caused by physiological reasons of the staff can be overcome, thereby improving the accuracy of detection of congestion. Furthermore, the application detects whether the sorting pocket is congested by detecting an image including the sorting pocket through a camera. The image is a real image, and the image includes the content in the sorting pocket. With the image, whether the sorting pocket is congested can be detected by using image detection technology and other related technologies. The image detection has higher accuracy, and thus the accuracy of detection of whether the sorting pocket is congested can be improved according to the real image.

Description

Technical Field

[0001] This application relates to the field of logistics, and in particular to a method and apparatus for detecting the sorting status of logistics objects. Background Technology

[0002] With the rapid development of logistics technology and e-commerce services, the number of express parcels has been growing rapidly. As a result, logistics centers often need to sort a massive number of parcels.

[0003] Currently, sorting equipment is highly favored by the industry as an automated device that can quickly sort packages. In this way, sorting equipment can be used to sort packages to improve sorting efficiency and reduce labor costs. Summary of the Invention

[0004] This application discloses a method and apparatus for detecting the sorting status of logistics objects.

[0005] In a first aspect, this application discloses a method for detecting the sorting status of logistics objects. The method includes: acquiring a first image and a second image sequentially captured by the same camera at preset time intervals, the first image including a first sorting slot in a sorting device, and the second image including a first sorting slot in a sorting device; detecting whether a first logistics object exists in the area of ​​the first sorting slot in the first image, and detecting whether a second logistics object exists in the area of ​​the first sorting slot in the second image; if a first logistics object exists in the area of ​​the first sorting slot in the first image and a second logistics object exists in the area of ​​the first sorting slot in the second image, determining whether the first logistics object and the second logistics object are the same; if the first logistics object and the second logistics object are the same, acquiring a first degree of overlap between the position range of the first logistics object in the area of ​​the first sorting slot and the position range of the second logistics object in the area of ​​the first sorting slot; if the first degree of overlap is greater than a first preset degree, determining that the first logistics object or the second logistics object is congested at the first sorting slot.

[0006] In one optional implementation, obtaining the first degree of overlap between the position range of the first logistics object in the area of ​​the first sorting grid and the position range of the second logistics object in the area of ​​the first sorting grid includes: calculating a first intersection-union ratio between the position range of the first logistics object in the area of ​​the first sorting grid and the position range of the second logistics object in the area of ​​the first sorting grid; and obtaining the first degree of overlap based on the first intersection-union ratio.

[0007] In one optional implementation, detecting whether a first logistics object exists in the region of the first sorting grid in the first image includes: detecting the position range of the logistics object in the first image; obtaining the position range of the first sorting grid in the first image; obtaining a second degree of overlap between the position range of the logistics object in the first image and the position range of the first sorting grid in the first image; if the second degree of overlap is greater than a second preset degree, determining the logistics object in the first image as a first logistics object located in the region of the first sorting grid in the first image; or, if the second degree of overlap is less than or equal to the second preset degree, determining that the logistics object in the first image is not a first logistics object located in the region of the first sorting grid in the first image.

[0008] In one optional implementation, obtaining the second degree of overlap between the position range of the logistics object in the first image and the position range of the first sorting grid in the first image includes: calculating a second intersection-union ratio between the position range of the logistics object in the first image and the position range of the first sorting grid in the first image; and obtaining the second degree of overlap based on the second intersection-union ratio.

[0009] In one optional implementation, obtaining the position range of the first sorting grid in the first image includes: obtaining the camera identifier of the camera that captures the first image; obtaining, based on the camera identifier, the position range of the first sorting grid in the image captured by the camera, which was recorded in advance; and obtaining the position range of the first sorting grid in the first image based on the position range of the first sorting grid in the image captured by the camera.

[0010] In one optional implementation, obtaining the location range of the first sorting grid in the image captured by the camera, which is recorded in advance according to the camera identifier, includes: finding the location range corresponding to the camera identifier in the correspondence between the camera identifier and the location range of the sorting grid in the image captured by the camera, and using it as the location range of the first sorting grid in the image captured by the camera.

[0011] In an optional implementation, the method further includes: determining the logistics delivery destination corresponding to the first sorting slot; searching for a second sorting slot corresponding to the logistics delivery destination among multiple sorting slots in the sorting equipment, the second sorting slot being different from the first sorting slot; if the second sorting slot corresponding to the logistics delivery destination is found, sending a sorting slot rejection instruction to the controller of the sorting equipment, the sorting slot rejection instruction being used to instruct the first sorting slot to be rejected from the sorting slots used for sorting logistics objects corresponding to the logistics delivery destination, so that the controller unbinds the first sorting slot from the logistics delivery destination at the software level according to the sorting slot rejection instruction; or, if the second sorting slot corresponding to the logistics delivery destination is not found, sending an abnormal sorting instruction to the controller of the sorting equipment, the abnormal sorting instruction being used to instruct the logistics objects corresponding to the logistics delivery destination to be sorted to an abnormal slot, so that the controller unbinds the first sorting slot from the logistics delivery destination and binds the abnormal sorting slot to the logistics delivery destination at the software level according to the abnormal sorting instruction.

[0012] In one optional implementation, acquiring the first image and the second image captured sequentially by the same camera at preset time intervals includes: acquiring the slope of the chute in the first sorting compartment; acquiring a preset time interval applicable to the slope, wherein a gentler slope has a longer preset time interval applicable to it, and a steeper slope has a shorter preset time interval applicable to it; and acquiring the first image and the second image captured sequentially by the same camera at preset time intervals applicable to the slope.

[0013] In an optional implementation, the method further includes: updating the number of times the first logistics object or the second logistics object is congested at the first sorting slot when it is determined that the first logistics object or the second logistics object is congested at the first sorting slot; determining whether the updated number of times the first logistics object is congested at the first sorting slot is greater than or equal to a preset number; if the updated number of times the first logistics object is congested at the first sorting slot is greater than or equal to the preset number, determining the logistics delivery destination corresponding to the first sorting slot; and outputting an addition prompt, which is used to prompt the addition of a sorting slot corresponding to the logistics delivery destination in the sorting equipment.

[0014] In one optional implementation, the output of the additional prompt includes: sending an additional prompt to a terminal used by a worker, so that the terminal used by the worker displays or plays the additional prompt; and / or sending an additional prompt to the controller of the sorting equipment, so that the controller binds the third sorting compartment to the logistics delivery destination at the software level based on the additional prompt.

[0015] In an optional implementation, the method further includes: when it is determined that the first logistics object or the second logistics object is congested at the first sorting slot, controlling a congestion indication device located outside the sorting equipment and corresponding to the first sorting slot to output a congestion indication.

[0016] In one optional implementation, the congestion indicator device includes an indicator light; the control of the congestion indicator device located outside the sorting equipment and corresponding to the first sorting slot to output a congestion indication includes: counting the number of logistics objects congested at the first sorting slot; obtaining a pre-set flashing frequency matching the number, wherein a larger number corresponds to a higher flashing frequency, or a smaller number corresponds to a lower flashing frequency; and controlling the indicator light located outside the sorting equipment and corresponding to the first sorting slot to flash at the flashing frequency.

[0017] Secondly, this application discloses an apparatus for detecting the sorting status of logistics objects. The apparatus includes: a first acquisition module, configured to acquire a first image and a second image sequentially captured by the same camera at preset time intervals, wherein the first image includes a first sorting grid in a sorting device, and the second image includes a first sorting grid in a sorting device; a detection module, configured to detect whether a first logistics object exists in the area of ​​the first sorting grid in the first image, and to detect whether a second logistics object exists in the area of ​​the first sorting grid in the second image; a first determination module, configured to determine whether the first logistics object and the second logistics object are the same if both exist in the area of ​​the first sorting grid in the first image and the area of ​​the first sorting grid in the second image; a second acquisition module, configured to acquire a first degree of overlap between the position range of the first logistics object in the area of ​​the first sorting grid and the position range of the second logistics object in the area of ​​the first sorting grid if the first degree of overlap is greater than a first preset degree; and a second determination module, configured to determine whether the first logistics object or the second logistics object is congested at the first sorting grid if the first degree of overlap is greater than a first preset degree.

[0018] In one optional implementation, the second acquisition module includes: a calculation unit, used to calculate a first intersection-union ratio between the position range of the first logistics object in the area of ​​the first sorting grid and the position range of the second logistics object in the area of ​​the first sorting grid; and a first acquisition unit, used to acquire a first overlap degree based on the first intersection-union ratio.

[0019] In one optional implementation, the detection module includes: a detection unit for detecting the position range of a logistics object in the first image; a second acquisition unit for acquiring the position range of a first sorting grid in the first image; a third acquisition unit for acquiring a second degree of overlap between the position range of the logistics object in the first image and the position range of the first sorting grid in the first image; and a first determination unit for determining, when the second degree of overlap is greater than a second preset degree, the logistics object in the first image as a first logistics object located in the area of ​​the first sorting grid in the first image; or, the second determination unit for determining, when the second degree of overlap is less than or equal to the second preset degree, that the logistics object in the first image is not a first logistics object located in the area of ​​the first sorting grid in the first image.

[0020] In an optional implementation, the third acquisition unit includes: a calculation subunit, used to calculate a second intersection-union ratio between the position range of the logistics object in the first image and the position range of the first sorting grid in the first image; and a first acquisition subunit, used to acquire a second overlap degree based on the second intersection-union ratio.

[0021] In one optional implementation, the second acquisition unit includes: a second acquisition subunit, used to acquire the camera identifier of the camera that acquires the first image; a third acquisition subunit, used to acquire, based on the camera identifier, the position range of the first sorting grid in the image acquired by the camera, which is recorded in advance; and a fourth acquisition subunit, used to acquire, based on the position range of the first sorting grid in the image acquired by the camera, the position range of the first sorting grid in the first image.

[0022] In an optional implementation, the third acquisition subunit is specifically used to: find the position range corresponding to the camera identifier in the correspondence between the camera identifier of the camera and the position range of the sorting grid in the image captured by the camera, and use it as the position range of the first sorting grid in the image captured by the camera.

[0023] In an optional implementation, the apparatus further includes: a third determining module, configured to determine the logistics delivery destination corresponding to the first sorting slot; a searching module, configured to search among multiple sorting slots in the sorting equipment for a second sorting slot corresponding to the logistics delivery destination, the second sorting slot being different from the first sorting slot; and a first sending module, configured to, upon finding the second sorting slot corresponding to the logistics delivery destination, send a sorting slot rejection instruction to the controller of the sorting equipment, the sorting slot rejection instruction indicating that the first sorting slot be removed from the sorting equipment used for sorting logistics objects corresponding to the logistics delivery destination. The first sorting grid is removed from the sorting slot, so that the controller unbinds the first sorting grid from the logistics delivery destination at the software level according to the sorting grid removal instruction; or, the second sending module is used to send an abnormal sorting instruction to the controller of the sorting equipment when the second sorting grid corresponding to the logistics delivery destination is not found. The abnormal sorting instruction is used to instruct the logistics object corresponding to the logistics delivery destination to be sorted into the abnormal grid, so that the controller unbinds the first sorting grid from the logistics delivery destination and binds the abnormal sorting grid to the logistics delivery destination at the software level according to the abnormal sorting instruction.

[0024] In an optional implementation, the first acquisition module includes: a fourth acquisition unit for acquiring the slope of the chute in the first sorting compartment; a fifth acquisition unit for acquiring a preset time duration applicable to the slope, wherein a gentler slope has a longer preset time duration applicable to it, and a steeper slope has a shorter preset time duration applicable to it; and a sixth acquisition unit for acquiring a first image and a second image sequentially captured by the same camera at preset time intervals applicable to the slope.

[0025] In an optional implementation, the device further includes: an update module, configured to update the number of times the first sorting slot is congested when it is determined that the first logistics object or the second logistics object is congested at the first sorting slot; a fourth determination module, configured to determine whether the updated number of times the first sorting slot is congested is greater than or equal to a preset number; a fifth determination module, configured to determine the logistics delivery destination corresponding to the first sorting slot when the updated number of times the first sorting slot is congested is greater than or equal to the preset number; and an output module, configured to output an addition prompt, the addition prompt being used to prompt the addition of a sorting slot corresponding to the logistics delivery destination in the sorting equipment.

[0026] In an optional implementation, the output module includes: a first sending unit for sending an additional prompt to a terminal used by a worker, so that the terminal used by the worker displays or plays the additional prompt; and / or, a second sending unit for sending an additional prompt to the controller of the sorting equipment, so that the controller binds the third sorting slot to the logistics delivery destination at the software level according to the additional prompt.

[0027] In an optional implementation, the device further includes a control module, configured to control a congestion indication device located outside the sorting equipment and corresponding to the first sorting grid to output a congestion indication when it is determined that the first logistics object or the second logistics object is congested at the first sorting grid.

[0028] In one optional implementation, the congestion indicator device includes an indicator light; the control module includes: a statistics unit for counting the number of logistics objects congested at the first sorting slot; a seventh acquisition unit for acquiring a pre-set flashing frequency matching the number, wherein a larger number corresponds to a higher flashing frequency, or a smaller number corresponds to a lower flashing frequency; and a control unit for controlling the indicator light located outside the sorting device and corresponding to the first sorting slot to flash at the flashing frequency.

[0029] Thirdly, this application discloses an electronic device comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to perform the methods shown in any of the foregoing aspects.

[0030] Fourthly, this application discloses a non-transitory computer-readable storage medium that, when the instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to perform the methods shown in any of the foregoing aspects.

[0031] Fifthly, this application discloses a computer program product in which, when the instructions in the computer program product are executed by a processor of an electronic device, the electronic device is enabled to perform the methods shown in any of the foregoing aspects.

[0032] Compared with the prior art, this application has the following advantages:

[0033] In this application, a first image and a second image are acquired sequentially at preset time intervals using the same camera. The first image includes a first sorting slot in the sorting equipment. The second image also includes the first sorting slot in the sorting equipment. The system detects whether a first logistics object exists in the area of ​​the first sorting slot in the first image, and detects whether a second logistics object exists in the area of ​​the first sorting slot in the second image. If both the first and second logistics objects exist in the area of ​​the first sorting slot in the first image and the second sorting slot in the second image, it determines whether the first and second logistics objects are the same. If the first and second logistics objects are the same, it obtains a first degree of overlap between the position range of the first logistics object in the area of ​​the first sorting slot and the position range of the second logistics object in the area of ​​the first sorting slot. If the first degree of overlap is greater than a first preset degree, it is determined that either the first or second logistics object is congested at the first sorting slot.

[0034] The detection process for whether there is congestion at the first sorting grid in this application can be carried out without the participation of staff, which can reduce labor costs.

[0035] In addition, since no staff are involved, the inaccuracy of detection due to human physiological reasons can be overcome, thereby improving the accuracy of detecting congestion.

[0036] Secondly, this application detects congestion by using images captured by a camera, including those of the sorting grid. These images are real images containing the contents of the sorting grid. With such images, image detection technology and related techniques can be used to detect congestion, offering higher accuracy. Therefore, using real images improves the accuracy of congestion detection. Furthermore, even if the number of items congested at the first sorting grid is small (e.g., one or two), the congestion can still be detected, allowing for timely discovery of the congestion. Additionally, the images used for congestion detection can be real-time images captured by the camera, further improving the timeliness of congestion detection and enabling timely discovery of congestion. Attached Figure Description

[0037] Figure 1 This is a flowchart of the steps of a method for detecting the sorting status of logistics objects according to this application.

[0038] Figure 2 This is a flowchart of the steps of a method for acquiring an image according to this application.

[0039] Figure 3 This is a flowchart of the steps of a method for detecting logistics objects according to this application.

[0040] Figure 4 This is a structural block diagram of a device for detecting the sorting status of logistics objects according to this application.

[0041] Figure 5 This is a structural block diagram of a device according to this application. Detailed Implementation

[0042] To make the above-mentioned objectives, features and advantages of this application more apparent and understandable, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0043] In one example, the sorting equipment includes a conveyor belt with a transport direction along which packages are transported. The sorting equipment also includes multiple sorting belts with sorting directions that intersect and are perpendicular to the transport direction of the conveyor belts. These sorting belts are used to sort packages into a sorting slot along their respective sorting directions. The conveyor belt and the multiple sorting belts constitute a cross-belt sorting line.

[0044] The sorting equipment also has multiple sorting slots, which are distributed along both sides of the conveyor belt, with each sorting slot corresponding to a destination.

[0045] For example, for any sorting slot, the packages sorted to that sorting slot are used for delivery to the destination corresponding to that sorting slot. The other end of the sorting slot is connected to a collection bag. The sorting belt is used to sort the packages that need to be sorted to that sorting slot to that sorting slot in the sorting direction so that the packages fall into the slot. Then the packages slide along the chute in the sorting slot into the collection bag connected to the other end of the sorting slot. The packages that fall into the collection bag are used for delivery to the destination corresponding to that sorting slot.

[0046] The sorting equipment also has multiple package feeding stations, which are distributed along both sides of the conveyor belt. The package feeding stations are used to transport packages to be sorted to the conveyor belt and simultaneously ensure that the packages to be sorted are located on a sorting belt, so that the conveyor belt can transport the packages to be sorted. For example, the packages to be sorted are located on a sorting belt. Secondly, the conveyor belt will drive the various sorting belts to move. The packages to be sorted and the sorting belts on which the packages to be sorted are located are relatively stationary. In this way, the conveyor belt can transport the packages to be sorted.

[0047] For any package awaiting sorting at any destination, a worker at the package supply station places the package on the station and scans the shipping label using a terminal. The terminal obtains the package's destination from the scanned information and determines the corresponding sorting slot. The supply station then transfers the package to a conveyor belt, placing it on a sorting belt. A binding relationship is then established between this sorting belt and the corresponding sorting slot. Once the conveyor belt has transported the package to the area matching the sorting slot, the sorting equipment controller directs the belt to sort the package into that slot. The package then slides from the chute into the corresponding collection bag. This process is repeated for every other package awaiting sorting at every other destination. This allows packages destined for the same destination to be placed in the same collection bag, facilitating subsequent unified delivery.

[0048] However, the inventors discovered that sometimes, a large number of packages destined for the same destination are transported on the conveyor belt, and a large number of packages are concentrated in one sorting slot. These packages need to be sorted to the sorting slot corresponding to the same destination and slide down the same chute to the collection bag corresponding to the same destination. Sometimes, some packages are irregular in shape and large in size. Therefore, sometimes multiple packages destined for the same destination may cause congestion at the sorting slot corresponding to the same destination. For example, multiple packages destined for the same destination may cause congestion at the chute in the sorting slot corresponding to the same destination.

[0049] However, the inventors discovered that if multiple packages destined for the same destination become congested at the sorting slot corresponding to that destination, the congested packages will be unable to fall into the collection bag corresponding to that destination, thus preventing normal sorting. Furthermore, other packages that need to be sorted through the sorting slot corresponding to that destination will also be unable to fall into the collection bag corresponding to that destination.

[0050] Secondly, the inventors also discovered that as more and more packages become congested at the sorting slots corresponding to the same destination, a large number of packages may extend and accumulate on the conveyor belt, causing them to pile up and collide. This could prevent packages destined for different destinations from moving normally on the conveyor belt, and consequently, prevent packages from being sorted to their corresponding sorting slots, affecting the entire sorting operation of the sorting equipment and leading to sorting failures. It could even cause packages that should be sorted to one destination's sorting slot to be mistakenly sorted to other destinations due to congestion, resulting in incorrect sorting.

[0051] Therefore, in order to avoid situations where normal sorting cannot be carried out and to avoid situations where incorrect sorting occurs, it is possible to detect in a timely manner whether there is congestion at the sorting slot corresponding to the same destination for multiple packages to the same destination. If there is congestion at the sorting slot corresponding to the same destination for multiple packages to the same destination, it is possible to intervene in a timely manner to eliminate the congestion, thus avoiding affecting the entire sorting operation and preventing incorrect sorting.

[0052] However, the inventors discovered that sometimes, sorting equipment has a closed structure, and each sorting slot has a shielding curtain to control the direction of the package as it slides down the chute, so that the package can fall accurately into the collection bag it needs to be placed in, and avoid the package falling outside the collection bag. The shielding curtain surrounds the sorting equipment, so the sorting equipment has a closed structure. In this way, the internal situation of the closed structure sorting equipment cannot be observed with the naked eye from the outside. Thus, even if multiple packages to the same destination are congested at the sorting slot corresponding to the same destination, the congestion cannot be detected by the naked eye from the outside.

[0053] As a result, staff cannot visually detect whether there is congestion at the sorting slot corresponding to the same destination for multiple packages destined for the same destination.

[0054] Therefore, in one approach, staff can be periodically dispatched into the enclosed structure of the sorting equipment to visually inspect whether there is any congestion at the sorting compartments.

[0055] However, the inventors discovered that the enclosed structure of sorting equipment is often large, and the number of sorting slots is large, ranging from dozens to hundreds. Adjacent sorting slots are separated by baffles, which are opaque and often large in size. One worker can only check a small number of sorting slots for congestion at the same time. Thus, it is often necessary to dispatch multiple workers to observe, and different workers check a portion of the sorting slots for congestion. It is evident that the above method has high labor costs.

[0056] In addition, due to physiological reasons, fatigue may lead to inaccurate detection. This could result in the fact that although there is objective congestion at the sorting grid, human error may cause the congestion to go undetected, and the person may subjectively believe that there is no congestion at the sorting grid. Therefore, the accuracy of congestion detection is low.

[0057] Therefore, the proposed solution in this application is put forward.

[0058] Before introducing the solution of this application, the technical terms that may be involved in the solution of this application will be explained.

[0059] YOLOR: An open-source object detection algorithm framework based on deep learning. After inputting an image, the algorithm outputs information such as the location, range, category, and detection confidence of the detected object.

[0060] IOU: Intersection over Union, is the area of ​​intersection of two targets / area of ​​union, reflecting the degree of overlap between the two targets.

[0061] Cross-belt automated sorting equipment (referred to as "cross-belt") consists of a circular conveyor belt and small belt conveyor trolleys. The circular conveyor belt is the main transport line, connecting all the parcels flowing through the sorting center to their designated slots. Small belt trolleys are arranged on the circular conveyor belt to carry and sort the parcels. The direction of the conveyor belt movement on the trolleys is perpendicular to the circular conveyor belt. When the trolley moves with the circular conveyor belt to the designated sorting position, the trolley rotates its belt to sort the parcel to the designated slot, thus completing one sorting task.

[0062] Multi-layer cross-belt automated sorting equipment (referred to as "multi-layer cross-belt"): Compared with traditional single-layer cross-belt systems, multi-layer cross-belt systems mainly come in two, three, and four-layer configurations. Each layer is connected by rails, which provide support and synchronous drive. Multiple trolleys can transport packages to the target compartment via chutes, and packages in the same compartment are subsequently grouped and sent to the same destination.

[0063] CPU: Central Processing Unit.

[0064] GPU: Graphics Processing Unit.

[0065] Specifically, see Figure 1 This application illustrates a method for detecting the sorting status of logistics objects, applied to an electronic device. The method includes:

[0066] In step S101, a first image and a second image are acquired sequentially at preset time intervals using the same camera. The first image includes the first sorting slot in the sorting device. The second image also includes the first sorting slot in the sorting device.

[0067] In this application, the position and acquisition direction of the camera do not change during the image acquisition process, so the size of the first image and the second image are the same. In addition, the first sorting slot is located within the acquisition range of the camera, so the position range of the first sorting slot in the first image is the same as the position range of the first sorting slot in the second image.

[0068] The preset duration includes a range of 250 milliseconds to 350 milliseconds, such as 250 milliseconds, 260 milliseconds, 270 milliseconds, 280 milliseconds, 290 milliseconds, 300 milliseconds, 310 milliseconds, 320 milliseconds, 330 milliseconds, 350 milliseconds, or 350 milliseconds, etc. The specific duration can be determined according to the actual situation. This application does not limit the specific value.

[0069] In one embodiment of this application, the camera may be located directly above the first sorting slot and vertically downwards to capture images including the first sorting slot.

[0070] Alternatively, in another embodiment of this application, the camera may be located diagonally above the first sorting slot and diagonally downward to capture images including the first sorting slot.

[0071] In one embodiment of this application, a camera can be positioned to target a single sorting grid, so that each image captured by the camera may only include the sorting grid targeted by that camera. Thus, the first image includes one sorting grid, and the second image includes one sorting grid. Different cameras may target different sorting grids.

[0072] Alternatively, in another embodiment of this application, the camera's acquisition range is often relatively large, typically encompassing two or more sorting slots. Thus, one camera can simultaneously target two sorting slots, and each image captured by a single camera can simultaneously include the two or more sorting slots it targets. Therefore, the first image includes two or more first sorting slots, and the second image includes two or more first sorting slots. The sorting slots targeted by different cameras do not overlap.

[0073] In this application, the camera can continuously capture images and store the captured images in a database.

[0074] Thus, in one embodiment of this application, the electronic device can read images continuously captured by the camera from the database, and filter two frames of images with a preset time interval from the read images, and use them as the first image and the second image, respectively.

[0075] Alternatively, in another embodiment of this application, the electronic device can transmit a preset duration to the database so that the database can filter two frames of images with a preset duration interval from the images continuously captured by the camera, and transmit the filtered two frames of images to the electronic device. The electronic device can receive the two frames of images and use them as the first image and the second image, respectively.

[0076] In one embodiment of this application, the second image may be the latest image captured by the camera, and the camera's capture time for the first image is earlier than the camera's capture time for the second image. A preset time interval exists between the camera's capture time for the first image and the camera's capture time for the second image.

[0077] In step S102, it is detected whether a first logistics object exists in the area of ​​the first sorting grid in the first image, and whether a second logistics object exists in the area of ​​the first sorting grid in the second image.

[0078] The first sorting compartment occupies a portion of the area in the first image. The area of ​​the first sorting compartment may or may not contain logistics objects. This step needs to detect whether there is a first logistics object in the area of ​​the first sorting compartment in the first image. The specific detection method can be found in the embodiments shown later, which will not be described in detail here.

[0079] Furthermore, the first sorting compartment occupies a portion of the area in the second image. The area of ​​the first sorting compartment may or may not contain logistics objects. This step requires detecting whether there are second logistics objects in the area of ​​the first sorting compartment in the second image. For specific detection methods, please refer to the embodiments shown later, which will not be detailed here.

[0080] Logistics items can include express parcels, etc.

[0081] The terms "first logistics object" and "second logistics object" refer to logistics objects in general, not to any specific logistics object.

[0082] If a first logistics object exists in the area of ​​the first sorting grid in the first image and a second logistics object exists in the area of ​​the first sorting grid in the second image, step S103 can be executed.

[0083] Alternatively, if there is no first logistics object in the area of ​​the first sorting grid in the first image or no second logistics object in the area of ​​the first sorting grid in the second image, the process can be terminated, and then returned to step S101 after a certain time interval. This time interval can be between 5 seconds and 5 minutes, etc. For example, a time interval can include 2 minutes, 3 minutes, or 4 minutes, etc.

[0084] If a first logistics object exists in the area of ​​the first sorting grid in the first image and a second logistics object exists in the area of ​​the first sorting grid in the second image, in step S103, it is determined whether the first logistics object and the second logistics object are the same.

[0085] In step S102, a detection model can be used to detect whether a first logistics object exists in the area of ​​the first sorting grid in the first image and whether a second logistics object exists in the area of ​​the first sorting grid in the second image. During the detection process, the detection model will acquire the feature information of the first logistics object in the first image and the feature information of the second logistics object in the second image. Then, the similarity between the first logistics object and the second logistics object can be calculated using the feature information of the first logistics object in the first image and the feature information of the second logistics object in the second image. If the similarity is greater than a preset similarity, it is determined that the first logistics object and the second logistics object are the same, that is, the first logistics object and the second logistics object are the same logistics object, and then step S104 can be executed.

[0086] Alternatively, if the similarity is less than or equal to a preset similarity, it can be determined that the first logistics object and the second logistics object are different, that is, the first logistics object and the second logistics object are not the same logistics object, and the process can be terminated. Then, after a certain period of time, the process can return to step S101. The period of time can be in the range of 5 seconds to 5 minutes, etc. For example, the period of time can include 2 minutes, 3 minutes, or 4 minutes, etc.

[0087] The specific calculation method for "calculating the similarity between the first logistics object and the second logistics object by using the feature information of the first logistics object in the first image and the feature information of the second logistics object in the second image" can refer to the existing methods. This application can use any existing similarity calculation method, and this application does not limit the specific calculation method.

[0088] The preset similarity can be in the range of 0.7 or higher, such as 0.7, 0.75, 0.8 or 0.85, etc. The specific value can be determined according to the actual situation, and this application does not limit it.

[0089] If the first logistics object and the second logistics object are the same, in step S104, the first degree of overlap between the position range of the first logistics object in the area of ​​the first sorting grid and the position range of the second logistics object in the area of ​​the first sorting grid is obtained.

[0090] In one embodiment of this application, this step can be implemented through the following process, including:

[0091] 1041. Calculate the first intersection-union ratio between the location range of the first logistics object in the area of ​​the first sorting grid and the location range of the second logistics object in the area of ​​the first sorting grid.

[0092] The first logistics object in the first image can be enclosed by a first bounding rectangle. The first bounding rectangle occupies a portion of the area in the first image, and its position is already determined. For example, the position of the center point of the first bounding rectangle is already determined. Thus, it is equivalent to the first bounding rectangle having a positional range in the first image, and the positional range is already determined. Since the position of the area of ​​the first sorting slot in the first image is fixed, the positional range of the first bounding rectangle in the first image can be regarded as the positional range of the first logistics object in the area of ​​the first sorting slot.

[0093] The second logistics object in the second image can be enclosed by a second bounding rectangle. The second bounding rectangle occupies a portion of the area in the second image, and its position is already determined. For example, the position of the center point of the second bounding rectangle is already determined. Thus, it is equivalent to the second bounding rectangle having a positional range in the second image, and the positional range is already determined. Since the position of the area of ​​the first sorting slot in the second image is fixed, the positional range of the second bounding rectangle in the second image can be regarded as the positional range of the second logistics object in the area of ​​the first sorting slot.

[0094] Since the first image and the second image are the same size, and the position and acquisition direction of the camera do not change during the acquisition of the first image and the second image, when calculating the first intersection-union ratio between the position range of the first logistics object in the area of ​​the first sorting grid and the position range of the second logistics object in the area of ​​the first sorting grid, the intersection-union ratio between the first rectangle and the second rectangle can be calculated. For example, the area of ​​the intersection area between the first rectangle and the second rectangle can be calculated, the area of ​​the union area between the first rectangle and the second rectangle can be calculated, and then the ratio between the area of ​​the intersection area and the area of ​​the union area can be calculated to obtain the first intersection-union ratio.

[0095] 1042. Obtain the first degree of overlap based on the first intersection-union ratio.

[0096] For example, the first intersection-union ratio can be determined as the first degree of overlap.

[0097] In step S105, if the degree of overlap is greater than the first preset degree, it is determined that the first logistics object or the second logistics object is congested at the first sorting grid.

[0098] The first preset level may include a range of 0.55 to 0.7, such as 0.55, 0.6, 0.65 or 0.7, which may be set in advance according to the actual situation or according to experience. This application does not limit the specific value.

[0099] In this application, the sorting compartment has a chute with a certain slope.

[0100] After the logistics items are sorted by the sorting belt to the sorting slot, if the sorting slot is not congested (for example, if the chute in the sorting slot is not congested), the logistics items will enter the chute in the sorting slot and slide along the chute into the bag (the sliding process has a certain speed). As the logistics items slide along the chute into the bag, their position in the chute changes continuously; that is, their position in the sorting slot changes continuously. Thus, the position range of the logistics items in the sorting slot area in two frames of images captured by the camera at preset time intervals will be different, and the differences will be significant; for example, the degree of overlap will be small.

[0101] Alternatively, after the logistics object is sorted to the sorting slot by the sorting belt, if the sorting slot is congested, for example, if the chute in the sorting slot is congested, the logistics object will not enter the chute in the sorting slot; or, the logistics object will enter the chute in the sorting slot but will not slide into the bag along the chute (sliding speed is 0), or the speed at which it slides into the bag along the chute is very slow (sliding speed is close to 0). As time passes, the position of the logistics object in the chute remains unchanged or changes very little (close to no change), that is, the position of the logistics object in the sorting slot remains unchanged or changes very little (close to no change). Thus, in two frames of images captured by the camera at a preset time interval, the positions of the logistics object in the area of ​​the sorting slot are the same or very close, for example, with a large degree of overlap.

[0102] Thus, if the degree of overlap is greater than a first preset degree, it can be determined that either the first or second logistics object is congested at the first sorting slot. Alternatively, if the degree of overlap is less than or equal to the first preset degree, it can be determined that either the first or second logistics object is not congested at the first sorting slot.

[0103] In this application, a first image and a second image are acquired sequentially at preset time intervals using the same camera. The first image includes a first sorting slot in the sorting equipment. The second image also includes the first sorting slot in the sorting equipment. The system detects whether a first logistics object exists in the area of ​​the first sorting slot in the first image, and detects whether a second logistics object exists in the area of ​​the first sorting slot in the second image. If both the first and second logistics objects exist in the area of ​​the first sorting slot in the first image and the second sorting slot in the second image, it determines whether the first and second logistics objects are the same. If the first and second logistics objects are the same, it obtains a first degree of overlap between the position range of the first logistics object in the area of ​​the first sorting slot and the position range of the second logistics object in the area of ​​the first sorting slot. If the first degree of overlap is greater than a first preset degree, it is determined that either the first or second logistics object is congested at the first sorting slot.

[0104] The detection process for whether there is congestion at the first sorting grid in this application can be carried out without the participation of staff, which can reduce labor costs.

[0105] In addition, since no staff are involved, the inaccuracy of detection due to human physiological reasons can be overcome, thereby improving the accuracy of detecting congestion.

[0106] Secondly, this application detects congestion by using images captured by a camera, including those of the sorting grid. These images are real images containing the contents of the sorting grid. With such images, image detection technology and related techniques can be used to detect congestion, offering higher accuracy. Therefore, using real images improves the accuracy of congestion detection. Furthermore, even if the number of items congested at the first sorting grid is small (e.g., one or two), the congestion can still be detected, allowing for timely discovery of the congestion. Additionally, the images used for congestion detection can be real-time images captured by the camera, further improving the timeliness of congestion detection and enabling timely discovery of congestion.

[0107] Secondly, in one scenario, the sorting equipment is already equipped with a camera, which is originally intended to allow staff to view the internal conditions of the sorting equipment. In this case, the solution proposed in this application can directly use the images captured by the original camera, without the need to deploy an additional camera in the sorting equipment. Therefore, the solution proposed in this application can avoid increasing additional hardware costs.

[0108] In addition, the solution proposed in this application consumes less computing resources, thus avoiding excessive consumption of computing resources. For example, it can use only the CPU and does not require an additional GPU. Therefore, the solution proposed in this application can avoid increasing the additional hardware cost.

[0109] Secondly, the logic of the solution in this application does not depend on the sorting solution logic of the sorting equipment. Thus, the solution in this application can be independent of the sorting solution of the sorting equipment, and can be standardized, customized, and deployed in batches. The solution in this application has stronger adaptability.

[0110] In one embodiment of this application, the electronic device can execute the process of steps S101 to S105 at regular intervals, which can be in the range of 5 seconds to 5 minutes. For example, the interval can include 30 seconds, 1 minute, 2 minutes, 3 minutes, or 4 minutes, etc., to maximize the timeliness or efficiency of congestion detection.

[0111] Furthermore, in another embodiment of this application, if it is determined that the first or second logistics object is congested at the first sorting slot, a congestion alert can be sent to the equipment used by the staff. The equipment can display or play the congestion alert so that the staff can perceive the congestion and thus know that congestion has occurred at the first sorting slot. They can then intervene as early as possible to eliminate the congestion at the first sorting slot, allowing the sorting operation to proceed normally. For example, the staff can remove the package congested at the first sorting slot from the first sorting slot and re-input the removed package from the package feeding station for re-sorting.

[0112] Secondly, there may be multiple first or second logistics objects. In the case of multiple first or second logistics objects, the number of first or second logistics objects can be counted and used as the number of logistics objects that are congested at the first sorting gate. In this way, the congestion alert can also carry the number of logistics objects that are congested at the first sorting gate, so that staff can perceive the number of logistics objects that are congested at the first sorting gate.

[0113] Alternatively, if the number of the first or second logistics object exceeds the preset number, a congestion alert will be sent to the equipment used by the staff. The preset number may include 3, 4, or 5, etc., and can be determined according to the actual situation. This application does not limit this number. The preset number can be adjusted according to the actual situation to meet the actual operation and maintenance needs.

[0114] In addition, the congestion alert can also include a first image and / or a second image, allowing staff to perceive the specific congestion situation at the first sorting grid. The first and / or second images can also mark the location of the congestion, for example, by using a rectangle to frame the congested logistics object.

[0115] In addition, the congestion alert can also include the grid identifier of the first sorting grid, the camera identifier or IP (Internet Protocol) address of the camera that captured the first and second images, so that staff can distinguish at which sorting grid the congestion occurred.

[0116] Secondly, the relevant data can be stored in a database for subsequent queries and statistical analysis of congestion. The relevant data includes at least: the identifier of the first sorting compartment, the camera identifier or IP address of the camera capturing the first and second images, the time when congestion occurred at the first sorting compartment, the time between the time of congestion at the first sorting compartment and the time when congestion was relieved, the first image, and / or the second image.

[0117] The aforementioned electronic devices sending information (such as congestion alerts) to staff terminals can do so via instant messaging software. This allows the instant messaging software on the staff's terminals to receive and display the information sent by the electronic device. In one example, the electronic device can send information to each staff member individually through a group chat within the instant messaging software.

[0118] In this application, congestion indicator devices are set on the outside of the sorting equipment for each sorting slot. The congestion indicator devices for each sorting slot are matched one-to-one with the position of each sorting slot. Thus, from the perspective of human eyes, it is easy to distinguish which congestion indicator device is for which sorting slot.

[0119] Each congestion indicator device can be directly or indirectly connected to the electronic device via communication or electrical connection. In this way, the electronic device can directly or indirectly control the congestion indicator device located outside the sorting equipment and corresponding to the first sorting slot to output a congestion indicator. This allows staff to perceive the congestion indicator output by the congestion indicator device corresponding to the first sorting slot and to know that congestion has occurred at the first sorting slot based on the congestion indicator output by the congestion indicator device corresponding to the first sorting slot. They can then intervene as early as possible to eliminate the congestion.

[0120] In one example, the congestion indicator device includes an indicator light. If there is no congestion at a sorting grid, the indicator light corresponding to that sorting grid can be off; or, if there is congestion at a sorting grid, the indicator light corresponding to that sorting grid can be on.

[0121] In this way, the electronic device can control the indicator light corresponding to the first sorting slot to light up. After the staff sees the indicator light light up, they can know that there is a congestion at the first sorting slot corresponding to that indicator light.

[0122] The sorting equipment in this application may include cross-belt automatic sorting equipment or multi-layer cross-belt automatic sorting equipment, etc.

[0123] In one embodiment, the indicator light may be constantly lit or flashing. The indicator light also supports multiple flashing frequencies when flashing.

[0124] Thus, when the electronic device controls the congestion indicator device located outside the sorting equipment and corresponding to the first sorting slot to output a congestion indication, it can count the number of logistics objects congested at the first sorting slot. The number of the first logistics objects in the first image can be taken as the number of logistics objects congested at the first sorting slot, or the number of the second logistics objects in the second image can be taken as the number of logistics objects congested at the first sorting slot.

[0125] Then, obtain the pre-set flashing frequency that matches the quantity. The larger the quantity, the higher the flashing frequency, or the smaller the quantity, the lower the flashing frequency.

[0126] Then control the indicator light corresponding to the first sorting slot located outside the sorting equipment to flash at that flashing frequency.

[0127] This allows staff to roughly determine the number of items congested at the first sorting slot by observing the flashing frequency of the indicator light corresponding to that slot.

[0128] In this way, when there are multiple congested sorting slots, staff can distinguish the number of logistics items congested at each sorting slot by the flashing frequency of the indicator lights corresponding to each sorting slot. They can then prioritize the congested items, for example, clearing the congested items at sorting slots with a large number of items first, and then clearing the congested items at sorting slots with a small number of items, so as to ensure that the sorting work can proceed normally as much as possible.

[0129] In one embodiment of this application, the first sorting slot corresponds to a logistics delivery destination. That is, the logistics object sorted into the first sorting slot and slid into the collection bag corresponding to the first sorting slot through the chute in the first sorting slot is to be sent to the logistics delivery destination corresponding to the first sorting slot.

[0130] However, if the conveyor belt also carries other logistics objects intended for delivery to the logistics distribution destination, even if the sorting belt sorts the other logistics objects to the first sorting slot as originally planned, the other logistics objects intended for delivery to the logistics distribution destination cannot be slid into the corresponding collection bag of the first sorting slot through the chute in the first sorting slot because at least the first or second logistics object is congested at the first sorting slot.

[0131] Secondly, if more and more other logistics items destined for the same distribution destination are sorted to the first sorting slot as originally planned, it will lead to increasing congestion at the first sorting slot. In this situation, a large number of logistics items may extend and accumulate on the conveyor belt, causing them to pile up and collide. This could prevent logistics items from being transported normally to their respective distribution destinations, thus preventing them from being sorted to their corresponding sorting slots and affecting the entire sorting operation, resulting in sorting failures. It could even cause logistics items that should have been sorted to one distribution destination to be collided with due to congestion and mistakenly sorted to other distribution destinations, leading to incorrect sorting.

[0132] Therefore, in another embodiment of this application, if it is determined that the first logistics object or the second logistics object is congested at the first sorting grid, the sorting of logistics objects to the first sorting grid can be suspended to avoid more and more logistics objects that need to be sent to the logistics delivery destination accumulating at the first sorting grid.

[0133] For example, in one instance, the logistics delivery destination corresponding to the first sorting compartment can be determined.

[0134] Then, among the multiple sorting slots in the sorting equipment, locate the second sorting slot corresponding to the logistics delivery destination.

[0135] In one embodiment, upon finding a second sorting slot corresponding to the logistics delivery destination, a sorting slot rejection instruction can be sent to the controller of the sorting equipment. This instruction instructs the first sorting slot to be removed from the sorting slots used for sorting logistics objects corresponding to the logistics delivery destination. This allows the controller to decouple the first sorting slot from the logistics delivery destination at the software level based on the rejection instruction. Furthermore, the second sorting slot remains bound to the logistics delivery destination; that is, before decoupling the first sorting slot from the logistics delivery destination at the software level, both the first and second sorting slots in the sorting equipment are bound to the logistics delivery destination.

[0136] Therefore, during subsequent sorting of logistics objects at the destination, since the first sorting slot has been decoupled from the destination at the software level, the sorting equipment will no longer sort other logistics objects from the destination to the first sorting slot. Instead, it will sort other logistics objects from the destination to the second sorting slot for further sorting. The second sorting slot is different from the first sorting slot. In other words, although the first sorting compartment and the second sorting compartment are different sorting compartments, both of them correspond to the logistics delivery destination. Other logistics objects that need to be sent to the logistics delivery destination can be sorted to the second sorting compartment and then slid into the corresponding collection bag through the chute in the second sorting compartment. This ensures that other logistics objects corresponding to the logistics delivery destination of the first sorting compartment can be sorted normally even if the first sorting compartment is congested. It also prevents more logistics objects from accumulating at the first sorting compartment and avoids the logistics objects congesting at the first sorting compartment from increasing.

[0137] Alternatively, in another embodiment, if a second sorting slot corresponding to the logistics delivery destination is not found, an abnormal sorting instruction can be sent to the controller of the sorting equipment. This instruction directs the logistics object corresponding to the delivery destination to be sorted into an abnormal slot, so that the logistics object is placed in the abnormal slot. An abnormal slot is at least one of a plurality of sorting slots in the sorting equipment.

[0138] This allows the controller to decouple the first sorting slot from the logistics delivery destination at the software level based on the abnormal sorting instruction, and then couple the abnormal sorting slot back to the logistics delivery destination. In other words, before decoupling the first sorting slot from the logistics delivery destination at the software level, only the first sorting slot in the sorting equipment is coupled to the logistics delivery destination.

[0139] Therefore, during subsequent sorting of logistics objects to the destination, since the first sorting slot has been decoupled from the destination at the software level, the sorting equipment will no longer sort other logistics objects to the first sorting slot. Instead, it will sort these other logistics objects to the abnormal sorting slot for further sorting. The abnormal sorting slot differs from the first sorting slot; that is, other logistics objects destined for the destination can be sorted to the abnormal sorting slot and then transferred to the corresponding collection bag via the chute within the abnormal sorting slot. Each abnormal sorting grid is equipped with staff specifically for handling logistics items in the corresponding bundled bags. For example, the logistics items in the bundled bags in the abnormal sorting grid are temporarily stored together. Later, when the logistics delivery destination is bound to a normal sorting grid, the logistics items in the bundled bags in the abnormal sorting grid are re-entered from the bag supply station for re-sorting. This allows for the centralized processing of other logistics items at the logistics delivery destination corresponding to the first sorting grid in the event of congestion at the first sorting grid, and also prevents more logistics items from accumulating at the first sorting grid, thus avoiding an increasing number of logistics items causing congestion at the first sorting grid.

[0140] Furthermore, a pause input instruction can be sent to the package supply station, which is used to instruct the package supply station to pause the transmission of the logistics object corresponding to the logistics delivery destination to the conveyor belt in the sorting equipment.

[0141] Furthermore, a pause input instruction can be sent to the terminal used by the staff responsible for inputting logistics objects into the conveyor belt of the sorting equipment. The pause input instruction is used to instruct the cessation of the transmission of the logistics object corresponding to the logistics delivery destination into the conveyor belt of the sorting equipment.

[0142] To prevent more logistics objects corresponding to the same delivery destination from entering the conveyor belt of the sorting equipment, thereby preventing more logistics objects corresponding to the same delivery destination from congesting at the first sorting compartment.

[0143] In this application, if it is determined that the first logistics object or the second logistics object is congested at the first sorting grid, the number of times the congestion occurs at the first sorting grid can be updated. For example, the number of times the congestion has already been recorded at the first sorting grid can be increased by 1. The number of times the congestion has already been recorded at the first sorting grid is the number of times the congestion has occurred at the first sorting grid before.

[0144] For example, in the correspondence between the sorting grid identifier and the number of times congestion occurs, the number of times congestion occurs corresponding to the grid identifier of the first sorting grid can be found, the sum of the found number and the value 1 can be calculated, and then this sum can be used to replace the number of times congestion occurs corresponding to the grid identifier of the first sorting grid in the correspondence between the sorting grid identifier and the number of times congestion occurs.

[0145] Different sorting compartments have different compartment labels. The compartment label may include the sorting compartment number, etc.

[0146] Secondly, it can be determined whether the number of updated congestion updates at the first sorting grid is greater than or equal to the preset number. If the number of updated congestion updates at the first sorting grid is greater than or equal to the preset number, it indicates that the number of updated congestion updates at the first sorting grid is relatively high. The reason for the relatively high number of updated congestion updates at the first sorting grid may be that there are too many logistics objects that need to be sorted to the first sorting grid. For example, there are too many logistics objects that need to be delivered to the corresponding logistics delivery destination of the first sorting grid.

[0147] Thus, in order to reduce the possibility of congestion at the first sorting grid, in another embodiment of this application, the number of logistics objects that need to be sorted to the first sorting grid can be reduced without affecting the normal sorting of logistics objects for delivery to the corresponding distribution destination of the first sorting grid.

[0148] Thus, if the number of updated congestion events at the first sorting grid is greater than or equal to the preset number, the logistics delivery destination corresponding to the first sorting grid can be determined.

[0149] The preset number of times can include 3, 4 or 5, etc., and the specific number can be determined according to the actual situation. This application does not limit the specific value.

[0150] For example, each sorting slot in the sorting equipment corresponds to a logistics delivery destination, and the logistics delivery destinations corresponding to each sorting slot are pre-set and recorded. Thus, the pre-recorded logistics delivery destination corresponding to the first sorting slot can be retrieved. Then, an "add" prompt can be output to suggest adding a sorting slot corresponding to that logistics delivery destination to the sorting equipment.

[0151] The output prompts may include:

[0152] An addition prompt is sent to the terminal used by the staff, causing the terminal to display or play the prompt, thus making the staff aware of the addition. Then, a sorting slot corresponding to the logistics delivery destination is added to the sorting equipment. For example, the staff can operate the sorting equipment controller to bind (couple) the third sorting slot with the logistics delivery destination corresponding to the first sorting slot at the software level. In this way, when sorting logistics objects from the logistics delivery destination corresponding to the first sorting slot, a portion of the logistics objects from the logistics delivery destination corresponding to the first sorting slot can be sorted to the third sorting slot for further sorting. The third sorting slot can be an idle sorting slot (i.e., a sorting slot bound to any logistics delivery destination).

[0153] And / or, send an addition prompt to the controller of the sorting equipment, so that the controller binds (couples) the third sorting slot to the logistics delivery destination corresponding to the first sorting slot at the software level according to the addition prompt. In this way, when sorting logistics objects corresponding to the logistics delivery destination of the first sorting slot, a portion of the logistics objects of the logistics delivery destination corresponding to the first sorting slot can be sorted to the third sorting slot for sorting through the third sorting slot. The third sorting slot can be an idle sorting slot (that is, a sorting slot located at any logistics delivery destination bound to it).

[0154] This embodiment increases the number of sorting slots corresponding to the same delivery destination. This allows more sorting slots to share the sorting work for logistics objects destined for the same destination, reducing the number of logistics objects that need to be sorted through each sorting slot. This reduces the possibility of congestion at each sorting slot. For example, in the example above, since some logistics objects that need to be sorted through the first sorting slot are sorted through the third sorting slot, the number of logistics objects that need to be sorted through the first sorting slot is reduced, thus reducing the possibility of congestion at the first sorting slot.

[0155] In another embodiment of this application, see Figure 2 Step S101 includes:

[0156] In step S201, the slope of the chute in the first sorting compartment is obtained.

[0157] In this application, it is possible to pre-calculate the various types of sorting slots that are often used in actual logistics sorting scenarios, and the slope of the chute in different types of sorting slots is not the same.

[0158] For any given camera, if its position and acquisition direction remain unchanged, the sorting grid in the captured images will also remain constant. In other words, the sorting grids captured by the camera will always be the same, and the sorting grid targeted by the camera will remain constant. Therefore, the sorting grid targeted by the camera is fixed, meaning the camera and the sorting grid are bound together. Based on this, the slope of the chute in the sorting grid targeted by the camera can be determined in advance (this can be determined manually or automatically by the electronic device based on the image of the sorting grid). Then, a correspondence table can be created between the camera identifier and the slope of the chute in the sorting grid targeted by the camera, and stored in the correspondence table between the camera identifier and the slope of the chute in the sorting grid targeted by the camera.

[0159] Different cameras have different camera markings.

[0160] The same applies to every other camera.

[0161] Therefore, when obtaining the slope of the chute in the first sorting compartment, the camera identifier of the camera that captures the first image and the second image can be obtained. Then, in the correspondence between the camera identifier of the camera and the slope of the chute in the sorting compartment targeted by the camera, the slope corresponding to the camera identifier of the camera that captures the first image and the second image can be found and used as the slope of the chute in the first sorting compartment.

[0162] In step S202, a preset time for the slope of the chute in the first sorting compartment is obtained. The gentler the slope, the longer the preset time; the steeper the slope, the shorter the preset time.

[0163] For example, we can pre-calculate the various types of sorting slots commonly used in actual logistics sorting scenarios, and the slope of the chutes in each type of sorting slot. For any given slope, based on experience, we can set a preset duration applicable to that slope, and create a corresponding table entry for that slope and the preset duration applicable to that slope, storing it in the correspondence between slope and the preset duration applicable to that slope. The same applies to every other slope that is calculated.

[0164] In this way, the preset time corresponding to the slope of the chute in the first sorting compartment can be found in the correspondence between the slope and the preset time applicable to the slope, and used as the preset time applicable to the slope of the chute in the first sorting compartment.

[0165] In step S203, the first and second images are acquired sequentially at a preset time interval between the same camera and the slope of the chute in the first sorting compartment.

[0166] In this application, the camera can continuously capture images and store the captured images in a database.

[0167] Thus, in one embodiment of this application, the electronic device can read images continuously captured by the camera from the database, and filter two frames of images from the read images at a preset time interval suitable for the slope of the chute in the first sorting slot, and use them as the first image and the second image respectively.

[0168] Alternatively, in another embodiment of this application, the electronic device may transmit a preset duration of the slope of the chute in the first sorting compartment to the database, so that the database filters two frames of images with a preset duration of the interval applicable to the slope of the chute in the first sorting compartment from the images continuously captured by the camera, and transmits the filtered two frames of images to the electronic device. The electronic device may receive the two frames of images and use them as the first image and the second image, respectively.

[0169] The first and second images are acquired sequentially by the same camera at a preset time interval appropriate to the slope of the chute in the first sorting compartment. This can improve the accuracy of subsequent detection of whether there is congestion at the first sorting compartment.

[0170] In another embodiment of this application, see Figure 3 The process of detecting whether a first logistics object exists in the area of ​​the first sorting grid in the first image in step S102 may include:

[0171] In step S301, the location range of the logistics object in the first image is detected.

[0172] In one embodiment of this application, the location range of logistics objects in the first image can be detected using a detection model.

[0173] The detection model can be trained in advance. For example, multiple training data can be obtained, including sample images and their annotation data. If there are logistics objects in the sample images, the annotation data includes the location range of the logistics objects in the sample images. Alternatively, if there are no logistics objects in the sample images, the annotation data is "No logistics objects exist in the sample images".

[0174] In one example, the sample image may include an image of the area including the sorting compartment captured by the aforementioned camera, and the image contains logistics objects, which may be located in or outside the sorting compartment area.

[0175] Then you can choose the initialization model, which can include YOLOR, etc.

[0176] The initialized model can then be trained using multiple training datasets until the parameters converge, resulting in a detection model. This detection model can then be deployed online.

[0177] Thus, when using the detection model to detect the location range of logistics objects in the first image, the first image can be input into the detection model so that the detection model can process the first image.

[0178] If a logistics object exists in the first image, the detection model will detect the location range of the logistics object in the first image and output the location range of the logistics object in the first image. The electronic device can then obtain the location range of the logistics object in the first image output by the detection model. Afterwards, the electronic device can execute step S302.

[0179] Alternatively, in another embodiment of this application, if there is no logistics object in the first image, the detection model will not detect the logistics object in the first image, and will output a detection result that there is no logistics object in the first image. The electronic device can obtain the detection result output by the detection model that there is no logistics object in the first image, that is, obtain the detection result that there is no first logistics object in the first image.

[0180] Afterwards, the electronic device can end the processing of the first image and the second image, and then re-execute step S101. The two frames of images obtained by re-executing step S101 with a preset time interval are different from the two frames of images with a preset time interval obtained by the previous execution of step S101.

[0181] In step S302, the position range of the first sorting grid in the first image is obtained.

[0182] In this application, the position and acquisition direction of the cameras that acquire the first and second images remain unchanged during the image acquisition process, and the size of each image acquired by the camera is the same. Therefore, the position range of the sorting grid in each image acquired by the camera is the same. Thus, the position range of the sorting grid in each image acquired by the camera can be determined in advance (either manually or automatically based on the image), and stored. In this step, the pre-stored position range of the sorting grid in each image acquired by the camera can be directly obtained and used as the position range of the first sorting grid in the first image acquired by the camera. This eliminates the need for real-time image analysis to determine the position range of the first sorting grid in the first image acquired by the camera, thus saving system resources and time.

[0183] In another embodiment of this application, there are multiple cameras, each used to capture images of a portion of the sorting grid. The camera capturing the first and second images is one of the multiple cameras. The positions of the different cameras are often different, and the capturing directions of the different cameras are often different. Furthermore, the positions of the different sorting grids are often different. Thus, the location range of the sorting grids in the images captured by different cameras is often different within their respective captured images.

[0184] Thus, for any given camera, the location range of the sorting grid in the image captured by that camera can be determined in advance, and this location range can be stored. Furthermore, the camera's identifier can be used to mark the location range of the sorting grid in the image captured by that camera. For example, the camera identifier and the location range of the sorting grid in the image captured by that camera can form a corresponding table entry, and this entry can be stored in a correspondence relationship between the camera identifier and the location range of the sorting grid in the image captured by that camera.

[0185] The same applies to every other camera.

[0186] Different cameras have different camera identifications. These identifications may include the camera's serial number, etc.

[0187] Thus, when obtaining the position range of the first sorting grid in the first image, the camera identifier of the camera that captured the first image can be obtained. Based on the camera identifier of the camera that captured the first image, the pre-recorded position range of the first sorting grid in the image captured by that camera can be obtained. For example, in the correspondence between the camera identifier of the camera and the position range of the sorting grid in the image captured by the camera, the position range corresponding to the camera identifier of the camera that captured the first image can be found and used as the position range of the first sorting grid in the image captured by that camera.

[0188] Then, the position range of the first sorting grid in the first image can be obtained based on the position range of the first sorting grid in the image captured by the camera. For example, the position range of the first sorting grid in the image captured by the camera can be determined as the position range of the first sorting grid in the first image.

[0189] In step S303, the second degree of overlap between the position range of the logistics object in the first image and the position range of the first sorting grid in the first image is obtained.

[0190] In one embodiment of this application, this step can be implemented through the following process, including:

[0191] 3031. Calculate the second intersection-union ratio between the position range of the logistics object in the first image and the position range of the first sorting grid in the first image.

[0192] The logistics objects in the first image can be enclosed by a first bounding rectangle. The first bounding rectangle occupies a portion of the area in the first image, and its position is already determined. For example, the position of the center point of the first bounding rectangle is already determined. Thus, it is equivalent to the first bounding rectangle having a positional range in the first image, and the positional range is already determined. Since the position of the area of ​​the first sorting grid in the first image is fixed, the positional range of the first bounding rectangle in the first image can be regarded as the positional range of the logistics objects in the first image.

[0193] The first sorting slot in the first image can be enclosed by a third circumscribed rectangle. The third circumscribed rectangle occupies a portion of the area in the first image, and its position is already determined. For example, the position of the center point of the third circumscribed rectangle is already determined. Thus, it is equivalent to the third circumscribed rectangle having a positional range in the first image, and the positional range is already determined. Since the position of the area of ​​the first sorting slot in the first image is fixed, the positional range of the third circumscribed rectangle in the first image can be regarded as the positional range of the first sorting slot in the first image.

[0194] Thus, when calculating the second intersection-union ratio between the location range of the logistics object in the first image and the location range of the first sorting grid in the first image, the intersection-union ratio between the first rectangle and the third rectangle can be calculated. For example, the area of ​​the intersection region between the first rectangle and the third rectangle can be calculated, the area of ​​the union region between the first rectangle and the third rectangle can be calculated, and then the ratio between the area of ​​the intersection region and the area of ​​the union region can be calculated to obtain the second intersection-union ratio.

[0195] 3032. Obtain the second degree of overlap based on the second intersection-union ratio.

[0196] For example, the second crossover ratio can be determined as the second degree of overlap.

[0197] In step S304, if the second degree of overlap is greater than the second preset degree, the logistics object in the first image is determined as the first logistics object located in the area of ​​the first sorting grid in the first image.

[0198] That is, the first logistics object exists in the area of ​​the first sorting grid in the first image.

[0199] The second preset level may include a range of 0.3 and 0.5, such as 0.3, 0.35, 0.4, 0.45 or 0.5, which may be set in advance according to the actual situation or according to experience. This application does not limit the specific value.

[0200] In step S305, if the second overlap degree is less than or equal to the second preset degree, it is determined that the logistics object in the first image is not the first logistics object located in the area of ​​the first sorting grid in the first image.

[0201] In addition, the process of "detecting whether there is a second logistics object in the area of ​​the first sorting grid in the second image" can refer to the process of steps S301 to S305 of "detecting whether there is a first logistics object in the area of ​​the first sorting grid in the first image" mentioned above, and will not be described in detail here.

[0202] It should be noted that, for the sake of simplicity, the method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, because according to this application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also understand that the embodiments described in the specification are all optional embodiments, and the actions involved are not necessarily required by this application.

[0203] Reference Figure 4 This diagram illustrates a structural block diagram of a device for detecting the sorting status of logistics objects according to this application. The device includes: a first acquisition module 11, used to acquire a first image and a second image sequentially captured by the same camera at preset time intervals, wherein the first image includes a first sorting slot in the sorting equipment, and the second image includes a first sorting slot in the sorting equipment; a detection module 12, used to detect whether a first logistics object exists in the area of ​​the first sorting slot in the first image, and to detect whether a second logistics object exists in the area of ​​the first sorting slot in the second image; a first determination module 13, used to determine whether the first logistics object and the second logistics object are the same if both exist in the area of ​​the first sorting slot in the first image and the area of ​​the first sorting slot in the second image; a second acquisition module 14, used to acquire a first degree of overlap between the position range of the first logistics object in the area of ​​the first sorting slot and the position range of the second logistics object in the area of ​​the first sorting slot if the first degree of overlap is greater than a first preset degree; and a second determination module 15, used to determine whether the first logistics object or the second logistics object is congested at the first sorting slot if the first degree of overlap is greater than a first preset degree.

[0204] In one optional implementation, the second acquisition module includes: a calculation unit, used to calculate a first intersection-union ratio between the position range of the first logistics object in the area of ​​the first sorting grid and the position range of the second logistics object in the area of ​​the first sorting grid; and a first acquisition unit, used to acquire a first overlap degree based on the first intersection-union ratio.

[0205] In one optional implementation, the detection module includes: a detection unit for detecting the position range of a logistics object in the first image; a second acquisition unit for acquiring the position range of a first sorting grid in the first image; a third acquisition unit for acquiring a second degree of overlap between the position range of the logistics object in the first image and the position range of the first sorting grid in the first image; and a first determination unit for determining, when the second degree of overlap is greater than a second preset degree, the logistics object in the first image as a first logistics object located in the area of ​​the first sorting grid in the first image; or, the second determination unit for determining, when the second degree of overlap is less than or equal to the second preset degree, that the logistics object in the first image is not a first logistics object located in the area of ​​the first sorting grid in the first image.

[0206] In an optional implementation, the third acquisition unit includes: a calculation subunit, used to calculate a second intersection-union ratio between the position range of the logistics object in the first image and the position range of the first sorting grid in the first image; and a first acquisition subunit, used to acquire a second overlap degree based on the second intersection-union ratio.

[0207] In one optional implementation, the second acquisition unit includes: a second acquisition subunit, used to acquire the camera identifier of the camera that acquires the first image; a third acquisition subunit, used to acquire, based on the camera identifier, the position range of the first sorting grid in the image acquired by the camera, which is recorded in advance; and a fourth acquisition subunit, used to acquire, based on the position range of the first sorting grid in the image acquired by the camera, the position range of the first sorting grid in the first image.

[0208] In an optional implementation, the third acquisition subunit is specifically used to: find the position range corresponding to the camera identifier in the correspondence between the camera identifier of the camera and the position range of the sorting grid in the image captured by the camera, and use it as the position range of the first sorting grid in the image captured by the camera.

[0209] In an optional implementation, the apparatus further includes: a third determining module, configured to determine the logistics delivery destination corresponding to the first sorting slot; a searching module, configured to search among multiple sorting slots in the sorting equipment for a second sorting slot corresponding to the logistics delivery destination, the second sorting slot being different from the first sorting slot; and a first sending module, configured to, upon finding the second sorting slot corresponding to the logistics delivery destination, send a sorting slot rejection instruction to the controller of the sorting equipment, the sorting slot rejection instruction indicating that the first sorting slot be removed from the sorting equipment used for sorting logistics objects corresponding to the logistics delivery destination. The first sorting grid is removed from the sorting slot, so that the controller unbinds the first sorting grid from the logistics delivery destination at the software level according to the sorting grid removal instruction; or, the second sending module is used to send an abnormal sorting instruction to the controller of the sorting equipment when the second sorting grid corresponding to the logistics delivery destination is not found. The abnormal sorting instruction is used to instruct the logistics object corresponding to the logistics delivery destination to be sorted into the abnormal grid, so that the controller unbinds the first sorting grid from the logistics delivery destination and binds the abnormal sorting grid to the logistics delivery destination at the software level according to the abnormal sorting instruction.

[0210] In an optional implementation, the first acquisition module includes: a fourth acquisition unit for acquiring the slope of the chute in the first sorting compartment; a fifth acquisition unit for acquiring a preset time duration applicable to the slope, wherein a gentler slope has a longer preset time duration applicable to it, and a steeper slope has a shorter preset time duration applicable to it; and a sixth acquisition unit for acquiring a first image and a second image sequentially captured by the same camera at preset time intervals applicable to the slope.

[0211] In an optional implementation, the device further includes: an update module, configured to update the number of times the first sorting slot is congested when it is determined that the first logistics object or the second logistics object is congested at the first sorting slot; a fourth determination module, configured to determine whether the updated number of times the first sorting slot is congested is greater than or equal to a preset number; a fifth determination module, configured to determine the logistics delivery destination corresponding to the first sorting slot when the updated number of times the first sorting slot is congested is greater than or equal to the preset number; and an output module, configured to output an addition prompt, the addition prompt being used to prompt the addition of a sorting slot corresponding to the logistics delivery destination in the sorting equipment.

[0212] In an optional implementation, the output module includes: a first sending unit for sending an additional prompt to a terminal used by a worker, so that the terminal used by the worker displays or plays the additional prompt; and / or, a second sending unit for sending an additional prompt to the controller of the sorting equipment, so that the controller binds the third sorting slot to the logistics delivery destination at the software level according to the additional prompt.

[0213] In an optional implementation, the device further includes a control module, configured to control a congestion indication device located outside the sorting equipment and corresponding to the first sorting grid to output a congestion indication when it is determined that the first logistics object or the second logistics object is congested at the first sorting grid.

[0214] In one optional implementation, the congestion indicator device includes an indicator light; the control module includes: a statistics unit for counting the number of logistics objects congested at the first sorting slot; a seventh acquisition unit for acquiring a pre-set flashing frequency matching the number, wherein a larger number corresponds to a higher flashing frequency, or a smaller number corresponds to a lower flashing frequency; and a control unit for controlling the indicator light located outside the sorting device and corresponding to the first sorting slot to flash at the flashing frequency.

[0215] In this application, a first image and a second image are acquired sequentially at preset time intervals using the same camera. The first image includes a first sorting slot in the sorting equipment. The second image also includes the first sorting slot in the sorting equipment. The system detects whether a first logistics object exists in the area of ​​the first sorting slot in the first image, and detects whether a second logistics object exists in the area of ​​the first sorting slot in the second image. If both the first and second logistics objects exist in the area of ​​the first sorting slot in the first image and the second sorting slot in the second image, it determines whether the first and second logistics objects are the same. If the first and second logistics objects are the same, it obtains a first degree of overlap between the position range of the first logistics object in the area of ​​the first sorting slot and the position range of the second logistics object in the area of ​​the first sorting slot. If the first degree of overlap is greater than a first preset degree, it is determined that either the first or second logistics object is congested at the first sorting slot.

[0216] The detection process for whether there is congestion at the first sorting grid in this application can be carried out without the participation of staff, which can reduce labor costs.

[0217] In addition, since no staff are involved, the inaccuracy of detection due to human physiological reasons can be overcome, thereby improving the accuracy of detecting congestion.

[0218] Secondly, this application detects congestion by using images captured by a camera, including those of the sorting grid. These images are real images containing the contents of the sorting grid. With such images, image detection technology and related techniques can be used to detect congestion, offering higher accuracy. Therefore, using real images improves the accuracy of congestion detection. Furthermore, even if the number of items congested at the first sorting grid is small (e.g., one or two), the congestion can still be detected, allowing for timely discovery of the congestion. Additionally, the images used for congestion detection can be real-time images captured by the camera, further improving the timeliness of congestion detection and enabling timely discovery of congestion.

[0219] This application also provides a non-volatile readable storage medium storing one or more modules (programs). When these modules are applied to a device, they enable the device to execute the instructions for the method steps in this application.

[0220] This application provides one or more machine-readable media storing instructions that, when executed by one or more processors, cause an electronic device to perform one or more methods as described in the above embodiments. In this application, the electronic device includes a server, a gateway, sub-devices, etc., and the sub-devices are devices such as Internet of Things (IoT) devices.

[0221] Embodiments of this disclosure can be implemented as an apparatus with any suitable hardware, firmware, software, or any combination thereof, configured as desired. This apparatus may include electronic devices such as servers (clusters) and terminal devices such as IoT devices.

[0222] Figure 5 An exemplary apparatus 1300 is schematically shown that can be used to implement the various embodiments of this application.

[0223] In one embodiment, Figure 5 An exemplary device 1300 is shown, which includes one or more processors 1302, a control module (chipset) 1304 coupled to at least one of the processors 1302, a memory 1306 coupled to the control module 1304, a non-volatile memory (NVM) / storage device 1308 coupled to the control module 1304, one or more input / output devices 1310 coupled to the control module 1304, and a network interface 1312 coupled to the control module 1304.

[0224] Processor 1302 may include one or more single-core or multi-core processors, and processor 1302 may include any combination of general-purpose processors or special-purpose processors (e.g., graphics processors, application processors, baseband processors, etc.). In some embodiments, device 1300 can function as a server device such as a gateway in the embodiments of this application.

[0225] In some embodiments, apparatus 1300 may include one or more computer-readable media (e.g., memory 1306 or NVM / storage device 1308) having instructions 1314 and one or more processors 1302 that are combined with the one or more computer-readable media and configured to execute the instructions 1314 to implement the module and thus perform the actions in this disclosure.

[0226] In one embodiment, the control module 1304 may include any suitable interface controller to provide any suitable interface to at least one of the processors 1302 and / or any suitable device or component communicating with the control module 1304.

[0227] The control module 1304 may include a memory controller module to provide an interface to the memory 1306. The memory controller module may be a hardware module, a software module, and / or a firmware module.

[0228] Memory 1306 may be used, for example, to load and store data and / or instructions 1314 for device 1300. In one embodiment, memory 1306 may include any suitable volatile memory, such as suitable DRAM. In some embodiments, memory 1306 may include double data rate quad synchronous dynamic random access memory (DDR4 SDRAM).

[0229] In one embodiment, the control module 1304 may include one or more input / output controllers to provide interfaces to the NVM / storage device 1308 and (one or more) input / output devices 1310.

[0230] For example, NVM / storage device 1308 may be used to store data and / or instructions 1314. NVM / storage device 1308 may include any suitable non-volatile memory (e.g., flash memory) and / or may include any suitable (one or more) non-volatile storage devices (e.g., one or more hard disk drives (HDDs), one or more optical disc drives (CDs), and / or one or more digital universal optical disc (DVD) drives).

[0231] NVM / storage device 1308 may include storage resources that are physically part of a device on which device 1300 is mounted, or that can be accessed by the device without needing to be part of the device. For example, NVM / storage device 1308 may be accessed via a network via one or more input / output devices 1310.

[0232] One or more input / output devices 1310 may provide an interface for device 1300 to communicate with any other suitable device. Input / output devices 1310 may include communication components, pinyin components, sensor components, etc. Network interface 1312 may provide an interface for device 1300 to communicate via one or more networks. Device 1300 may wirelessly communicate with one or more components of a wireless network according to any of one or more wireless network standards and / or protocols, such as accessing wireless networks based on communication standards, such as WiFi, 2G, 3G, 4G, 5G, etc., or combinations thereof.

[0233] In one embodiment, at least one of the processors 1302 may be logically packaged with one or more controllers (e.g., memory controller modules) of the control module 1304. In one embodiment, at least one of the processors 1302 may be logically packaged with one or more controllers of the control module 1304 to form a system-in-package (SiP). In one embodiment, at least one of the processors 1302 may be integrated with the logic of one or more controllers of the control module 1304 on the same die. In one embodiment, at least one of the processors 1302 may be integrated with the logic of one or more controllers of the control module 1304 on the same die to form a system-on-a-chip (SoC).

[0234] In various embodiments, device 1300 may be, but is not limited to, a server, desktop computing device, or mobile computing device (e.g., laptop computing device, handheld computing device, tablet computer, netbook, etc.). In various embodiments, device 1300 may have more or fewer components and / or different architectures. For example, in some embodiments, device 1300 includes one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including a touchscreen display), a non-volatile memory port, multiple antennas, a graphics chip, an application-specific integrated circuit (ASIC), and a speaker.

[0235] This application provides an electronic device, including: one or more processors; and one or more machine-readable media having instructions stored thereon, which, when executed by the one or more processors, cause the electronic device to perform one or more methods as described in this application.

[0236] As the device embodiment is basically similar to the method embodiment, the description is relatively simple. For relevant details, please refer to the description of the method embodiment.

[0237] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0238] This application describes embodiments with reference to flowchart illustrations and / or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable information processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable information processing terminal device, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0239] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable information processing terminal device to operate in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0240] These computer program instructions can also be loaded onto a computer or other programmable information processing terminal equipment, causing a series of operational steps to be performed on the computer or other programmable terminal equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable terminal equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0241] Although preferred embodiments of the present application have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including both the preferred embodiments and all changes and modifications falling within the scope of the embodiments of the present application.

[0242] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or terminal device that includes the element.

[0243] The method and apparatus for detecting the sorting status of logistics objects provided in this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A method for detecting the sorting status of logistics objects, characterized in that, The method includes: Acquire a first image and a second image sequentially captured by the same camera at preset time intervals. The first image includes the first sorting slot in the sorting device, and the second image includes the first sorting slot in the sorting device. Detect whether a first logistics object exists in the area of ​​the first sorting grid in the first image, and detect whether a second logistics object exists in the area of ​​the first sorting grid in the second image; If a first logistics object exists in the area of ​​the first sorting grid in the first image and a second logistics object exists in the area of ​​the first sorting grid in the second image, determine whether the first logistics object and the second logistics object are the same. When the first logistics object and the second logistics object are the same, calculate the first intersection-union ratio between the position range of the first logistics object in the area of ​​the first sorting grid and the position range of the second logistics object in the area of ​​the first sorting grid. The first degree of overlap between the location range of the first logistics object in the area of ​​the first sorting grid and the location range of the second logistics object in the area of ​​the first sorting grid is obtained based on the first intersection-union ratio. If the degree of overlap is greater than the first preset degree, it is determined that the first logistics object or the second logistics object is congested at the first sorting grid. Determine the logistics and delivery destination corresponding to the first sorting slot; In the sorting equipment, locate the second sorting slot corresponding to the logistics delivery destination among the multiple sorting slots. The second sorting slot is different from the first sorting slot. If the second sorting slot corresponding to the logistics delivery destination is found, a sorting slot rejection instruction is sent to the controller of the sorting equipment. The sorting slot rejection instruction is used to instruct the first sorting slot to be rejected from the sorting slot used for sorting the logistics objects corresponding to the logistics delivery destination, so that the controller can unbind the first sorting slot from the logistics delivery destination at the software level according to the sorting slot rejection instruction. The step of determining whether the first logistics object and the second logistics object are the same includes: The feature information of the first logistics object and the feature information of the second logistics object are obtained through the detection model; The similarity between the first logistics object and the second logistics object is calculated using the feature information of the first logistics object and the feature information of the second logistics object. If the similarity is greater than the preset similarity, the first logistics object and the second logistics object are determined to be the same.

2. The method according to claim 1, characterized in that, The detection of whether a first logistics object exists in the area of ​​the first sorting grid in the first image includes: Detect the location range of logistics objects in the first image; Obtain the location range of the first sorting grid in the first image; Obtain the second degree of overlap between the location range of the logistics object in the first image and the location range of the first sorting grid in the first image; If the degree of overlap is greater than the second preset degree, the logistics object in the first image is determined as the first logistics object located in the area of ​​the first sorting grid in the first image; or, If the second degree of overlap is less than or equal to the second preset degree, it is determined that the logistics object in the first image is not the first logistics object located in the area of ​​the first sorting grid in the first image.

3. The method according to claim 2, characterized in that, The second degree of overlap between the location range of the logistics object in the first image and the location range of the first sorting compartment in the first image includes: Calculate the second intersection-union ratio between the location range of the logistics object in the first image and the location range of the first sorting grid in the first image; The second degree of overlap is obtained based on the second intersection-union ratio.

4. The method according to claim 2, characterized in that, The step of obtaining the location range of the first sorting grid in the first image includes: Obtain the camera identifier of the camera that captured the first image; Based on the camera identifier, obtain the location range of the first sorting grid in the image captured by the camera, which was recorded in advance; The position range of the first sorting grid in the first image is obtained based on the position range of the first sorting grid in the image captured by the camera.

5. The method according to claim 4, characterized in that, The step of obtaining the location range of the first sorting grid in the image captured by the camera, based on the camera identifier and pre-recorded information, includes: In the correspondence between the camera identifier and the location range of the sorting grid in the image captured by the camera, find the location range corresponding to the camera identifier and use it as the location range of the first sorting grid in the image captured by the camera.

6. The method according to claim 1, characterized in that, The method further includes: If the second sorting slot corresponding to the logistics delivery destination is not found, an abnormal sorting instruction is sent to the controller of the sorting equipment. The abnormal sorting instruction is used to instruct the logistics object corresponding to the logistics delivery destination to be sorted to the abnormal slot, so that the controller can unbind the first sorting slot from the logistics delivery destination and bind the abnormal sorting slot to the logistics delivery destination at the software level according to the abnormal sorting instruction.

7. The method according to claim 1, characterized in that, The acquisition of the first and second images captured sequentially at preset time intervals by the same camera includes: Obtain the slope of the chute in the first sorting compartment; Obtain a preset time applicable to the slope. The gentler the slope, the longer the preset time applicable; the steeper the slope, the shorter the preset time applicable. First and second images are acquired sequentially by the same camera at a preset time interval suitable for the slope.

8. The method according to claim 1, characterized in that, The method further includes: If it is determined that the first or second logistics object is congested at the first sorting gate, update the number of times the first sorting gate is congested. Determine whether the updated number of times the congestion occurs at the first sorting grid is greater than or equal to the preset number; If the number of updated congestion events at the first sorting grid is greater than or equal to the preset number, determine the logistics delivery destination corresponding to the first sorting grid. The output includes a prompt to indicate when to add a sorting slot corresponding to the logistics delivery destination in the sorting equipment.

9. The method according to claim 8, characterized in that, The output now includes prompts, including: Send an addition prompt to the terminal used by the staff so that the terminal used by the staff can display or play the addition prompt; And / or, Send an addition prompt to the controller of the sorting equipment so that the controller can bind the third sorting compartment to the logistics delivery destination at the software level based on the addition prompt.

10. The method according to claim 1, characterized in that, The method further includes: If it is determined that the first or second logistics object is congested at the first sorting slot, the congestion indicator device located outside the sorting equipment and corresponding to the first sorting slot is controlled to output a congestion indicator.

11. The method according to claim 10, characterized in that, Congestion indication devices include indicator lights; The control of the congestion indication device located outside the sorting equipment and corresponding to the first sorting slot to output a congestion indication includes: Count the number of logistics items that are congested at the first sorting grid; Obtain a pre-set flashing frequency that matches the quantity, wherein a larger quantity corresponds to a higher flashing frequency, or a smaller quantity corresponds to a lower flashing frequency; The indicator light corresponding to the first sorting compartment located outside the sorting equipment is controlled to flash at the stated flashing frequency.

12. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, The processor executes the program to implement the method as claimed in any one of claims 1 to 11.

13. A computer-readable storage medium, characterized in that, A computer-readable storage medium stores a computer program that, when executed by a processor, implements the method as claimed in any one of claims 1 to 11.

Images