Express delivery full-process monitoring method and apparatus, electronic device, and storage medium
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-06-30
- Publication Date
- 2026-08-13
Smart Images
Figure CN2025105985_13082026_PF_FP_ABST
Abstract
Description
Methods, devices, electronic equipment, and storage media for full-process monitoring of express delivery
[0001] This application claims priority to Chinese Patent Application No. 202510145792.X, filed on February 10, 2025, the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to the field of express delivery technology, such as a method, device, electronic device, and storage medium for monitoring the entire express delivery process. Background Technology
[0003] In the express delivery industry, issues such as misdelivery, loss, delays, damage, and theft of packages not only severely impact customer experience but also place enormous operational pressure on companies. While conventional monitoring technologies generate substantial amounts of data during the transit and distribution of packages, scanning devices, monitoring systems, and other related equipment operate relatively independently, lacking close correlation and coordination. This makes it difficult to quickly pinpoint specific monitoring times, and the complexity of monitoring hosts and wiring further complicates the process. From searching and downloading surveillance videos to editing and uploading, each step requires significant manual intervention, resulting in low efficiency in evidence collection and verification. Summary of the Invention
[0004] This application provides a method, device, electronic device, and storage medium for monitoring the entire express delivery process, in order to solve the problem of low efficiency in the process of collecting and verifying express delivery evidence.
[0005] According to one aspect of this application, a method for monitoring the entire express delivery process is provided, comprising:
[0006] Determine the type and identifier of the target courier;
[0007] The target mapping trajectory is matched from the candidate mapping trajectories according to the target express type; the candidate mapping trajectory is used to represent the relationship between the express type and the mapping trajectory; the mapping trajectory is used to represent the sorting route and express processing device on the sorting route corresponding to different express types; the express processing device is used to assist in the sorting and transportation of expresses and to record the sorting and transportation process of expresses.
[0008] The target processing device is matched according to the target mapping trajectory, and the target video data is obtained from the target processing device according to the target express identification; the target video data is video data of target express sorting and transportation captured by the target device.
[0009] The target express delivery is tracked based on the target video data.
[0010] According to another aspect of this application, a device for monitoring the entire express delivery process is provided, comprising:
[0011] The type determination module is set to determine the target courier type and target courier identifier;
[0012] The target mapping trajectory determination module is configured to match the corresponding target mapping trajectory from the candidate mapping trajectories according to the target express delivery type; the candidate mapping trajectory is used to represent the relationship between the express delivery type and the mapping trajectory; the mapping trajectory is used to represent the sorting route and the express delivery processing device on the sorting route corresponding to different express delivery types; the express delivery processing device is configured to assist in the sorting and transportation of express delivery and to record the sorting and transportation process of express delivery.
[0013] The target video data determination module is configured to match the target processing device according to the target mapping trajectory and obtain target video data from the target processing device according to the target express identification; the target video data is video data of target express sorting and transportation captured by the target device.
[0014] The tracking module is configured to track the target express delivery based on the target video data.
[0015] According to another aspect of this application, an electronic device is provided, the electronic device comprising:
[0016] At least one processor; and
[0017] A memory communicatively connected to the at least one processor; wherein,
[0018] The memory stores a computer program that can be executed by the at least one processor, which enables the at least one processor to perform the express delivery end-to-end monitoring method according to any embodiment of this application.
[0019] According to another aspect of this application, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a processor to execute and implement the express delivery full-process monitoring method of any embodiment of this application.
[0020] The technical solution of this application embodiment determines the target express delivery type and target express delivery identifier; matches the corresponding target mapping trajectory from candidate mapping trajectories according to the target express delivery type, and the construction of candidate trajectories provides key technical support for subsequent video data extraction, event tracing, and monitoring analysis; matches the target processing device according to the target mapping trajectory, and obtains target video data from the target processing device according to the target express delivery identifier, which can improve the accuracy of target express delivery location; tracks the target express delivery based on the target video data, which can help users submit accurate video evidence with one click, providing strong support for express delivery anomaly handling and liability determination. This method can match the target video data in the corresponding target processing device through the target mapping trajectory, and track the target express delivery based on the target video data, which not only significantly improves the speed and accuracy of express delivery anomaly handling, but also optimizes the workflow, reduces the cost of manual intervention, and greatly improves transportation efficiency.
[0021] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this application, nor is it intended to limit the scope of this application. Other features of this application will become readily apparent from the following description. Attached Figure Description
[0022] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0023] Figure 1 is a flowchart of a method for monitoring the entire express delivery process according to an embodiment of this application;
[0024] Figure 2 shows a mapping trajectory of a large express delivery provided in an embodiment of this application;
[0025] Figure 3 shows a mapping trajectory of a small parcel express delivery provided in an embodiment of this application;
[0026] Figure 4 shows a display interface provided in an embodiment of this application;
[0027] Figure 5 is a flowchart of the full-chain traceability and maintenance process for express delivery provided in an embodiment of this application;
[0028] Figure 6 illustrates a target express delivery traceability process provided in an embodiment of this application;
[0029] Figure 7 illustrates a traceability process for a large-item express delivery as provided in an embodiment of this application.
[0030] Figure 8 illustrates a traceability process for a small parcel delivery as provided in an embodiment of this application.
[0031] Figure 9 is a timing diagram of a location and device binding relationship provided in an embodiment of this application;
[0032] Figure 10 is a structural schematic diagram of a full-process express delivery monitoring device provided in an embodiment of this application;
[0033] Figure 11 is a schematic diagram of the structure of an electronic device for implementing the express delivery full-process monitoring method according to an embodiment of this application. Detailed Implementation
[0034] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.
[0035] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0036] Figure 1 is a flowchart of a method for monitoring the entire express delivery process according to an embodiment of this application. This embodiment is applicable to tracking and locating the express delivery sorting process. This method can be executed by an express delivery full-process monitoring device, which can be implemented in hardware and / or software. The express delivery full-process monitoring device can be configured in any electronic device with network communication capabilities. As shown in Figure 1, the method includes:
[0037] S110. Determine the target courier type and target courier identification.
[0038] The target courier type can be either large parcel courier or small parcel courier.
[0039] Furthermore, based on the type of packaging, express delivery can be divided into: bagged express delivery, letter express delivery, and boxed express delivery.
[0040] Specifically, when the target package is transported to the target site, the scanning device configured in the warehouse area scans the target package to obtain the target package identifier; the camera configured on the scanning device takes a picture of the target package, and the type of the target package is determined based on the captured image.
[0041] Furthermore, the type of express delivery is determined based on the captured images: the captured images are identified and segmented to obtain the target express delivery image, and edge features are extracted from the target express delivery image. The type of the target express delivery is determined based on the length of the extracted edge feature lines. That is, if the length is greater than a first preset length, the target express delivery is considered a large express delivery; if the length is less than the first preset length, the target express delivery is considered a small express delivery. The packaging type of the target express delivery is determined based on the shape reflected by the edge feature lines.
[0042] S120. Match the corresponding target mapping trajectory from the candidate mapping trajectories according to the target express delivery type.
[0043] Among them, the candidate mapping trajectory is used to characterize the relationship between the express delivery type and the mapping trajectory.
[0044] Among them, the mapping trajectory is used to represent the sorting routes corresponding to different express delivery types and the express delivery processing devices on the sorting routes.
[0045] Further, let's take large and small parcel deliveries as examples. As shown in Figure 2, the mapping trajectory of large parcels is as follows: sorting of large parcels is completed only in the unloading area. The corresponding sorting route is: unloading at the unloading port, transmitting data to the line master data, and then transporting to the loading port for loading via a swing wheel. There are two loading ports, corresponding to the S001 and S002 line master data respectively. The line refers to the conveyor belt; the line master data refers to the main body that transmits the parcels.
[0046] The express processing equipment installed on the large-item express sorting route includes: scanning equipment, line master data, shooting equipment, and balance wheel.
[0047] The express delivery processing device is used to assist in the sorting and transportation of express packages and to record the sorting and transportation process.
[0048] Furthermore, as shown in Figure 3, the mapping trajectory of small parcels is as follows. It can be seen from the figure that the sorting of small parcels needs to be completed jointly by the unloading area, the sorting area, and the loading area. The corresponding sorting route is as follows: the parcels are unloaded at the unloading port and scanned as a whole package, which is then transmitted to the main data of the line for transportation. The parcels are transported to the second-floor sorting area via the packing line, unpacked in the unpacking area, and then sorted in a loop via the circulation line. After sorting, the parcels are transported to the loading area via the spiral chute. The loading area weighs the parcels using a dynamic scale and then loads them onto the vehicle using a swing wheel.
[0049] The parcel processing equipment installed on the small parcel sorting route includes: scanning equipment, line master data, shooting equipment, balance wheel and dynamic scale.
[0050] Specifically, based on the target express delivery type, a target mapping trajectory corresponding to the target express delivery type is matched from the candidate mapping trajectories.
[0051] For example, if the target express delivery type is large item express delivery, then the large item express delivery mapping trajectory is matched as the target mapping trajectory.
[0052] S130. Match the target processing device according to the target mapping trajectory, and obtain the target video data from the target processing device according to the target express identification.
[0053] Among them, the target video data is the video data of the target express delivery sorting and transportation captured by the target device.
[0054] Specifically, the target processing device contained in the target mapping trajectory is retrieved; the scanning time is obtained from the scanning device based on the target express identification, and the video data after the scanning time is obtained from the shooting device as the target video data.
[0055] The above steps match the corresponding flow trajectory and sorting operation type based on the events triggered by package scanning, generating a real-time monitoring mapping table between events and site locations. By combining the order of event occurrence and site flow rules, the accuracy and real-time nature of target video data acquisition are ensured, while also supporting high-concurrency traceability data requests, meeting the needs of efficient processing in express delivery operations.
[0056] S140. Track the target express delivery based on the target video data.
[0057] Specifically, the obtained target video data is sliced to obtain several target express delivery images, and the target express delivery images are then used for target express delivery identification, thereby enabling the tracking of the target express delivery.
[0058] Furthermore, as shown in Figure 4, the display interface shows the transportation status of the express delivery at various stages during different time periods.
[0059] For example, as shown in Figure 5, the traceability query node is used to obtain the tracking number of the target express delivery, i.e., the target express delivery identifier; the public service node is used to determine the scanning trajectory, i.e., the target mapping trajectory; the park-line node is used to determine the corresponding target processing device and its location information based on the target mapping trajectory, where the target processing device is a scanning device, a shooting device, an unloading line, or a loading line; the video data of the target express delivery obtained from the target processing device is displayed on the display interface of the park-monitoring node; and the target video data is transferred and keyframes are captured through the park-transfer node; the traceability-evidence node provides evidence based on the obtained video data and keyframe images.
[0060] For example, as shown in Figures 6, 7, and 8, the monitoring process includes: operations, ticket tracing system, viewing video columns, Qimen system, master data system, routing system, and trajectory center.
[0061] The operations node is used to view the video list (waybill number, center).
[0062] The ticket tracking system node is used to view the video list (waybill number, center code).
[0063] Among them, the video list node is used to view the scan trajectory list of waybills (waybill number); calculate the size of packages and the arrival and departure of packages; parse the last arrival and last departure of the current center; and determine whether it is a large or small package.
[0064] The scan trajectory list includes: order number, scan time, scan site, scan equipment type, equipment SN, sorting line number, next station id, next station code, current node sitecode, current node siteid, grid code, package number, scan type, platform code (the platform code is generated when the scanner is used), and line number (the loading line number is generated when the item is scanned).
[0065] Further, the process of calculating large and small items and dispatched items is as follows: 1) Parsing large and small items: Determine if all devices are scanning devices. If not, it is a small item, and the parsing ends; retrieve the location list of all devices; traverse the scan, fast scan, and dynamic scale lists to match whether the device is bound to an area or platform. If a match is found, it is a large item, and the parsing ends; traverse the scan list to determine if the scan record has a platform code. If a match is found, it is a large item, and the parsing ends. If no match is found according to the above rules, it is a small item. 2) Parsing whether dispatched items exist: Obtain the attribute information of whether the platform is a loading platform or an unloading platform based on the platform and platform code in all locations; group according to the platform attribute list to determine whether dispatched items exist; reverse match the scan trajectory from the platform to the device to determine whether it is a dispatched item or a dispatched item.
[0066] Further, the system determines whether the target package is a large or small item. If it is a large item, the processing flow is shown in Figure 7. It checks if the package has arrived. If so, it obtains the large item arrival traceability monitoring list (unloading equipment SN). If no package has arrived, it parses the previous station's scan records to obtain the large item arrival traceability monitoring list (previous station sitecode, dispatch scan time). The unloading record includes: one record per unloading, previous station code, unloading center code, unloading platform code, and unloading completion time. Further, it determines whether a shipment has been dispatched. If a shipment has been dispatched, it checks whether the shipment scan has a loading line number. That is, the operation domain will bind the loading line number that the swing wheel has swung down to during the shipment scan. If a line number exists, the large shipment dispatch traceability monitoring list (loading line number) is obtained. If no line number exists, the next station of the shipment is parsed. The next station parsing rule is: prioritize the dispatch record. If no dispatch record exists, scan the record group and then parse the next station. After parsing, it determines whether there is a next station. If there is, the large shipment dispatch traceability monitoring list (next station of the shipment) is obtained. If not, the same logic as when there is no shipment is followed, and the route is matched to the next station.
[0067] Furthermore, if no shipment is dispatched, the next station (order number, current center sitecode) is matched and the large shipment dispatch traceability monitoring list (next station of dispatch) is obtained.
[0068] The process of obtaining the large-item arrival traceability monitoring list (unloading equipment SN) includes: finding the unloading platform based on the unloading equipment SN; obtaining the unloading platform monitoring list (unloading line number); obtaining the unloading line (unloading platform code); and obtaining the unloading line monitoring list (unloading line number). Platform monitoring is arranged in chronological order of addition time; unloading line monitoring is arranged manually.
[0069] The rules for parsing the previous station include: 1) First, group the data according to the site_code of the scanned nodes, and take the time of the first scanned record for each group, and then sort them in order; 2) Match the data according to the site_code of the current center, and match the earliest record; 3) If a match is found, take the previous group, and the sitecode of the previous group is the previous station; 4) If no match is found, take the last record of the entire group and take its sitecode as the previous station.
[0070] Furthermore, parsing the previous station by scanning records includes: obtaining the unloading platform closest to the time (previous station), obtaining the unloading platform monitoring list (unloading platform number), obtaining the unloading line (unloading platform code), and obtaining the unloading line monitoring list (unloading line number).
[0071] Furthermore, the matching logic for the platform is as follows: the mail scanning may be before or after this time, so the minimum time interval between the completion of each batch is taken.
[0072] The traceability process for obtaining the large shipment traceability monitoring list (loading line body number) includes: matching the platform according to the loading line body number; obtaining the loading platform monitoring list (loading platform code) and obtaining the loading line body monitoring list (loading line body number).
[0073] The process of obtaining the large shipment traceability monitoring list (next station of shipment) includes: obtaining the loading platform code (next station of shipment); obtaining the loading platform monitoring list (loading platform code); and obtaining the loading line monitoring list (loading platform code).
[0074] The process of obtaining the large shipment traceability monitoring list (next station of shipment) includes: obtaining the loading platform code (next station of shipment); obtaining the loading platform monitoring list (loading platform code); and obtaining the loading line monitoring list (loading platform code).
[0075] Furthermore, if it is a small item, the processing flow is as shown in Figure 8. It is determined whether the previous item scan exists. If it does not exist, the small item traceability monitoring list (small item sorting device SN) is obtained.
[0076] The process of obtaining the small item traceability monitoring list (small item sorting equipment SN) includes: obtaining the associated equipment line (small item sorting machine); parsing the line tree, i.e., parsing and linking through the preceding lines; batch obtaining all monitoring data in the line tree; attaching the monitoring data to the lines in the line tree; parsing the predicted monitoring time of all preceding lines associated with the small item sorting machine based on the item scanning time; parsing the grid monitoring list and attaching it to the end of the tree; obtaining the packaging time based on the waybill; parsing the packaging monitoring list and attaching it to the end of the tree; parsing the platform code associated with the first line; obtaining the platform monitoring list (unloading platform code); and supplementing the loading platform monitoring data to the beginning of the line tree.
[0077] Optionally, at least one method for determining the candidate mapping trajectory includes steps A1-A4:
[0078] Step A1: Obtain basic building information for the target site.
[0079] Among them, basic building information is used to characterize the type and location of basic buildings.
[0080] Specifically, information on buildings, floors, areas, units (platforms), and lines within the target site is obtained as basic building information.
[0081] Furthermore, the areas and units are matched with barcodes and QR codes.
[0082] The above steps enable the construction of basic building information to achieve layer-by-layer refinement from the park level to the building itself, then to the floor, area, unit, and line, ensuring the comprehensiveness and accuracy of the data. This also supports the access of IoT devices, providing a solid foundation of data for the traceability and scheduling of the entire express delivery process. Furthermore, it improves the operability of site management and optimization.
[0083] Step A2: Perform path planning on the basic building information to obtain the target path information.
[0084] Specifically, based on the distance between basic building information and the distribution of buildings, shortest path planning is performed to obtain transportation route information for different types of express delivery, and the obtained transportation route information is used as the target route information.
[0085] Step A3: Build a courier processing device based on the target route information and courier transportation needs.
[0086] Among them, express delivery demand refers to information on the transmission and sorting devices required by different express delivery companies.
[0087] Specifically, based on the target route information and express delivery needs, express processing devices are installed on the target route, and the location information of the installed express processing devices is obtained.
[0088] For example, the scanning device is constructed by: assigning specific location information to the fixed scanning device; and embedding the scanning process into the mobile device.
[0089] The above steps, including the assignment of location information, ensure that the data generated by both fixed scanning devices and mobile devices automatically includes location information, achieving efficient information collection without adding extra operations or costs.
[0090] For example, the camera is configured to: assign detailed location information (such as area or unit) to the camera connected to the cloud platform, and mark the specific attributes of the monitoring (such as the camera facing the equipment, the interior of the carriage or other key points) to ensure the accurate location of the monitoring data.
[0091] For example, the construction of the line is as follows: record the data of the belt conveyor in the site, include it in the system management, and at the same time, provide each line with corresponding monitoring location information and operation sequence.
[0092] Step A4: Synchronize the number and location information of the express processing device, and establish the correspondence between it and the basic building information and express type to obtain the candidate mapping trajectory.
[0093] Specifically, the express delivery processing device number and the location information of the express delivery processing device are matched, and the matching information is matched with the basic building information and the type of express delivery to obtain the candidate mapping trajectory.
[0094] For example, relying on cloud services, all monitoring devices in the sorting center are connected to the system, and detailed location information, including the area, orientation, and functional attributes, is configured for each monitoring channel in batches. At the same time, tags are set according to the device type (such as fixed cameras, PTZ cameras, etc.) and the purpose of the deployment (such as loss prevention monitoring, operation monitoring, etc.) to build a mapping relationship between the shooting devices and the site location information.
[0095] Furthermore, unified location information is provided for various scanning devices on the site (such as barcode scanners, RFID devices, etc.), and the devices are bound to the operating units and areas according to the location information to obtain the mapping relationship between the scanning devices and the site location.
[0096] Furthermore, based on the location information and target path information, the mapping relationship between the shooting device and the site location is fused with the mapping relationship between the scanning device and the site location to obtain candidate mapping relationships.
[0097] Furthermore, the candidate mapping relationships are also updated based on changes in the basic building information.
[0098] For example, as shown in Figure 9, based on the triggered message queue (mq) data consumption, i.e., basic building change information, the processing of location and equipment binding relationship change events first parses the unit change type and area change type. The change type includes: no change and change, with change further divided into: add, unbind, and change. The system determines whether a platform or area has generated a change based on the change type. If a platform or area change occurs, it processes the change according to its type: if the change type is add, it retrieves the platform or area associated line list, iterates through the list, and adds the associated equipment; if the change type is unbind, it retrieves the platform or area associated line list, iterates through the list, and unbinds the associated equipment; if the change type is change and the change object is a unit, it retrieves the source platform and target platform associated line lists, iterates through the source platform associated line list and unbinds the associated equipment, and iterates through the target platform associated line list and adds the associated equipment. If the change type is "change" and the change object is "region", then determine whether the source region is an automation region. If so, obtain the list of production lines under the region, traverse the production line list, and unbind the associated devices of the production lines. Determine whether the target region is an automation region. If so, obtain the list of production lines under the region, traverse the production line list, and add associated devices of the production lines.
[0099] The above steps, in constructing candidate mapping trajectories, provide key technical support for subsequent video data extraction, event tracing, and monitoring analysis, while also improving equipment management efficiency and supporting express delivery tracking, anomaly handling, and data backtracking in complex scenarios.
[0100] Optionally, path planning can be performed on the basic building information to obtain the target path information, including steps B1-B2:
[0101] Step B1: Divide the basic buildings according to the type of express delivery and basic building information to obtain reference basic buildings.
[0102] Specifically, the basic buildings are divided according to the type of express delivery and the functions they perform, resulting in reference basic buildings.
[0103] For example, as shown in Figures 2 and 3, the sorting and distribution of large and small parcels require different areas to work together. Therefore, the required area size for each area is different. Thus, by planning the basic buildings according to the type of parcel and the basic building information, the land resources of the target site can be fully utilized.
[0104] Step B2: Plan the transportation route based on the distribution and orientation of the reference basic buildings to obtain the target route information.
[0105] Specifically, based on the distribution and location of reference buildings and the distance between them, the shortest path is planned for the express delivery route to obtain the target path information.
[0106] Optionally, the target package can be tracked based on the target video data, including steps C1-C4:
[0107] Step C1: Randomly extract at least two first target images from the target video data.
[0108] Specifically, random frames are extracted from the target video data to obtain at least two images of the first target.
[0109] Step C2: Perform target express delivery recognition on at least two first target images to obtain at least two target location boxes.
[0110] Specifically, image recognition is performed on at least two first target images to identify the target express delivery, and the location of the target express delivery is marked with a bounding box to obtain at least two target location boxes.
[0111] Step C3: Obtain at least two first position information of at least two target location boxes in at least two first target images.
[0112] Specifically, the coordinate information of the target location box is obtained based on its position in the first target image, and is used as the first location information.
[0113] Step C4: Determine the stagnation status information based on at least two first location information.
[0114] Among them, the delay status information is used to characterize whether the target express delivery has been delayed.
[0115] Specifically, at least two first location information are compared. If the obtained location difference is less than a preset difference, it is considered that the target package is delayed; if the obtained location difference is greater than the preset difference, it is considered that the target package is not delayed.
[0116] Furthermore, after a delay occurs, the frame number information corresponding to the first target image where the delay occurs is obtained, the corresponding time point is obtained based on the frame number information, the corresponding shooting device number is determined based on the obtained time point information, the location information is determined based on the shooting device number, and the location information and delay status are displayed on the warning interface to issue a warning.
[0117] Optionally, tracking the target package based on the target video data also includes steps D1-D4:
[0118] Step D1: Randomly extract the target video data to obtain the second target image.
[0119] Specifically, a target frame is randomly selected to extract the target video data, resulting in a second target image.
[0120] Step D2: Compare the second target image with the reference image.
[0121] The reference image is the one taken when the target package enters the first scanning device.
[0122] Specifically, features are extracted from the second target image and the reference image, and the obtained features are compared to obtain the image difference.
[0123] Step D3: If the difference between the second target image and the reference image is greater than a preset threshold, the target express delivery status is damaged, and a damage warning is issued.
[0124] Specifically, if the difference between the second target image and the reference image is greater than a preset threshold, it indicates that the target package is damaged. The status of the target package will then be changed to "damaged" and a damage warning will be issued, which means that the order number of the damaged target package will be displayed on the display interface.
[0125] Step D4: If the difference between the second target image and the reference image is less than a preset threshold, then the target express delivery status is "express delivery complete".
[0126] Specifically, if the difference between the second target image and the reference image is less than a preset threshold, it indicates that the target package is not damaged. The target package status is then changed to "package intact," and the corresponding target video is captured and saved for subsequent inspection.
[0127] Optionally, tracking the target package based on the target video data also includes steps E1-E5:
[0128] Step E1: Randomly extract the target video data to obtain the third target image.
[0129] Specifically, random frames are extracted from the target video data, and the extracted images are used as the third target image.
[0130] Step E2: Recognize the third target image to obtain the target recognition result.
[0131] Among them, the target identification result is used to characterize whether the target express delivery exists.
[0132] Specifically, the third target image is identified to determine whether the target express delivery exists in the third target image, and a target identification result is generated based on the obtained existence result.
[0133] Step E3: If the target identification result is that it exists, continue tracking.
[0134] Specifically, if the target recognition result indicates that the target package exists, other frames of images are selected for tracking. If, after a preset number of recognitions, it is found that the target package has not disappeared, the result is output.
[0135] Step E4: If the target identification result is that it does not exist, then determine the target's disappearance location and disappearance time based on the target video data.
[0136] Specifically, if the target recognition result is that the target package does not exist, then based on the frame number information of the third target image of the non-existent target package, the time and location of the target package disappearance are determined according to the frame number information and video data within a preset range of the frame number, and the obtained time and location information are used as the target disappearance location and target disappearance time.
[0137] Step E5: Track the target package based on the location and time of its disappearance.
[0138] Specifically, a camera is positioned within a preset range based on the location where the target disappears; video data collected by the selected camera is extracted based on the time the target disappears; and the extracted video data is used to track the target express delivery.
[0139] Optionally, the target package can be tracked based on its disappearance location and time, including steps F1-F3:
[0140] Step F1: Obtain the identification number of the shooting device within the preset reference area based on the location where the target disappears.
[0141] Specifically, based on the location where the target disappears, the location information and number information of the shooting device within the preset reference area are searched from the candidate mapping relationship.
[0142] Step F2: Retrieve reference video data based on the number information, and extract the reference video data according to the target disappearance time to obtain the video data to be confirmed.
[0143] Specifically, reference video data is retrieved from the shooting device based on the obtained number information, and the reference video data is extracted according to the target disappearance time to obtain the video data between the target disappearance time and the time when the target express was found to have disappeared, which is used as the video data to be confirmed.
[0144] Step F3: Determine the offset status information based on the video data to be confirmed.
[0145] Among them, the offset status information is used to characterize whether the target express delivery has deviated from its path.
[0146] Specifically, the target package is tracked within the confirmed video data. If the target package is found, it indicates that its transmission path has deviated. If not found, further investigation is conducted to determine if the target package has left the transport line, and the line at the location where the target disappeared is investigated.
[0147] The technical solution of this embodiment determines the target express delivery type and target express delivery identifier; matches the corresponding target mapping trajectory from candidate mapping trajectories based on the target express delivery type. The construction of candidate trajectories provides a key technical basis for subsequent video data extraction, event tracing, and monitoring analysis; matches the target processing device based on the target mapping trajectory and obtains target video data from the target processing device based on the target express delivery identifier, which can improve the accuracy of target express delivery location; and tracks the target express delivery based on the target video data, which can help users submit accurate video evidence with one click, providing strong support for express delivery anomaly handling and liability determination. This method can match the target video data in the corresponding target processing device through the target mapping trajectory and track the target express delivery based on the target video data. It not only significantly improves the speed and accuracy of express delivery anomaly handling but also optimizes the workflow, reduces manual intervention costs, and greatly improves transportation efficiency.
[0148] Figure 10 is a schematic diagram of a full-process monitoring device for express delivery provided in an embodiment of this application. This embodiment is applicable to tracking and locating the express delivery sorting process. The full-process monitoring device can be implemented in hardware and / or software, and can be configured in any electronic device with network communication capabilities. As shown in Figure 10, the device includes: a type determination module 210, a target mapping trajectory determination module 220, a target video data determination module 230, and a tracking module 240, wherein:
[0149] Type determination module 210: set to determine the target express delivery type and target express delivery identifier;
[0150] Target mapping trajectory determination module 220: configured to match the corresponding target mapping trajectory from the candidate mapping trajectories according to the target express type; the candidate mapping trajectory is used to represent the relationship between the express type and the mapping trajectory; the mapping trajectory is used to represent the sorting route corresponding to different express types and the express processing device on the sorting route; the express processing device is configured to assist in the sorting and transportation of express and to record the sorting and transportation process of express.
[0151] Target video data determination module 230: configured to match the target processing device according to the target mapping trajectory, and obtain the target video data from the target processing device according to the target express identification; the target video data is the video data of the target express sorting and transportation captured by the target device;
[0152] Tracking module 240: Set to track the target express delivery based on the target video data.
[0153] Optionally, the target mapping trajectory determination module 220 includes:
[0154] Basic building information determination unit: set to acquire basic building information of the target site; basic building information is used to characterize the type and location of basic buildings;
[0155] Target path information determination unit: This unit is configured to perform path planning on basic building information to obtain target path information;
[0156] Express delivery processing device construction unit: set up to build express delivery processing devices based on target route information and express delivery transportation needs; express delivery transportation needs include information on the transmission devices and sorting devices required for different express deliveries;
[0157] Candidate mapping trajectory determination unit: It is set to synchronize the number and location information of the express processing device, and construct the correspondence between it and the basic building information and express type to obtain the candidate mapping trajectory.
[0158] Optionally, the target path information determination unit includes:
[0159] Determine sub-units based on reference foundation buildings: This is set up to divide the foundation buildings according to the delivery type and foundation building information to obtain reference foundation buildings;
[0160] Target path information determination sub-unit: This is set to plan transportation routes based on the distribution and orientation of reference infrastructure buildings to obtain target path information.
[0161] Optional, the tracking module 240 includes:
[0162] First target image determination unit: configured to randomly extract at least two first target images from the target video data;
[0163] Target location bounding box determination unit: configured to perform target express delivery recognition on at least two first target images to obtain at least two target location bounding boxes;
[0164] First location information determination unit: configured to acquire at least two first location information of at least two target location boxes in at least two first target images;
[0165] Detention status information determination unit: configured to determine detention status information based on at least two first location information; detention status information is used to characterize whether the target express delivery has been detained.
[0166] Optionally, the tracking module 240 also includes:
[0167] Second target image determination unit: configured to randomly extract target video data to obtain a second target image;
[0168] The comparison unit is configured to compare the second target image with a reference image; the reference image is the image captured when the target express enters the first scanning device.
[0169] Damage warning unit: If the difference between the second target image and the reference image is greater than a preset threshold, the target express delivery status is considered to be damaged, and a damage warning is issued.
[0170] The package integrity status determination unit is set to determine that if the difference between the second target image and the reference image is less than a preset threshold, the target package status is "package integrity".
[0171] Optionally, the tracking module 240 also includes:
[0172] Third target image determination unit: configured to randomly extract target video data to obtain a third target image;
[0173] Target recognition result determination unit: configured to recognize a third target image and obtain a target recognition result; the target recognition result is used to characterize whether the target express delivery exists.
[0174] Tracking determination unit: If the target identification result is that it exists, then the tracking continues;
[0175] Disappearance information determination unit: If the target recognition result is that the target does not exist, then the target disappearance location and the target disappearance time are determined based on the target video data;
[0176] Tracking Unit: Set to track the target package based on the location and time of the target's disappearance.
[0177] Optional, the tracking unit includes:
[0178] Numbering information determination unit: set to obtain the numbering information of the shooting devices within a preset reference area based on the location where the target disappears;
[0179] The unit for determining video data to be confirmed is set to retrieve reference video data based on the number information and extract the reference video data based on the target disappearance time to obtain the video data to be confirmed.
[0180] Offset status information determination unit: set to determine offset status information based on the video data to be confirmed; offset status information is used to characterize whether the target express has deviated from its path.
[0181] The express delivery full-process monitoring device provided in this application embodiment can execute the express delivery full-process monitoring method provided in any of the above embodiments of this application, and has the corresponding functions and beneficial effects of executing the express delivery full-process monitoring method. For details, please refer to the relevant operations of the express delivery full-process monitoring method in the foregoing embodiments.
[0182] Figure 11 is a schematic diagram of the structure of an electronic device implementing the express delivery end-to-end monitoring method according to an embodiment of this application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or claimed herein.
[0183] As shown in Figure 11, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer programs stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 can also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.
[0184] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.
[0185] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as the express delivery end-to-end monitoring method.
[0186] In some embodiments, the express delivery end-to-end monitoring method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the express delivery end-to-end monitoring method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the express delivery end-to-end monitoring method by any other suitable means (e.g., by means of firmware).
[0187] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), hybrid programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.
[0188] Computer programs used to implement the methods of this application may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.
[0189] In the context of this application, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0190] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).
[0191] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.
[0192] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.
[0193] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this application can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this application can be achieved, and this is not limited herein.
Claims
1. A method for monitoring the entire express delivery process, comprising: Determine the type and identifier of the target courier; Match the corresponding target mapping trajectory from the candidate mapping trajectories according to the target express delivery type; The candidate mapping trajectory is used to characterize the relationship between express delivery type and mapping trajectory; The mapping trajectory is used to characterize the sorting routes corresponding to different express delivery types and the express delivery processing devices on the sorting routes; The express delivery processing device is used to assist in the sorting and transportation of express packages and to record the sorting and transportation process. The target processing device is matched according to the target mapping trajectory, and the target video data is obtained from the target processing device according to the target express identification. The target video data is video data of the target express delivery sorting and transportation captured by the target device. The target express delivery is tracked based on the target video data.
2. The method of claim 1, wherein, At least one method for determining candidate mapping trajectories includes: Obtain basic building information of the target site; the basic building information is used to characterize the type and location of the basic buildings; Path planning is performed on the basic building information to obtain the target path information; An express delivery processing device is constructed based on the target route information and express delivery transportation requirements; the express delivery transportation requirements are information on the transmission and sorting devices required for different express deliveries. The number and location information of the express delivery processing device are synchronized, and a correspondence between the device and the basic building information and the type of express delivery is established to obtain candidate mapping trajectories.
3. The method according to claim 2, wherein, The step of performing path planning on the basic building information to obtain target path information includes: The basic buildings are divided according to the type of express delivery and basic building information to obtain reference basic buildings; Transportation routes are planned based on the distribution and orientation of reference infrastructure to obtain target route information.
4. The method according to claim 1, wherein, The step of tracking the target express delivery based on the target video data includes: Randomly extract at least two first target images from the target video data; Target express delivery recognition is performed on the at least two first target images to obtain at least two target location boxes; Obtain at least two first position information of the at least two target location boxes in at least two first target images; The stagnation status information is determined based on the at least two first location information; the stagnation status information is used to characterize whether the target express delivery has been delayed.
5. The method according to claim 1, wherein, The step of tracking the target express delivery based on the target video data further includes: The second target image is obtained by randomly cropping the target video data. The second target image is compared with a reference image, which is an image taken when the target express delivery enters the first scanning device. If the difference between the second target image and the reference image is greater than a preset threshold, the target express delivery status is damaged, and a damage warning is issued. If the difference between the second target image and the reference image is less than a preset threshold, then the target express delivery status is "express delivery complete".
6. The method according to claim 1, wherein, The step of tracking the target express delivery based on the target video data further includes: Randomly crop the target video data to obtain a third target image; The third target image is identified to obtain a target identification result; the target identification result is used to characterize whether the target express delivery exists. If the target identification result indicates that it exists, then the tracking continues; If the target identification result is that the target does not exist, then the target disappearance location and target disappearance time are determined based on the target video data; The target express delivery is tracked based on the location and time of its disappearance.
7. The method according to claim 6, wherein, The step of tracking the target express delivery based on the target's disappearance location and disappearance time includes: Based on the location where the target disappears, obtain the identification information of the shooting devices within the preset reference area; The reference video data is retrieved based on the number information, and the reference video data is extracted based on the target disappearance time to obtain the video data to be confirmed. The offset status information is determined based on the video data to be confirmed; the offset status information is used to characterize whether the target express delivery has deviated from its path.
8. A device for monitoring the entire express delivery process, comprising: The type determination module is set to determine the target courier type and target courier identifier; The target mapping trajectory determination module is configured to match the corresponding target mapping trajectory from the candidate mapping trajectories according to the target express delivery type. The candidate mapping trajectory is used to characterize the relationship between express delivery type and mapping trajectory; The mapping trajectory is used to characterize the sorting routes corresponding to different express delivery types and the express delivery processing devices on the sorting routes; The express delivery processing device is configured to assist in the sorting and transportation of express packages and to record the sorting and transportation process. The target video data determination module is configured to match the target processing device according to the target mapping trajectory, and obtain the target video data from the target processing device according to the target express delivery identifier; The target video data is video data of the target express delivery sorting and transportation captured by the target device. The tracking module is configured to track the target express delivery based on the target video data.
9. An electronic device, comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the express delivery full-process monitoring method according to any one of claims 1-7.
10. A computer-readable storage medium storing computer instructions for causing a processor to execute the express delivery end-to-end monitoring method according to any one of claims 1-7.