Express full-process monitoring method and device, electronic equipment and storage medium

Abstract

The invention discloses an express full-process monitoring method and device, electronic equipment and a storage medium. The method comprises the following steps: determining a target express type and a target express identifier; matching a corresponding target mapping track from the candidate mapping tracks according to the target express delivery type; matching a target processing device according to the target mapping track, and acquiring target video data from the target processing device according to the target express delivery identifier; and tracking the target express according to the target video data. According to the method, the target video data in the corresponding target processing device can be matched through the target mapping track, and the target express is tracked according to the target video data, so that the express abnormity processing speed and accuracy are remarkably improved, the working process is optimized, the manual intervention cost is reduced, and the transportation efficiency is greatly improved.

Description

Technical Field

[0001] The present invention relates to the technical field of express delivery transportation, and particularly to a method, device, electronic device and storage medium for monitoring the entire process of express delivery. Background Art

[0002] In the express delivery industry, problems such as misdelivery, loss, delay, damage and theft of express items not only seriously affect the customer experience, but also bring huge operating pressure to enterprises. However, although the existing monitoring technologies generate a large amount of data during the transfer and distribution process of express items, the scanning devices, monitoring systems and other related devices are relatively independent and lack close association and coordination. This makes it difficult not only to quickly locate the specific monitoring time point, but also due to the complexity of the monitoring host and lines, the operation process becomes more cumbersome. From the search, download to editing and uploading of monitoring videos, each link requires a large amount of manual intervention, resulting in low efficiency in the process of evidence collection and verification. Summary of the Invention

[0003] The present invention provides a method, device, electronic device and storage medium for monitoring the entire process of express delivery to solve the problem of low efficiency in the process of express evidence collection and verification.

[0004] According to one aspect of the present invention, there is provided a method for monitoring the entire process of express delivery, including:

[0005] Determine the target express type and the target express identifier;

[0006] Match the corresponding target mapping trajectory from the candidate mapping trajectories according to the target express type; the candidate mapping trajectories are used to represent the relationship between the express type and the mapping trajectory; the mapping trajectory is used to represent the sorting route corresponding to different express types and the express processing devices on the sorting route; the express processing devices are used to assist in the sorting and transportation of express items and record the sorting and transportation process of express items;

[0007] Match the target processing device according to the target mapping trajectory, and obtain the target video data from the target processing device according to the target express identifier; the target video data is the video data of the target express item sorted and transported taken by the target device;

[0008] Track the target express item according to the target video data.

[0009] According to another aspect of the present invention, there is provided a device for monitoring the entire process of express delivery, including:

[0010] A type determination module, configured to determine the target express type and the target express identifier;

[0011] A target mapping trajectory determination module, configured to match a corresponding target mapping trajectory from candidate mapping trajectories according to the target express type; the candidate mapping trajectories are used to characterize the relationship between express types and mapping trajectories; the mapping trajectories are used to characterize sorting routes corresponding to different express types and express processing devices on the sorting routes; the express processing devices are used to assist in the sorting and transportation of express and record the sorting and transportation process of express.

[0012] A target video data determination module, configured to match a target processing device according to the target mapping trajectory, and obtain target video data from the target processing device according to the target express identifier; the target video data is video data of the target express sorting and transportation captured by the target device.

[0013] A tracking module, configured to track the target express according to the target video data.

[0014] According to another aspect of the present invention, there is provided an electronic device, which includes:

[0015] At least one processor; and

[0016] A memory communicatively connected to the at least one processor; wherein,

[0017] The memory stores a computer program executable by the at least one processor, and when the computer program is executed by the at least one processor, the at least one processor can execute the express full-process monitoring method according to any embodiment of the present invention.

[0018] According to another aspect of the present invention, there is provided a computer-readable storage medium storing computer instructions for causing a processor to implement the express full-process monitoring method according to any embodiment of the present invention when executed.

[0019] The technical solution of the embodiment of the present invention determines the target express type and the target express identifier; matches the corresponding target mapping trajectory from the candidate mapping trajectories, and the construction of the candidate trajectories provides key technical dependencies for subsequent video data extraction, event traceability, and monitoring analysis; matches the target processing device according to the target mapping trajectory, and obtains the target video data from the target processing device according to the target express identifier, which can improve the accuracy of target express positioning; tracking the target express according to the target video data can help users submit accurate video frame evidence with one key, providing strong support for express exception handling and liability determination. This method can match the target video data in the corresponding target processing device through the target mapping trajectory, and track the target express according to the target video data, which not only significantly improves the speed and accuracy of express exception handling, but also optimizes the work process, reduces the cost of manual intervention, and greatly improves the transportation efficiency.

[0020] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present invention, nor is it used to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0022] Figure 1 It is a flowchart of a method for monitoring the entire process of express delivery provided by an embodiment of the present invention;

[0023] Figure 2 It is a mapping trajectory of a large-piece express provided by an embodiment of the present invention;

[0024] Figure 3 It is a mapping trajectory of a small-piece express provided by an embodiment of the present invention;

[0025] Figure 4 It is a display interface provided by an embodiment of the present invention;

[0026] Figure 5 It is a flowchart of the full-link traceability and maintenance of an express provided by an embodiment of the present invention;

[0027] Figure 6 It is a traceability process of a target express provided by an embodiment of the present invention;

[0028] Figure 7A tracing process for large-piece express deliveries provided by an embodiment of the present invention;

[0029] Figure 8 A tracing process for small-piece express deliveries provided by an embodiment of the present invention;

[0030] Figure 9 A timing diagram of the binding relationship between positions and devices provided by an embodiment of the present invention;

[0031] Figure 10 A structural schematic diagram of an express delivery full-process monitoring device provided by an embodiment of the present invention;

[0032] Figure 11 A structural schematic diagram of an electronic device for implementing the express delivery full-process monitoring method according to an embodiment of the present invention. Detailed implementation manners

[0033] In order to enable those skilled in the art to better understand the solution of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0034] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily need to be used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units does not necessarily need to be limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or are inherent to these processes, methods, products, or devices.

[0035] Figure 1 A flowchart of an express delivery full-process monitoring method provided by an embodiment of the present invention. This embodiment is applicable to the situation of tracking and positioning the express delivery sorting process. This method can be executed by an express delivery full-process monitoring device, which can be implemented in the form of hardware and / or software, and can be configured in any electronic device with network communication functions. As Figure 1 shown, the method includes:

[0036] S110. Determine the target express type and the target express identifier.

[0037] Among them, the target express type can be: large-piece express and small-piece express.

[0038] Furthermore, according to the packaging type of the express, it can be further divided into: bagged express, letter express, and boxed express.

[0039] Specifically, when the target express is transported to the target site, the scanning device configured in the warehousing area is used to scan the target express to obtain the target express identifier; the imaging device configured on the scanning device is used to capture the target express, and the type of the target express is determined according to the captured image.

[0040] Furthermore, determine the express type according to the captured image: identify and cut the captured image to obtain the target express image, extract the edge features of the target express image, and determine the type of the target express according to the length of the extracted edge feature lines. That is, if the length is greater than the first preset length, the target express is considered a large-piece express; if the length is less than the first preset length, the target express is considered a small-piece express. Determine the packaging type of the target express according to the shape reflected by the edge feature lines.

[0041] S120. Match the corresponding target mapping trajectory from the candidate mapping trajectories according to the target express type.

[0042] Among them, the candidate mapping trajectories are used to represent the relationship between the express type and the mapping trajectories.

[0043] Among them, the mapping trajectories are used to represent the sorting routes corresponding to different express types and the express handling devices on the sorting routes.

[0044] Furthermore, taking large-piece express and small-piece express as an example. As Figure 2 shown, it is the mapping trajectory of the large-piece express. It can be seen from the figure that the sorting of the large-piece express is only completed in the unloading area, and the corresponding sorting route is: unload the express at the unloading port, transfer it to the main line data for transmission, and transport it to the loading port for express loading through the turntable. Among them, there are 2 loading ports, corresponding to the main line data of S001 line and the main line data of S002 line respectively. Among them, the line is a conveyor belt; the main line data is the main body for transporting the express.

[0045] Among them, the express handling devices equipped on the sorting route of the large-piece express include: scanning device, main line data, imaging device, turntable.

[0046] Among them, the express handling devices are used to assist the sorting and transportation of the express and record the sorting and transportation process of the express.

[0047] Furthermore, asFigure 3 As shown, it is the mapping trajectory of small-piece express delivery. It can be seen from the figure that the sorting of small-piece express delivery needs to be jointly completed in the unloading area, sorting area and loading area. The corresponding sorting route is as follows: unload the express delivery at the unloading port, perform whole-package scanning, transmit it to the main data of the line for transportation, transport it to the second-floor sorting area through the package loading line, remove the packages through the unpacking area, and perform circular sorting through the circular line. After sorting, it is transported to the loading area through the spiral chute. After weighing by the dynamic scale in the loading area, it is loaded through the swing wheel.

[0048] Among them, the express delivery processing devices equipped on the sorting route of small-piece express delivery include: scanning equipment, line main data, shooting equipment, swing wheel and dynamic scale.

[0049] Specifically, match the target mapping trajectory corresponding to the target express delivery type from the candidate mapping trajectories according to the target express delivery type.

[0050] Exemplarily, if the target express delivery type is large-piece express delivery, then match the large-piece express delivery mapping trajectory as the target mapping trajectory.

[0051] S130. Match the target processing device according to the target mapping trajectory, and obtain the target video data from the target processing device according to the target express delivery identifier.

[0052] Among them, the target video data is the video data of the sorting and transportation of the target express delivery taken by the target device.

[0053] Specifically, retrieve the target processing device included in the target mapping trajectory; obtain the scanning time from the scanning equipment according to the target express delivery identifier, and obtain the video data after the scanning time from the shooting equipment as the target video data.

[0054] The above steps match the corresponding flow trajectories and sorting operation types according to the events triggered by the express delivery scanning, and generate a monitoring mapping table of events and site locations in real time. Combining the order of event occurrence and the site flow rules, while ensuring the accuracy and real-time of obtaining the target video data, it can also support high-concurrency traceability data requests and meet the requirements of efficient processing in the express delivery business.

[0055] S140. Track the target express delivery according to the target video data.

[0056] Specifically, slice the obtained target video data to obtain a number of target express delivery images, and identify the target express delivery from the obtained target express delivery images, so as to realize the tracking of the target express delivery.

[0057] Furthermore, as Figure 4 shown, it can be seen from the figure that the transportation conditions of express deliveries in each link at different time periods are displayed on the display interface.

[0058] Exemplarily, as Figure 5 shown, it can be seen from the figure that the trace query node is used to obtain the waybill number of the target express delivery, that is, the target express delivery identifier; the public service node is used to determine the scanning trajectory, that is, the target mapping trajectory; the park-line body node is used to determine the corresponding target processing device and the location information of the target processing device according to the target mapping trajectory, where the target processing device is a scanning device, a photographing device, an unloading line body, and a loading line body; the video data of the target express delivery is displayed on the display interface of the park-monitoring node according to the obtained target processing device; and the target video data is stored and the key frames are captured by the park-storage node; the trace-evidence node presents evidence according to the obtained video data and key frame images.

[0059] Exemplarily, as Figure 6 、 7 、8 shows that the monitoring process includes: operation, waybill traceability system, viewing video column, Qimen system, master data system, routing system, and trajectory center.

[0060] Among them, the operation node: is used to view the video list (waybill number, center).

[0061] Among them, the waybill traceability system node: is used to view the video list (waybill number, center code).

[0062] Among them, the viewing video list node: is used to view the scanning trajectory list of the waybill (waybill number); calculate the large and small packages and the arrival and departure packages; analyze the last arrival and the last departure of the current center; and judge whether it is a large or small package.

[0063] Among them, the scanning trajectory list includes: waybill number, scanning time, scanning station, scanning device type, device sn, sorting line number, next station id, next station code, current node sitecode, current node siteid, grid code, package number, scanning type, platform code (there is a platform code for gun scanning), and line body number (the loading line body number is generated for arrival scanning).

[0064] Further, the process of calculating large and small parcels and incoming and outgoing parcels is as follows: 1) Analyze large and small parcels: Determine whether all devices are scanning devices. If not, they are small parcels and the analysis is terminated; extract the location list of all devices; traverse the crazy scan, fast hand, and dynamic scale lists to match whether the devices are bound to an area or a platform. If a match is found, they are large parcels and the analysis is terminated; traverse the gun scanning list to determine whether there is a platform code in the scan record. If a match is found, they are large parcels and the analysis is terminated. If none of the above rules match, they are small parcels. 2) Analyze whether there are incoming and outgoing parcels: Obtain the attribute information of whether the platform is a loading platform or an unloading platform based on the platform and platform code in all locations; group according to the platform attribute list to determine whether there are incoming parcels and whether there are outgoing parcels; determine whether it is an incoming or outgoing parcel by reverse matching the scan trajectory from the platform to the device.

[0065] Further, determine whether the target express parcel is a large or small parcel. If it is a large parcel, the processing flow is as Figure 7 shown. Determine whether there is an incoming parcel. If there is, obtain the large parcel incoming parcel traceability monitoring list (unloading device SN). If there is no incoming parcel, parse the previous station through the scan record to obtain the large parcel incoming parcel traceability monitoring list (previous station sitecode, outgoing scan time). Among them, the unloading record: one record for each unloading, previous station code, unloading center code, unloading platform code, unloading completion time. Further, determine whether there is an outgoing parcel. If there is an outgoing parcel, determine whether there is a loading line number in the incoming parcel scan, that is, the operation area will bind the loading line where the incoming parcel scan and the swing wheel swing down. If there is a line, obtain the large parcel outgoing parcel traceability monitoring list (loading line number); if there is no line, parse the next station of the outgoing parcel. The rule for parsing the next station: First, take the outgoing parcel record. If there is no outgoing parcel record, group the scan records and then parse the next station; after parsing, determine whether there is a next station. If there is, obtain the large parcel outgoing parcel traceability monitoring list (next station of the outgoing parcel); if there is no next station, follow the same logic as when there is no outgoing parcel and find the route to match the next station.

[0066] Further, if there is no outgoing parcel, match the next station (waybill number, current center sitecode) and obtain the large parcel outgoing parcel traceability monitoring list (next station of the outgoing parcel).

[0067] Among them, obtaining the large parcel incoming parcel traceability monitoring list (unloading device SN) includes: finding the unloading platform according to the unloading device sn; obtaining the unloading platform monitoring list (unloading line number); obtaining the unloading line (unloading platform code); obtaining the unloading line monitoring list (unloading line number). Among them, the platform monitoring is sorted in the order of addition time; the monitoring of the unloading line is sorted manually.

[0068] Among them, the rules for parsing the previous station include: 1) First, group by the site_code of the scanned nodes, take the time of the first scanned record for each group, and then sort them in sequence; 2) Match according to the site_code of the current center and take the one with the earliest matching time; 3) If a match is found, take the previous group of this group, and the sitecode of the previous group is the previous station; 4) If no match is found, take the last group of the entire group and take the sitecode as the previous station.

[0069] Furthermore, parsing the previous station through scanned records includes: obtaining the unloading platform (previous station) closest to the time, obtaining the monitoring list of the unloading platform (unloading platform number), obtaining the unloading line body (unloading platform code), and obtaining the monitoring list of the unloading line body (unloading line body number).

[0070] Furthermore, the matching platform logic is as follows: The sender scan may be before or after this time. Take the time interval from the completion time of each batch and take the minimum.

[0071] Among them, the tracing process of obtaining the monitoring list of large-piece sender tracing (loading line body number) includes: matching the platform according to the loading line body number; obtaining the monitoring list of the loading platform (loading platform code) and obtaining the monitoring list of the loading line body (loading line body number).

[0072] Among them, obtaining the monitoring list of large-piece sender tracing (next station of the sender) includes: obtaining the loading platform code (next station of the sender); obtaining the monitoring list of the loading platform (loading platform code); obtaining the monitoring list of the loading line body (loading platform code).

[0073] Among them, obtaining the monitoring list of large-piece sender tracing (next station of the sender) includes: obtaining the loading platform code (next station of the sender); obtaining the monitoring list of the loading platform (loading platform code) and obtaining the monitoring list of the loading line body (loading platform code).

[0074] Furthermore, if it is a small piece, the processing flow is as Figure 8 shown. Judge whether the scanning of the upper piece exists. If not, obtain the monitoring list of small-piece tracing (small-piece sorting equipment SN).

[0075] Among them, obtaining the small-item traceability monitoring list (small-item sorting equipment SN) includes: obtaining the equipment-associated line body (small-item sorter); parsing the line body tree, that is, parsing and linking through the front-line body; batch-obtaining all the monitoring of the line body tree; mounting the monitoring to the line bodies in the line body tree; parsing the monitoring prediction time of all the line bodies in front of the small-item sorter-associated line body according to the item scanning time; parsing the grid monitoring list and mounting it to the end of the tree; obtaining the packet sealing time according to the waybill; parsing the packet sealing monitoring list and mounting it to the end of the tree; parsing the platform code associated with the first line body; obtaining the platform monitoring list (unloading platform code); and supplementing the loading platform monitoring to the head of the line body tree.

[0076] Optionally, at least one determination method for the candidate mapping trajectory includes steps A1-A4:

[0077] Step A1: Obtain the basic building information of the target site.

[0078] Among them, the basic building information is used to characterize the types and locations of the basic buildings.

[0079] Specifically, obtain the information of buildings, floors, areas, units (platforms), and line bodies within the target site as the basic building information.

[0080] Furthermore, barcodes and two-dimensional code identifiers are matched on the areas and units.

[0081] In the above steps, the construction of the basic building information can achieve the gradual refinement from the park to the building, and then to the floor, area, unit, and line body, ensuring the comprehensiveness and accuracy of the data. At the same time, it can also support the access of Internet of Things devices, providing a solid foundation data guarantee for the traceability and scheduling of the entire express delivery process. It can also improve the operability of site management and optimization.

[0082] Step A2: Perform path planning on the basic building information to obtain the target path information.

[0083] Specifically, according to the distances between the basic building information and the distribution of the buildings, perform the shortest path planning to obtain the transportation path information of different types of express deliveries, and use the obtained transportation path information as the target path information.

[0084] Step A3: Build an express delivery processing device according to the target path information and the express delivery transportation requirements.

[0085] Among them, the express delivery transportation requirements are the information of the transmission devices and sorting devices required for different express deliveries.

[0086] Specifically, assemble the express delivery processing device on the target path according to the target path information and the express delivery transportation requirements, and obtain the location information of the assembled express delivery processing device.

[0087] Exemplarily, the scanning device is constructed as follows: specific location information is assigned to the fixed scanning device; meanwhile, the scanning process link is embedded in the mobile device.

[0088] In the above steps, the assignment of location information can ensure that the data generated by both the fixed scanning device and the mobile device automatically carry location information, achieving efficient information collection without additional operations and costs.

[0089] Exemplarily, the shooting device is constructed as follows: detailed location information (such as area or unit) is assigned to the shooting device connected to the cloud platform, and the specific attributes of the monitoring (such as the camera facing the device, the interior of the carriage or other key points) are marked to ensure the accurate positioning of the monitoring data.

[0090] Exemplarily, the conveyor line is constructed as follows: the data of the belt conveyor line in the site is recorded and classified into system management, and at the same time, the corresponding monitoring location information and running order are provided for each conveyor line.

[0091] Step A4: Synchronize the numbers and location information of the express processing devices, and establish the corresponding relationship with the basic building information and the express type to obtain the candidate mapping trajectory.

[0092] Specifically, the numbers of the express processing devices are corresponded to the location information where the express processing devices are assembled, and according to the obtained corresponding information, the corresponding relationship with the basic building information and the express type is established to obtain the candidate mapping trajectory.

[0093] Exemplarily, relying on cloud services, all monitoring devices in the sorting center site are connected to the system, and detailed location information including the area where they are located, the orientation and functional attributes, etc. is batch-configured for each monitoring channel. At the same time, tags are set in combination with the device type (such as fixed cameras, PTZ cameras, etc.) and the layout purpose (such as anti-theft monitoring, operation monitoring, etc.) to establish the mapping relationship between the shooting device and the site location information.

[0094] Furthermore, unified location information is provided for various scanning devices (such as barcode scanners, RFID devices, etc.) on the site, and the devices are bound to the operation units and areas according to the location information to obtain the mapping relationship between the scanning devices and the site location.

[0095] Furthermore, the mapping relationship between the shooting device and the site location and the mapping relationship between the scanning device and the site location are fused according to the location information and the target path information to obtain the candidate mapping relationship.

[0096] Furthermore, the candidate mapping relationship is updated according to the change of the basic building information.

[0097] Exemplarily, such as Figure 9As shown in the figure, according to the triggered mq data consumption, that is, the basic building change information, the binding relationship change event of the location and equipment is processed. First, the unit change type and the area change type are parsed. Among them, the change types include: no change and change. The change is further divided into: addition, unbinding, and change. It is judged whether the platform or area has changed according to the change type. If there is a change in the platform or area, it is processed according to the change type. That is, if the change type is addition, the list of line bodies associated with the platform or area is obtained, the list is traversed, and the line body associated equipment is added; if the change type is unbinding, the list of line bodies associated with the platform or area is obtained, the list is traversed, and the line body associated equipment is unbound; if the change type is change and the change object is a unit, the list of line bodies associated with the source platform and the target platform is obtained, the list of line bodies associated with the source platform is traversed, and the line body associated equipment is unbound. The list of line bodies associated with the target platform is traversed, and the line body associated equipment is added. If the change type is change and the change object is an area, it is judged whether the source area is an automated area. If so, the list of line bodies in the area is obtained, the line body list is traversed, and the line body associated equipment is unbound; it is judged whether the target area is an automated area. If so, the list of line bodies in the area is obtained, the line body list is traversed, and the line body associated equipment is added.

[0098] In the above steps, the construction of the candidate mapping trajectory provides key technical dependencies for subsequent video data extraction, event tracing, and monitoring analysis, while also improving the management efficiency of equipment and supporting express tracking, exception handling, and data backtracking in subsequent complex scenarios.

[0099] Optionally, path planning is performed on the basic building information to obtain the target path information, including steps B1 - B2:

[0100] Step B1: The basic building is divided according to the express type and the basic building information to obtain the reference basic building.

[0101] Specifically, the basic building is divided according to the express type and the functions implemented by the basic building to obtain the reference basic building.

[0102] Exemplarily, as Figure 2 、 Figure 3 shown, the sorting and distribution of large and small express deliveries require different areas to cooperate to complete. Therefore, the sizes of the sites required for each area are different. Therefore, planning the basic building according to the express type and the basic building information can make full use of the land resources of the target site.

[0103] Step B2: Transportation path planning is performed according to the distribution orientation of the reference basic building to obtain the target path information.

[0104] Specifically, based on information such as the distribution orientation of reference buildings and the distances between reference buildings, the shortest path planning is performed on the transportation path of the express delivery to obtain the target path information.

[0105] Optionally, tracking the target express delivery according to the target video data includes steps C1 - C4:

[0106] Step C1: Randomly intercept at least two first target images from the target video data.

[0107] Specifically, randomly intercept frames from the target video data to obtain at least two first target images.

[0108] Step C2: Identify the target express delivery in at least two first target images to obtain at least two target position frames.

[0109] Specifically, perform image recognition on at least two first target images respectively, identify the target express delivery therein, and mark it with a bounding box at the location of the target express delivery to obtain at least two target position frames.

[0110] Step C3: Obtain at least two first position information of at least two target position frames in at least two first target images.

[0111] Specifically, obtain the coordinate information of the target position frame according to the position of the target position frame in the first target image as the first position information.

[0112] Step C4: Determine the detention status information according to at least two first position information.

[0113] Among them, the detention status information is used to represent whether the target express delivery has a detention phenomenon.

[0114] Specifically, compare at least two first position information. If the obtained position difference is less than the preset difference, it is considered that the target express delivery has a detention; if the obtained position difference is greater than the preset difference, it is considered that the target express delivery has no detention.

[0115] Furthermore, after the detention occurs, obtain the frame number information corresponding to the first target image with detention, obtain the corresponding time point according to the frame number information, determine the corresponding shooting device number according to the obtained time point information, determine the position information according to the number of the shooting device, and give an early warning of the position information and the detention status on the early warning interface.

[0116] Optionally, tracking the target express delivery according to the target video data further includes steps D1 - D4:

[0117] Step D1: Randomly intercept the target video data to obtain a second target image.

[0118] Specifically, randomly select a target frame to intercept the target video data to obtain a second target image.

[0119] Step D2: Compare the second target image with the reference image.

[0120] Among them, the reference image is the image taken when the target express enters the first scanning device.

[0121] Specifically, extract the features of the second target image and the reference image, compare the obtained features, and obtain the image difference degree.

[0122] Step D3: If the difference degree between the second target image and the reference image is greater than the preset threshold, the status of the target express is damaged, and a damage warning is issued.

[0123] Specifically, if the difference degree between the second target image and the reference image is greater than the preset threshold, it indicates that the target express is damaged. Then, modify the status of the target express to damaged and issue a damage warning, that is, display the order number of the damaged target express on the display interface.

[0124] Step D4: If the difference degree between the second target image and the reference image is less than the preset threshold, the status of the target express is intact.

[0125] Specifically, if the difference degree between the second target image and the reference image is less than the preset threshold, it indicates that the target express is not damaged. Then, modify the status of the target express to intact and intercept and save the corresponding target video for subsequent inspection.

[0126] Optionally, tracking the target express according to the target video data further includes steps E1 - E5:

[0127] Step E1: Randomly intercept the target video data to obtain a third target image.

[0128] Specifically, intercept a random frame of the target video data, and use the intercepted image as the third target image.

[0129] Step E2: Identify the third target image to obtain a target recognition result.

[0130] Among them, the target recognition result is used to represent whether the target express exists.

[0131] Specifically, identify the third target image, determine whether the target express exists in the third target image, and generate a target recognition result according to the obtained existence result.

[0132] Step E3: If the target recognition result is existence, continue the tracking.

[0133] Specifically, if the target recognition result is that the target express delivery exists, select the images of other frames for tracking. If, after the recognition for the preset number of times, it is found that there is no situation where the target express delivery disappears, then output the result.

[0134] Step E4: If the target recognition result is non-existence, determine the target disappearance position and target disappearance time according to the target video data.

[0135] Specifically, if the target recognition result is that the target express delivery does not exist, according to the frame number information of the third target image obtaining the non-existent target express delivery, determine the disappearance time and disappearance position of the target express delivery according to the frame number information and the video data within the preset range adjacent to the frame number, and use the obtained time information and position information as the target disappearance position and target disappearance time.

[0136] Step E5: Track the target express delivery according to the target disappearance position and target disappearance time.

[0137] Specifically, determine the shooting device within the preset range according to the target disappearance position; intercept the video data collected by the determined shooting device according to the target disappearance time, and track the target express delivery according to the intercepted video data.

[0138] Optionally, tracking the target express delivery according to the target disappearance position and target disappearance time includes steps F1 - F3:

[0139] Step F1: Obtain the number information of the shooting device within the preset reference area according to the target disappearance position.

[0140] Specifically, search for the position information and number information of the shooting device within the preset reference area from the candidate mapping relationship according to the target disappearance position.

[0141] Step F2: Retrieve the reference video data according to the number information, and intercept the reference video data according to the target disappearance time to obtain the video data to be confirmed.

[0142] Specifically, retrieve the reference video data from the shooting device according to the obtained number information, and intercept the reference video data according to the target disappearance time to obtain the video data from the target disappearance time to the time when the target express delivery disappearance is discovered, as the video data to be confirmed.

[0143] Step F3: Determine the offset status information according to the video data to be confirmed.

[0144] Among them, the offset status information is used to represent whether the target express delivery has a path offset.

[0145] Specifically, perform target express tracking on the video data to be confirmed. If the target express is found, it indicates that the transmission of the target express has a path deviation. If not found, further query whether the target express has left the transportation line body and conduct a search on the line body at the target disappearance position.

[0146] The technical solution of this embodiment determines the target express type and the target express identifier; matches the corresponding target mapping trajectory from the candidate mapping trajectories according to the target express type. The construction of the candidate trajectories provides key technical dependencies for subsequent video data extraction, event tracing, and monitoring analysis; matches the target processing device according to the target mapping trajectory, and obtains the target video data from the target processing device according to the target express identifier, which can improve the accuracy of target express positioning; tracks the target express according to the target video data, which can help users submit accurate video frame evidence with one key and provide strong support for express exception handling and liability determination. This method can match the target video data in the corresponding target processing device through the target mapping trajectory, and track the target express according to the target video data, which not only significantly improves the speed and accuracy of express exception handling, but also optimizes the work process, reduces the cost of manual intervention, and greatly improves the transportation efficiency.

[0147] Figure 10 It is a schematic structural diagram of an express full-process monitoring device provided by an embodiment of the present invention. This embodiment is applicable to the situation of tracking and positioning the express sorting process. This express full-process monitoring device can be implemented in the form of hardware and / or software, and this express full-process monitoring device can be configured in any electronic device with network communication functions. As Figure 10 shown, the device includes: a type determination module 210, a target mapping trajectory determination module 220, a target video data determination module 230, and a tracking module 240, where:

[0148] The type determination module 210: is used to determine the target express type and the target express identifier;

[0149] The target mapping trajectory determination module 220: is used to match the corresponding target mapping trajectory from the candidate mapping trajectories according to the target express type; the candidate mapping trajectories are used to represent the relationship between the express type and the mapping trajectory; the mapping trajectory is used to represent the sorting routes corresponding to different express types and the express processing devices on the sorting routes; the express processing devices are used to assist in the sorting and transportation of express and record the sorting and transportation process of express;

[0150] The target video data determination module 230: is used to match the target processing device according to the target mapping trajectory, and obtain the target video data from the target processing device according to the target express identifier; the target video data is the video data of the target express sorting and transportation captured by the target device;

[0151] Tracking module 240: used to track the target express delivery according to the target video data.

[0152] Optionally, the target mapping trajectory determination module 220 includes:

[0153] Basic building information determination unit: used to obtain the basic building information of the target site; the basic building information is used to characterize the type and location of the basic building;

[0154] Target path information determination unit: used to perform path planning on the basic building information to obtain the target path information;

[0155] Express delivery processing device building unit: used to build an express delivery processing device according to the target path information and the express delivery transportation requirements; the express delivery transportation requirements are information on the transmission device and sorting device required for different express deliveries;

[0156] Candidate mapping trajectory determination unit: used to synchronize the numbers and location information of the express delivery processing devices, and construct the corresponding relationship between the basic building information and the express delivery type to obtain the candidate mapping trajectory.

[0157] Optionally, the target path information determination unit includes:

[0158] Reference basic building determination subunit: used to divide the basic buildings according to the express delivery type and the basic building information to obtain the reference basic buildings;

[0159] Target path information determination subunit: used to perform transportation path planning according to the distribution orientation of the reference basic buildings to obtain the target path information.

[0160] Optionally, the tracking module 240 includes:

[0161] First target image determination unit: used to randomly intercept at least two first target images from the target video data;

[0162] Target position box determination unit: used to identify the target express delivery from at least two first target images to obtain at least two target position boxes;

[0163] First position information determination unit: used to obtain at least two first position information of at least two target position boxes in at least two first target images;

[0164] Detention status information determination unit: used to determine the detention status information according to at least two first position information; the detention status information is used to characterize whether the target express delivery has a detention phenomenon.

[0165] Optionally, the tracking module 240 further includes:

[0166] Second target image determination unit: used to randomly intercept the target video data to obtain a second target image;

[0167] Comparison unit: used to compare the second target image with a reference image; the reference image is an image taken when the target express enters the first scanning device;

[0168] Damage warning unit: used to give a damage warning if the difference degree between the second target image and the reference image is greater than a preset threshold, and the status of the target express is damaged;

[0169] Express integrity status determination unit: used to determine that the status of the target express is intact if the difference degree between the second target image and the reference image is less than a preset threshold.

[0170] Optionally, the tracking module 240 further includes:

[0171] Third target image determination unit: used to randomly intercept the target video data to obtain a third target image;

[0172] Target recognition result determination unit: used to recognize the third target image to obtain a target recognition result; the target recognition result is used to represent whether the target express exists;

[0173] Tracking determination unit: used to continue tracking if the target recognition result is that the target exists;

[0174] Disappearance information determination unit: used to determine the target disappearance position and target disappearance time according to the target video data if the target recognition result is that the target does not exist;

[0175] Tracking unit: used to track the target express according to the target disappearance position and target disappearance time.

[0176] Optionally, the tracking unit includes:

[0177] Number information determination unit: used to obtain the number information of the shooting device in the preset reference area according to the target disappearance position;

[0178] Video data to be confirmed determination unit: used to retrieve the reference video data according to the number information and intercept the reference video data according to the target disappearance time to obtain the video data to be confirmed;

[0179] Offset status information determination unit: used to determine the offset status information according to the video data to be confirmed; the offset status information is used to represent whether the target express has a path offset.

[0180] The express delivery full - process monitoring device provided in the embodiments of the present invention can execute the express delivery full - process monitoring method provided in any of the above - mentioned embodiments of the present invention, and has the corresponding functions and beneficial effects for executing the express delivery full - process monitoring method. For the detailed process, refer to the relevant operations of the express delivery full - process monitoring method in the foregoing embodiments.

[0181] Figure 11 FIG. is a schematic structural diagram of an electronic device for implementing the express delivery full - process monitoring method of the embodiments of the present invention. The electronic device is intended to represent various forms of digital computers, such as, laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as, personal digital processors, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0182] As Figure 11 shown, the electronic device 10 includes at least one processor 11, and a memory communicatively connected to the at least one processor 11, such as a read - only memory (ROM) 12, a random - access memory (RAM) 13, etc. Among them, the memory stores a computer program executable by the at least one processor. The processor 11 can execute various appropriate actions and processes according to the computer program stored in the read - only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random - access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. The input / output (I / O) interface 15 is also connected to the bus 14.

[0183] Multiple components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0184] The processor 11 may be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the express delivery full-process monitoring method.

[0185] In some embodiments, the express delivery full-process monitoring method may be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed onto the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the express delivery full-process monitoring method described above may be executed. Alternatively, in other embodiments, the processor 11 may be configured to execute the express delivery full-process monitoring method by any other suitable means (e.g., by means of firmware).

[0186] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuitry, integrated circuit systems, field-programmable gate arrays (FPGA), application-specific integrated circuits (ASIC), application-specific standard products (ASSP), systems-on-chip (SOC), complex programmable logic devices (CPLD), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special or general-purpose programmable processor, that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit the data and instructions to the storage system, the at least one input device, and the at least one output device.

[0187] The computer programs for implementing the methods of the present invention can be written in any combination of one or more programming languages. These computer programs can be provided to the processors of general-purpose computers, special-purpose computers, or other programmable data processing devices such that the computer programs, when executed by the processors, cause the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The computer programs can be executed entirely on the machine, partially on the machine, as a stand-alone software package partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0188] In the context of the present invention, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer-readable storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, the computer-readable storage medium can be a machine-readable signal medium. More specific examples of the machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0189] To provide for interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices can also be used to provide for interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0190] The systems and techniques described herein can be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer having a graphical user interface or a web browser through which the user can interact with an implementation of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0191] A computing system may include a client and a server. The client and the server are generally far from each other and usually interact via a communication network. The client-server relationship is created by computer programs running on respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system, solving the defects of difficult management and weak business scalability existing in traditional physical hosts and VPS services.

[0192] It should be understood that various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in the present invention can be executed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved, and no limitation is imposed herein.

[0193] The above specific embodiments do not constitute a limitation on the protection scope of the present invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.

Claims

1. A method for monitoring the entire express delivery process, characterized in that: include: Determine the target courier type and target courier logo; Matching a corresponding target mapping track from candidate mapping tracks according to the target express type; The candidate mapping trajectory is used to characterize the relationship between the express type and the mapping trajectory; The mapping trajectory is used to characterize the sorting routes corresponding to different express delivery types and the express delivery processing devices on the sorting routes; The express delivery processing device is used to assist in the sorting and transportation of express delivery and to record the sorting and transportation process of express delivery; Matching a target processing device according to the target mapping trajectory, and acquiring target video data from the target processing device according to the target express identifier; The target video data is the video data of the target express sorting and transportation taken by the target device; The target courier is tracked according to the target video data.

2. The method according to claim 1, characterized in that At least one method of determining candidate mapping trajectories includes: Obtaining basic building information of the target site; the basic building information is used to characterize the type and location of the basic building; Performing path planning on the basic building information to obtain target path information; Building an express processing device according to the target path information and express transportation requirements; the express transportation requirements are information about transmission devices and sorting devices required by different express delivery; The serial number and location information of the express processing device are synchronized, and a corresponding relationship between the basic building information and the express type is constructed to obtain a candidate mapping trajectory.

3. The method according to claim 2, characterized in that The performing path planning on the basic building information to obtain target path information includes: Divide the basic buildings according to the express type and basic building information to obtain reference basic buildings; The transportation route is planned according to the distribution orientation of the reference basic buildings to obtain the target route information.

4. The method according to claim 1, characterized in that: The tracking of the target express according to the target video data includes: Randomly intercepting at least two first target images from the target video data; Performing target express recognition on the at least two first target images to obtain at least two target position frames; Acquire at least two first position information of the at least two target position frames in at least two first target images; The detention status information is determined based on the at least two first position information; the detention status information is used to indicate whether the target express is detained.

5. The method according to claim 1, characterized in that The tracking of the target express according to the target video data further includes: Randomly intercepting the target video data to obtain a second target image; Comparing the second target image with a reference image; the reference image is an image captured when the target express enters the first scanning device; If the difference between the second target image and the reference image is greater than a preset threshold, the target express status is damaged, and a damage warning is issued; If the difference between the second target image and the reference image is less than a preset threshold, the target delivery status is delivery complete.

6. The method according to claim 1, characterized in that The tracking of the target express according to the target video data further includes: Randomly intercepting the target video data to obtain a third target image; Recognize the third target image to obtain a target recognition result; the target recognition result is used to indicate whether the target express exists; If the target identification result is existence, continue tracking; If the target recognition result is that the target does not exist, determining the target disappearance position and target disappearance time according to the target video data; The target express is tracked according to the target disappearance location and target disappearance time.

7. The method according to claim 6, characterized in that The tracking of the target express according to the target disappearance position and target disappearance time includes: Acquire serial number information of a shooting device in a preset reference area according to the disappearance position of the target; Retrieving reference video data according to the number information, and intercepting the reference video data according to the target disappearance time to obtain the video data to be confirmed; The deviation status information is determined according to the video data to be confirmed; the deviation status information is used to indicate whether a path deviation has occurred in the target express.

8. A full-process express delivery monitoring device, characterized in that: include: A type determination module, used to determine the target express type and target express identification; A target mapping trajectory determination module, used for matching a corresponding target mapping trajectory from candidate mapping trajectories according to the target express type; The candidate mapping trajectory is used to characterize the relationship between the express type and the mapping trajectory; The mapping trajectory is used to characterize the sorting routes corresponding to different express delivery types and the express delivery processing devices on the sorting routes; The express delivery processing device is used to assist in the sorting and transportation of express delivery and to record the sorting and transportation process of express delivery; A target video data determination module, used to match a target processing device according to the target mapping trajectory, and obtain target video data from the target processing device according to the target express identifier; The target video data is the video data of the target express sorting and transportation taken by the target device; A tracking module is used to track the target express according to the target video data.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the express delivery full-process monitoring method described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the express delivery full-process monitoring method described in any one of claims 1-7 when executed.

Images