Logistics information detection method and system, electronic device, and storage medium

Abstract

The present application provides a logistics information detection method and system, an electronic device, and a storage medium. The method comprises: receiving at least one group of transit information of a target package, wherein any group of transit information comprises a perspective image, weighing data and order information of the target package at a corresponding transit node; on the basis of the perspective image and at least one of the weighing data and the order information in the at least one group of transit information, determining a target transit node corresponding to the target package entering a preset loss state, wherein the preset loss state is used for representing that the target package is in a lost state; and outputting the order information at the target transit node and information of the target transit node. In embodiments of the present application, most of transit data can be automatically filtered out, thereby greatly improving the detection efficiency.

Description

Logistics information detection method, system, electronic equipment and storage medium Technical Field

[0001] The present application relates to the field of logistics technology, and specifically to a logistics information detection method, system, electronic device and storage medium. Background Art

[0002] Logistics is the process of moving goods from a source to a destination, encompassing a series of activities such as transportation, storage, packaging, distribution, loading and unloading, safekeeping, and logistics information management. During this process, items are often lost. Currently, lost items and parcels are manually inspected. However, with tens of thousands of parcels and multiple delivery links, this is not only labor-intensive but also inefficient. Summary of the Invention

[0003] This application proposes a logistics information detection method, system, electronic device and storage medium, which can automatically screen out suspected lost packages from a large number of packages, which can not only save labor costs but also improve detection efficiency.

[0004] In a first aspect, an embodiment of the present application proposes a logistics information detection method, comprising: receiving at least one set of transit information of a target package, wherein any set of transit information includes a perspective image, weighing data, and order information of the target package at a corresponding transit node; based on at least one item of the weighing data and order information in at least one set of transit information and the perspective image, determining the target transit node corresponding to the target package entering a preset lost state, wherein the preset lost state is used to characterize that the target package is in a lost state; and outputting the order information of the target transit node and the information of the target transit node.

[0005] In the second aspect, an embodiment of the present application provides a logistics information detection system, including: a receiving module for receiving at least one set of transit information of a target package, wherein any set of transit information includes a perspective image, weighing data and order information of the target package at the corresponding transit node; a determination module for determining the target transit node corresponding to the target package entering a preset lost state based on at least one item of the weighing data and order information in at least one set of transit information and the perspective image, wherein the preset lost state is used to characterize that the target package is in a lost state; an output module for outputting the order information of the target transit node and the information of the target transit node.

[0006] An embodiment of the third aspect of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method of the first aspect.

[0007] An embodiment of the fourth aspect of the present application provides a computer-readable storage medium on which a computer program is stored. The computer program is executed by a processor to implement the method of the first aspect above.

[0008] In an embodiment of the present application, a system receives transit information such as X-ray images, weight data, and order information of a target package at various transit nodes. Based on processing at least one set of transit information, it is possible to detect whether the target package is suspected of being lost, as well as the transit link at which it is suspected of being lost. The system then outputs the relevant detection results to facilitate further confirmation of the loss. This not only automatically filters out most of the transit data, significantly improving detection efficiency, but also facilitates timely resolution of lost item issues before users become aware of them, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] FIG1 shows a schematic diagram of the architecture of a logistics system provided in an embodiment of the present application.

[0010] FIG2 shows a flow chart of a method for detecting logistics information provided in an embodiment of the present application.

[0011] FIG3 shows a schematic diagram of the architecture of a logistics information detection system provided in an embodiment of the present application.

[0012] FIG4 shows a schematic diagram of the composition of a logistics information detection system provided in an embodiment of the present application.

[0013] FIG5 shows a schematic structural diagram of an electronic device provided in an embodiment of the present application.

[0014] FIG6 shows a schematic structural diagram of a storage medium provided in an embodiment of the present application. DETAILED DESCRIPTION

[0015] First, the technical scenarios involved in the embodiments of the present application are described.

[0016] In the logistics field, items are typically packaged into parcels for transportation. During this process, these parcels undergo at least one transfer. In practice, large numbers of parcels often undergo multiple transfers. This situation often leads to the loss or substitution of items within parcels, resulting in a poor user experience.

[0017] Existing methods for detecting lost items typically involve receiving user feedback about a lost item and manually tracing the package's route, number of transfers, and relevant data from each transfer to identify the transit point where the item is suspected to have been lost. Further inspection and verification are then performed to provide a conclusion and solution. Because the package being inspected may have been through multiple transfers, each of which may be handled alongside a large number of other packages, manual inspection is not only labor-intensive but also requires processing a large amount of data, resulting in low detection efficiency and a further degraded user experience.

[0018] In view of this, an embodiment of the present application provides a logistics information detection system. This logistics information detection system can identify suspected lost packages and the transportation links where the packages are suspected of being lost by detecting the package information (also called transit information) obtained by each transit node. After that, the relevant identification results are output to facilitate further confirmation of the loss situation. In this way, not only can most of the data be filtered out in an automated manner, which can greatly improve the detection efficiency, but it is also conducive to timely solving the problem of lost items before the user perceives it, thereby improving the user experience.

[0019] As shown in FIG1 , the logistics system involved in the embodiment of the present application may include: at least one transfer node 10 and a detection system 20 , and the related equipment of at least one transfer node 10 are all communicatively connected with the detection system 20 .

[0020] It should be understood that the technical scenario shown in Figure 1 is only one technical scenario of the solution of the present application and does not constitute a limitation on the technical scenario of the solution of the present application. The transfer node 10 and the detection system 20 shown in Figure 1 can be considered as logically equivalent functional components. In an exemplary embodiment, in the technical scenario of the solution of the present application, each transfer node 10 may include multiple package detection devices, and the detection system 20 may also include multiple detection devices. As shown in Figure 3, the multiple detection devices of the detection system 20 include a cloud server and multiple edge servers. This is not limited here.

[0021] Any transit node 10 may correspond to a logistics transit site in an actual logistics scenario. Accordingly, the multiple package detection devices of any transit node 10 may include a six-sided scanning device, a weighing device, and a security inspection device. The six-sided scanning device may be used to scan the package passing through the transit node 10 on six sides to obtain the order information of the package; the weighing device may be used to weigh the package to obtain the weighing data of the package at the transit node; and the security inspection device may be used to scan the package to obtain a perspective image of the package. The package information obtained by the three devices of the transit node 10 may be used as the transit information of the transit node 10. Afterwards, the three devices of the transit node 10 may respectively transmit the obtained package information to the detection system 20, so that the detection system 20 may detect the transit information of the package at the transit node 10 to determine whether the status of the package at the transit node 10 is a preset lost status.

[0022] In one exemplary embodiment, the six-sided scanner, weighing device, and security inspection device at any transfer node 10 can be arranged in a sequential order. For example, after a package enters the transfer node 10, it first passes through the six-sided scanner, then the weighing device, and finally the security inspection device. After acquiring package information, the three devices at any transfer node 10 can transmit the acquired package information to the detection system 20.

[0023] It should be noted that different packages may pass through different numbers of transfer nodes 10 depending on the address and route of the logistics. For example, the logistics routes of some packages are relatively short (such as adjacent cities) and may pass through one transfer node 10; for another example, the logistics routes of some packages are relatively long (such as spanning multiple cities) and may pass through multiple transfer nodes 10. If an item in a package is lost during transportation, then at least one of the perspective image and weighing data of the package will change. Based on this, after each transfer node 10 obtains the package information, it transmits it to the detection system 20, which helps the detection system 20 to screen out packages suspected of lost items by detecting the transfer information of each transfer node 10.

[0024] After receiving a set of transit information from any transit node 10, the detection system 20 can establish a correspondence between the perspective image, weighing data and order information in the set of transit information, and detect the perspective image, weighing data and order information according to the preset detection rules. The detection system 20 can detect the perspective image by identifying the state of the corresponding perspective image based on the image features of the perspective image, or detecting the similarity of the image features of the same package at two transit nodes 10, identifying the state of the items in the corresponding package, etc. In the embodiment of the present application, the image features of the perspective image can be implemented as different features in different implementation methods. The detection system 20 detects the weighing data by comparing the consistency of the weighing data of the same package in two adjacent transit nodes, so as to assist in identifying whether the items in the package are lost. The detection of order information by the detection system 20 can include determining the item information in the package or the attribute information of the package through the order information.

[0025] Accordingly, functional modules such as image recognition algorithms or network models, data comparison modules, and information recognition modules can be pre-deployed in the detection system 20. The image recognition algorithms or network models can include multiple ones according to the implementation scenario, such as a lightweight convolutional neural network (MobileNet) and a Siamese network.

[0026] The detection system 20 can be implemented as any electronic device that supports the above detection functions. The electronic device can be an independent server, or a server network composed of servers, a server cluster or a blockchain system, etc. The electronic devices described in the embodiments of the present application may include but are not limited to computers, network hosts, single network servers, multiple network server sets, cloud servers composed of multiple servers, or a combination of edge servers and cloud servers, etc. The cloud server is composed of a large number of computers or network servers based on cloud computing.

[0027] In an exemplary embodiment, when the detection system 20 includes a first detection device and a second detection device, different functional modules can be deployed in different detection devices according to the computing power of the first detection device and the second detection device, so that the first detection device and the second detection device perform different steps in the detection method (as shown in the embodiment of Figure 2).

[0028] The following describes the logistics information detection method, system, device and storage medium of the embodiments of the present application with reference to examples.

[0029] FIG2 illustrates a logistics information detection method provided in an embodiment of the present application. The logistics information detection method illustrated in FIG2 can be applied to the detection system 20 illustrated in FIG1 , for example, by the cloud server and / or edge server in FIG3 . The logistics information detection method described in an embodiment of the present application may include the following steps.

[0030] In step S201, at least one set of transfer information of a target package is received.

[0031] The target package can be any package being transferred.

[0032] It should be understood that although a package may pass through multiple transit nodes, and a transit node may process multiple packages, the process of detecting transit information for any package at each transit node can be considered the same. Based on this, the embodiments of this application use any transited package as the target package to illustrate the embodiments of the logistics information detection method of this application.

[0033] Combining the above technical scenarios, it can be seen that any set of transit information includes a perspective image, weighing data, and order information of the target package at the corresponding transit node.

[0034] In an exemplary embodiment, the order information can be implemented in the form of a barcode or a QR code, which can be converted from the order number, item name or note information (for example, the number of items, whether it is fragile or whether it is insured) of the target package.

[0035] As can be seen from the embodiment illustrated in Figure 1, the X-ray image, weight data, and order information in any set of transit information for a target package are acquired by three devices at the corresponding transit node. Accordingly, the detection system can receive the corresponding information from the three devices at the corresponding transit node. To facilitate the management and detection of individual package information at the corresponding transit node, after receiving the X-ray image, weight data, and order information for the target package, the detection system can establish a corresponding relationship between the three pieces of information, for example, using the order information as an index.

[0036] In an exemplary embodiment, when the inspection system includes a first inspection device and a second inspection device, the first inspection device and the second inspection device may each receive at least one set of transit information for a target package. If the computing power of the first inspection device and the second inspection device differs, for example, the computing power of the first inspection device is less than that of the second inspection device, the first inspection device may receive the X-ray image and order information from the at least one set of transit information for the target package, while the second inspection device may receive the X-ray image, weighing data, and order information from the at least two sets of transit information for the target package, and establish a correspondence between the three pieces of package information for each set of transit information, if the target package corresponds to at least two sets of transit information.

[0037] For example, when the computing power of the first detection device is less than that of the second detection device, the first detection device can first receive the perspective image and order information in at least one set of transit information of the target package. When it is determined that the target package corresponds to at least two sets of transit information, the first detection device can send a command to each connected transit node to enable each transit node to send all the transit information of the target package to the second detection device.

[0038] In step S202, based on at least one item of the weighing data and order information in at least one set of transit information and the perspective image, a target transit node corresponding to the target package entering a preset lost state is determined.

[0039] If the transit information meets the preset conditions, it can be determined that the transit information indicates that the target package is in a preset lost state. The preset lost state is used to indicate that the target package is in a lost state.

[0040] It should be noted that there are various scenarios in which items in a target package may be lost, such as all items in the target package being lost, part of the items in the target package being lost, or items in the target package being swapped. Different package information changes depending on the loss scenario. For example, if all items in the target package are lost, the X-ray image of the target package will show that there are no items in the target package, and the weight data of the target package will be reduced. For another example, if part of the items in the target package are lost, the X-ray image of the target package will still show that there are items in the target package, but the weight data of the target package will still be reduced. For another example, if the items in the target package are swapped, the X-ray image of the target package will still show that there are items in the target package, and the weight data of the target package may change slightly, but the X-ray image content of the different transit information corresponding to the target package will change.

[0041] It should be understood that the above examples are merely illustrative of the scenarios in which items are lost, and the changes in package information caused by different loss scenarios, and do not constitute a limitation on the scenarios involved in the embodiments of this application. In actual implementation scenarios, the scenarios in which items are lost may be more numerous than those listed above, and the changes in package information corresponding to different loss scenarios may be more complex and varied. A comprehensive list of examples is not provided here.

[0042] With reference to the changes in package information caused by the above different loss scenarios, the conditions under which the transit information indicates that the target package is in a preset lost state may include, for example: the target package contains no items, the target package contains no items and the weighing data of two adjacent sets of transit information for the target package are different, or the weighing data and the content of the fluoroscopic images of two adjacent sets of transit information for the target package are different, etc. Furthermore, embodiments of the present application can detect whether the target package is in the preset lost state at relevant transit nodes from different angles based on at least one of the weighing data and order information and the fluoroscopic images, depending on different loss scenarios.

[0043] It should be understood that detecting whether the target package is in a preset lost state at the relevant transfer node from different angles can be understood as there are multiple ways to detect whether the target package is in a preset lost state at the relevant transfer node, and different methods correspond to different angles. These methods can be flexibly combined according to different needs, that is, these methods are not mutually exclusive.

[0044] In some embodiments for detecting whether a target package is in a predetermined lost state at a corresponding transit node, for any set of transit information, in response to receiving the transit information, the detection system may detect, based on the order information and the X-ray image in the transit information, whether the transit information indicates that the target package is in a predetermined lost state. If the transit information indicates that the target package is in a predetermined lost state, the detection system may determine the transit node corresponding to the transit information as the target transit node.

[0045] For example, the detection system can determine the item status of the target package based on the X-ray image in the transit information. If the target package is determined to be empty, i.e., the target package is empty, the detection system can determine whether the item type indicated by the order information in the transit information is a preset type. If the item type indicated by the order information is a preset type, the transit information is determined to indicate that the target package is in a preset lost state.

[0046] The X-ray image can characterize the contents of the target package through color or brightness. For example, an item that the security scanner cannot penetrate may appear as a blue image with a defined outline, while an item that can pass through the scanner may appear as a relatively low-brightness orange image. Based on this, the detection system can extract color features from the X-ray image, including a brightness characteristic value. For example, if the brightness characteristic value exceeds a preset brightness threshold, the target package is determined to be empty.

[0047] For example, the brightness characteristic value can be flexibly set according to needs, for example, the brightness characteristic value can be set to 128. The brightness characteristic value is used to represent the brightness value of the perspective image.

[0048] For example, the detection system can call a pre-trained MobileNet to extract color features from the perspective image. These color features may include features of each of the three primary colors (red, green, and blue, RGB) in the perspective image, as well as brightness or transparency features of each color. Furthermore, the MobileNet can determine the type of item status in the package matched by the perspective image based on the extracted color features. For example, the item status in the package may include no item (i.e., an empty package), an item present but not full, or a full package. The item status is used to indicate whether the target package contains an item and, if so, whether the package is full.

[0049] It should be noted that in actual implementation scenarios, the color characteristics of some X-ray images of items, such as clothing or paper, may be similar to those of empty packages. Therefore, determining the target package as lost based on the color characteristics of the X-ray image may be inaccurate. To improve the accuracy of detection results, after determining the target package is empty based on the color characteristics of the X-ray image, the target package's status can be further detected based on at least one of its order information and weighing data.

[0050] In actual implementation scenarios, some item types can be pre-set based on empirically determined high loss rates to further determine whether an empty package is a lost package. Furthermore, after determining that the target package contains no items, the order information for the target package can be used to determine whether the items in the target package are of the preset types. If the items in the target package are of the preset types, the target package can be determined to be a lost package. Pre-set types can, for example, include the item name indicating the type of electronic product and the user-selected insurance type.

[0051] In addition, when it is determined that there is no item in the target package, and the item in the target package is not an item of the preset type, and when the target package corresponds to at least two sets of transit information, it is possible to determine whether the weight of the target package has changed during the transit process by comparing the weighing data in each two adjacent sets of transit information. If the weight of the target package has changed during the transit process, it can be determined that the target package has changed to the preset lost state.

[0052] Exemplarily, when the item type indicated by the order information is not a preset type, the detection system can start with the transit information and sequentially compare the weighing data in each two adjacent groups of transit information in the earlier transit information obtained earlier than the transit information. The weighing data in the transit information obtained later (later in time) of any two adjacent groups of transit information is used as the first weighing data, and the weighing data in the transit information obtained earlier (earlier in time) of the two adjacent groups of transit information is used as the second weighing data. When the first weight indicated by the first weighing data is less than the second weight indicated by the second weighing data, it can be determined that the item in the target package is lost during the transportation between the transit nodes corresponding to the two adjacent groups of transit information. Accordingly, it can be determined that the transit information corresponding to the first weighing data indicates that the target package has changed to the preset lost state.

[0053] The above implementation method is aimed at detecting the scenario where all items in the target package are lost. For the scenario where some items in the target package are lost or replaced, the embodiment of the present application can perform detection by comparing the perspective images and weighing data in two adjacent sets of transit information.

[0054] In other embodiments for detecting whether a target package is in a predetermined lost state at a relevant transit node, if the at least one set of transit information includes at least two sets of transit information, the detection system may detect whether the target package has changed to the predetermined lost state based on the weighing data and X-ray images in the at least two sets of transit information. If the target package has changed to the predetermined lost state, the transit node corresponding to the transit information after the target package changed its state is determined as the target transit node.

[0055] Exemplarily, in response to receiving the i-th group of transit information, the detection system may compare the i-th weighing data with the i-1-th weighing data, where the i-th weighing data refers to the weighing data in the i-th group of transit information, and the i-1-th weighing data refers to the weighing data in the i-1-th group of transit information. i is an integer greater than or equal to 2, that is, the i-1-th group of transit information and the i-th group of transit information are transit information of any two adjacent transit nodes. If the i-th weight indicated by the i-th weighing data is less than the i-1-th weight indicated by the i-1-th weighing data, the detection system detects whether the i-th fluoroscopic image and the i-1-th fluoroscopic image are the same. The i-th fluoroscopic image refers to the fluoroscopic image in the i-th group of transit information, and the i-1-th fluoroscopic image refers to the fluoroscopic image in the i-1-th group of transit information. When the i-th perspective image is different from the i-1-th perspective image, it means that the weight and content of the items in the two sets of transit information of the target package are different. Then, it can be determined that some of the items in the target package are lost during the transportation between the adjacent transit nodes. It can be determined that the target package is changed to the preset lost state at the transit node corresponding to the i-th set of transit information.

[0056] It should be noted that in this example, detecting whether the i-th fluoroscopic image is identical to the i-1-th fluoroscopic image refers to detecting whether the image content in the i-th fluoroscopic image is identical to the image content in the i-1-th fluoroscopic image. Based on this, in this example, the detection system can extract the semantic features of the i-th fluoroscopic image and the semantic features of the i-1-th fluoroscopic image, respectively, to obtain a first semantic feature and a second semantic feature. Thereafter, a similarity parameter is calculated between the first semantic feature and the second semantic feature. If the similarity represented by the similarity parameter does not meet the preset similarity condition, it is determined that the i-th fluoroscopic image is different from the i-1-th fluoroscopic image.

[0057] The detection system may, for example, call a pre-deployed Siamese Network to extract the first and second semantic features. The similarity parameter between the first and second semantic features may be implemented as a parameter representing feature similarity, such as Euclidean distance or cosine distance.

[0058] It should be understood that the above is only an exemplary implementation of lost item detection and does not limit the technical solutions of the embodiments of this application. In actual implementation scenarios, the neural network used to extract color features and semantic features can also be other algorithm networks that support related functions, which is not limited here.

[0059] Furthermore, in scenarios where the detection system includes a first detection device and a second detection device, the first detection device may be pre-configured with, for example, a MobileNet, and the second detection device may be pre-configured with a Siamese Network. The first detection device may, for example, detect empty packages and determine whether the item type is a preset type, while the second detection device may, for example, detect whether the weighing data and the perspective image content in the transfer information of any two adjacent transfer nodes are consistent.

[0060] In an exemplary embodiment, when it is determined that the items in the target package are not of a preset type, the first detection device may obtain the weighing data in each set of transit information of the target package from the second detection device to detect whether there is a change in the weighing data in each two adjacent sets of transit information. In another exemplary embodiment, when it is determined that the items in the target package are not of a preset type, the first detection device may send the order information of the target package to the second detection device, so that the second detection device detects whether there is a change in the weighing data in each two adjacent sets of transit information corresponding to the target package, and further determines whether the target package is in a preset lost state.

[0061] In step S203, the order information and information of the target transfer node are output.

[0062] After determining that an item in a target package is suspected of being lost and the target transfer node corresponding to the suspected loss is located, the detection system can output the order information of the target transfer node corresponding to the target package and the information of the target transfer node suspected of being lost, thereby triggering relevant personnel to further verify the status of the target package. The target transfer node information can include, for example, the transfer station number corresponding to the target transfer node.

[0063] Exemplarily, the detection system can output the order information and information of the target transit node through any device in the first detection device or the second detection device that has an information output function or a display function. For example, if the first detection device is implemented as an edge server as shown in Figure 3, and the second detection device is implemented as a cloud server as shown in Figure 3, the order information and information of the target transit node can be output by the cloud server.

[0064] The embodiments of the present application receive transit information such as X-ray images, weighing data, and order information of the target package at various transit nodes. Based on processing at least one set of transit information, the system can detect whether the target package is suspected of being lost, as well as the transit link at which it is suspected of being lost, and output the relevant detection results to further confirm the loss. This not only automatically filters out most of the transit data, greatly improving detection efficiency, but also helps to promptly resolve the issue of lost items before the user notices it, thereby improving the user experience.

[0065] In an exemplary embodiment, taking the first detection device implemented as an edge server and the second detection device implemented as a cloud server as an example, the structure of the detection system can be shown in Figure 3. In Figure 3, each transit node can be configured with an edge server, and the edge server of each transit node can be communicatively connected to the cloud server.

[0066] The functions of the edge server and the cloud server can be referred to the description of the corresponding embodiments above and will not be repeated here.

[0067] It can be seen that the implementation method of this application provides a logistics information detection system. This logistics information detection system can detect the package information (also called transit information) obtained by each transit node, identify suspected lost packages and the transportation link where the package is suspected to be lost, and then output the relevant identification results to facilitate further confirmation of the loss situation. In this way, not only can most of the data be filtered out in an automated manner, which can greatly improve the detection efficiency, but it is also conducive to timely solving the problem of lost items before the user perceives it, thereby improving the user experience.

[0068] Corresponding to the implementation of the above logistics information detection method, an embodiment of the present application also provides a logistics information detection system, which can be used as the detection system 20 shown in Figure 1 to execute the logistics information detection method of any of the above embodiments. It should be understood that the description of the logistics information detection method embodiment corresponds to the description of the logistics information detection system embodiment. Therefore, for parts not described in detail, please refer to the previous method embodiment. As shown in Figure 4, the logistics information detection system includes: a receiving module 41, a determination module 42, and an output module 43.

[0069] The receiving module 41 is used to receive at least one set of transit information of the target package, wherein any set of transit information includes a perspective image, weighing data and order information of the target package at the corresponding transit node; the determining module 42 is used to determine the target transit node corresponding to the target package entering a preset lost state based on at least one item of the weighing data and order information in at least one set of transit information and the perspective image, wherein the preset lost state is used to indicate that the target package is in a lost state; the output module 43 is used to output the order information of the target transit node and the information of the target transit node.

[0070] Optionally, the determination module 42 is specifically used to: for any set of transit information, based on the order information and perspective image in the transit information, detect whether the transit information indicates that the target package is in a preset lost state; when the transit information indicates that the target package is in a preset lost state, determine the transit node corresponding to the transit information as the target transit node.

[0071] Optionally, when the determination module 42 detects whether the transit information indicates that the target package is in a preset lost state based on the order information and the perspective image in the transit information, it is further used to: determine the item status of the target package according to the perspective image in the transit information, wherein the item status is used to indicate whether the item exists in the target package and whether the item fills the target package when the item exists; when it is determined that there is no item in the target package, determine whether the item type indicated by the order information in the transit information is a preset type to determine whether the transit information indicates that the target package is in a preset lost state, wherein when the item type indicated by the order information is a preset type, the transit information indicates that the target package is in a preset lost state.

[0072] Optionally, when determining the item status of the target package based on the perspective image in the transit information, the determination module 42 is further used to: extract color features of the perspective image, wherein the color features include a brightness feature value of the perspective image, and the brightness feature value is used to characterize the brightness value of the perspective image; determine the item status of the target package based on a size relationship between the brightness feature value and a preset brightness threshold, wherein when the brightness feature value is greater than the preset brightness threshold, there is no item in the target package.

[0073] Optionally, in the case where at least one set of transit information includes at least two sets of transit information, the determination module 42 is specifically used to: for any set of transit information, based on the order information and the perspective image in the transit information, detect whether the target package has changed to a preset lost state; in the case where the target package has changed to a preset lost state, determine the transit node corresponding to the transit information after the target package changes its state as the target transit node.

[0074] Optionally, when the determination module 42 detects whether the target package has changed to a preset lost state based on the order information and the perspective image in the transit information, it is further used to: determine the item status of the target package according to the perspective image in the transit information, wherein the item status is used to characterize whether the item exists in the target package and whether the item fills the target package if the item exists; when it is determined that there is no item in the target package, determine whether the item type indicated by the order information in the transit information is a preset type to determine whether the target package has changed to a preset lost state.

[0075] Optionally, when determining whether the item type indicated by the order information in the transit information is a preset type to determine whether the target package has been changed to a preset lost state, the determination module 42 is further used to: when the item type indicated by the order information is not a preset type, starting with the transit information, sequentially compare the weighing data in each two adjacent groups of transit information in the transit information obtained earlier than the transit information, wherein, in the weighing data in each two adjacent groups of transit information, the weighing data in the transit information obtained later is the first weighing data, and the weighing data in the transit information obtained earlier is the second weighing data; based on the first weighing data and the second weighing data, determine whether the target package has been changed to a preset lost state, wherein, when the first weight indicated by the first weighing data is less than the second weight indicated by the second weighing data, the transit node corresponding to the transit information obtained later for the target package is changed to the preset lost state, and the transit node corresponding to the transit information obtained later is the transit node corresponding to the transit information after the target package changes its state.

[0076] Optionally, when at least one set of transit information includes at least two sets of transit information, the determination module 42 is specifically used to: detect whether the target package has changed to a preset lost state based on the weighing data and the perspective image in the at least two sets of transit information; when the target package has changed to a preset lost state, determine the transit node corresponding to the transit information after the target package changes its state as the target transit node.

[0077] Optionally, when the determination module 42 detects whether the target package has changed to a preset lost state based on the weighing data and the perspective image in at least two sets of transit information, it is further used to: compare the i-th weighing data with the i-1-th weighing data, wherein the i-th weighing data is the weighing data in the i-th group of transit information in the at least two sets of transit information, the i-1-th weighing data is the weighing data in the i-1-th group of transit information in the at least two sets of transit information, and i is an integer greater than or equal to 2; when the i-th weighing indicated by the i-th weighing data is less than the i-1-th weighing data, the i-th weighing data is the weighing data in the i-1-th group of transit information in the at least two sets of transit information. According to the indicated i-1th weighing, detect whether the i-th perspective image is the same as the i-1th perspective image, wherein the i-th perspective image is the perspective image in the i-th group of transit information, and the i-1th perspective image is the perspective image in the i-1th group of transit information; when the i-th perspective image is different from the i-1th perspective image, determine that the target package is changed to a preset lost state at the transit node corresponding to the i-th group of transit information, wherein the transit node corresponding to the transit information after the target package changes its state is the transit node corresponding to the i-th group of transit information.

[0078] Optionally, when detecting whether the i-th perspective image and the i-1-th perspective image are the same, the determination module 42 is further used to: extract the semantic features of the i-th perspective image and the semantic features of the i-1-th perspective image respectively to obtain a first semantic feature and a second semantic feature; calculate a similarity parameter of the first semantic feature and the second semantic feature, wherein the similarity parameter is used to characterize the similarity between the first semantic feature and the second semantic feature; determine whether the i-th perspective image and the i-1-th perspective image are the same based on the similarity represented by the similarity parameter and a preset similarity condition, wherein, when the similarity represented by the similarity parameter does not meet the preset similarity condition, the i-th perspective image and the i-1-th perspective image are different.

[0079] Optionally, when the determination module 42 detects whether the target package has changed to a preset lost state based on the weighing data and the fluoroscopic image in at least two sets of transit information, it is further used to: for any set of transit information, determine the item status of the target package according to the fluoroscopic image in the transit information, wherein the item status is used to characterize whether the item exists in the target package and whether the item fills the target package if the item exists; when it is determined that there is no item in the target package and the item type indicated by the order information in the transit information is not a preset type, starting with the transit information, sequentially compare the weighing data in each two adjacent sets of transit information in the transit information obtained earlier than the transit information, wherein In the embodiment, among the weighing data in each two adjacent groups of transit information, the weighing data in the transit information obtained later is the first weighing data, and the weighing data in the transit information obtained earlier is the second weighing data; based on the first weighing data and the second weighing data, it is determined whether the target package has changed to a preset lost state, wherein, when the first weight indicated by the first weighing data is less than the second weight indicated by the second weighing data, the transit node corresponding to the transit information obtained later for the target package is changed to the preset lost state, and the transit node corresponding to the transit information obtained later is the transit node corresponding to the transit information after the target package changes its state.

[0080] Optionally, the detection system includes a first detection device, and the receiving module 41 is specifically configured to: the first detection device receives the perspective image and order information in at least one set of transit information of the target package.

[0081] Optionally, the determination module 42 is specifically used for: in response to receiving the perspective image and order information in at least one set of transit information, the first detection device detects whether the at least one set of transit information indicates that the target package is in a preset lost state based on the order information and the perspective image in at least one set of transit information.

[0082] Optionally, the detection system includes a first detection device and a second detection device, and the receiving module 41 is specifically used to: when the first detection device receives at least two sets of transit information of the target package, the second detection device receives the perspective image, weighing data and order information in the at least two sets of transit information of the target package.

[0083] Optionally, the determination module 42 is specifically configured to: the second detection device detects whether the target package has changed to a preset lost state based on the weighing data and the perspective image in at least two sets of transit information.

[0084] It should be noted that the modules illustrated in Figure 4 can be understood as software modules that perform different logical functions in the process of executing the logistics information detection method. This does not conflict with the devices divided by network deployment in Figure 3, but the division dimensions are different.

[0085] The logistics information detection system provided in the above-mentioned embodiments of the present application and the logistics information detection method provided in the embodiments of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, run or implemented by the application programs stored therein.

[0086] In addition, what is shown in FIG4 is only one embodiment of the logistics information detection system, not all embodiments. Based on the embodiment of the logistics information detection system in this application, all other embodiments obtained by those skilled in the art without making any creative work are within the scope of protection of this application.

[0087] Figure 4 shows the software modules divided from a logical functional perspective. During implementation, the functions of this software module can be integrated into hardware entities. For example, the functions of the receiving module and the output module can be integrated into the communication interface, and the functions of the determination module can be integrated into the processor.

[0088] Based on this, the embodiments of the present application also provide an electronic device that can be used as the detection system 20 shown in Figure 1 to perform the above-mentioned logistics information detection method. Please refer to Figure 5, which shows a schematic diagram of an electronic device provided by some embodiments of the present application. As shown in Figure 5, the electronic device includes: a processor 500, a memory 501, a bus 502 and a communication interface 503, and the processor 500, the communication interface 503 and the memory 501 are connected via the bus 502; the memory 501 stores a computer program running on the processor 500, and when the processor 500 runs the computer program, it executes the logistics information detection method provided by any of the aforementioned embodiments of the present application.

[0089] The memory 501 may include high-speed random access memory (RAM) and may also include non-volatile memory (NVM), such as at least one disk storage. The communication connection between the system network element and at least one other network element is achieved through at least one communication interface 503 (which may be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. may be used.

[0090] Bus 502 can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, or an EISA (Extended Industry Standard Architecture) bus. Buses can be divided into address buses, data buses, and control buses. Memory 501 is used to store computer programs. Processor 500 executes the computer programs after receiving execution instructions. The logistics information detection method disclosed in any of the embodiments illustrated in FIG. 2 can be applied to processor 500 or implemented by processor 500.

[0091] The processor 500 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by an integrated logic circuit of hardware in the processor 500 or by instructions in the form of software. The above-mentioned processor 500 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, or discrete hardware components, which can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium well-known in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, or a register. The storage medium is located in the memory 501, and the processor 500 reads the information in the memory 501 and performs the steps of the above method in conjunction with its hardware.

[0092] The electronic device provided in the embodiment of the present application and the logistics information detection method provided in the embodiment of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, operated or implemented by them.

[0093] In addition, FIG5 shows only one embodiment of the electronic device, not all embodiments. All other embodiments obtained by those skilled in the art based on the electronic device embodiment in this application without any creative work shall fall within the scope of protection of this application.

[0094] Corresponding to the logistics information detection method provided in the aforementioned embodiment, as shown in Figure 6, the embodiment of the present application also provides a computer-readable storage medium 600, on which a computer program 610 (i.e., program item) is stored. When the computer program 610 is run by the processor, it will execute the logistics information detection method provided in any of the aforementioned embodiments.

[0095] It should be noted that computer-readable storage media may also include, but are not limited to, phase-change random access memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical or magnetic storage media, which are not listed here one by one.

[0096] The computer-readable storage medium provided in the above-mentioned embodiments of the present application and the logistics information detection method provided in the embodiments of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, run or implemented by the application programs stored therein.

[0097] In addition, FIG6 shows only one embodiment of a computer-readable storage medium, not all embodiments. All other embodiments obtained by those skilled in the art based on the computer-readable storage medium embodiment in this application without any creative work shall fall within the scope of protection of this application.

[0098] The above description is merely a preferred embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A logistics information detection method, characterized in that, Including: Receiving at least one set of transfer information of a target package, where any one set of transfer information includes a perspective image, weighing data, and order information of the target package at a corresponding transfer node; Based on at least one of the weighing data and order information in the at least one set of transfer information and the perspective image, determining a target transfer node corresponding to the target package entering a preset lost state, where the preset lost state is used to represent that the target package is in a lost state; Outputting the order information of the target transfer node and the information of the target transfer node.

2. The method according to claim 1, wherein The determining, based on at least one of the weighing data and order information in the at least one set of transfer information and the perspective image, of a target transfer node corresponding to the target package entering a preset lost state includes: For any one set of transfer information, based on the order information and the perspective image in the transfer information, detecting whether the transfer information represents that the target package is in the preset lost state; In the case where the transfer information represents that the target package is in the preset lost state, determining the transfer node corresponding to the transfer information as the target transfer node.

3. The method according to claim 2, wherein The detecting, based on the order information and the perspective image in the transfer information, of whether the transfer information represents that the target package is in the preset lost state includes: Determining the item state of the target package according to the perspective image in the transfer information, where the item state is used to represent whether an item exists in the target package and whether the item fills the target package when the item exists; In the case where it is determined that there is no item in the target package, determining whether the item type indicated by the order information in the transfer information is a preset type to determine whether the transfer information represents that the target package is in the preset lost state, where in the case where the item type indicated by the order information is the preset type, the transfer information represents that the target package is in the preset lost state.

4. The method according to claim 3, wherein The determining of the item state of the target package according to the perspective image in the transfer information includes: Extracting the color feature of the perspective image, where the color feature includes the brightness feature value of the perspective image, and the brightness feature value is used to represent the brightness value of the perspective image; According to the magnitude relationship between the brightness feature value and a preset brightness threshold, determining the item state of the target package, where in the case where the brightness feature value is greater than the preset brightness threshold, there is no item in the target package.

5. The method according to any one of claims 1 to 4, characterized in that In the case where the at least one set of transfer information includes at least two sets of transfer information, the determining, based on at least one of the weighing data and order information in the at least one set of transfer information and the perspective image, of a target transfer node corresponding to the target package entering a preset lost state includes: For any one set of transfer information, based on the order information and the perspective image in the transfer information, detecting whether the target package has changed to the preset lost state; When the target package is changed to the preset lost state, determine the transfer node corresponding to the transfer information after the state change of the target package as the target transfer node.

6. The method according to claim 5, characterized in that, The detecting whether the target package is changed to the preset lost state based on the order information and the perspective image in the transfer information includes: Determine the item state of the target package according to the perspective image in the transfer information, where the item state is used to indicate whether an item exists in the target package and whether the item fills the target package when the item exists; When it is determined that there is no item in the target package, determine whether the item type indicated by the order information in the transfer information is a preset type to determine whether the target package is changed to the preset lost state.

7. The method according to claim 6, characterized in that, The determining whether the item type indicated by the order information in the transfer information is a preset type to determine whether the target package is changed to the preset lost state includes: When the item type indicated by the order information is not the preset type, starting from the transfer information, sequentially compare the weighing data in each adjacent two sets of transfer information obtained earlier than the transfer information. Among the weighing data in each adjacent two sets of transfer information, the weighing data in the transfer information obtained later in time is the first weighing data, and the weighing data in the transfer information obtained earlier in time is the second weighing data; According to the first weighing data and the second weighing data, determine whether the target package is changed to the preset lost state. When the first weighing indicated by the first weighing data is less than the second weighing indicated by the second weighing data, the target package is changed to the preset lost state at the transfer node corresponding to the transfer information obtained later in time, and the transfer node corresponding to the transfer information obtained later in time is the transfer node corresponding to the transfer information after the state change of the target package.

8. The method according to any one of claims 1 to 7, characterized in that, When the at least one set of transfer information includes at least two sets of transfer information, the determining the target transfer node corresponding to the target package entering the preset lost state based on at least one of the weighing data and the order information in the at least one set of transfer information and the perspective image includes: Based on the weighing data and the perspective image in the at least two sets of transfer information, detect whether the target package is changed to the preset lost state; When the target package is changed to the preset lost state, determine the transfer node corresponding to the transfer information after the state change of the target package as the target transfer node.

9. The method according to claim 8, wherein The detecting whether the target package is changed to the preset lost state based on the weighing data and the perspective image in the at least two sets of transfer information includes: Compare the i-th weighing data with the (i - 1)-th weighing data, where the i-th weighing data is the weighing data in the i-th set of transfer information among the at least two sets of transfer information, the (i - 1)-th weighing data is the weighing data in the (i - 1)-th set of transfer information among the at least two sets of transfer information, and i is an integer greater than or equal to 2; When the i-th weighing indicated by the i-th weighing data is less than the (i - 1)-th weighing indicated by the (i - 1)-th weighing data, detect whether the i-th perspective image is the same as the (i - 1)-th perspective image, where the i-th perspective image is the perspective image in the i-th set of transfer information, and the (i - 1)-th perspective image is the perspective image in the (i - 1)-th set of transfer information; When the i-th perspective image is different from the (i - 1)-th perspective image, determine that the target package changes to the preset lost state at the transfer node corresponding to the i-th set of transfer information, where the transfer node corresponding to the transfer information after the target package changes its state is the transfer node corresponding to the i-th set of transfer information.

10. The method according to claim 9, characterized in that, The detection of whether the i-th perspective image is the same as the (i - 1)-th perspective image includes: Extract the semantic features of the i-th perspective image and the semantic features of the (i - 1)-th perspective image respectively to obtain the first semantic feature and the second semantic feature; Calculate the similarity parameter between the first semantic feature and the second semantic feature, where the similarity parameter is used to characterize the similarity between the first semantic feature and the second semantic feature; Determine whether the i-th perspective image is the same as the (i - 1)-th perspective image according to the similarity characterized by the similarity parameter and the preset similarity condition, where when the similarity characterized by the similarity parameter does not meet the preset similarity condition, the i-th perspective image is different from the (i - 1)-th perspective image.

11. The method according to any one of claims 8 to 10, characterized in that, The detection of whether the target package changes to the preset lost state based on the weighing data and perspective images in the at least two sets of transfer information includes: For any set of transfer information, determine the item state of the target package according to the perspective image in the transfer information, where the item state is used to characterize whether an item exists in the target package and whether the item fills the target package when the item exists; When it is determined that there is no item in the target package and the item type indicated by the order information in the transfer information is not the preset type, starting from the transfer information, sequentially compare the weighing data in each adjacent two sets of transfer information among the transfer information obtained earlier than the transfer information. Among the weighing data in each adjacent two sets of transfer information, the weighing data in the transfer information obtained later in time is the first weighing data, and the weighing data in the transfer information obtained earlier in time is the second weighing data; Determine whether the target package has changed to the preset lost state according to the first weighing data and the second weighing data, wherein, when the first weighing indicated by the first weighing data is less than the second weighing indicated by the second weighing data, the transfer node corresponding to the transfer information obtained later in time for the target package changes to the preset lost state, and the transfer node corresponding to the transfer information obtained later in time is the transfer node corresponding to the transfer information after the state of the target package has changed.

12. The method according to any one of claims 1 to 11, characterized in that, The detection system includes a first detection device, wherein the receiving at least one set of transfer information of the target package includes: The first detection device receives the perspective image and order information in the at least one set of transfer information of the target package.

13. The method according to claim 12, characterized in that, Determining the target transfer node corresponding to the target package entering the preset lost state based on at least one of the weighing data and order information in the at least one set of transfer information and the perspective image includes: In response to receiving the perspective image and order information in the at least one set of transfer information, the first detection device detects whether the at least one set of transfer information represents that the target package is in the preset lost state based on the order information and the perspective image in the at least one set of transfer information.

14. The method according to any one of claims 1 to 13, characterized in that, The detection system includes a first detection device and a second detection device, wherein the receiving at least one set of transfer information of the target package includes: When the first detection device receives at least two sets of transfer information of the target package, the second detection device receives the perspective image, weighing data and order information in the at least two sets of transfer information of the target package.

15. The method according to claim 14, wherein Determining the target transfer node corresponding to the target package entering the preset lost state based on at least one of the weighing data and order information in the at least one set of transfer information and the perspective image includes: The second detection device detects whether the target package has changed to the preset lost state based on the weighing data and the perspective image in the at least two sets of transfer information.

16. A logistics information detection system, characterized in that, Includes: A receiving module, configured to receive at least one set of transfer information of the target package, wherein any set of transfer information includes the perspective image, weighing data and order information of the target package at the corresponding transfer node; A determining module, configured to determine the target transfer node corresponding to the target package entering the preset lost state based on at least one of the weighing data and order information in the at least one set of transfer information and the perspective image, wherein the preset lost state is used to represent that the target package is in a lost state; An output module, configured to output the order information of the target transfer node and the information of the target transfer node.

17. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and running on the processor, characterized in that, The processor runs the computer program to implement the method according to any one of claims 1 to 15.

18. A computer-readable storage medium having a computer program stored thereon, characterized in that, The computer program is executed by the processor to implement the method according to any one of claims 1 to 15.

Images