Method and all-in-one machine for collecting multi-dimensional information of express delivery parcel

Abstract

A method and all-in-one machine for collecting multi-dimensional information of an express delivery parcel. The method comprises: scanning an express delivery parcel by means of an X-ray module, so as to obtain an X-ray image of the express delivery parcel (S101); on the basis of the X-ray image, determining external information of the content inside the parcel and express delivery waybill information, wherein a waybill of the express delivery parcel comprises information printed using special ink that appears under X-rays (S102); on the basis of the external information of the content inside the parcel, determining semantic information of the content inside the parcel (S103); and on the basis of the express delivery waybill information, determining express-delivery-waybill-associated information of the express delivery parcel (S104).

Description

Multi-dimensional information collection methods and all-in-one machines for express parcels

[0001] This application claims priority to Chinese Patent Application No. 202411536824.0, filed with the Chinese Patent Office on October 31, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of express parcel technology, such as a method and all-in-one machine for collecting multi-dimensional information from express parcels. Background Technology

[0003] In recent years, as the express delivery industry has grown larger and users' demand for online shopping has increased, the number of express parcels transferred every day can reach hundreds of millions.

[0004] Currently, in express delivery central warehouses, security checks, dynamic weighing, and package scanning modules are typically distributed across different lines, increasing the management complexity of these devices, as well as electricity and space costs. Furthermore, the industry's ability to infer semantic information about the contents of express packages is still in its early stages, resulting in relatively limited data dimensions for acquiring express package data. Summary of the Invention

[0005] This application provides a method and an all-in-one machine for collecting multi-dimensional information from express parcels, so as to realize the simultaneous acquisition of express parcel waybill information, external information of the contents of the express parcel, and semantic information.

[0006] According to one aspect of this application, a method for collecting multi-dimensional information about express parcels is provided, the method comprising:

[0007] The express package is scanned using an X-ray module to obtain a photographic image of the package.

[0008] The external information of the contents of the package and the information on the waybill are determined based on the photographic images; the waybill of the express package includes information printed with special ink for X-ray imaging.

[0009] Determine the semantic information of the contents of the package based on the external information of the contents;

[0010] Determine the associated information of the express delivery package based on the express delivery label information.

[0011] According to another aspect of this application, a multi-dimensional information collection device for express parcels is provided, the device comprising:

[0012] The X-ray module is set to scan express parcels and obtain photographic images of them.

[0013] The main control processing module is configured to determine the external information of the contents of the package and the express delivery label information based on the imaging image; determine the semantic information of the contents of the package based on the external information of the contents of the package; and determine the express delivery label association information of the express package based on the express delivery label information. The express delivery label includes information printed with special ink for X-ray imaging. Attached Figure Description

[0014] Figure 1 is a flowchart of a multi-dimensional information collection method for express parcels provided in Embodiment 1 of this application;

[0015] Figure 2 is a flowchart of a multi-dimensional information collection method for express parcels provided in Embodiment 2 of this application;

[0016] Figure 3 is a structural schematic diagram of a multi-dimensional information collection device for express parcels provided in Embodiment 3 of this application. Detailed Implementation

[0017] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. Such data may be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0018] The data involved in this technical solution (including the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and provisions.

[0019] Example 1

[0020] Figure 1 is a flowchart of a multi-dimensional information collection method for express parcels provided in Embodiment 1 of this application. This embodiment is applicable to situations where external and semantic information of the contents of an express parcel, as well as information associated with the waybill, are identified. This method can be executed by an integrated multi-dimensional information collection machine for express parcels. As shown in Figure 1, the method includes:

[0021] S101. The express package is scanned using an X-ray module to obtain an image of the express package.

[0022] In this embodiment, the X-ray module refers to a scanning module that must be used during the security inspection of express delivery packages to ensure accurate identification of whether dangerous items are contained within the package. The imaging image refers to a three-dimensional image formed after the express delivery package has been scanned, which can identify some basic information about the package.

[0023] Specifically, when a package passes through security, an X-ray module is used to scan the package comprehensively, obtaining a three-dimensional image of the package, which is then used as a photographic image of the package.

[0024] S102. Determine the external information of the contents of the package and the information on the waybill based on the photographic image; wherein, the waybill of the express package includes information printed with special ink for X-ray imaging.

[0025] In this embodiment, the external information of the contents of the package refers to the external information such as the shape, size, volume, and color of the contents of the express package. The express waybill information refers to the information attached to the express label on the express package, including the recipient and sender information, logistics information, tracking number, and information printed with special X-ray imaging ink.

[0026] Specifically, based on the image obtained after the express package is scanned by the X-ray module, the external information of the contents of the express package and the information on the express delivery label are identified. The express delivery label information includes information printed on the label using special ink that can be visualized by X-rays. By using special ink that can be visualized by X-rays to print corresponding information on the express delivery label, this information can be simultaneously acquired when the express package undergoes security scanning by the X-ray module, thereby improving the efficiency of express package security checks and express delivery label information acquisition. Furthermore, due to the projective nature of X-rays, the image is a three-dimensional image of the express package, meaning that even if the express delivery label is facing down (i.e., in contact with the conveyor belt) during security checks, the information on the express delivery label can still be accurately identified.

[0027] S103. Determine the semantic information of the contents of the package based on the external information of the contents.

[0028] Specifically, based on the external information of the contents of the express package identified from the photographic image of the express package, the semantic information of the contents of the express package can be inferred. The semantic information refers to the descriptive information of the contents of the express package, including the type or purpose of the contents, which can be used to determine whether the contents of the express package are dangerous goods.

[0029] In some embodiments, the external information includes at least the image color, shape, and size information;

[0030] Accordingly, the semantic information of the contents of the package is determined based on the external information of the contents, including the following steps A1-A2:

[0031] Step A1: Determine the material information of the contents of the package based on the color of the image.

[0032] Step A2: Determine the semantic information of the contents of the package based on the material, shape, and size information.

[0033] Specifically, by analyzing photographic images of express delivery packages, at least the color, shape, and size of the contents within the package must be identified. Based on the identified color information, the material composition of the contents can be inferred. Combining the shape and size information with the material composition information, the type of the contents can be inferred, and this type information is used as semantic information about the contents.

[0034] In some embodiments, determining the material information of the package contents based on the image color includes:

[0035] The material information of the contents of the package is determined by combining the image color with a predefined rule dictionary; the rule dictionary includes the relationship between image color and material.

[0036] Specifically, based on the actual contents information of the express package, the correlation between the color and material of the contents is determined, and a pre-defined rule dictionary for the contents of the express package is established in advance based on this correlation. Then, based on the color of the image identified from the image of the express package, the range of materials matching the image color is determined in the pre-defined rule dictionary, and this range of materials matching the image color is used as the material information of the contents of the package.

[0037] In some embodiments, determining the semantic information of the package contents based on material information, shape and size information includes the following steps B1-B2:

[0038] Step B1: Based on a pre-trained deep learning model, determine the probability dictionary of the type of contents in the package according to the material information, shape and size information.

[0039] Step B2: Determine the semantic information of the contents of the package based on the type probability dictionary, and determine the warning information based on the type probability dictionary.

[0040] In this embodiment, the deep learning model refers to a machine learning model trained based on deep learning theory to determine the type and corresponding probability of the contents of a courier package based on the material, shape, and size information of the contents. The type probability dictionary refers to a dataset consisting of various types of courier package contents and their corresponding probabilities.

[0041] Specifically, based on a pre-trained deep learning model and the material, shape, and size information of the contents of the express package, the type of the contents and the corresponding probability of each type are determined, and this type and probability are used as a type probability dictionary for the express package contents. The semantic information of the contents is inferred from this type probability dictionary, and based on this semantic information, it is determined whether the contents are dangerous items. If the contents are determined to be dangerous items, a warning message is issued. For example, if the type probability dictionary determined by the deep learning model contains a knife with a 50% probability, clothing with a 20% probability, a mobile phone with a 10% probability, and a toy with a 5% probability, and the probability of identifying a knife is the highest, then the express package is considered to contain a knife, a dangerous item, and a warning message will be issued.

[0042] In some embodiments, the semantic information of the contents of the package is determined according to the type probability dictionary, including taking the type corresponding to the highest type probability in the type probability dictionary of the contents of the express package as the semantic information of the contents of the express package.

[0043] In some embodiments, the semantic information of the contents of the package is determined according to the type probability dictionary, including using all types in the type probability dictionary of the contents of the express package as the semantic information of the contents of the express package.

[0044] S104. Determine the associated information of the express parcel's express waybill based on the express waybill information.

[0045] Specifically, the system obtains the waybill information of the express package based on the image captured during security screening. Then, it retrieves associated information from the waybill. For example, it retrieves the sender's and recipient's information, as well as logistics information, associated with the waybill based on the waybill information.

[0046] In some embodiments, the express waybill associated information includes at least the waybill item information;

[0047] Accordingly, before determining the semantic information of the package contents based on the type probability dictionary, the method further includes:

[0048] The semantic information of the contents of the package is determined based on the type probability dictionary and the item information on the waybill.

[0049] In this embodiment, the waybill item information refers to the basic information of the contents of the express package recorded when the package is packed, including the type of contents. Generally, the waybill item information is determined by the sender or courier; however, due to recording errors, there may be some uncertainty in the waybill item information.

[0050] Specifically, before determining the semantic information of the package contents based on the type probability dictionary, the item information on the waybill is identified. Then, the type of the package contents, as contained in the waybill item information, is combined with the type probability dictionary to determine the semantic information of the package contents. Combining the waybill item information with the type probability dictionary facilitates a more precise determination of the waybill item information, avoiding the uncertainty that may arise when the sender or courier records the waybill item information during packaging, thus improving the accuracy of obtaining the semantic information of the package contents. For example, if the sender records that the package contents are food, the range of the waybill item information is too broad to accurately determine the contents. However, if the identified type probability dictionary shows a 50% probability for books and a 50% probability for cookies, combining the waybill item information and the type probability dictionary can determine that the contents are cookies.

[0051] In some embodiments, the express delivery label information is barcode information, and the express delivery label associated information includes at least one of the following: express delivery label number information, sender information, and recipient information;

[0052] Accordingly, the associated information of the express delivery package is determined based on the express delivery label information, including:

[0053] Based on a pre-established barcode association information database, the associated information of the express delivery package is determined according to the express delivery label information.

[0054] In this embodiment of the application, the barcode association information database refers to the information database established when the express parcel is packaged, which associates the express parcel's tracking number information, sender information, and recipient information with the barcode information of the express parcel.

[0055] Specifically, when printing waybills for express parcels, barcode information is selected as the waybill information. This facilitates the printing of waybills and avoids data loss due to lower printing resolution requirements. When the image of the express parcel identifies the waybill information as barcode information, the identified barcode information is matched with a pre-established barcode association information database to determine the waybill association information of the express parcel associated with that barcode information. For example, the tracking number information associated with the barcode information of the express parcel is searched in the barcode association information database, and the associated tracking number information is used as the waybill association information of the express parcel. Here, the tracking number information is associated with the sender's information and the recipient's information of the express parcel.

[0056] In some embodiments, the method for collecting multi-dimensional information about express parcels further includes:

[0057] The weighing module is used to weigh the express package to obtain its weight information.

[0058] Specifically, while the express parcels are undergoing security checks, a weighing module is used to weigh the parcels and obtain their weight information.

[0059] In some embodiments, after obtaining a photographic image of the express package, the method further includes:

[0060] Determine the volume information of the express package based on the photographic image;

[0061] The weight-to-volume ratio of a courier package is determined based on its volume and weight information.

[0062] Specifically, during security checks of express parcels, X-ray modules are used to acquire images of the parcels, and the volume information of the parcels is identified based on these images. The ratio of the parcel's weight to its volume is used as the parcel's weight-to-volume ratio. This ratio is used to determine whether the parcel is charged based on weight or volume, thereby determining the transportation cost.

[0063] In this embodiment, an X-ray module scans a courier package to obtain an image of the package. Based on the image, the external information of the contents and the waybill information are determined. The waybill includes information printed with special X-ray imaging ink, enabling the effective acquisition of external information such as the color, size, and shape of the contents during security checks, while simultaneously scanning the waybill. This improves the efficiency of both security checks and waybill scanning, reducing time and economic costs. Determining the semantic information of the contents based on their external information allows for the inference of the type of contents and the determination of whether they contain dangerous goods, thus improving the reliability and accuracy of security checks. Furthermore, determining the waybill association information allows for the identification of the sender and recipient information, logistics information, and tracking number, enabling the collection of multi-dimensional information about the courier package during security checks, which better meets the development needs of the express delivery industry.

[0064] Example 2

[0065] Figure 2 is a flowchart of a multi-dimensional information collection method for express parcels provided in Embodiment 2 of this application. As shown in Figure 2, the method includes the following steps C1-C3:

[0066] Step C1: When the express package enters the multi-dimensional information collection machine, the weighing module of the machine weighs the express package to determine its weight information, and the X-ray module scans the express package to determine its imaging image.

[0067] Step C2: The main control processing module of the multi-dimensional information collection machine for express parcels determines the external information of the contents of the express parcel and the volume information of the express parcel based on the imaging image determined by the X-ray module. The external information of the contents of the parcel includes at least the imaging color, shape and size information.

[0068] Step C3: The main control processing module collects external information about the contents of the package, the volume information of the express package, and the weight information of the express package.

[0069] In some embodiments, after the main control processing module collects the external information of the contents of the package, the volume information of the express package, and the weight information of the express package, it also includes automatic security inspection and manual security inspection of the express package.

[0070] In some embodiments, automated security checks include the following steps D1-D4:

[0071] Step D1: The main control processing module calculates the weight-to-bubble ratio of the express package based on the volume and weight information of the express package, and determines the material information of the contents of the package based on the image color.

[0072] Step D2: The main control processing module determines the type probability dictionary of the package contents based on the pre-trained deep learning model, according to the material information, shape and size information.

[0073] Step D3: The main control processing module determines the semantic information of the contents of the package based on the type probability dictionary.

[0074] Step D4: The main control processing module determines whether the package contents include dangerous goods based on the type probability dictionary. If the package contents include dangerous goods, an early warning is triggered, and manual processing begins. The package is then re-entered into the multi-dimensional information collection machine for further inspection. If the package contents do not contain dangerous goods, the main control processing module writes the relevant package information into the database.

[0075] In some embodiments, manual security checks include:

[0076] The system manually assesses whether the image captured by the scanner contains hazardous materials. If the image contains hazardous materials, an alert is triggered, and the package is manually re-entered into the multi-dimensional information collection machine for further inspection. If the image does not contain hazardous materials, and the automatic security check does not trigger an alert, both checks are normal, and the package passes security.

[0077] In some embodiments, after the X-ray module determines the image of the express package, the following steps E1-E2 are further included:

[0078] Step E1: The main control processing module determines the express waybill information based on the photographed image.

[0079] Step E2: The main control processing module determines whether a warning message appears within the set time. If a warning message appears within the set time, it waits for manual processing. After manual processing is completed, the main control processing module writes the express waybill information into the database, indicating that the package has passed the scanning process. If no warning message appears within the set time, the main control processing module writes the express waybill information into the database, indicating that the package has passed the scanning process. The set time is a pre-set time for express security checks; for example, the set time can be pre-set to 10 minutes.

[0080] In this embodiment, a weighing module determines the weight of the express package, an X-ray module obtains an image of the package, and a main control processing module determines the external information of the contents, the volume of the package, and the waybill information based on the image. It also infers the semantic information of the contents, enabling the collection of multi-dimensional information about the express package while conducting security checks, which better meets the development needs of the express delivery industry. Furthermore, the main control processing module determines whether the contents of the package include dangerous goods based on the semantic information, improving the efficiency and accuracy of express package security checks.

[0081] Example 3

[0082] Figure 3 is a structural schematic diagram of a multi-dimensional information collection device for express parcels provided in Embodiment 3 of this application. This embodiment is applicable to situations where external information and semantic information of the contents of an express parcel, as well as information associated with the express waybill, are identified. As shown in Figure 3, the device includes:

[0083] X-ray module 301 is configured to scan express parcels and obtain photographic images of the express parcels;

[0084] The main control processing module 302 is configured to determine the external information of the contents of the package and the express delivery label information based on the photographic image; determine the semantic information of the contents of the package based on the external information of the contents of the package; and determine the express delivery label association information of the express package based on the express delivery label information; wherein, the express delivery label of the express package includes information printed with special ink for X-ray imaging.

[0085] In some embodiments, the all-in-one machine further includes:

[0086] The weighing module is set to weigh the express parcels and obtain their weight information.

[0087] The main control processing module 302 is configured to determine the volume information of the express package based on the photographic image; and to determine the weight-to-bubble ratio of the express package based on the volume and weight information of the express package.

[0088] In some embodiments, the external information includes at least the image color, shape, and size information;

[0089] Accordingly, the semantic information of the contents of the package is determined based on the external information of the contents, including:

[0090] Determine the material information of the package contents based on the color of the image;

[0091] The semantic information of the contents of the package is determined based on the material, shape, and size information.

[0092] In some embodiments, determining the material information of the package contents based on the image color includes:

[0093] The material information of the contents of the package is determined by combining the image color with a predefined rule dictionary; the rule dictionary includes the relationship between image color and material.

[0094] In some embodiments, semantic information about the contents of a package is determined based on material information, shape, and size information, including:

[0095] Based on a pre-trained deep learning model, a probability dictionary of the type of contents in a package is determined according to material, shape, and size information.

[0096] The semantic information of the contents of the package is determined based on the type probability dictionary, and the warning information is also determined based on the type probability dictionary.

[0097] In some embodiments, the express waybill associated information includes at least the waybill item information;

[0098] Accordingly, before determining the semantic information of the package contents based on the type probability dictionary, the following steps are also included:

[0099] The semantic information of the contents of the package is determined based on the type probability dictionary and the item information on the waybill.

[0100] In some embodiments, the express delivery label information is barcode information, and the express delivery label associated information includes at least one of the following: express delivery label number information, sender information, and recipient information;

[0101] Accordingly, the associated information of the express delivery package is determined based on the express delivery label information, including:

[0102] Based on a pre-established barcode association information database, the associated information of the express delivery package is determined according to the express delivery label information.

[0103] In some embodiments, the all-in-one machine further includes:

[0104] Input interface module: configured to control and manage the integrated machine for collecting multi-dimensional information about express parcels;

[0105] Output interface module: This module is configured to provide a human-computer interaction interface and output relevant information about the express parcel, including photographic images of the parcel.

[0106] In this embodiment, an X-ray module scans a courier package to obtain an image of the package. Based on the image, the external information of the contents and the waybill information are determined. The waybill includes information printed with special X-ray imaging ink, enabling the effective acquisition of external information such as the color, size, and shape of the contents during security checks, while simultaneously scanning the waybill. This improves the efficiency of both security checks and waybill scanning, reducing time and economic costs. Determining the semantic information of the contents based on their external information allows for the inference of the type of contents and the determination of whether they contain dangerous goods, thus improving the reliability and accuracy of security checks. Furthermore, determining the waybill association information allows for the identification of the sender and recipient information, logistics information, and tracking number, enabling the collection of multi-dimensional information about the courier package during security checks, which better meets the development needs of the express delivery industry. The multi-dimensional information collection device for express parcels provided in this application can execute the multi-dimensional information collection method for express parcels provided in any embodiment of this application, and has the corresponding functional modules and beneficial effects of the execution method.

Claims

1. A method for collecting multi-dimensional information about express parcels, comprising: The express package is scanned using an X-ray module to obtain a photographic image of the express package; The external information of the contents of the package and the information on the waybill are determined based on the photographic image; wherein, the waybill of the express package includes information printed with special ink for X-ray imaging; Determine the semantic information of the contents of the package based on the external information of the contents of the package; The waybill association information of the express package is determined based on the waybill information.

2. The method according to claim 1, wherein, The external information includes at least the color, shape, and size of the image; Determining the semantic information of the contents of the package based on the external information of the contents includes: The material information of the contents of the package is determined based on the color of the reflected image. The semantic information of the contents of the package is determined based on the material information, shape, and size information.

3. The method according to claim 2, wherein, Determining the material information of the contents of the package based on the reflected color includes: The material information of the contents of the package is determined based on a predetermined rule dictionary and the reflected color; wherein, the rule dictionary includes the relationship between the reflected color and the material.

4. The method according to claim 2 or 3, wherein, The semantic information of the contents of the package is determined based on the material, shape, and size information, including: Based on a pre-trained deep learning model, a probability dictionary of the type of contents of the package is determined according to the material information, shape and size information; The semantic information of the contents of the package is determined based on the type probability dictionary, and the warning information is determined based on the type probability dictionary.

5. The method according to claim 4, wherein, The information associated with the express delivery waybill includes at least the item information on the waybill. Before determining the semantic information of the package contents based on the type probability dictionary, the method further includes: The semantic information of the contents of the package is determined based on the type probability dictionary and the item information on the shipping label.

6. The method according to claim 1, wherein, The express delivery label information is barcode information, and the express delivery label associated information includes at least one of the following: express delivery label number information, sender information, and recipient information; The express waybill association information of the express package is determined based on the express waybill information, including: Based on a pre-established barcode association information database, the express delivery label association information of the express parcel is determined according to the express delivery label information.

7. The method according to claim 1, further comprising: The weight of the express package is obtained by weighing the package using a weighing module.

8. The method according to claim 7, after obtaining the photographic image of the express package, the method further includes: The volume information of the express package is determined based on the photographic image; The weight-to-volume ratio of the express package is determined based on its volume and weight information.

9. A multi-dimensional information collection device for express parcels, comprising: The X-ray module is configured to scan express parcels to obtain imaging images of the parcels. The main control processing module is configured to determine the external information of the contents of the package and the express delivery label information based on the photographic image; determine the semantic information of the contents of the package based on the external information of the contents of the package; and determine the express delivery label association information of the express package based on the express delivery label information; wherein the express delivery label of the express package includes information printed with special ink for X-ray imaging.

10. The all-in-one machine according to claim 9, further comprising: The weighing module is configured to weigh the express package and obtain the weight information of the express package; The main control processing module is configured to determine the volume information of the express package based on the photographic image; And determine the weight-to-volume ratio of the express package based on the volume information and weight information of the express package.

Images