Method, device and equipment for calculating effective volume of irregular package and storage medium
By setting reference and offset areas on the conveyor belt and using airflow disturbances caused by wind power equipment to calculate the effective volume of irregular packages, the problem of inaccurate calculation of effective volume of packages in the logistics industry is solved, and the reasonable solution to transportation costs is achieved plan.
Patent Information
- Application Number
- CN202410836987.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-26
- Publication Date
- 2024-11-26
AI Technical Summary
The existing technology cannot accurately calculate the effective volume of irregular parcels, resulting in unreasonable transportation costs in the logistics industry.
The reference area and the offset area are set on the conveyor belt, and the offset area is equipped with wind power equipment. By taking images wrapped in different areas, the position of the invalid volume is changed by using airflow disturbance, so that the effective volume is calculated through the image overlap area.
Efficient and fault-tolerant calculation of the effective volume of the parcel ensures the rationality of transportation costs in the logistics industry and overcomes the accuracy of traditional methods.
Smart Images

Figure CN119027481A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of logistics technology, and in particular to a method, device, equipment and storage medium for calculating the effective volume of an irregular package. Background Art
[0002] In the logistics industry, items need to be packed into packages before being transported. When calculating freight, the volume of the package is measured as the volume of the item. The existing measurement method is to obtain the three-dimensional contour data of the package through three-dimensional visual measurement and depth sensor technology, and calculate the volume, size and other information of the package after processing and analysis.
[0003] However, in the actual transportation scenarios of the logistics industry, the existing measurement methods have certain shortcomings, mainly reflected in the following aspects: the volume of a package usually includes two parts: effective volume and invalid volume. For example, when a package has a tie, the tie is the invalid volume part, and the part without the tie is the effective volume part. However, in the measurement, the tie will also be counted as the package volume, which is contrary to the charging rules of the logistics industry. Therefore, a method for calculating the effective volume of irregular packages is urgently needed. Summary of the invention
[0004] The present invention provides a method, device, equipment and storage medium for calculating the effective volume of an irregular package, which are used to solve the defect that the effective volume of an irregular package cannot be accurately calculated in the traditional method.
[0005] In order to solve the above technical problems, in a first aspect, the present invention provides a method for calculating the effective volume of an irregular package, the method comprising:
[0006] A reference area and an offset area are arranged on the conveyor belt along its transport direction; the offset area is provided with a wind power device so that air flow disturbance exists in the offset area;
[0007] Taking a first set of images of a package including an effective volume portion and an ineffective volume portion passing through the reference area, and a second set of images of the package passing through the offset area; the second set of images including the effective volume portion of the package, and the ineffective volume portion whose position is offset due to airflow disturbance;
[0008] An overlapping area between the first set of images and the second set of images is determined, and a volume of the effective volume portion of the package is calculated based on the overlapping area.
[0009] Optionally, the first set of images includes a first top view and a first side view, and the second set of images includes a second top view and a second side view;
[0010] The determining an overlapping area between the first group of images and the second group of images, and calculating the volume of the effective volume portion of the package according to the overlapping area, comprises:
[0011] Determine a top view overlapping area between the first top view and the second top view, and a side view overlapping area between the first side view and the second side view;
[0012] Stereo matching is performed on the top-view overlapping area and the side-view overlapping area to obtain depth information of the effective volume portion of the package, so as to calculate the volume of the effective volume portion of the package.
[0013] Optionally, determining a top view overlapping area between the first top view and the second top view, and a side view overlapping area between the first side view and the second side view includes:
[0014] By matching feature points, respectively calculating a first homography matrix between the first top view and the second top view, and a second homography matrix between the first side view and the second side view;
[0015] The top-view overlapping area is determined according to the first homography matrix, and the side-view overlapping area is determined according to the second homography matrix.
[0016] Optionally, determining the top-view overlapping area according to the first homography matrix, and determining the side-view overlapping area according to the second homography matrix includes:
[0017] According to the first homography matrix, an intersection of polygons enclosed by feature points determined by feature point matching between the first top view and the second top view is calculated to determine the top view overlapping area;
[0018] According to the second homography matrix, an intersection of polygons enclosed by feature points determined by feature point matching between the first side view and the second side view is calculated to determine the side view overlapping area.
[0019] Optionally, performing stereo matching on the top-view overlapping area and the side-view overlapping area to obtain depth information of the effective volume portion of the package to calculate the volume of the effective volume portion of the package includes:
[0020] Performing stereo matching on the binary image corresponding to the top-view overlapping area and the binary image corresponding to the side-view overlapping area to obtain depth information corresponding to the overlapping area;
[0021] The volume of the effective volume of the package is calculated based on the three-dimensional data including the depth information of the overlapping area.
[0022] Optionally, the wind power device is arranged on one side of the conveyor belt parallel to the offset area to provide wind power to the offset area.
[0023] Optionally, a first camera is provided above the conveyor belt to capture the first top view and the second top view; a second camera is provided on the other side of the conveyor belt opposite to the wind power equipment to capture the first side view and the second side view.
[0024] In a second aspect, the present invention provides an effective volume calculation device for irregular packages, comprising a transmission module, a shooting module and a calculation module;
[0025] The transmission module is used to set a reference area and an offset area on the conveyor belt along its transport direction; the offset area is provided with a wind power device so that there is airflow disturbance in the offset area;
[0026] The shooting module is used to shoot a first group of images of the package passing through the reference area, including an effective volume part and an invalid volume part, and a second group of images of the package passing through the offset area; the second group of images includes the effective volume part of the package, and the invalid volume part whose position is offset under airflow disturbance;
[0027] The calculation module is used to determine the overlapping area of the first group of images and the second group of images, and calculate the volume of the effective volume portion of the package according to the overlapping area.
[0028] In a third aspect, the present invention provides a device for calculating the effective volume of an irregular package, comprising a memory and a processor, wherein:
[0029] The memory is used to store computer programs;
[0030] The processor is used to read the program in the memory and execute the steps of a method for calculating the effective volume of an irregular package provided in the first aspect above.
[0031] In a fourth aspect, the present invention provides a computer-readable storage medium having a readable computer program stored thereon, which, when executed by a processor, implements the steps of a method for calculating the effective volume of an irregular package as provided in the first aspect above.
[0032] Compared with the prior art, the method, device, equipment and storage medium for calculating the effective volume of irregular packages provided by the present invention have the following beneficial effects:
[0033] First, a reference area and an offset area are set on the conveyor belt along the transportation direction, and a wind power device is set in the offset area; when the package passes through the reference area on the conveyor belt, a first group of images of the package are taken, and when the package passes through the offset area of the conveyor belt, a second group of images of the package are taken. Since the package is affected by airflow disturbance when passing through the offset area, the invalid volume part of the package in the offset area changes position compared with the reference area, so the second group of images is the same as the effective volume part in the first group of images, and the invalid volume part is different; based on the overlapping area of the first group of images and the second group of images, the overlapping area can be regarded as the effective volume part of the package, and the volume of the effective volume part of the package is calculated according to the overlapping area.
[0034] The embodiment of the present invention arranges wind power equipment in the offset area of the conveyor belt, so that when the package passes through the offset area, the position of the invalid volume portion changes, while the effective volume portion remains unchanged. Therefore, the volume of the effective volume portion of the package can be calculated efficiently and with high fault tolerance based on the overlapping area of the first group of images and the second group of images, thereby overcoming the defect of the existing method that the effective volume of the package cannot be accurately calculated, and ensuring the rationality of charges in the logistics industry. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only part of the embodiments of the present invention, rather than all of the embodiments. For ordinary technicians in this field, without paying creative work, other drawings obtained based on these drawings all fall within the scope of protection of this application.
[0036] Figure 1 is a flow chart of a method for calculating the effective volume of an irregular package provided by an embodiment of the present invention;
[0037] Figure 2 is a flow chart of a method for calculating an effective volume based on an overlapping area provided by an embodiment of the present invention;
[0038] Figure 3 is an image schematic diagram of a first group of images and a second group of images provided by an embodiment of the present invention;
[0039] Figure 4 is an image schematic diagram of a top view overlapping area and a side view overlapping area provided by an embodiment of the present invention;
[0040] Figure 5 is a schematic diagram of a homography matrix provided by an embodiment of the present invention;
[0041] Figure 6is a schematic diagram of the relative positions of a wind power device and a conveyor belt provided by an embodiment of the present invention;
[0042] Figure 7 is a schematic diagram of the relative positions of a first camera, a second camera and a conveyor belt provided by an embodiment of the present invention;
[0043] Figure 8 is a schematic structural diagram of an effective volume calculation device for irregular packages provided by an embodiment of the present invention;
[0044] Fig. 9 The present invention also provides a schematic diagram of the structure of an effective volume calculation device for irregular packages;
[0045] Fig.10 An embodiment of the present invention further provides a structural schematic diagram of a computer-readable storage medium. DETAILED DESCRIPTION
[0046] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.
[0047] In order to make the description of the disclosed content more detailed and complete, the following is an illustrative description of the implementation mode and specific examples of the present invention; however, this is not the only form of implementing or applying the specific embodiments of the present invention. The implementation mode covers the features of multiple specific embodiments and the method steps and their sequence for constructing and operating these specific embodiments. However, other specific embodiments can also be used to achieve the same or equal functions and step sequences. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.
[0048] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein.
[0049] In the description of the embodiments of the present invention, unless otherwise specified, “ / ” means or, for example, A / B can mean A or B; “and / or” in the text is merely a description of the association relationship of associated objects, indicating that three relationships may exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, “multiple” refers to two or more than two, and other quantifiers are similar. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention, and the embodiments of the present application and the features in the embodiments may be combined with each other without conflict.
[0050] Example 1
[0051] like Figure 1 The flowchart of a method for calculating the effective volume of an irregular package provided in an embodiment of the present invention includes the following steps.
[0052] Step S101, setting a reference area and an offset area on a conveyor belt along its transport direction; the offset area is provided with wind power equipment so that there is airflow disturbance in the offset area.
[0053] A reference area and an offset area are pre-set along the transport direction of the conveyor belt. The offset area is provided with a wind power device. Exemplarily, the wind power device provides parallel wind in a certain direction to the offset area, so that airflow disturbance exists in the offset area.
[0054] Step S102, capturing a first set of images of a package including an effective volume portion and an invalid volume portion passing through the reference area, and a second set of images of the package passing through the offset area; the second set of images includes the effective volume portion of the package, and the invalid volume portion whose position is offset due to airflow disturbance.
[0055] The package is an irregular package after the goods are packed with a packaging bag. The package includes an effective volume part and an invalid volume part. For example, the effective volume part of the package is the actual volume part that tightly wraps the packaged goods and can reflect the volume of the goods. The position of this part will not change under the disturbance of airflow; the invalid volume part is the remaining part of the package that does not reflect the volume of the goods, such as the tie of the packaging bag. The position of the invalid volume part will change under the disturbance of airflow in the offset area. Based on this, when the package is in the reference area, the first set of images of the package is taken; when the package is in the offset area, when the shape of the invalid volume part of the package disturbed by the airflow changes, the second set of images of the package is taken. It can be known that the packages captured by the first set of images and the second set of images both include an effective volume part and an invalid volume part, but the invalid volume part of the package captured by the second set of images changes its position under the disturbance of airflow, but the position of the effective volume part does not change. Therefore, relative to the first set of images of the package, in the second set of images of the package, the shape of the effective volume part of the package is the same, while the shape of the invalid volume part is different.
[0056] Step S103: determining an overlapping area between the first set of images and the second set of images, and calculating the volume of the effective volume portion of the package according to the overlapping area.
[0057] Since the size and position of the effective volume part wrapped in the first group of images and the second group of images are the same, and the size of the invalid volume part is the same but the position is different, that is, the effective volume part wrapped is the overlapping area of the first group of images and the second group of images, therefore, the overlapping area of the first group of images and the second group of images is determined, and the volume of the effective volume part wrapped can be calculated according to the overlapping area.
[0058] The embodiment of the present invention arranges wind power equipment in the offset area of the conveyor belt so that the position of the invalid volume portion changes when the package passes through the offset area, while the effective volume portion remains unchanged. Therefore, the volume of the effective volume portion of the package can be calculated efficiently and with high fault tolerance based on the overlapping area of the first group of images and the second group of images.
[0059] As an optional implementation, the first group of images includes a first top view and a first side view, and the second group of images includes a second top view and a second side view;
[0060] like Figure 2 FIG. 1 is a flow chart of a method for calculating an effective volume according to an overlapping area provided by an embodiment of the present invention. In step S103, determining the overlapping area of the first group of images and the second group of images, and calculating the volume of the effective volume portion of the package according to the overlapping area, includes:
[0061] S1031: Determine a top view overlapping area between the first top view and the second top view, and a side view overlapping area between the first side view and the second side view.
[0062] For example, Figure 3 As shown, it is an image schematic diagram of a first group of images and a second group of images provided in an embodiment of the present invention. The arrow in the figure indicates the transmission direction of the package on the conveyor belt, the reference area is set in the front, and the offset area is set in the back. The first group of images includes a first top view and a first side view. When the package is transmitted to the reference area, the first top view is collected downward from above the conveyor belt, and the first side view is collected in parallel on one side of the conveyor belt. The second group of images includes a second top view and a second side view. When the package is transmitted to the reference area, the second top view is collected downward from above the conveyor belt, and the second side view is collected in parallel on one side of the conveyor belt. The effective partial volume is calculated based on the overlapping area. The side view overlapping area corresponding to the effective partial volume can be determined based on the first side view and the second side view. At the same time, the top view overlapping area corresponding to the effective partial volume can be determined based on the first top view and the second top view. The following is obtained: Figure 4 The image schematic diagram of the top view overlapping area and the side view overlapping area is shown, wherein the shaded portion in the first top view and the second top view is the top view overlapping area, and the shaded portion in the first side view and the second side view is the side view overlapping area.
[0063] S1032: Perform stereo matching on the top-view overlapping area and the side-view overlapping area to obtain depth information of the effective volume portion of the package to calculate the volume of the effective volume portion of the package.
[0064] By performing stereo matching on the top view overlapping area determined in the aforementioned step S1031, i.e., the top view of the effective volume part of the package, and the side view overlapping area, i.e., the side view of the effective volume part of the package, important depth information in the three-dimensional data of the effective volume part of the package can be obtained, so that the volume of the effective volume part can be calculated in combination with the data of the other two dimensions in the three-dimensional data.
[0065] The embodiment of the present invention captures two groups of images of a package at different angles, and obtains depth information of the effective volume portion of the package by stereo matching the two overlapping area images at different angles, thereby improving the accuracy and efficiency of volume calculation of the effective volume portion of the package.
[0066] As an optional implementation manner, determining the top view overlapping area of the first top view and the second top view, and the side view overlapping area of the first side view and the second side view in step S1031 includes:
[0067] By matching feature points, respectively calculating a first homography matrix between the first top view and the second top view, and a second homography matrix between the first side view and the second side view;
[0068] The top-view overlapping area is determined according to the first homography matrix, and the side-view overlapping area is determined according to the second homography matrix.
[0069] Exemplarily, taking the feature point matching between the first top view and the second top view as an example, algorithms such as the Scale-Invariant Feature Transform (SIFT), the Speeded-Up Robust Features (SURF), the Features from Accelerated Segment Test (FAST), the Oriented FAST and Rotated BRIEF (ORB) and the like can be used to extract the feature points of the two top views respectively; then, the descriptors corresponding to each feature point in the first top view and the second top view are extracted respectively; then, by matching the descriptors, the matching feature point pairs in the first top view and the second top view are found; according to the coordinates of the matching feature point pairs of the first top view and the second top view, the equation group is solved by mathematical methods to calculate the first homography matrix between the first top view and the second top view.
[0070] Optionally, since there may be incorrect matches in the feature point matching results, the Random Sample Consensus (RANSAC) algorithm can be used to eliminate incorrectly matched feature point pairs in the top view and the top view to obtain matched feature point pairs, and then the homography matrix is determined based on the matched feature point pairs.
[0071] like Figure 5 FIG. 1 is a schematic diagram of a homography matrix provided by an embodiment of the present invention. The calculation principle of the homography matrix is as follows:
[0072] Given two images c, c′ and a plane π, the matching feature points x = [u, υ] on the two images are T and x′=[u′,υ′] T A pixel point x projected onto plane π π , the homography matrix H is defined as a linear matrix such that:
[0073]
[0074] Among them, ~ represents homogeneous coordinates, and u and υ represent conversion to homogeneous coordinate form.
[0075] The homography matrix is calculated based on the homogeneous coordinates of the matching feature points, and formula (1) is simplified to obtain:
[0076] q b =H ba q a , (2)
[0077] Among them, H ba is the homography matrix from pixel system a to pixel system b:
[0078]
[0079] The homography matrix contains the camera intrinsic parameter matrix K a and K b , rotation parameter R ba , translation parameter t ba and plane parameters {n a ,d a}, it can be seen from formula (1) to formula (3) that after the homography matrix is introduced, all the feature points of image c are projected into image c′, so that the pixels of b can be directly obtained through the pixels of a.
[0080] The second homography matrix of the first side view and the second side view is calculated according to the same steps. The specific calculation process is the same as the above steps. Please refer to the above steps for details, which will not be repeated here.
[0081] The homography matrix constrains the 2D homogeneous coordinates of the same 3D spatial point in two pixel planes. With the homography matrix, the positions of the vertices of the second top view in the first top view and the positions of the vertices of the second side view in the first top view can be calculated, thereby calculating the polygon vertices in the two sets of images.
[0082] As an optional implementation manner, determining the top-view overlapping area according to the first homography matrix, and determining the side-view overlapping area according to the second homography matrix includes:
[0083] According to the first homography matrix, an intersection of polygons enclosed by feature points determined by feature point matching between the first top view and the second top view is calculated to determine the top view overlapping area;
[0084] According to the second homography matrix, an intersection of polygons enclosed by feature points determined by feature point matching between the first side view and the second side view is calculated to determine the side view overlapping area.
[0085] According to the first homography matrix, the positions of the feature points of the first top view in the second top view are calculated, and the feature points in the first top view are connected. For example, each vertex in the first top view is connected to obtain a polygon enclosed by the first top view. At the same time, the feature points in the second top view corresponding to each vertex in the first top view are connected to obtain a polygon enclosed by the second top view. According to the intersection of the polygons enclosed by the feature points of the first top view and the second top view, the top view overlapping area is determined.
[0086] At the same time, according to the second homography matrix, the positions of each feature point of the first side view in the second side view are calculated, and the feature points in the first side view are connected. For example, each vertex in the first side view is connected to obtain a polygon enclosed by the first side view. At the same time, the feature points in the second side view corresponding to each vertex in the first side view are connected to obtain a polygon enclosed by the second side view. According to the intersection of the polygons enclosed by the feature points of the first side view and the second side view, the side view overlapping area is determined.
[0087] The present invention extracts the common area in two groups of images through the homography matrix, thereby realizing the rapid determination of the effective volume part of the package.
[0088] As an optional implementation manner, the performing stereo matching on the top view overlapping area and the side view overlapping area to obtain depth information of the effective volume portion of the package to calculate the volume of the effective volume portion of the package includes:
[0089] Performing stereo matching on the binary image corresponding to the top-view overlapping area and the binary image corresponding to the side-view overlapping area to obtain depth information corresponding to the overlapping area;
[0090] The volume of the effective volume of the package is calculated based on the three-dimensional data including the depth information of the overlapping area.
[0091] Exemplarily, the top-view overlapping area and the side-view overlapping area can be read by the imread function in the MTLAB software; then the image conversion is performed by the rgb2gray function and the imbinarize function to obtain a binary image corresponding to the top-view overlapping area and a binary image corresponding to the side-view overlapping area.
[0092] Stereo matching is performed on the binary image corresponding to the overlapping area in the top view and the binary image corresponding to the overlapping area in the side view to obtain the depth information corresponding to the overlapping area. Three-dimensional data containing the depth information is created through the size function and the zeros function, and the volume of the effective volume part is obtained by summing up using the sum function.
[0093] As an optional implementation, the wind power device is arranged on one side of the conveyor belt parallel to the offset area to provide wind power to the offset area.
[0094] like Figure 6 The figure shows a schematic diagram of the setting of a wind power device provided by an embodiment of the present invention. The wind power device is arranged in parallel on one side of the offset area in the conveyor belt, and the wind power device provides wind to the offset area. A coordinate system is constructed with the starting point of the conveyor belt as the origin, the range of the reference area is (a1, a2), and the range of the offset area is (a2, b2). Then, the effective range of the wind power device is (a2, b2), so as to ensure that when the package is transmitted to the offset area, the position of the package mouth of the invalid volume part will be significantly offset due to the light weight, so that the position of the invalid volume part in the first group of images and the second group of images is different.
[0095] As an optional embodiment, a first camera is provided above the conveyor belt to capture the first top view and the second top view; a second camera is provided on the other side of the conveyor belt opposite to the wind power equipment to capture the first side view and the second side view.
[0096] For example, Figure 7 As shown, it is a schematic diagram of the setting of a first camera and a second camera provided in an embodiment of the present invention, wherein a first camera is arranged above a conveyor belt, and a first top view of a package passing through a reference area and a second top view of the package passing through an offset area are obtained through the first camera; a second camera is arranged on the other side of the conveyor belt, the second camera is arranged parallel to the conveyor belt, and the second camera is arranged opposite to the other side where the wind power equipment is arranged, and a second top view of the package passing through the reference area and a second side view of the package passing through the offset area are obtained through the second camera.
[0097] Among them, the first top view and the second top view taken by the first camera and the first side view and the second side view taken by the second camera are directly uploaded to the cloud, and the effective volume of the package is calculated in the cloud, thereby realizing automatic measurement.
[0098] The present invention provides a method, device, equipment and storage medium for calculating the effective volume of an irregular package, which has the following beneficial effects:
[0099] First, a reference area and an offset area are set on the conveyor belt along the transportation direction, and a wind power device is set in the offset area; when the package passes through the reference area on the conveyor belt, a first group of images of the package are taken, and when the package passes through the offset area of the conveyor belt, a second group of images of the package are taken. Since the package is affected by airflow disturbance when passing through the offset area, the invalid volume part of the package in the offset area changes position compared with the reference area, so the second group of images is the same as the effective volume part in the first group of images, and the invalid volume part is different; based on the overlapping area of the first group of images and the second group of images, the overlapping area can be regarded as the effective volume part of the package, and the volume of the effective volume part of the package is calculated according to the overlapping area.
[0100] The embodiment of the present invention arranges wind power equipment in the offset area of the conveyor belt, so that when the package passes through the offset area, the position of the invalid volume portion changes, while the effective volume portion remains unchanged. Therefore, the volume of the effective volume portion of the package can be calculated efficiently and with high fault tolerance based on the overlapping area of the first group of images and the second group of images, thereby overcoming the defect of the traditional method that the effective volume of the package cannot be accurately calculated, and ensuring the rationality of the charges in the logistics industry.
[0101] Example 2
[0102] Based on the above-mentioned method for calculating the effective volume of an irregular package, an embodiment of the present invention provides a device for calculating the effective volume of an irregular package, such as Figure 8 As shown, it includes a transmission module 810, a shooting module 820 and a calculation module 830;
[0103] The transmission module 810 is used to set a reference area and an offset area on the conveyor belt along its transport direction; the offset area is provided with a wind power device so that there is airflow disturbance in the offset area;
[0104] The photographing module 820 is used to photograph a first group of images of the package passing through the reference area, including an effective volume portion and an ineffective volume portion, and a second group of images of the package passing through the offset area; the second group of images includes the effective volume portion of the package and the ineffective volume portion whose position is offset due to airflow disturbance;
[0105] The calculation module 830 is used to determine the overlapping area between the first group of images and the second group of images, and calculate the volume of the effective volume portion of the package according to the overlapping area.
[0106] For other details about how the modules in the above-mentioned device for calculating the effective volume of an irregular package implement the above-mentioned technical solution, please refer to the description of the method for calculating the effective volume of an irregular package provided in the above-mentioned embodiment of the invention, which will not be repeated here.
[0107] Based on the above-mentioned method for calculating the effective volume of an irregular package, Fig. 9 As shown, an embodiment of the present invention further provides a schematic diagram of the structure of an effective volume calculation device for irregular packages, the recognition device includes a processor 91 and a memory 92 coupled to the processor 91. The memory 92 stores a computer program, and when the computer program is executed by the processor 91, the processor 91 executes the steps of an effective volume calculation method for irregular packages in the above embodiment.
[0108] For other details about how the processor 91 in the above-mentioned device for calculating the effective volume of an irregular package implements the above-mentioned technical solution, please refer to the description of the method for calculating the effective volume of an irregular package provided in the above-mentioned embodiment of the invention, which will not be repeated here.
[0109] Among them, the processor 91 can also be called a CPU (Central Processing Unit), and the processor 91 may be an integrated circuit chip with signal processing capabilities; the processor 91 can also be a general-purpose processor, DSP (Digital Signal Process), ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, among which the general-purpose processor can be a microprocessor or the processor 91 can also be any conventional processor, etc.
[0110] like Fig.10 As shown, the embodiment of the present invention also provides a schematic diagram of the structure of a computer-readable storage medium, on which a readable computer program 101 is stored; wherein the computer program 101 can be stored in the above storage medium in the form of a software product, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, magnetic disk or optical disk, ROM (Read-Only Memory), RAM (Random Access Memory) and other media that can store program codes, or terminal devices such as computers, servers, mobile phones, and tablets.
[0111] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules, which can be electrical, mechanical or other forms.
[0112] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0113] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium.
[0114] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.
[0115] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, a computer, a server, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or a data center that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.
[0116] The technical solution provided by the present application is introduced in detail above. The principles and implementation methods of the present application are explained by using specific examples in the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
[0117] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.
[0118] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0119] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0120] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0121] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims
1. A method for calculating the effective volume of an irregular package, characterized in that: include: A reference area and an offset area are arranged on the conveyor belt along its transport direction; the offset area is provided with a wind power device so that air flow disturbance exists in the offset area; capturing a first set of images of a parcel including an effective volume portion and an ineffective volume portion passing through the reference region, and a second set of images of the parcel passing through the offset region; The second set of images includes the effective volume portion of the package and the ineffective volume portion whose position is shifted due to airflow disturbance; An overlapping area between the first set of images and the second set of images is determined, and a volume of the effective volume portion of the package is calculated based on the overlapping area.
2. The method for calculating the effective volume of irregular packages according to claim 1, characterized in that: The first set of images includes a first top view and a first side view, and the second set of images includes a second top view and a second side view; The determining an overlapping area between the first group of images and the second group of images, and calculating the volume of the effective volume portion of the package according to the overlapping area, comprises: Determine a top view overlapping area between the first top view and the second top view, and a side view overlapping area between the first side view and the second side view; Stereo matching is performed on the top-view overlapping area and the side-view overlapping area to obtain depth information of the effective volume portion of the package, so as to calculate the volume of the effective volume portion of the package.
3. The method for calculating the effective volume of irregular packages according to claim 2, characterized in that: The determining of the top view overlapping area of the first top view and the second top view, and the side view overlapping area of the first side view and the second side view includes: By matching feature points, respectively calculating a first homography matrix between the first top view and the second top view, and a second homography matrix between the first side view and the second side view; The top-view overlapping area is determined according to the first homography matrix, and the side-view overlapping area is determined according to the second homography matrix.
4. The method for calculating the effective volume of irregular packages according to claim 3, characterized in that: The determining the top-view overlapping area according to the first homography matrix, and determining the side-view overlapping area according to the second homography matrix, comprises: According to the first homography matrix, an intersection of polygons enclosed by feature points determined by feature point matching between the first top view and the second top view is calculated to determine the top view overlapping area; According to the second homography matrix, an intersection of polygons enclosed by feature points determined by feature point matching between the first side view and the second side view is calculated to determine the side view overlapping area.
5. The method for calculating the effective volume of irregular packages according to claim 2, characterized in that: The performing stereo matching on the top view overlapping area and the side view overlapping area to obtain depth information of the effective volume portion of the package to calculate the volume of the effective volume portion of the package includes: Performing stereo matching on the binary image corresponding to the top-view overlapping area and the binary image corresponding to the side-view overlapping area to obtain depth information corresponding to the overlapping area; The volume of the effective volume of the package is calculated based on the three-dimensional data including the depth information of the overlapping area.
6. The method for calculating the effective volume of irregular packages according to claim 2, characterized in that: The wind power device is arranged on one side of the conveyor belt and parallel to the offset area to provide wind power to the offset area.
7. The method for calculating the effective volume of irregular packages according to claim 6, characterized in that: A first camera is disposed above the conveyor belt to photograph the first top view and the second top view; a second camera is disposed on the other side of the conveyor belt opposite to the wind power equipment to photograph the first side view and the second side view.
8. An effective volume calculation device for irregular packages, characterized in that: It includes a transmission module, a shooting module and a calculation module; The transmission module is used to set a reference area and an offset area on the conveyor belt along its transport direction; the offset area is provided with a wind power device so that there is airflow disturbance in the offset area; The shooting module is used to shoot a first group of images of the package passing through the reference area, including an effective volume part and an invalid volume part, and a second group of images of the package passing through the offset area; the second group of images includes the effective volume part of the package, and the invalid volume part whose position is offset under airflow disturbance; The calculation module is used to determine the overlapping area of the first group of images and the second group of images, and calculate the volume of the effective volume portion of the package according to the overlapping area.
9. An effective volume calculation device for irregular packages, characterized in that: comprising a memory and a processor, wherein: The memory is used to store computer programs; The processor is used to read the computer program in the memory and execute the steps of the method for calculating the effective volume of an irregular package as described in any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: A readable computer program is stored thereon, and when the program is executed by a processor, the steps of the method for calculating the effective volume of an irregular package as described in any one of claims 1 to 7 are implemented.
