Container board cargo loading contour detection method, device, equipment and medium

Abstract

The invention relates to the technical field of computer vision, and provides a container plate cargo loading contour detection method, device and equipment and a medium, and the method comprises the steps: obtaining the space coordinate information of a cargo packaging surface, and obtaining a plurality of to-be-detected points; according to each to-be-measured point, determining a unit topological relation between each to-be-measured point and a reference plate model according to the previously obtained reference plate model of the container plate; wherein the datum plate type model is obtained by equidistant expansion based on a three-dimensional datum model corresponding to the plate type of the container plate, and the unit topological relation is used for representing the spatial position relation between the corresponding to-be-measured point and the basic geometric unit in the datum plate type model; according to the unit topological relation, when it is determined that the to-be-detected point is located outside the space envelope body, an overrun point is obtained; and according to each over-limit point, determining the maximum space distance between the over-limit point and each surface of the reference plate model, and obtaining a contour detection result. According to the invention, various complex cargo forms can be accurately handled, full-process digital tracing of detection is realized, and the detection efficiency is improved.

Description

Technical Field

[0001] This invention relates to the field of computer vision technology, and in particular to a method, apparatus, equipment and medium for detecting the outline of cargo loading on pallets. Background Technology

[0002] As a crucial pillar of the modern logistics system, the safety and efficiency of cargo transportation have always been the primary goals of the air transport industry. As core equipment in air freight, the compliance of pallet loading profiles not only affects the safety of individual shipments but is also a key factor influencing the operational efficiency of the entire air logistics system. According to the airworthiness standards of the International Air Transport Association (IATA), pallets must strictly comply with the outline restrictions of aircraft cargo holds; any dimensional deviation can lead to significant safety hazards such as loading failures and damage to the cargo hold structure. Therefore, pallet cargo loading profile inspection, as an indispensable quality control link in the air freight process, through systematic dimensional inspection and airworthiness assessment, not only ensures transportation safety but also significantly improves cargo hold space utilization, which is of strategic significance for optimizing the overall operational efficiency of air logistics.

[0003] Currently, the inspection of palletized cargo loading contours in the air cargo sector is still dominated by traditional manual inspection methods, mainly relying on visual inspection by operators and measurement with simple measuring tools (such as calipers).

[0004] However, this manual inspection method suffers from limitations in comprehensive coverage, low efficiency, inefficient data management, poor standard adaptability, and increasingly prominent unavoidable human error. Furthermore, it struggles to address the varying standardized unit load device (ULD) profiles across different airlines, and lacks effective countermeasures for the unique "compression rebound" phenomenon of e-commerce goods. More seriously, the frequent work at heights during inspection poses significant safety hazards, threatening the personal safety of personnel. Summary of the Invention

[0005] This invention provides a method, apparatus, equipment, and medium for detecting the loading contour of containerized cargo, which solves the problems of low efficiency and large errors in manual inspection in the prior art, realizes digital traceability of the entire inspection process, and improves inspection efficiency.

[0006] This invention provides a method for detecting the loading contour of cargo on a container pallet, comprising: acquiring spatial coordinate information of the cargo packaging surface to obtain multiple test points; determining the element topology relationship between each test point and the reference plate model based on each test point and a previously acquired reference plate model of the container pallet; wherein the reference plate model is obtained by isometric expansion based on a three-dimensional reference model corresponding to the container plate shape, and the element topology relationship is used to characterize the spatial positional relationship between the corresponding test point and the basic geometric elements in the reference plate model; determining, based on the element topology relationship, when the test point is located outside the spatial envelope of the reference plate model, an out-of-limit point is obtained; determining, based on each out-of-limit point, the maximum spatial distance between the out-of-limit point and each surface of the reference plate model, to obtain the contour detection result.

[0007] According to the present invention, a method for detecting the loading contour of a container pallet is provided. Based on each excess point, the maximum spatial distance between the excess point and each surface of a reference plate model is determined to obtain the contour detection result. The method includes: performing density-based clustering based on all excess points to obtain excess region clusters; extracting and fitting principal planes for each excess region cluster to obtain multiple plane clusters with the same distance representation; for each plane cluster, traversing the points within the plane cluster to determine the maximum spatial distance and normal angle between each point within the plane cluster and each surface of the reference plate model; and obtaining the contour detection result based on the maximum spatial distance and normal angle between each point within the plane cluster and each surface of the reference plate model.

[0008] According to the present invention, a method for detecting the loading contour of a containerized cargo is provided. The method obtains the contour detection result based on the maximum spatial distance and normal angle between each point within a planar cluster and each surface of a reference plate model. The method includes: selecting the minimum maximum spatial distance as the feature distance of the planar cluster based on the maximum spatial distance between each point within the planar cluster and each surface of the reference plate model; determining the orientation to be mapped based on the normal angle between the point corresponding to the minimum maximum spatial distance and each surface of the reference plate model, combined with a preset mapping orientation rule; and mapping the corresponding point to the surface of the reference plate model according to the orientation to be mapped, thereby obtaining the position orientation positioning information of the corresponding planar cluster. The preset mapping orientation rule is configured in advance based on different ranges of normal angle values ​​and their corresponding mapping orientations. The contour detection result is obtained based on the feature distance of the planar cluster and the position orientation positioning information of the planar cluster.

[0009] According to the present invention, a method for detecting the loading contour of a container pallet is provided. Before determining the unit topological relationship between each test point and the reference plate type model based on each test point and a previously acquired reference plate type model of the container pallet, the method includes: calling the corresponding three-dimensional reference model of the container pallet from a preset parameter library based on the previously determined container pallet type; wherein, the preset parameter library includes three-dimensional reference models of container pallets of various types, and the three-dimensional reference model is constructed based on the corresponding type of container pallet; generating a spatial offset vector along the normal direction for each topological unit on the surface of the three-dimensional reference model, and smoothing the spatial offset vector; and obtaining the reference plate type model by using equidistant dilation based on the corrected spatial offset vector and the three-dimensional reference model.

[0010] According to the present invention, a method for detecting the loading contour of a container pallet is provided. Based on a corrected spatial offset vector and a three-dimensional reference model, a reference plate shape model is obtained by isometric expansion. The method includes: isometric expansion of the three-dimensional reference model based on the corrected spatial offset vector to generate a spatial envelope; dividing the internal space of the spatial envelope into tetrahedral elements and establishing a spatial position query index to obtain the reference plate shape model.

[0011] According to the present invention, a method for detecting the loading contour of containerized cargo is provided, which obtains spatial coordinate information of the cargo packaging surface, including: obtaining point cloud, depth map and original spatial coordinates of containerized cargo packaging; interpolating and completing the depth map according to the original spatial coordinates and point cloud, and converting the interpolated and completed depth map into three-dimensional point cloud data to obtain fusion information; and obtaining spatial coordinate information of the cargo packaging surface according to the fusion information.

[0012] According to the present invention, a method for detecting the loading contour of cargo on a container pallet includes the following steps before obtaining the spatial coordinate information of the cargo packaging surface based on the fusion information: establishing a point cloud topology network based on the fusion information, and using curvature analysis to identify and remove discrete points with topological anomalies to obtain fusion information after removing discrete points; and / or, extracting effective data regions based on the fusion information or the fusion information after removing discrete points, combined with a spatial region extraction algorithm.

[0013] This invention also provides a container pallet cargo loading contour detection device, comprising: a data acquisition module for acquiring spatial coordinate information of the cargo packaging surface to obtain multiple test points; a relationship determination module for determining the element topology relationship between each test point and the reference plate model based on each test point and a previously acquired reference plate model of the container pallet; wherein the reference plate model is obtained by isometric expansion based on a three-dimensional reference model corresponding to the container plate shape, and the element topology relationship is used to characterize the spatial positional relationship between the corresponding test point and the basic geometric elements in the reference plate model; a point judgment module for determining, based on the element topology relationship, when the test point is located outside the spatial envelope of the reference plate model, an out-of-limit point is obtained; and a contour detection module for determining, based on each out-of-limit point, the maximum spatial distance between the out-of-limit point and each surface of the reference plate model, and obtaining the contour detection result.

[0014] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the container cargo loading contour detection method as described above.

[0015] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the container cargo loading contour detection method as described above.

[0016] The present invention also provides a computer program product, including a computer program that, when executed by a processor, implements the container cargo loading contour detection method as described above.

[0017] The present invention provides a method, apparatus, equipment, and medium for detecting the loading contour of containerized cargo. By collecting spatial coordinate information of the cargo packaging surface, it comprehensively covers the cargo packaging surface, avoiding analytical biases caused by missing data and improving the accuracy of subsequent detection. Combined with a reference plate model obtained through equidistant expansion, it quickly establishes a topological relationship with the points to be measured, avoiding complex geometric calculations, improving processing efficiency, and rapidly identifying out-of-limit points. This avoids the subjectivity and errors of manual inspection, requires no human intervention, and can efficiently complete the anomaly detection of large-scale point cloud data. Furthermore, by calculating the maximum spatial distance between out-of-limit points and each surface of the reference plate model, it further analyzes the distance relationship between the out-of-limit points and the model surface, ensuring the comprehensiveness and accuracy of contour detection. This ensures that it can accurately handle various complex cargo shapes and flexibly adapt to diverse inspection standard requirements, providing a revolutionary intelligent solution for the air cargo industry, realizing digital traceability of the entire inspection process, and improving inspection efficiency. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0019] Figure 1 This is a flowchart illustrating the method for detecting the loading contour of cargo on a container pallet provided by the present invention. Figure 2 This is a schematic diagram of the structure of the container cargo loading contour detection device provided by the present invention; Figure 3 This is a schematic diagram of the structure of the electronic device provided by the present invention. Detailed Implementation

[0020] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0021] Figure 1 This is a flowchart illustrating the container cargo loading contour detection method provided by the present invention, as shown below. Figure 1 As shown, the method includes: S11, Obtain the spatial coordinate information of the surface of the goods packaging to obtain multiple points to be measured; S12. Based on each test point and the previously acquired reference plate model of the container plate, determine the element topology relationship between each test point and the reference plate model. The reference plate model is obtained by isometric expansion based on the three-dimensional reference model corresponding to the container plate shape. The element topology relationship is used to characterize the spatial positional relationship between the corresponding test point and the basic geometric elements in the reference plate model. S13, based on the unit topology, when the point to be measured is located outside the spatial envelope of the reference plate model, the point exceeding the limit is obtained; S14. Based on each out-of-limit point, determine the maximum spatial distance between the out-of-limit point and each surface of the reference plate model, and obtain the contour detection result.

[0022] It should be noted that the step number "S1N" in this specification does not represent the order of the container cargo loading contour detection method. The container cargo loading contour detection method of the present invention is described in detail below.

[0023] Step S11: Obtain the spatial coordinate information of the surface of the goods packaging to obtain multiple test points.

[0024] In this embodiment, obtaining the spatial coordinate information of the cargo packaging surface includes: obtaining the point cloud, depth map, and original spatial coordinates of the pallet cargo packaging; interpolating and completing the depth map based on the original spatial coordinates and point cloud, and converting the interpolated and completed depth map into three-dimensional point cloud data to obtain fused information; and obtaining the spatial coordinate information of the cargo packaging surface based on the fused information.

[0025] It should be added that point clouds and depth maps can be acquired based on single sensors or multi-sensor arrays. When using a multi-sensor array, multiple depth maps will be obtained, independently capturing different perspectives of the scene. This allows for the acquisition of depth information through multi-view stereo vision technology. Therefore, after obtaining the fusion information corresponding to each depth map, the fusion information needs to be stitched together to obtain complete point cloud data, thereby improving data coverage integrity. Additionally, the original spatial coordinates can be acquired simultaneously using infrared coded 3D reconstruction technology. The specific choice can be made according to actual design requirements, and no further limitations are made here.

[0026] It should be noted that before acquiring the corresponding depth map, it is also necessary to perform uniform spatial calibration on the sensors in the sensor array to eliminate imaging deviations caused by camera manufacturing errors, installation deviations, etc., so as to ensure that the acquired image data has high geometric accuracy.

[0027] Furthermore, depth maps can be acquired using sensors such as cameras. If acquisition fails, an empty value will be returned. Based on this, erroneous or failed acquisition data can be flagged and discarded to skip subsequent processing. Similarly, point clouds can be acquired using sensors such as radar. After acquiring the corresponding point cloud, the number of points in the point cloud is obtained through point cloud reconstruction technology. If the number of points is lower than a preset threshold, subsequent processing can be skipped based on a prompt.

[0028] Furthermore, before obtaining the spatial coordinate information of the cargo packaging surface based on the fusion information, the process includes: establishing a point cloud topology network based on the fusion information, and using curvature analysis to identify and remove discrete points with topological anomalies to obtain fusion information after removing discrete points, thereby eliminating discrete interference points; and / or, extracting effective data regions based on the fusion information or the fusion information after removing discrete points, combined with a spatial region extraction algorithm.

[0029] In an optional embodiment, before determining the element topology relationship between each test point and the reference plate model based on each test point and the previously acquired reference plate model of the container plate, the method includes: calling the corresponding three-dimensional reference model of the container plate from a preset parameter library according to the previously determined container plate type; wherein, the preset parameter library includes three-dimensional reference models of container plates of various plate types, and the three-dimensional reference model is constructed based on the corresponding plate type of the container plate; for each topological element on the surface of the three-dimensional reference model, a spatial offset vector is generated along the normal direction, and the spatial offset vector is smoothed to suppress the distortion caused by the surface displacement of the three-dimensional reference model; based on the corrected spatial offset vector and the three-dimensional reference model, the reference plate model is obtained by using equidistant dilation.

[0030] Furthermore, based on the corrected spatial offset vector and the three-dimensional reference model, an equidistant expansion is used to obtain a reference plate model, including: performing equidistant expansion on the three-dimensional reference model based on the corrected spatial offset vector to generate a spatial envelope to adapt to goods packaging of different sizes; dividing the internal space of the spatial envelope into tetrahedral elements and establishing a spatial location query index to obtain the reference plate model.

[0031] Step S12: Based on each test point and the previously acquired reference plate model of the container plate, determine the element topology relationship between each test point and the reference plate model; wherein, the reference plate model is obtained by isometric expansion based on the three-dimensional reference model corresponding to the container plate shape, and the element topology relationship is used to characterize the spatial positional relationship between the corresponding test point and the basic geometric elements in the reference plate model.

[0032] In this embodiment, based on each test point and combined with the previously acquired reference plate model of the container plate, the unit topology relationship between each test point and the reference plate model is determined, including: using a spatial location query index to quickly locate the spatial envelope or adjacent spatial envelope where the test point may be located, and using a preset geometric algorithm to determine whether the test point is located in the spatial envelope or adjacent spatial envelope where it may be located, thereby obtaining the unit topology relationship between the corresponding test point and the reference plate model.

[0033] Step S13: Based on the element topology, when the point to be measured is located outside the spatial envelope of the reference plate model, the out-of-limit point is obtained. It should be noted that the out-of-limit point includes the point's location coordinates and the minimum penetration distance.

[0034] Step S14: Based on each out-of-limit point, determine the maximum spatial distance between the out-of-limit point and each surface of the reference plate model, and obtain the contour detection result.

[0035] In this embodiment, based on each out-of-limit point, the maximum spatial distance between the out-of-limit point and each surface of the reference plate model is determined to obtain the contour detection result. This includes: performing density-based clustering based on all out-of-limit points to separate multiple spatially independent out-of-limit region clusters; extracting and fitting the principal plane of each out-of-limit region cluster to obtain multiple plane clusters with the same distance representation; for each plane cluster, traversing the points within the plane cluster to determine the maximum spatial distance and normal angle between each point within the plane cluster and each surface of the reference plate model; and obtaining the contour detection result based on the maximum spatial distance and normal angle between each point within the plane cluster and each surface of the reference plate model.

[0036] It should be added that, after determining the maximum spatial distance and normal angle between each point within the planar cluster and each surface of the reference plate model, the data for the corresponding point can be represented as {(x, y, z), d}. i , θ i In set form, (x, y, z) represents the point cloud coordinates, and d i θ represents the maximum spatial distance. i Indicates the included angle of the normal.

[0037] Specifically, the contour detection result is obtained based on the maximum spatial distance and normal angle between each point in the planar cluster and each surface of the reference plate model. This includes: selecting the minimum maximum spatial distance as the feature distance of the planar cluster based on the maximum spatial distance between each point in the planar cluster and each surface of the reference plate model; determining the orientation to be mapped based on the normal angle between the point corresponding to the minimum maximum spatial distance and each surface of the reference plate model, combined with a preset mapping orientation rule; and mapping the corresponding point to the surface of the reference plate model according to the orientation to be mapped, thereby obtaining the position orientation positioning information of the corresponding planar cluster. The preset mapping orientation rule is configured in advance based on the different ranges of normal angle values ​​and their corresponding mapping orientations. The contour detection result is obtained based on the feature distance of the planar cluster and the position orientation positioning information of the planar cluster.

[0038] In summary, this invention collects spatial coordinate information of the cargo packaging surface to comprehensively cover the surface, avoiding analytical biases caused by missing data and improving the accuracy of subsequent inspections. Combined with a baseline plate model obtained through equidistant expansion, it quickly establishes a topological relationship with the points to be tested, avoiding complex geometric calculations and improving processing efficiency. This allows for rapid identification of out-of-limit points, avoiding the subjectivity and errors of manual inspection. It can efficiently complete anomaly detection of large-scale point cloud data without human intervention. Furthermore, by calculating the maximum spatial distance between out-of-limit points and each surface of the baseline plate model, it further analyzes the distance relationship between these points and the model surface, ensuring the comprehensiveness and accuracy of contour detection. This ensures precise handling of various complex cargo shapes and flexible adaptation to diverse inspection standards, providing a revolutionary intelligent solution for the air cargo industry. It achieves digital traceability throughout the entire inspection process and improves inspection efficiency.

[0039] The container cargo loading contour detection device provided by the present invention is described below. The container cargo loading contour detection device described below can be referred to in correspondence with the container cargo loading contour detection method described above.

[0040] Figure 2 A schematic diagram of a container pallet cargo loading contour detection device is shown. The device includes: Data acquisition module 21 acquires the spatial coordinate information of the surface of the goods packaging to obtain multiple test points; The relationship determination module 22 determines the element topology relationship between each test point and the reference plate model of the container plate based on each test point and the previously acquired reference plate model. The reference plate model is obtained by isometric expansion based on the three-dimensional reference model corresponding to the container plate shape. The element topology relationship is used to characterize the spatial positional relationship between the corresponding test point and the basic geometric elements in the reference plate model. The point determination module 23 determines the out-of-limit point when the point to be measured is located outside the spatial envelope of the reference plate model based on the unit topology relationship. The contour detection module 24 determines the maximum spatial distance between each out-of-limit point and each surface of the reference plate model, based on each out-of-limit point, and obtains the contour detection result.

[0041] In this embodiment, the data acquisition module 21 includes: a data acquisition unit for acquiring point cloud, depth map and original spatial coordinates of containerized cargo packaging; a data fusion unit for interpolating and completing the depth map based on the original spatial coordinates and point cloud, and converting the interpolated and completed depth map into three-dimensional point cloud data to obtain fusion information; and a coordinate determination unit for obtaining spatial coordinate information of the cargo packaging surface based on the fusion information.

[0042] Furthermore, the data acquisition module 21 also includes: a denoising unit, which, before obtaining the spatial coordinate information of the cargo packaging surface based on the fusion information, establishes a point cloud topology network based on the fusion information, and uses curvature analysis to identify and remove discrete points with topological anomalies, thereby obtaining fusion information after removing discrete points and eliminating discrete interference points; and / or a target data extraction unit, which, based on the fusion information or the fusion information after removing discrete points, combines a spatial region extraction algorithm to extract the effective data region.

[0043] In an optional embodiment, the device further includes: a model invocation module, which, before determining the unit topology relationship between each test point and the reference plate type model based on each test point and in conjunction with the previously acquired reference plate type model of the container plate, invokes the corresponding three-dimensional reference model of the container plate from a preset parameter library according to the previously determined container plate type; wherein, the preset parameter library includes three-dimensional reference models of container plates of various plate types, and the three-dimensional reference model is constructed based on the corresponding plate type of the container plate; a correction module, which generates a spatial offset vector along the normal direction for each topological unit on the surface of the three-dimensional reference model, and performs smooth correction on the spatial offset vector to suppress the distortion caused by the surface displacement of the three-dimensional reference model; and a model generation module, which obtains the reference plate type model by using equidistant dilation based on the corrected spatial offset vector and the three-dimensional reference model.

[0044] Furthermore, the model generation module includes: a model generation unit that performs isometric expansion on the three-dimensional reference model based on the corrected spatial offset vector to generate a spatial envelope to adapt to goods packaging of different sizes; and an index creation unit that divides the internal space of the spatial envelope into tetrahedral elements and establishes a spatial location query index to obtain a reference plate model.

[0045] The relationship determination module 22 is used to: quickly locate the spatial envelope in which the test point may be located or the adjacent spatial envelope by using the spatial location query index, and use a preset geometric algorithm to determine whether the test point is located in the spatial envelope in which it may be located or the adjacent spatial envelope, so as to obtain the unit topology relationship between the corresponding test point and the reference plate model.

[0046] The contour detection module 24 includes: a clustering unit, which performs density-based clustering based on all out-of-limit points to separate multiple spatially independent out-of-limit region clusters; a feature fitting unit, which extracts and fits the principal plane of each out-of-limit region cluster to obtain multiple planar clusters with the same distance representation; a feature determination unit, which, for each planar cluster, traverses the points within the planar cluster to determine the maximum spatial distance and normal angle between each point within the planar cluster and each surface of the reference plate model; and a result acquisition unit, which obtains the contour detection result based on the maximum spatial distance and normal angle between each point within the planar cluster and each surface of the reference plate model.

[0047] Specifically, the result acquisition unit includes: a data selection subunit, which selects the minimum maximum spatial distance as the feature distance of the plane cluster based on the maximum spatial distance between each point in the plane cluster and each surface of the reference plate model; a mapping subunit, which determines the orientation to be mapped based on the normal angle between the point corresponding to the minimum maximum spatial distance and each surface of the reference plate model, combined with a preset mapping orientation rule, and maps the corresponding point to the surface of the reference plate model according to the orientation to be mapped, thereby obtaining the position orientation positioning information of the corresponding plane cluster; wherein, the preset mapping orientation rule is configured in advance based on the value range of different normal angles and their corresponding mapping orientations; and the result acquisition subunit obtains the contour detection result based on the feature distance of the plane cluster and the position orientation positioning information of the plane cluster.

[0048] In summary, this invention collects spatial coordinate information of the cargo packaging surface through a data acquisition module to comprehensively cover the packaging surface, avoiding analytical biases caused by missing data and improving the accuracy of subsequent inspections. Furthermore, a relationship determination module, combined with a baseline plate model obtained through equidistant expansion, quickly establishes a topological relationship with the points to be tested, avoiding complex geometric calculations and improving processing efficiency. The point judgment module then quickly identifies out-of-limit points, avoiding the subjectivity and errors of manual inspection. This eliminates the need for human intervention and efficiently completes anomaly detection of large-scale point cloud data. Finally, a contour detection module calculates the maximum spatial distance between out-of-limit points and each surface of the baseline plate model to further analyze the distance relationship between these points and the model surface, ensuring the comprehensiveness and accuracy of contour detection. This ensures precise handling of various complex cargo shapes and flexible adaptation to diverse inspection standards, providing a revolutionary intelligent solution for the air cargo industry. It achieves digital traceability throughout the entire inspection process and improves inspection efficiency.

[0049] Figure 3 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 3As shown, the electronic device may include: a processor 310, a communications interface 320, a memory 330, and a communications bus 340, wherein the processor 310, the communications interface 320, and the memory 330 communicate with each other through the communications bus 340. The processor 310 can call logical instructions in the memory 330 to execute a container cargo loading contour detection method. This method includes: acquiring spatial coordinate information of the cargo packaging surface to obtain multiple test points; determining the element topology relationship between each test point and the reference plate model based on each test point and a previously acquired reference plate model of the container; wherein the reference plate model is obtained by isometric expansion based on a three-dimensional reference model corresponding to the container plate shape, and the element topology relationship is used to characterize the spatial positional relationship between the corresponding test point and the basic geometric elements in the reference plate model; determining, based on the element topology relationship, that when a test point is located outside the spatial envelope of the reference plate model, an out-of-limit point is obtained; and determining, based on each out-of-limit point, the maximum spatial distance between the out-of-limit point and each surface of the reference plate model, to obtain the contour detection result.

[0050] Furthermore, the logical instructions in the aforementioned memory 330 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, essentially, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0051] On the other hand, the present invention also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the container cargo loading contour detection method provided by the above methods. The method includes: acquiring spatial coordinate information of the cargo packaging surface to obtain multiple test points; determining the element topology relationship between each test point and the reference plate model based on each test point and a previously acquired reference plate model of the container; wherein the reference plate model is obtained by isometric expansion based on a three-dimensional reference model corresponding to the container plate shape, and the element topology relationship is used to characterize the spatial positional relationship between the corresponding test point and the basic geometric elements in the reference plate model; determining, based on the element topology relationship, when the test point is located outside the spatial envelope of the reference plate model, an out-of-limit point is obtained; determining, based on each out-of-limit point, the maximum spatial distance between the out-of-limit point and each surface of the reference plate model, and obtaining the contour detection result.

[0052] In another aspect, the present invention also provides a non-transitory computer-readable storage medium storing a computer program thereon. When executed by a processor, the computer program implements the container cargo loading contour detection method provided by the above methods. The method includes: acquiring spatial coordinate information of the cargo packaging surface to obtain multiple test points; determining the element topology relationship between each test point and the reference plate model based on each test point and a previously acquired reference plate model of the container; wherein the reference plate model is obtained by isometric expansion based on a three-dimensional reference model corresponding to the container plate shape, and the element topology relationship is used to characterize the spatial positional relationship between the corresponding test point and the basic geometric elements in the reference plate model; determining, based on the element topology relationship, when the test point is located outside the spatial envelope of the reference plate model, an out-of-limit point is obtained; and determining, based on each out-of-limit point, the maximum spatial distance between the out-of-limit point and each surface of the reference plate model, to obtain the contour detection result.

[0053] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0054] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0055] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for detecting the loading contour of cargo on a container pallet, characterized in that, include: Obtain the spatial coordinate information of the surface of the goods packaging to obtain multiple points to be measured; Based on each of the test points and in conjunction with the previously acquired reference plate model of the container plate, the element topology relationship between each of the test points and the reference plate model is determined; wherein, the reference plate model is obtained by isometric expansion based on the three-dimensional reference model corresponding to the container plate shape, and the element topology relationship is used to characterize the spatial positional relationship between the corresponding test point and the basic geometric units in the reference plate model. Based on the unit topology, when the point to be measured is located outside the spatial envelope of the reference plate model, the out-of-limit point is obtained; Based on each of the aforementioned over-limit points, the maximum spatial distance between the over-limit points and each surface of the reference plate model is determined, and the contour detection result is obtained.

2. The method for detecting the loading contour of cargo on a container pallet according to claim 1, characterized in that, Based on each of the aforementioned exceedance points, determine the maximum spatial distance between the exceedance point and each surface of the reference plate model to obtain the contour detection result, including: Based on all the out-of-limit points, density-based clustering is performed to obtain out-of-limit region clusters; The principal plane of each of the aforementioned over-limit regions is extracted and fitted to obtain multiple planar clusters with the same distance representation; For each plane cluster, traverse the points within the plane cluster and determine the maximum spatial distance and normal angle between each point within the plane cluster and each surface of the reference plate model; The contour detection result is obtained based on the maximum spatial distance and normal angle between each point in the plane cluster and each surface of the reference plate model.

3. The method for detecting the loading contour of cargo on a container pallet according to claim 2, characterized in that, Based on the maximum spatial distance and normal angle between each point within the planar cluster and each surface of the reference plate model, the contour detection result is obtained, including: Based on the maximum spatial distance between each point in the planar cluster and each surface of the reference plate model, the minimum maximum spatial distance is selected as the feature distance of the planar cluster. Based on the angle between the minimum spatial maximum distance corresponding to the point and the normal of each surface of the reference plate model, and combined with the preset mapping orientation rules, the orientation to be mapped is determined, and the corresponding point is mapped to the surface of the reference plate model according to the orientation to be mapped, to obtain the position orientation positioning information of the corresponding plane cluster; wherein, the preset mapping orientation rules are configured in advance according to the different range of values ​​of the normal angle and their corresponding mapping orientations; Based on the feature distance of the planar cluster and the position orientation information of the planar cluster, the contour detection result is obtained.

4. The method for detecting the loading contour of cargo on a container pallet according to claim 1, characterized in that, Before determining the element topology relationship between each of the test points and the previously acquired reference plate model of the container plate, based on each of the test points, the process includes: Based on the pre-determined container pallet type, the corresponding three-dimensional reference model of the container pallet is called from the preset parameter library; wherein, the preset parameter library includes three-dimensional reference models of container pallets of various types, and the three-dimensional reference models are constructed in advance based on the container pallets of the corresponding types; For each topological unit on the surface of the three-dimensional reference model, a spatial offset vector is generated along the normal direction, and the spatial offset vector is smoothly corrected. Based on the corrected spatial offset vector and the three-dimensional reference model, the reference plate model is obtained by using equidistant dilatation.

5. The method for detecting the loading contour of cargo on a container pallet according to claim 4, characterized in that, Based on the corrected spatial offset vector and the aforementioned three-dimensional reference model, a reference plate model is obtained using equidistant dilatation, including: Based on the corrected spatial offset vector, the three-dimensional reference model is dilated at equal intervals to generate a spatial envelope. The internal space of the spatial envelope is divided into tetrahedral elements, and a spatial location query index is established to obtain the baseline plate model.

6. The method for detecting the loading contour of cargo on a container pallet according to claim 1, characterized in that, Obtain the spatial coordinate information of the surface of the goods packaging, including: Obtain the point cloud, depth map, and original spatial coordinates of the palletized cargo packaging; Based on the original spatial coordinates and the point cloud, the depth map is interpolated and completed, and the interpolated depth map is converted into three-dimensional point cloud data to obtain fused information; Based on the fused information, the spatial coordinate information of the cargo packaging surface is obtained.

7. The method for detecting the loading contour of cargo on a container pallet according to claim 6, characterized in that, Before obtaining the spatial coordinate information of the cargo packaging surface based on the fused information, the process includes: Based on the fused information, a point cloud topology network is established, and curvature analysis is used to identify and remove discrete points with topological anomalies, obtaining fused information after removing discrete points; and / or, Based on the fusion information or the fusion information after removing discrete points, and combined with a spatial region extraction algorithm, an effective data region is extracted.

8. A container pallet cargo loading contour detection device, characterized in that, include: The data acquisition module acquires the spatial coordinate information of the surface of the goods packaging to obtain multiple test points; The relationship determination module determines the element topology relationship between each of the test points and the reference plate model of the container plate, based on each test point and the previously acquired reference plate model. The reference plate model is obtained by isometric expansion based on the three-dimensional reference model corresponding to the container plate shape. The element topology relationship is used to characterize the spatial positional relationship between the corresponding test point and the basic geometric units in the reference plate model. The point determination module determines the out-of-limit point when the point to be measured is located outside the spatial envelope of the reference plate model based on the unit topology relationship. The contour detection module determines the maximum spatial distance between each of the out-of-limit points and each surface of the reference plate model, based on each out-of-limit point, and obtains the contour detection result.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, When the processor executes the computer program, it implements the pallet cargo loading contour detection method as described in any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the pallet cargo loading contour detection method as described in any one of claims 1 to 7.

Images