Automatic hoisting method and system of truck-mounted crane, electronic equipment and storage medium
Through ant colony algorithm and lidar point cloud data processing, automatic lifting of large equipment is realized, solving the problems of low lifting accuracy and safety accidents caused by manual operations, improving lifting accuracy and safety, and reducing labor costs.
Patent Information
- Application Number
- CN202411115193.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-14
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2044-08-14
AI Technical Summary
Due to limited viewing angle and inaccurate manual operation during lifting of large equipment, low lifting accuracy and increased safety accidents. Especially in special scenarios, such as when a large transformer is lifted into a depression station, how to ensure safe and accurate lifting has become an urgent solution. The problem.
The ant colony algorithm is used to combine point cloud data acquired by multiple lidars, and through ICP registration and point cloud grid cutting, the center point of the bottom surface of the station is determined as the end point and the center point of the bottom surface of the object to be lifted as the starting point, and the lifting path is dynamically controlled. , realize automatic lifting, and optimize lifting speed and steering angle through PID control algorithm.
It realizes safe, accurate and automatic lifting of large equipment, avoids obstacles, reduces labor costs, and improves lifting accuracy and safety.
Smart Images

Figure CN119018787A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of hoisting technology, and in particular to an automatic hoisting method, system, electronic equipment and storage medium of a truck-mounted crane. Background Art
[0002] The lifting of large equipment is a common process in the field of industrial assembly, and is common in the fields of power supply and distribution, chemical industry, and petroleum. At present, the lifting of large goods mainly uses manually operated cranes to lift the goods to the designated location or container. However, due to the large size of the goods, the viewing angle is limited, and manual operation requires high workers. The use of manual operation to complete the lifting of goods often leads to low lifting accuracy and even safety accidents such as collisions between goods and other objects. Especially in special scenarios, such as when lifting a large transformer into a workstation sunken below the surface, how to ensure safe and accurate lifting into the workstation; if there are obstacles on the lifting path that need to be bypassed, multiple workers are required to direct the lifting on site, which brings great inconvenience and increases labor costs.
[0003] How to solve the above-mentioned technical problems has become a technical problem that needs to be solved urgently in the industry. Summary of the invention
[0004] In order to at least solve the above-mentioned technical problems, the purpose of the present invention is to provide an automatic lifting method for a truck crane, taking the projection coordinates of the bottom surface center point of the workstation on the first cutting surface as the end point, and the bottom surface center coordinates of the object to be lifted as the starting point, and obtaining the horizontal moving path of the object to be lifted through an ant colony algorithm, thereby realizing automatic lifting of the object to be lifted.
[0005] In order to achieve the above-mentioned purpose, the present application provides an automatic lifting method for a truck-mounted crane, comprising:
[0006] Obtaining point clouds of multiple laser radars scanning the same object to be hoisted, where the scanning of the same object to be hoisted by the multiple laser radars has a common intersection, and determining a parent laser radar and a child laser radar from the multiple laser radars;
[0007] Take the point cloud of the parent laser radar as the target point cloud and the point cloud of the child laser radar as the source point cloud to perform ICP registration to obtain the transformation matrix;
[0008] Convert the transformation matrix into the transformation matrix of each child lidar relative to the parent lidar;
[0009] Fusion of the transformation matrix with the point cloud acquired by each lidar;
[0010] Constructing a point cloud grid including the coordinates of the front end of the boom of the truck crane, the coordinates of the end of the boom, and the coordinates of the bottom surface of the object to be hoisted;
[0011] Cut the point cloud grid, the first cutting surface is the intersection of the work station and the ground level, and the second cutting surface is the horizontal plane where the bottom surface of the object to be hoisted is located;
[0012] The projection coordinates of the bottom center point of the workstation on the first cutting surface are taken as the end point, and the bottom center coordinates of the object to be hoisted are taken as the starting point, and the horizontal moving path of the object to be hoisted is obtained through the ant colony algorithm.
[0013] Furthermore, the horizontal movement path also includes:
[0014] The maximum travel speed, acceleration and steering angle of the truck crane are dynamically controlled through the PID control algorithm.
[0015] Furthermore, it also includes: obtaining the height difference between the bottom of the workstation and the ground level, the height of the parent laser radar from the ground level, the height of the end of the boom from the ground level, and the horizontal coordinate difference between the end of the boom and the parent laser radar.
[0016] Furthermore, in the step of performing ICP registration to obtain a transformation matrix using the point cloud of the parent laser radar as the target point cloud and the point cloud of the child laser radar as the source point cloud, the ICP registration obtains the transformation matrix of the child laser radar relative to the parent laser radar.
[0017] In order to achieve the above-mentioned purpose, an automatic lifting system for a truck-mounted crane provided in an embodiment of the present invention comprises:
[0018] Multiple laser radars surround the workstations that hold the objects to be hoisted;
[0019] A data acquisition module is used to acquire point clouds of multiple laser radars scanning the same object to be hoisted, where the scanning of the same object to be hoisted by multiple laser radars has a common intersection;
[0020] A data processing module, for determining a parent laser radar and a child laser radar from a plurality of laser radars;
[0021] Take the point cloud of the parent laser radar as the target point cloud and the point cloud of the child laser radar as the source point cloud to perform ICP registration to obtain the transformation matrix;
[0022] Convert the transformation matrix into the transformation matrix of each child lidar relative to the parent lidar;
[0023] Fusion of the transformation matrix with the point cloud acquired by each lidar;
[0024] Point cloud mesh construction module, which constructs a point cloud mesh including the coordinates of the front end of the boom of the truck crane, the coordinates of the end of the boom, and the coordinates of the bottom surface of the object to be hoisted;
[0025] The data processing module also includes: cutting the point cloud grid, the first cutting surface is the intersection surface of the work station and the horizontal surface of the ground, and the second cutting surface is the horizontal surface where the bottom surface of the object to be hoisted is located;
[0026] The projection coordinates of the bottom center point of the workstation on the first cutting surface are taken as the end point, and the bottom center coordinates of the object to be hoisted are taken as the starting point, and the horizontal moving path of the object to be hoisted is obtained through the ant colony algorithm.
[0027] Furthermore, the horizontal movement path also includes:
[0028] The maximum travel speed, acceleration and steering angle of the truck crane are dynamically controlled through the PID control algorithm.
[0029] Furthermore, the data acquisition module also includes: obtaining the height difference between the bottom of the workstation and the ground level, the height of the parent laser radar from the ground level, the height of the end of the boom from the ground level, and the horizontal coordinate difference between the end of the boom and the parent laser radar.
[0030] Furthermore, in the step of performing ICP registration to obtain a transformation matrix using the point cloud of the parent laser radar as the target point cloud and the point cloud of the child laser radar as the source point cloud, the ICP registration obtains the transformation matrix of the child laser radar relative to the parent laser radar.
[0031] To achieve the above object, an embodiment of the present invention further provides an electronic device, including a processor; and
[0032] A memory arranged to store computer executable instructions, which, when executed, cause a processor to perform the steps of the above-mentioned automatic lifting method with a truck-mounted crane.
[0033] To achieve the above-mentioned purpose, an embodiment of the present invention further provides a computer-readable storage medium, which stores one or more programs. When the one or more programs are executed by an electronic device including multiple application programs, the electronic device executes the steps of the above-mentioned automatic lifting method of the truck crane.
[0034] The automatic lifting method of the truck-mounted crane in the embodiment of the present application includes: obtaining point clouds of multiple laser radars scanning the same object to be lifted, the scans of the multiple laser radars on the same object to be lifted have a common intersection, and determining the parent laser radar and the child laser radar from the multiple laser radars; using the point cloud of the parent laser radar as the target point cloud and the point cloud of the child laser radar as the source point cloud to perform ICP alignment to obtain a transformation matrix; converting the transformation matrix into a transformation matrix of each child laser radar relative to the parent laser radar; fusing the transformation matrix with the point cloud obtained by each laser radar; constructing a point cloud grid including the front end coordinates of the boom of the truck-mounted crane, the end coordinates of the boom, and the bottom surface coordinates of the object to be lifted; cutting the point cloud grid, the first cutting plane is the intersection of the work station and the horizontal plane of the ground, and the second cutting plane is the horizontal plane where the bottom surface of the object to be lifted is located; using the projection coordinates of the bottom surface center point of the work station on the first cutting plane as the end point, and the bottom surface center coordinates of the object to be lifted as the starting point, and obtaining the horizontal movement path of the object to be lifted through the ant colony algorithm. The projection coordinates of the bottom center point of the workstation on the first cutting surface are taken as the end point, and the bottom center coordinates of the object to be hoisted are taken as the starting point. The horizontal moving path of the object to be hoisted is obtained through the ant colony algorithm, so that the object to be hoisted can be automatically hoisted while avoiding obstacles, saving labor costs. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] The accompanying drawings are used to provide a further understanding of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the accompanying drawings:
[0036] Figure 1 It is a schematic flow chart of the automatic lifting method of the truck-mounted crane according to an embodiment of the present application;
[0037] Figure 2 It is a structural schematic diagram of the automatic lifting system of the truck-mounted crane according to an embodiment of the present application;
[0038] Figure 3 This is a schematic diagram of the structure when the object to be suspended is located above the workstation in the embodiment of the present application;
[0039] Figure 4 This is a schematic diagram of the structure when the object to be suspended is translated toward the workstation in the embodiment of the present application;
[0040] Figure 5 It is a schematic diagram of the structure of an electronic device according to an embodiment of the present application.
[0041] Description of reference numerals:
[0042] 301-truck crane; 302-crane arm; 303-work station; 304-laser radar; 305-bottom of work station; 306-obstacle; 307-object to be lifted. DETAILED DESCRIPTION
[0043] The embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be construed as being limited to the embodiments described herein. Instead, these embodiments are provided to provide a more thorough and complete understanding of the present application. It should be understood that the drawings and embodiments of the present application are only for exemplary purposes and are not intended to limit the scope of protection of the present application.
[0044] It should be understood that the various steps described in the method implementation of the present application can be performed in different orders and / or performed in parallel. In addition, the method implementation may include additional steps and / or omit the steps shown. The scope of the present application is not limited in this respect.
[0045] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.
[0046] It should be noted that the modifications of "one" and "plurality" mentioned in this application are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more". "Plurality" should be understood as two or more.
[0047] Hereinafter, embodiments of the present application will be described in detail with reference to the accompanying drawings.
[0048] An embodiment of the present invention provides an automatic lifting method for a truck-mounted crane, comprising:
[0049] Obtaining point clouds of multiple laser radars scanning the same object to be hoisted, where the scanning of the same object to be hoisted by the multiple laser radars has a common intersection, and determining a parent laser radar and a child laser radar from the multiple laser radars;
[0050] Take the point cloud of the parent laser radar as the target point cloud and the point cloud of the child laser radar as the source point cloud to perform ICP registration to obtain the transformation matrix;
[0051] Convert the transformation matrix into the transformation matrix of each child lidar relative to the parent lidar;
[0052] Fusion of the transformation matrix with the point cloud acquired by each lidar;
[0053] Constructing a point cloud grid including the coordinates of the front end of the boom of the truck crane, the coordinates of the end of the boom, and the coordinates of the bottom surface of the object to be hoisted;
[0054] Cut the point cloud grid, the first cutting surface is the intersection of the work station and the ground level, and the second cutting surface is the horizontal plane where the bottom surface of the object to be hoisted is located;
[0055] The projection coordinates of the bottom center point of the workstation on the first cutting surface are taken as the end point, and the bottom center coordinates of the object to be hoisted are taken as the starting point, and the horizontal moving path of the object to be hoisted is obtained through the ant colony algorithm.
[0056] Example 1
[0057] Figure 1 is a flow chart of the automatic lifting method of the truck-mounted crane according to an embodiment of the present application, Figure 3 is a schematic diagram of the structure when the object to be suspended is located above the workstation in the embodiment of the present application. Figure 4 This is a schematic diagram of the structure when the object to be suspended is translated toward the workstation in the embodiment of the present application. Figure 1 , 3 -4 The automatic lifting method of the truck-mounted crane in the embodiment of the present application is described in detail.
[0058] The automatic lifting method of a truck-mounted crane in the embodiment of the present application is applicable to the automatic lifting of a truck-mounted crane 301 , where the truck-mounted crane 301 is a truck-mounted crane, including a wheeled truck-mounted crane and a crawler truck-mounted crane.
[0059] First, in step 101, point clouds of multiple laser radars scanning the same object to be suspended are obtained, the scans of the same object to be suspended by the multiple laser radars have a common intersection, and the parent laser radar and the child laser radar are determined from the multiple laser radars.
[0060] In an exemplary embodiment, it is taken as an example that the object to be suspended 307 needs to be placed in a work station 303 sunken below the ground surface, that is, the work station 303 for accommodating the object to be suspended 307 is in the shape of a groove.
[0061] In an exemplary embodiment, as needed, when the object to be suspended 307 is placed on the work station 303, the upper part of the object to be suspended 307 can be flush with the ground surface; the upper part of the object to be suspended 307 can also be slightly protruding above the ground surface.
[0062] In an exemplary embodiment, a plurality of laser radars 304 surround the workstation 303. For example, when the workstation 303 is rectangular, four laser radars 304 are arranged above the four corners of the workstation 303, that is, the laser radars 304 are arranged above the ground surface. Figure 3 shown.
[0063] In an exemplary embodiment, a plurality of laser radars 304 are arranged at equal intervals around the workstation 303 .
[0064] In an exemplary embodiment, the ground clearance of the laser radar 304 is guaranteed to be able to detect the workstation 303 and the surrounding obstacles 306 between the workstation 303 and the temporary placement of the object 307 to be hoisted as a reference.
[0065] In an exemplary embodiment, laser radar (light detection and ranging, lidar) is an optical remote sensing technology that measures parameters such as the direction and distance of a target by irradiating a beam of pulsed laser to the target.
[0066] In an exemplary embodiment, if the laser beam is scanned along a certain trajectory, the reflected laser point information will be recorded while scanning. Since the scanning is extremely precise, a large number of laser points can be obtained, thus forming a laser point cloud, i.e., a point cloud.
[0067] In an exemplary embodiment, the scans of the same object 307 to be suspended by multiple laser radars 304 have a common intersection, which can be understood as the laser radars 304 can all illuminate the same object 307 to be suspended.
[0068] In an exemplary embodiment, as needed, after acquiring point clouds of the same object to be hoisted 307 scanned by multiple laser radars 304 , the step further includes: filtering and downsampling the point clouds.
[0069] In an exemplary embodiment, filtering is performed to eliminate high frequency noise; filtering and downsampling are performed to reduce the hardware requirements for subsequent registration, namely, ICP registration.
[0070] In an exemplary embodiment, one of the multiple laser radars 304 is selected as a parent laser radar, and the remaining laser radars are child laser radars.
[0071] In an exemplary embodiment, the parent laser radar may be selected by selecting the laser radar 304 with the widest imaging range for the suspended object 307 as the parent laser radar.
[0072] In step 102, the point cloud of the parent laser radar is used as the target point cloud, and the point cloud of the child laser radar is used as the source point cloud to perform ICP registration to obtain a transformation matrix.
[0073] In an exemplary embodiment, ICP (Iterative Closest Point) registration is a point cloud registration algorithm, which is mainly used to find rotation and translation parameters so that point clouds in two different coordinate systems can overlap.
[0074] In an exemplary embodiment, ICP registration is for 3D reconstruction, that is, reconstruction is performed after scanning by the laser radar 304 to align and fuse point clouds acquired from different perspectives to generate a complete 3D model.
[0075] In an exemplary embodiment, registration is to find the transformation relationship between the two point sets in space given two three-dimensional data points from different coordinate systems so that the two point sets can be unified into the same coordinate system.
[0076] In an exemplary embodiment, ICP registration obtains the transformation matrix of the sub-lidar relative to the parent radar, that is, the point cloud of the sub-lidar is used as the source point cloud and converted into displacement and Euler angles relative to the target point cloud.
[0077] In an exemplary embodiment, the transformation matrix is converted into a transformation matrix of each child lidar relative to the parent lidar.
[0078] In an exemplary embodiment, for example, the coordinates of a point in the child laser radar point cloud are [x, y, z] in the coordinate system, and the transformation matrix from the coordinate system of the point in the parent laser radar point cloud to the coordinate system of the point in the child laser radar point cloud is RT. Assuming that the corresponding point coordinates in the coordinate system of the point in the parent laser radar point cloud are [a, b, c], then [x, y, z, 1]' = RT × [a, b, c, 1]', and the corresponding [a, b, c, 1] = the inverse of RT × [x, y, z, 1]; that is, the coordinate system of the unified laser radar 304 is converted to the coordinate system of the point in the parent laser radar point cloud by multiplying the corresponding point coordinates in the coordinate system of the point in the child laser radar point cloud by the inverse of the transformation matrix on the left; the above coordinates are padded with 1 because the transformation matrix is of order 4 and needs to match before multiplication.
[0079] In an exemplary embodiment, ICP registration obtains the transformation matrix of the child lidar relative to the parent lidar.
[0080] Step 103, fusing the transformation matrix with the point cloud acquired by each of the laser radars.
[0081] In an exemplary embodiment, the transformation matrix of the child laser radar relative to the parent laser radar is obtained through ICP alignment, and the coordinates of each point in the child laser radar point cloud are multiplied on the left by the inverse of the transformation matrix to obtain the coordinates of the point in the parent laser radar; the coordinates of each child laser radar are unified into the coordinate point cloud of the parent laser radar, which is equivalent to all laser radars 304 using the coordinate system of the parent laser radar.
[0082] In an exemplary embodiment, after point cloud fusion is performed, the fused point cloud is also downsampled to the point cloud density obtained by a single laser radar 304; that is, the point cloud is density downsampled in order to restore the point cloud to a reasonable level, that is, to restore it to the point cloud density level obtained by a single laser radar 304.
[0083] In an exemplary implementation, a new coordinate system of the fused point cloud is set as the point cloud coordinate system.
[0084] Step 104, constructing a point cloud grid including the coordinates of the front end of the boom of the truck crane, the coordinates of the end of the boom, and the coordinates of the bottom surface of the object to be hoisted.
[0085] In an exemplary embodiment, the coordinates of the boom end of the truck crane 301 in the truck crane 301 coordinate system and the point cloud coordinate system are obtained. Through measurement, it can be known that the coordinate difference between the origin of the truck crane 301 coordinate system and the origin of the point cloud coordinate system in three-dimensional space is [-Δx, -Δy, -Δz] T ; Real-time acquisition of the deflection angle α, pitch angle θ, length l and hook droop length h of the boom 302 in the coordinate system of the truck crane 301. The coordinates of the hook in the point cloud coordinate system are [lcosθcosα-Δx, lcosθsinα-Δy, lsinθ-h-Δz] T , after the measurement is completed, the point cloud mesh is obtained.
[0086] In an exemplary embodiment, the front end of the boom 302 is the end where the boom 302 is connected to the truck crane 301 ; the rear end of the boom 302 is the end away from the truck crane 301 , that is, the end connected to the hook.
[0087] In an exemplary embodiment, the bottom surface coordinates of the object to be suspended 307 are the bottom surface coordinates of the object to be suspended 307 when the object to be suspended 307 is placed in the temporary storage area.
[0088] Step 105, cutting the point cloud grid, the first cutting surface is the intersection of the work station 303 and the horizontal plane of the ground surface, and the second cutting surface is the horizontal plane where the bottom surface of the object to be hoisted is located.
[0089] In an exemplary embodiment, the point cloud mesh is cut, and the first cutting plane is the intersection of the workstation 303 and the horizontal plane of the ground, that is, the intersection of the upper part of the workstation 303 and the ground, or the cutting plane of the horizontal plane of the ground where the workstation 303 is located.
[0090] In an exemplary embodiment, the point cloud grid is cut, and the second cutting surface is the horizontal plane where the bottom surface of the object to be suspended 307 is located; that is, the horizontal plane where the bottom surface of the object to be suspended 307 is located when the object to be suspended 307 is in a temporary storage place.
[0091] In an exemplary embodiment, for example, the work station 303 is at A and the temporary storage place is at B, and the object to be suspended 307 at B needs to be suspended into the work station 303 at A, the first cutting surface is the horizontal plane of the ground surface of the work station 303 at A, and the second cutting surface is the horizontal plane of the bottom surface of the object to be suspended 307 at B; the second cutting surface is selected as the horizontal plane of the bottom surface of the object to be suspended 307 because a buffer pad is usually laid under the bottom surface of the object to be suspended 307. In order to deduct the thickness of the buffer pad, the horizontal plane of the bottom surface of the object to be suspended 307 is taken as the second cutting surface.
[0092] In an exemplary embodiment, the first cutting surface obtains the center coordinates of the cutting surface contour, and obtains the coordinates of the center point of the bottom surface of the station 303 according to the height difference between the bottom surface of the station 303 and the horizontal plane of the ground; assuming that the center coordinates of the cutting surface contour obtained are [a, b, c] T , the height difference between the point cloud coordinate system and the ground is h0, and the height difference between the ground and the container ground is h1, then the coordinates of the center of the bottom of the container are [a,b,-h0-h1] T .
[0093] In an exemplary embodiment, for the second cutting surface, assuming that the height from the hook to the bottom of the cargo is h2, the coordinates of the center of the bottom of the cargo are [lcosθcosα-Δx, lcosθsinα-Δy, lsinθ-h-h2-Δz] T , the projection coordinates of the center of the bottom of the container to the horizontal plane are [a,b,lsinθ-h-h2-Δz] T .
[0094] Step 106, taking the projection coordinates of the center point of the bottom surface of the workstation on the first cutting surface as the end point, and the bottom surface center coordinates of the object to be suspended as the starting point, and obtaining the horizontal moving path of the object to be suspended by using an ant colony algorithm.
[0095] In an exemplary embodiment, the projection coordinates of the center point of the bottom surface of the work station 303 on the first cutting surface are used as the end point; the bottom surface center coordinates of the object to be suspended 307 are used as the starting point, that is, the bottom surface center coordinates of the object to be suspended 307 located in the temporary placement are used as the starting point.
[0096] In an exemplary embodiment, the horizontal movement path of the object to be hoisted 307 is obtained by using an ant colony algorithm, that is, the horizontal movement path of the object to be hoisted 307 from the starting point to the ending point is obtained by using an ant colony algorithm. The purpose of using the ant colony algorithm is that there will be obstacles 306 in the contours of the first cutting surface and the second cutting surface, that is, it is necessary to consider whether there are obstacles 306 blocking the straight-line distance route of the truck crane 301 from the starting point to the ending point.
[0097] In an exemplary embodiment, the maximum travel speed, acceleration and steering angle of the truck crane 301 are dynamically controlled by a PID control algorithm; the PID control algorithm is used to lift the object 307 to the end point along the horizontal moving path obtained by the ant colony algorithm, and then the hook is lowered so that the bottom surface of the object 307 gradually approaches the center of the bottom 305 of the workstation [a, b, -h0-h1] T When the bottom surface of the object 307 to be hoisted is in contact with the bottom surface of the work station 303, the hoisting is completed.
[0098] In an exemplary embodiment, it also includes obtaining the height difference between the bottom of the work station 303, i.e., the bottom 305 of the work station, and the ground level, the height of the parent laser radar from the ground level, the height of the end of the boom 302 from the ground level, and the horizontal coordinate difference between the end of the boom 302 and the parent laser radar.
[0099] In an exemplary embodiment, the height difference between the bottom of the workstation 303 , ie, the workstation bottom 305 , and the ground level is the depth of the workstation 303 .
[0100] In an exemplary embodiment, the height of the parent lidar from the ground level is the ground clearance of the parent lidar.
[0101] Example 2
[0102] Figure 2 is a schematic diagram of the structure of the automatic lifting system of the truck-mounted crane in the embodiment of the present application, Figure 3 is a schematic diagram of the structure when the object to be suspended is located above the workstation in the embodiment of the present application. Figure 4 This is a schematic diagram of the structure when the object to be suspended is translated toward the workstation in the embodiment of the present application. Figure 2-4 The automatic lifting system of the truck-mounted crane in the embodiment of the present application is described in detail.
[0103] In an exemplary embodiment, the automatic lifting system of the truck-mounted crane of the embodiment of the present application includes: multiple laser radars 304.
[0104] In an exemplary embodiment, a plurality of laser radars 304 surround the workstation 303 containing the object to be hoisted 307, that is, a plurality of laser radars 304 surround the workstation 303. For example, when the workstation 303 is rectangular, four laser radars 304 are arranged above the four corners of the workstation 303, that is, the laser radars 304 are arranged above the ground surface. Figure 3 shown.
[0105] In an exemplary embodiment, the work station 303 is in a groove shape, that is, the work station 303 is at least partially sunken below the ground surface, or when the object 307 to be suspended is placed on the work station 303, the object 307 to be suspended is at least partially submerged below the ground surface.
[0106] In an exemplary embodiment, a plurality of laser radars 304 are arranged at equal intervals around the workstation 303 .
[0107] In an exemplary embodiment, the ground clearance of the laser radar 304 is guaranteed to be able to detect the workstation 303 and the surrounding obstacles 306 between the workstation 303 and the temporary placement of the object 307 to be hoisted as a reference.
[0108] In an exemplary implementation, the automatic lifting system of the truck-mounted crane of the embodiment of the present application includes: a data acquisition module 201 .
[0109] In an exemplary embodiment, the data acquisition module 201 is used to acquire point clouds of a plurality of laser radars 304 above the hoisting equipment scanning the same object 307 to be hoisted.
[0110] In an exemplary embodiment, the scans of the same object 307 to be suspended by multiple laser radars 304 have a common intersection, which can be understood as the laser radars 304 can all illuminate the same object 307 to be suspended.
[0111] In an exemplary embodiment, the data acquisition module 201 includes multiple laser radars 304 ; it can be understood that the laser radars 304 belong to the data acquisition module 201 , or that at least part of the data acquired by the data acquisition module 201 is acquired through the laser radars 304 .
[0112] In an exemplary embodiment, one of the multiple laser radars 304 is selected as a parent laser radar, and the remaining laser radars 304 are child laser radars.
[0113] In an exemplary embodiment, the parent laser radar may be selected by selecting the laser radar 304 with the widest imaging range for the suspended object 307 as the parent laser radar.
[0114] In an exemplary implementation, the automatic lifting system of the truck-mounted crane of the embodiment of the present application further includes: a data processing module 202 .
[0115] In an exemplary implementation, the data processing module 202 determines a parent lidar and a child lidar from the plurality of lidars 304 .
[0116] In an exemplary embodiment, after acquiring point clouds of the same object to be hoisted 307 scanned by multiple laser radars 304 , the data processing module 202 further includes: filtering and downsampling the point clouds.
[0117] In an exemplary embodiment, filtering is performed to eliminate high frequency noise; filtering and downsampling are performed to reduce the hardware requirements for subsequent registration, namely, ICP registration.
[0118] In an exemplary embodiment, ICP (Iterative Closest Point) registration is a point cloud registration algorithm, which is mainly used to find rotation and translation parameters so that point clouds in two different coordinate systems can overlap.
[0119] In an exemplary embodiment, ICP registration is for 3D reconstruction, that is, reconstruction is performed after scanning by the laser radar 304 to align and fuse point clouds acquired from different perspectives to generate a complete 3D model.
[0120] In an exemplary embodiment, registration is to find the transformation relationship between the two point sets in space given two three-dimensional data points from different coordinate systems so that the two point sets can be unified into the same coordinate system.
[0121] In an exemplary embodiment, the point cloud of the parent laser radar is used as the target point cloud, and the point cloud of the child laser radar is used as the source point cloud to perform ICP registration to obtain the transformation matrix.
[0122] In an exemplary embodiment, ICP registration obtains the transformation matrix of the sub-lidar relative to the parent radar, that is, the point cloud of the sub-lidar is used as the source point cloud and converted into displacement and Euler angles relative to the target point cloud.
[0123] In an exemplary embodiment, for example, the coordinates of a point in the child laser radar point cloud are [x, y, z] in the coordinate system, and the transformation matrix from the coordinate system of the point in the parent laser radar point cloud to the coordinate system of the point in the child laser radar point cloud is RT. Assuming that the corresponding point coordinates in the coordinate system of the point in the parent laser radar point cloud are [a, b, c], then [x, y, z, 1]' = RT × [a, b, c, 1]', and the corresponding [a, b, c, 1] = the inverse of RT × [x, y, z, 1]; that is, the coordinate system of the unified laser radar 304 is converted to the coordinate system of the point in the parent laser radar point cloud by multiplying the corresponding point coordinates in the coordinate system of the point in the child laser radar point cloud by the inverse of the transformation matrix on the left; the above coordinates are padded with 1 because the transformation matrix is of order 4 and needs to match before multiplication.
[0124] In an exemplary embodiment, the transformation matrix is converted into a transformation matrix of each child lidar relative to the parent lidar.
[0125] In an exemplary embodiment, the transformation matrix is fused with the point cloud acquired by each lidar 304 .
[0126] In an exemplary embodiment, the transformation matrix of the child laser radar relative to the parent laser radar is obtained through ICP alignment, and the coordinates of each point in the child laser radar point cloud are multiplied on the left by the inverse of the transformation matrix to obtain the coordinates of the point in the parent laser radar; the coordinates of each child laser radar are unified into the coordinate point cloud of the parent laser radar, which is equivalent to all laser radars 304 using the coordinate system of the parent laser radar.
[0127] In an exemplary embodiment, after point cloud fusion is performed, the fused point cloud is also downsampled to the point cloud density obtained by a single laser radar 304; that is, the point cloud is density downsampled in order to restore the point cloud to a reasonable level, that is, to restore it to the point cloud density level obtained by a single laser radar 304.
[0128] In an exemplary embodiment, the data acquisition module 201 also includes: obtaining the height difference between the bottom of the work station 303, i.e., the bottom 305 of the work station, and the ground level, the height of the parent laser radar from the ground level, the height of the end of the boom 302 from the ground level, and the horizontal coordinate difference between the end of the boom 302 and the parent laser radar.
[0129] In an exemplary embodiment, the data processing module 202 further includes: after acquiring point clouds of the same object to be hoisted 307 scanned by multiple laser radars 304 , filtering and downsampling the point clouds.
[0130] In an exemplary implementation, the automatic lifting system of the truck-mounted crane of the embodiment of the present application further includes: a point cloud mesh construction module 203.
[0131] In an exemplary embodiment, the point cloud mesh construction module 203 constructs a point cloud mesh including the front end coordinates of the boom 302 of the truck crane 301 , the end coordinates of the boom 302 , and the bottom surface coordinates of the object 307 to be lifted.
[0132] In an exemplary embodiment, the coordinates of the end of the boom 302 of the truck crane 301 in the truck crane 301 coordinate system and the point cloud coordinate system are obtained. Through measurement, it can be known that the coordinate difference between the origin of the truck crane 301 coordinate system and the origin of the point cloud coordinate system in three-dimensional space is [-Δx, -Δy, -Δz] T ; Real-time acquisition of the deflection angle α, pitch angle θ, length l and hook droop length h of the boom 302 in the coordinate system of the truck crane 301. The coordinates of the hook in the point cloud coordinate system are [lcosθcosα-Δx, lcosθsinα-Δy, lsinθ-h-Δz] T , after the measurement is completed, the point cloud mesh is obtained.
[0133] In an exemplary embodiment, the front end of the boom 302 is the end where the boom 302 is connected to the truck crane 301 ; the rear end of the boom 302 is the end away from the truck crane 301 , that is, the end connected to the hook.
[0134] In an exemplary embodiment, the bottom surface coordinates of the object to be suspended 307 are the bottom surface coordinates of the object to be suspended 307 when the object to be suspended 307 is placed in the temporary storage area.
[0135] In an exemplary embodiment, the data processing module 202 further includes: cutting the point cloud grid, the first cutting surface is the intersection of the work station 303 and the horizontal plane of the ground surface, and the second cutting surface is the horizontal plane where the bottom surface of the object to be hoisted is located.
[0136] In an exemplary embodiment, the point cloud mesh is cut, and the first cutting plane is the intersection of the workstation 303 and the horizontal plane of the ground, that is, the intersection of the upper part of the workstation 303 and the ground, or the cutting plane of the horizontal plane of the ground where the workstation 303 is located.
[0137] In an exemplary embodiment, the point cloud grid is cut, and the second cutting surface is the horizontal plane where the bottom surface of the object to be suspended 307 is located; that is, the horizontal plane where the bottom surface of the object to be suspended 307 is located when the object to be suspended 307 is in a temporary storage place.
[0138] In an exemplary embodiment, for example, the work station 303 is at A and the temporary storage place is at B, and the object to be suspended 307 at B needs to be suspended into the work station 303 at A, the first cutting surface is the horizontal plane of the ground surface of the work station 303 at A, and the second cutting surface is the horizontal plane of the bottom surface of the object to be suspended 307 at B; the second cutting surface is selected as the horizontal plane of the bottom surface of the object to be suspended 307 because a buffer pad is usually laid under the bottom surface of the object to be suspended 307. In order to deduct the thickness of the buffer pad, the horizontal plane of the bottom surface of the object to be suspended 307 is taken as the second cutting surface.
[0139] In an exemplary embodiment, the first cutting surface obtains the center coordinates of the cutting surface contour, and obtains the coordinates of the center point of the bottom surface of the station 303 according to the height difference between the bottom surface of the station 303 and the horizontal plane of the ground; assuming that the center coordinates of the cutting surface contour obtained are [a, b, c] T , the height difference between the point cloud coordinate system and the ground is h0, and the height difference between the ground and the container ground is h1, then the coordinates of the center of the bottom of the container are [a,b,-h0-h1] T .
[0140] In an exemplary embodiment, for the second cutting surface, assuming that the height from the hook to the bottom of the cargo is h2, the coordinates of the center of the bottom of the cargo are [lcosθcosα-Δx, lcosθsinα-Δy, lsinθ-h-h2-Δz] T, the projection coordinates of the center of the bottom of the container to the horizontal plane are [a,b,lsinθ-h-h2-Δz] T .
[0141] In an exemplary embodiment, the projection coordinates of the bottom center point of the workstation 303 on the first cutting surface are used as the end point, and the bottom center coordinates of the object to be suspended 307 are used as the starting point, and the horizontal movement path of the object to be suspended 307 is obtained through an ant colony algorithm.
[0142] In an exemplary embodiment, the projection coordinates of the center point of the bottom surface of the work station 303 on the first cutting surface are used as the end point; the bottom surface center coordinates of the object to be suspended 307 are used as the starting point, that is, the bottom surface center coordinates of the object to be suspended 307 located in the temporary placement are used as the starting point.
[0143] In an exemplary embodiment, the horizontal movement path of the object to be hoisted 307 is obtained by using an ant colony algorithm, that is, the horizontal movement path of the object to be hoisted 307 from the starting point to the ending point is obtained by using an ant colony algorithm. The purpose of using the ant colony algorithm is that there will be obstacles 306 in the contours of the first cutting surface and the second cutting surface, that is, it is necessary to consider whether there are obstacles 306 blocking the straight-line distance route of the truck crane 301 from the starting point to the ending point.
[0144] In an exemplary embodiment, the maximum travel speed, acceleration and steering angle of the truck crane 301 are dynamically controlled by a PID control algorithm; the PID control algorithm is used to lift the object 307 to the end point along the horizontal moving path obtained by the ant colony algorithm, and then the hook is lowered so that the bottom surface of the object 307 gradually approaches the bottom center of the workstation 303 [a, b, -h0-h1] T When the bottom surface of the object 307 to be hoisted is in contact with the bottom surface of the work station 303, the hoisting is completed.
[0145] Example 3
[0146] Figure 5 is a schematic diagram of the structure of an electronic device according to an embodiment of the present invention. Figure 5 As shown, at the hardware level, the electronic device includes a processor, and optionally also includes a bus, a network interface, and a memory. Among them, the memory may include a memory, such as a high-speed random access memory (RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage, etc. Of course, the electronic device may also include hardware required for other services.
[0147] The processor, network interface and memory can be connected to each other through a bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 5 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0148] The memory is used to store programs. Specifically, the programs may include program codes, and the program codes include computer operation instructions.
[0149] The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs it, forming a shared resource access control device at the logical level. The processor executes the program stored in the memory and is specifically used to execute the steps of the above-mentioned automatic lifting method of the truck crane.
[0150] Example 4
[0151] The embodiment of the present invention further proposes a computer-readable storage medium, which stores one or more programs, and the one or more programs include instructions. When the instructions are executed by a portable electronic device including multiple application programs, the portable electronic device can execute the method of the embodiment shown in the accompanying drawings, and is specifically used to execute the steps of the above-mentioned automatic lifting method of the truck crane. Although the implementation methods disclosed by the present invention are as above, the content is only an implementation method adopted to facilitate the understanding of the present invention, and is not used to limit the present invention. Any technician in the field to which the present invention belongs can make any modifications and changes in the form and details of the implementation without departing from the spirit and scope disclosed by the present invention, but the scope of patent protection of the present invention shall still be based on the scope defined by the attached claims.
Claims
1. A method for automatic lifting with a truck crane, characterized in that: include: Acquire point clouds of multiple laser radars scanning the same object to be hoisted, where the scanning of the same object to be hoisted by the multiple laser radars has a common intersection, and determine a parent laser radar and a child laser radar from the multiple laser radars; Taking the point cloud of the parent laser radar as the target point cloud and the point cloud of the child laser radar as the source point cloud, ICP registration is performed to obtain a transformation matrix; Convert the transformation matrix into a transformation matrix of each of the child laser radars relative to the parent laser radar; Fusion of the transformation matrix with the point cloud acquired by each laser radar; Constructing a point cloud grid including the coordinates of the front end of the boom of the truck crane, the coordinates of the end of the boom, and the coordinates of the bottom surface of the object to be hoisted; cutting the point cloud grid, the first cutting surface is the intersection of the work station and the horizontal surface of the ground, and the second cutting surface is the horizontal plane where the bottom surface of the object to be hoisted is located; The projection coordinates of the bottom center point of the workstation on the first cutting surface are taken as the end point, and the bottom center coordinates of the object to be suspended are taken as the starting point, and the horizontal moving path of the object to be suspended is obtained by using an ant colony algorithm.
2. The automatic lifting method of a truck-mounted crane according to claim 1, characterized in that: The horizontal movement path also includes: dynamically controlling the maximum travel speed, acceleration and steering angle of the truck crane through a PID control algorithm.
3. The automatic lifting method of a truck-mounted crane according to claim 1, characterized in that: Also includes: Obtain the height difference between the bottom of the workstation and the ground level, the height of the parent laser radar from the ground level, the height of the boom end from the ground level, and the horizontal coordinate difference between the boom end and the parent laser radar.
4. The automatic lifting method of a truck-mounted crane according to claim 1, characterized in that: In the step of performing ICP registration to obtain a transformation matrix using the point cloud of the parent laser radar as the target point cloud and the point cloud of the child laser radar as the source point cloud, the ICP registration obtains the transformation matrix of the child laser radar relative to the parent laser radar.
5. An automatic lifting system for a truck crane, characterized in that: include: Multiple laser radars surround the workstations that hold the objects to be hoisted; A data acquisition module, which acquires point clouds of multiple laser radars scanning the same object to be hoisted, and the scans of the multiple laser radars on the same object to be hoisted have a common intersection; A data processing module, for determining a parent laser radar and a child laser radar from the plurality of laser radars; Taking the point cloud of the parent laser radar as the target point cloud and the point cloud of the child laser radar as the source point cloud, ICP registration is performed to obtain a transformation matrix; Convert the transformation matrix into a transformation matrix of each of the child laser radars relative to the parent laser radar; Fusion of the transformation matrix with the point cloud acquired by each laser radar; A point cloud mesh construction module is used to construct a point cloud mesh including the coordinates of the front end of the boom of the truck crane, the coordinates of the end of the boom, and the coordinates of the bottom surface of the object to be hoisted; The data processing module further includes: cutting the point cloud grid, the first cutting surface is the intersection surface of the work station and the horizontal surface of the ground, and the second cutting surface is the horizontal surface where the bottom surface of the object to be hoisted is located; The projection coordinates of the bottom center point of the workstation on the first cutting surface are taken as the end point, and the bottom center coordinates of the object to be suspended are taken as the starting point, and the horizontal moving path of the object to be suspended is obtained by using an ant colony algorithm.
6. The automatic lifting system of a truck-mounted crane according to claim 5, characterized in that: The horizontal movement path also includes: dynamically controlling the maximum travel speed, acceleration and steering angle of the truck crane through a PID control algorithm.
7. The automatic lifting system of a truck-mounted crane according to claim 5, characterized in that: The data acquisition module also includes: obtaining the height difference between the bottom of the workstation and the ground level, the height of the parent laser radar from the ground level, the height of the end of the boom from the ground level, and the horizontal coordinate difference between the end of the boom and the parent laser radar.
8. The automatic lifting system of a truck-mounted crane according to claim 5, characterized in that: In the step of performing ICP registration to obtain a transformation matrix using the point cloud of the parent laser radar as the target point cloud and the point cloud of the child laser radar as the source point cloud, the ICP registration obtains the transformation matrix of the child laser radar relative to the parent laser radar.
9. An electronic device, characterized in that: include: processor; as well as A memory arranged to store computer executable instructions, wherein when the executable instructions are executed, the processor executes the steps of the automatic lifting method of a truck-mounted crane according to any one of claims 1 to 4.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores one or more programs, which, when executed by an electronic device including a plurality of application programs, enable the electronic device to execute the steps of the automatic lifting method of the truck-mounted crane according to any one of claims 1 to 4.
Citation Information
Patent Citations
Path planning method and system based on double radars, storage medium and electronic equipment
CN113670316A
Container alignment method, system and equipment based on point cloud and storage medium
CN118196195A
Automated Cut Planning For Removal of Diseased Regions
US20210282858A1
Region estimation method, measurement region display system, and crane
WO2020122026A1
Method for aligning container truck and crane, and related device
WO2022160896A1
Cited By
Laser radar calibration method and system for unmanned screw ship unloader
CN120972147A
A laser radar calibration method and system for unmanned spiral ship unloader
CN120972147B
