Ceramic tile laying robot paving method, device, electronic equipment and storage medium
Through three-dimensional vision sensors, the high cost and complexity of the tile laying robots when collecting wall information and segmenting processing is solved, and the flange suction cups are quickly replaced to suit a variety of tile sizes The ability to reduce operating costs and robotic arm load.
Patent Information
- Application Number
- CN202110265591.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-03-11
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2041-03-11
AI Technical Summary
When collecting wall information and dividing processing of existing tile laying robots, the operating time and personnel operation costs are greatly increased, and it is more difficult to replace the end flange suction cup to apply to various tile sizes.
Three-dimensional vision sensors are used to collect point cloud data, identify the edges of the laid tiles and determine the gaps of the tiles in combination with preset spacing, obtain wall depth information, automatically determine the amount of glue, and control the robot to perform laying actions to simplify the load of the six-axis robot arm and flange suction cup replacement process.
This greatly reduces working time and staff costs, reduces the load on the six-degree of freedom robotic arms, and simplifies the process of replacing the end flange suction cup for a variety of tile sizes.
Smart Images

Figure CN115082535B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of paving technology, and in particular to a paving method, device, electronic equipment and storage medium of a tile paving robot. Background Art
[0002] In the related technology, the front end of the flange suction cup of the tile laying robot that grabs the tiles has two two-dimensional vision sensors and their equipped light sources and their telescopic devices, two laser ranging sensors, an inclination sensor and other sensors. Before the tile laying robot operates, it needs to input the relative depth information of the paving wall.
[0003] However, manually collecting wall information, segmenting it, and then transmitting it to the tile-laying robot greatly increases the operation time and personnel operating costs; and the tile-laying robot not only increases its own weight, but also has a high difficulty in replacing the end flange suction cup to adapt to a variety of tile sizes, which needs to be solved urgently.
[0004] Application Contents
[0005] The present application provides a paving method, device, electronic equipment and storage medium for a tile paving robot to solve the problems in the related art of manually collecting wall information, segmenting it and then transmitting it to the tile paving robot, which greatly increases the operation time and personnel operation costs, increases the weight of the tile paving robot itself, and is difficult to replace the end flange suction cup to adapt to a variety of tile sizes. The application greatly reduces the operation time and personnel costs, while reducing the required load of the six-degree-of-freedom robot arm, and can quickly replace the end flange suction cup to adapt to a variety of tile sizes, which is simple and easy to implement.
[0006] The first embodiment of the present application provides a paving method of a tile paving robot, wherein a three-dimensional visual sensor is arranged on a vertical lifting platform with a fixed relative position of a six-axis mechanical arm of the tile paving robot, and the method comprises the following steps:
[0007] Using the three-dimensional visual sensor to collect point cloud data of adjacent laid tiles;
[0008] Identify the upper edge of the laid tile according to the point cloud data of the adjacent laid tile, and determine the tile gap in combination with the preset spacing to perform area cutting, and obtain the wall depth information of the current tile to be laid relative to the paving area; and
[0009] The current glue application amount is determined according to the wall depth information, and after applying glue according to the current glue application amount, the tile paving robot is controlled to perform a paving action on the tile to be laid.
[0010] Optionally, the step of identifying the upper edge of the laid tiles according to the point cloud data of the adjacent laid tiles, and determining the tile gaps in combination with a preset spacing to perform area cutting, and obtaining the wall depth information of the current tiles to be laid relative to the paving area, includes:
[0011] Detecting whether the tiles currently to be laid are tiles in the first row and / or first column;
[0012] If it is the first row of tiles, or it is not the first row of tiles and not the first row of tiles, the coordinate origin is established with the upper left corner of the reference tile, and the long side is used as the X-axis of the coordinate system. At the same time, the tile-paved plane below the field of view of the three-dimensional vision sensor is fitted, and the three-dimensional information of the area to be laid above the field of view of the three-dimensional vision sensor is extracted, so as to obtain a target brick area according to the relative position segmentation;
[0013] If it is not the first row of tiles, but the first row of tiles, then the coordinate far point is established with the lower right corner or lower left corner of the laid tiles in the left or right column, and the short side is used as the Y-axis of the coordinate system. At the same time, plane fitting and comparison stitching are performed on the overlapping area of the three-dimensional sensor's field of view close to the side of the laid tiles, and three-dimensional information is extracted from the area to be laid in the three-dimensional vision sensor's field of view, and the two target brick areas are divided according to their relative positions with the adjacent areas.
[0014] Optionally, the controlling the tile paving robot to perform a paving action on the tile to be paved after applying glue according to the current glue application amount includes:
[0015] The compensation value of the six-axis robotic arm is determined according to the conversion relationship between the coordinates of the three-dimensional vision sensor and the end tool coordinates of the six-axis robotic arm of the tile laying robot.
[0016] Optionally, determining the compensation value of the six-axis robot arm according to the conversion relationship between the coordinates of the three-dimensional vision sensor and the end tool coordinates of the six-axis robot arm of the tile laying robot includes:
[0017] The degrees of freedom of movement in the X direction and the Y direction and rotation in the Z direction are determined according to the two-dimensional information of the point cloud, and the degrees of freedom of rotation in the X direction and the Y direction and movement in the Z direction are determined according to the depth information of the point cloud.
[0018] A second aspect of the present application provides a paving device of a tile paving robot, wherein a three-dimensional visual sensor is arranged on a vertical lifting platform with a fixed relative position of a six-axis mechanical arm of the tile paving robot, and the device comprises:
[0019] A collection module, used to collect point cloud data of adjacent laid tiles using the three-dimensional visual sensor;
[0020] an acquisition module, for identifying the upper edge of the laid tiles according to the point cloud data of the adjacent laid tiles, and determining the tile gaps in combination with the preset spacing to perform area cutting, and obtaining the wall depth information of the current tile to be laid relative to the paving area; and
[0021] The control module is used to determine the current glue application amount according to the wall depth information, and control the tile paving robot to perform the paving action on the current tile to be laid after applying glue according to the current glue application amount.
[0022] Optionally, the acquisition module includes:
[0023] A detection unit, used for detecting whether the tiles currently to be laid are tiles in the first row and / or first column;
[0024] The first segmentation unit is used to establish a coordinate origin with the upper left corner of the reference tile if it is the first row of tiles, or is not the first row of tiles and is not the first row of tiles, and use the long side as the X-axis of the coordinate system, and at the same time fit the tile-paved plane below the field of view of the three-dimensional vision sensor, and extract three-dimensional information of the area to be laid above the field of view of the three-dimensional vision sensor, so as to obtain a target brick area according to the relative position segmentation;
[0025] The second segmentation unit is used to establish a coordinate far point with the lower right corner or lower left corner of the laid tiles in the left or right column if it is not the first column of tiles and is the first row of tiles, and use the short side as the Y-axis of the coordinate system, and at the same time perform plane fitting and comparison stitching on the overlapping area of the field of view of the three-dimensional sensor close to the side of the laid tiles, and extract three-dimensional information from the area to be laid in the field of view of the three-dimensional vision sensor, and segment the two target brick areas according to their relative positions with adjacent areas.
[0026] Optionally, the control module includes
[0027] A determination unit is used to determine the compensation value of the six-axis robotic arm according to the conversion relationship between the coordinates of the three-dimensional vision sensor and the end tool coordinates of the six-axis robotic arm of the tile laying robot.
[0028] Optionally, the determining unit includes:
[0029] The degrees of freedom of movement in the X direction and the Y direction and rotation in the Z direction are determined according to the two-dimensional information of the point cloud, and the degrees of freedom of rotation in the X direction and the Y direction and movement in the Z direction are determined according to the depth information of the point cloud.
[0030] The third aspect of the present application provides an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are configured to execute the paving method of the tile paving robot as described in the above embodiment.
[0031] A fourth aspect of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the paving method of the tile paving robot as described in the above embodiment.
[0032] Therefore, a three-dimensional visual sensor can be used to collect point cloud data of adjacent laid tiles, and the upper edge of the laid tiles can be identified based on the point cloud data of adjacent laid tiles, and the tile gap can be determined in combination with the preset spacing for regional cutting, so as to obtain the wall depth information of the current tile to be laid relative to the paving area, and the current glue application amount can be determined based on the wall depth information, and the tile paving robot can be controlled to perform the paving action on the current tile to be laid after gluing based on the current glue application amount. This solves the problem in the related technology that the wall information is manually collected and segmented and then transmitted to the tile paving robot, which greatly increases the operation time and personnel operation costs, as well as the increase in the weight of the tile paving robot itself, and it is difficult to replace the end flange suction cup to adapt to a variety of tile sizes. This greatly reduces the operation time and personnel costs, while reducing the required load of the six-degree-of-freedom robotic arm, and the end flange suction cup can be quickly replaced to adapt to a variety of tile sizes, which is simple and easy to implement.
[0033] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:
[0035] Figure 1 A flowchart of a paving method of a tile paving robot provided according to an embodiment of the present application;
[0036] Figure 2 This is an example diagram of the layout of a three-dimensional vision sensor and a six-axis robotic arm in a tile laying robot and their coordinate system according to an embodiment of the present application;
[0037] Figure 3 This is an example diagram of the field of view of the first row of brick three-dimensional vision sensor according to one embodiment of the present application;
[0038] Figure 4This is an example diagram of the field of view of the three-dimensional visual sensor for non-first row bricks according to an embodiment of the present application.
[0039] Figure 5 This is a flow chart of a paving method of a tile paving robot according to an embodiment of the present application;
[0040] Figure 6 It is a block diagram of an exemplary paving device of a tile paving robot according to an embodiment of the present application;
[0041] Figure 7 1 is a block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION
[0042] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.
[0043] The following describes the paving method, device, electronic device and storage medium of the tile paving robot of the embodiment of the present application with reference to the accompanying drawings. In view of the problem mentioned in the background technology center that the wall information is manually collected and segmented and then transmitted to the tile paving robot, which greatly increases the operation time and personnel operation costs, as well as the weight of the tile paving robot itself increases, and it is difficult to replace the end flange suction cup to adapt to a variety of tile sizes, the present application provides a paving method for a tile paving robot, in which a three-dimensional visual sensor can be used to collect point cloud data of adjacent laid tiles, and the upper edge of the laid tiles can be identified based on the point cloud data of adjacent laid tiles, and the tile gap is determined in combination with the preset spacing for regional cutting to obtain the wall surface of the current tile to be laid relative to the paving area. The system can detect wall depth information and determine the current amount of glue applied according to the wall depth information. After applying glue according to the current amount of glue, the system controls the tile paving robot to perform the paving action on the current tile to be laid. This solves the problem in the related technology that wall information is manually collected and segmented and then transmitted to the tile paving robot, which greatly increases the operation time and personnel operation costs, increases the weight of the tile paving robot itself, and is difficult to replace the end flange suction cup to adapt to a variety of tile sizes. It greatly reduces the operation time and personnel costs, while reducing the required six-degree-of-freedom robotic arm load. The end flange suction cup can be quickly replaced to adapt to a variety of tile sizes, which is simple and easy to implement.
[0044] Specifically, Figure 1 A schematic flow chart of a tile laying method provided by a tile laying robot in an embodiment of the present application.
[0045] In this embodiment, a three-dimensional vision sensor is arranged on a vertical lifting platform with a fixed relative position of the six-axis mechanical arm of the tile laying robot.
[0046] Specifically, if Figure 2 As shown, Figure 2 This is a schematic diagram of the structure of a tile laying robot according to an embodiment of the present application. The tile laying machine includes: 1. a structured light sensor and its light source and its spatial coordinate system A; 2. a six-axis robot and its base coordinate system A0 and tool coordinate system AT; 3. tiles to be laid; wherein, 1. the structured light sensor and 2. the six-axis robot are on the same vertical lifting work platform. Specifically, firstly, the relative posture relationship between the structured light sensor and the six-axis robot is calibrated through three-dimensional vision to obtain the transformation matrix TA, that is, A0=A×TA. According to the transformation relationship between the base coordinate system of the six-axis robot and the tool coordinate system, it can be known that AT=A0×T1×T2×T3×T4×T5×T6, wherein T1, T2, T3, T4, T5, T6 are the coordinate transformation matrices of the six-axis robot, so AT=A×TA×T1×T2×T3×T4×T5×T6.
[0047] Thus, the conversion relationship between the coordinates of the three-dimensional vision sensor and the end tool coordinates of the six-axis robot arm can be obtained.
[0048] Furthermore, if Figure 1 As shown, the paving method of the tile paving robot includes the following steps:
[0049] In step S101, a three-dimensional vision sensor is used to collect point cloud data of adjacent laid tiles.
[0050] It should be understood that the tile laying robot of the embodiment of the present application can collect point cloud data of adjacent laid tiles and the area above them (that is, the total field of view area is larger than the area of the upper and lower tiles) through a three-dimensional vision sensor.
[0051] In step S102, the upper edge of the laid tiles is identified based on the point cloud data of the adjacent laid tiles, and the tile gap is determined in combination with the preset spacing to perform area cutting, so as to obtain the wall depth information of the current tile to be laid relative to the paving area.
[0052] Optionally, in some embodiments, the upper edge of the laid tile is identified based on the point cloud data of the adjacent laid tiles, and the tile gap is determined in combination with the preset spacing to perform area cutting, so as to obtain the wall depth information of the current tile to be laid relative to the paving area, including: detecting whether the current tile to be laid is the first row of tiles and / or the first row of tiles; if it is the first row of tiles, or not the first row of tiles and not the first row of tiles, the coordinate origin is established with the upper left corner of the reference tile, and the long side is used as the X-axis of the coordinate system, and at the same time, the tile-laid plane below the field of view of the three-dimensional vision sensor is fitted, And extract three-dimensional information of the area to be laid above the field of view of the three-dimensional vision sensor, so as to obtain a target brick area according to the relative position; if it is not the first row of tiles, but the first row of tiles, then establish the coordinate far point with the lower right corner or lower left corner of the laid tiles in the left or right column, and use the short side as the Y-axis of the coordinate system, and at the same time perform plane fitting and comparison stitching on the overlapping area of the field of view of the three-dimensional sensor close to the side of the laid tiles, and extract three-dimensional information of the area to be laid in the field of view of the three-dimensional vision sensor, and divide the two target brick areas according to the relative position with the adjacent area.
[0053] It should be understood that the tile laying robot of the embodiment of the present application can be positioned at the designated first row of tile stations through the chassis, thereby detecting whether the tiles currently to be laid are the first row of tiles and / or the first column of tiles.
[0054] If the tile to be laid is the first row of tiles, or is not the first row of tiles and is not the first row of tiles, the upper left corner of the reference tile is extracted by the two-dimensional information of the point cloud data collected in step S101 to establish the coordinate origin, thereby determining two of the six degrees of freedom of the tile to be laid in the x and y directions, and then taking the long side as the x-axis of the coordinate system, thereby determining the z-direction rotational degree of freedom of the six degrees of freedom of the tile to be laid, such as Figure 3 Then, the depth information of the point cloud data is used to fit the tile-paved plane under the field of view of the 3D vision sensor, thereby determining the x- and y-direction rotational freedom and z-direction movement freedom of the six degrees of freedom of the tile to be laid, so as to obtain a target brick area according to the relative position segmentation.
[0055] If the tile to be laid is not the first row of tiles, but the first column of tiles, then after determining the two x and y directions of the six degrees of freedom of the tile to be laid, the z direction of the six degrees of freedom of the tile to be laid can be determined by taking the short side as the y axis of the coordinate system, as follows: Figure 4 As shown. Then, the depth information of the point cloud data is used to Figure 3 and Figure 4The shadow part is fitted with a plane, and after being compared and spliced with the plane fitted with the depth information of the point cloud data of the area, the x- and y-direction rotational freedom and the z-direction movement freedom of the six degrees of freedom of the tiles to be laid are determined. At the same time, the three-dimensional information of the area to be laid in the field of view of the three-dimensional vision sensor is extracted, so as to divide the two target brick areas according to the relative position with the adjacent area.
[0056] In step S103, the current glue application amount is determined according to the wall depth information, and after applying glue according to the current glue application amount, the tile paving robot is controlled to perform a paving action on the tile to be laid.
[0057] Based on the above embodiments, it should be understood that the embodiments of the present application can automatically cut out the amount of glue required for the previous brick to be laid according to the data in the reference brick coordinate system, and accurately glue it through the precise gluing system of the tile paving robot, and automatically cut out the amount of glue required for the previous brick to be laid according to the data in the coordinate system of the non-first brick in the first row and the data in the coordinate systems of the remaining bricks, and accurately glue it through the precise gluing system of the tile paving robot.
[0058] Optionally, in some embodiments, after gluing according to the current amount of glue, the tile paving robot is controlled to perform the paving action on the current tile to be laid, including: determining the compensation value of the six-axis robotic arm according to the conversion relationship between the coordinates of the three-dimensional vision sensor and the end tool coordinates of the six-axis robotic arm of the tile paving robot.
[0059] Optionally, in some embodiments, the compensation value of the six-axis robotic arm is determined according to the conversion relationship between the coordinates of the three-dimensional vision sensor and the end tool coordinates of the six-axis robotic arm of the tile laying robot, including: determining the degrees of freedom of movement in the X and Y directions and rotation in the Z axis direction according to the two-dimensional information of the point cloud, and determining the degrees of freedom of rotation in the X and Y directions and movement in the Z direction according to the depth information of the point cloud.
[0060] That is to say, the embodiment of the present application ensures that the conversion coordinates of the three-dimensional vision sensor and the six-axis robot arm are fixed at a fixed value by placing the three-dimensional vision sensor on a vertical lifting platform with a fixed relative position to the six-axis robot arm, and only needs to be calibrated once, and the field of view of the three-dimensional vision sensor is greatly increased, so that it can use the two-dimensional information of the collected point cloud to compensate for the errors of the three degrees of freedom of the translation of the tile surface in the X and Y directions and the rotation in the Z direction perpendicular to the tile surface when performing the first transmission and the non-first transmission. At the same time, by fitting the collected point cloud depth information to the tile plane and the extended surface that have been laid, it can compensate for the errors of the three degrees of freedom of the rotation in the X and Y directions and the translation in the Z direction perpendicular to the tile surface when performing the first transmission and the non-first transmission, so that the number of sensors on the end flange suction cup is greatly reduced, the weight of the end flange suction cup itself and the difficulty of replacing the flange suction cup suitable for various tile sizes are reduced, and the load of the six-degree-of-freedom robot arm carrying it and the difficulty of designing the sensor replacement line are greatly reduced.
[0061] In order to enable those skilled in the art to further understand the paving method of the tile paving robot in the embodiment of the present application, a detailed description is given below in conjunction with specific embodiments.
[0062] like Figure 5 As shown, the paving method of the tile paving robot includes the following steps:
[0063] S501, calibrate the three-dimensional vision sensor and the six-axis robotic arm coordinate system.
[0064] S502, the tile laying robot moves to a designated position and lifts the vertical lifting platform.
[0065] S503, the three-dimensional vision sensor collects point cloud data.
[0066] S504, determine whether it is the first row of tiles, if so, execute step S509, otherwise, execute step S505.
[0067] S505, determine whether it is the first row of tiles, if so, execute step S506, otherwise, execute step S509.
[0068] S506, establishing a coordinate origin with the lower right corner or lower left corner of the laid tiles in the left column or right column, and then taking the short side as the y-axis of the coordinate system.
[0069] S507, performing plane fitting, comparison and splicing on the overlapping area of the field of view of the three-dimensional vision sensor close to the side where the tiles have been laid.
[0070] S508, extracting three-dimensional information from the area to be paved in the field of view of the three-dimensional vision sensor, and dividing it into two areas of bricks according to the relative position with the adjacent area.
[0071] S509, establishing a coordinate origin with the upper left corner of the reference tile, and then taking the long side as the x-axis of the coordinate system.
[0072] S510, fitting the tiled plane below the field of view of the three-dimensional vision sensor.
[0073] S511, extracting three-dimensional information of the area to be paved above the field of view of the three-dimensional vision sensor, and dividing it into the area of a brick according to the relative position.
[0074] S512, the two-dimensional information of the point cloud determines the freedom of movement in the x and y directions and rotation in the z direction; the depth information of the point cloud determines the freedom of rotation in the x and y directions and movement in the z direction; the three-dimensional information of the point cloud determines the base surface information for segmentation to provide data basis for accurate gluing.
[0075] S513, the six-axis robot arm compensates and lays the tiles at the positions to be laid according to the compensation information of the three-dimensional sensor.
[0076] S514, determine whether all paving work is completed, if so, execute step S515, otherwise, execute step S502.
[0077] S515, end.
[0078] Therefore, the six degrees of freedom to be compensated for the tiles to be laid at the end of the six-axis robotic arm can be determined by a three-dimensional vision sensor. At the same time, the three-dimensional information of the point cloud can be used to automatically cut out the amount of glue required for the previous tile to be laid according to the base surface data. The precise gluing system of the tile laying robot can then accurately gluing it, saving the process of pre-reference surface information processing in the existing solution of the tile laying robot.
[0079] According to the paving method of a tile paving robot proposed in the embodiment of the present application, a three-dimensional visual sensor can be used to collect point cloud data of adjacent laid tiles, and the upper edge of the laid tiles can be identified based on the point cloud data of the adjacent laid tiles, and the tile gap can be determined in combination with the preset spacing for regional cutting, so as to obtain the wall depth information of the current tile to be laid relative to the paving area, and the current glue application amount can be determined based on the wall depth information, and the tile paving robot can be controlled to perform paving actions on the current tile to be laid after gluing based on the current glue application amount. This solves the problem in the related art that the wall information is manually collected and segmented and then transmitted to the tile paving robot, which greatly increases the operation time and personnel operation costs, as well as the increase in the weight of the tile paving robot itself, and the difficulty in replacing the end flange suction cup to adapt to a variety of tile sizes is high. This greatly reduces the operation time and personnel costs, while reducing the required load of the six-degree-of-freedom robotic arm, and the end flange suction cup can be quickly replaced to adapt to a variety of tile sizes, which is simple and easy to implement.
[0080] Next, the paving device of the tile paving robot proposed in the embodiment of the present application is described with reference to the accompanying drawings.
[0081] Figure 6 It is a block diagram of a paving device of a tile paving robot according to an embodiment of the present application.
[0082] In this embodiment, a three-dimensional vision sensor is arranged on a vertical lifting platform with a fixed relative position of the six-axis mechanical arm of the tile laying robot.
[0083] like Figure 6 As shown, the paving device 10 of the tile paving robot includes: a collection module 100, an acquisition module 200 and a control module 300.
[0084] Wherein, the acquisition module 100 is used to collect point cloud data of adjacent laid tiles using a three-dimensional visual sensor;
[0085] The acquisition module 200 is used to identify the upper edge of the laid tiles according to the point cloud data of the adjacent laid tiles, and determine the tile gaps in combination with the preset spacing to perform area cutting, and obtain the wall depth information of the current tile to be laid relative to the paving area; and
[0086] The control module 300 is used to determine the current glue application amount according to the wall depth information, and control the tile paving robot to perform the paving action on the current tile to be laid after applying glue according to the current glue application amount.
[0087] Optionally, in some embodiments, the acquisition module 200 includes:
[0088] A detection unit, used to detect whether the tiles currently to be laid are the first row of tiles and / or the first column of tiles;
[0089] The first segmentation unit is used to establish a coordinate origin with the upper left corner of the reference tile if it is the first row of tiles, or not the first row of tiles and not the first row of tiles, and use the long side as the X-axis of the coordinate system, and at the same time fit the tile-paved plane below the field of view of the three-dimensional vision sensor, and extract three-dimensional information of the area to be laid above the field of view of the three-dimensional vision sensor, so as to obtain a target brick area according to the relative position segmentation;
[0090] The second segmentation unit is used to establish a coordinate far point with the lower right corner or lower left corner of the laid tiles in the left or right column if it is not the first row of tiles but the first row of tiles, and use the short side as the Y-axis of the coordinate system. At the same time, plane fitting and comparison stitching are performed on the overlapping area of the three-dimensional sensor's field of view close to the side of the laid tiles, and three-dimensional information is extracted from the area to be laid in the three-dimensional vision sensor's field of view, and the two target brick areas are segmented according to their relative positions with adjacent areas.
[0091] Optionally, in some embodiments, the control module 300 includes
[0092] The determination unit is used to determine the compensation value of the six-axis robotic arm according to the conversion relationship between the coordinates of the three-dimensional vision sensor and the end tool coordinates of the six-axis robotic arm of the tile laying robot.
[0093] Optionally, in some embodiments, the determining unit includes:
[0094] The degrees of freedom of movement in the X and Y directions and rotation in the Z axis direction are determined according to the two-dimensional information of the point cloud, and the degrees of freedom of rotation in the X and Y directions and movement in the Z direction are determined according to the depth information of the point cloud.
[0095] It should be noted that the aforementioned explanation of the embodiment of the paving method of the tile paving robot is also applicable to the paving device of the tile paving robot of this embodiment, and will not be repeated here.
[0096] According to the paving device of the tile paving robot proposed in the embodiment of the present application, a three-dimensional visual sensor can be used to collect point cloud data of adjacent laid tiles, and the upper edge of the laid tiles can be identified based on the point cloud data of the adjacent laid tiles, and the tile gap can be determined in combination with the preset spacing for regional cutting, so as to obtain the wall depth information of the current tile to be laid relative to the paving area, and the current glue application amount can be determined based on the wall depth information, and the tile paving robot can be controlled to perform the paving action on the current tile to be laid after glue application based on the current glue application amount. This solves the problem in the related art that the wall information is manually collected and segmented and then transmitted to the tile paving robot, which greatly increases the operation time and personnel operation costs, as well as the increase in the weight of the tile paving robot itself, and the difficulty in replacing the end flange suction cup to adapt to a variety of tile sizes is high. This greatly reduces the operation time and personnel costs, while reducing the required load of the six-degree-of-freedom robotic arm, and the end flange suction cup can be quickly replaced to adapt to a variety of tile sizes, which is simple and easy to implement.
[0097] Figure 7 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device may include:
[0098] A memory 701 , a processor 702 , and a computer program stored in the memory 701 and executable on the processor 702 .
[0099] When the processor 702 executes the program, the paving method of the tile paving robot provided in the above embodiment is implemented.
[0100] Furthermore, the electronic device further comprises:
[0101] The communication interface 703 is used for communication between the memory 701 and the processor 702 .
[0102] The memory 701 is used to store computer programs that can be executed on the processor 702 .
[0103] The memory 701 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
[0104] If the memory 701, the processor 702 and the communication interface 703 are implemented independently, the communication interface 703, the memory 701 and the processor 702 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0105] Optionally, in a specific implementation, if the memory 701, the processor 702 and the communication interface 703 are integrated on a chip, the memory 701, the processor 702 and the communication interface 703 can communicate with each other through an internal interface.
[0106] The processor 702 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.
[0107] This embodiment also provides a computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the above-mentioned tile laying method of the robot.
[0108] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.
[0109] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0110] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.
[0111] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or N wirings (electronic devices), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.
[0112] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiment, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.
[0113] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.
[0114] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
[0115] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.
Claims
1. A paving method for a tile paving robot, characterized in that: A three-dimensional visual sensor is arranged on a vertical lifting platform with a fixed relative position of a six-axis mechanical arm of a tile laying robot, wherein the method comprises the following steps: Using the three-dimensional visual sensor to collect point cloud data of adjacent laid tiles; Identify the upper edge of the laid tile according to the point cloud data of the adjacent laid tile, and determine the tile gap in combination with the preset spacing to perform area cutting, and obtain the wall depth information of the current tile to be laid relative to the paving area; and Determining the current glue application amount according to the wall depth information, and controlling the tile paving robot to perform a paving action on the tile to be laid according to the current glue application amount after applying glue; identifying the upper edge of the laid tile according to the point cloud data of the adjacent laid tiles, and determining the tile gap in combination with the preset spacing for area cutting, and obtaining the wall depth information of the tile to be laid relative to the paving area, including: Detecting whether the tiles currently to be laid are tiles in the first row and / or first column; If it is the first row of tiles, or it is not the first row of tiles and not the first row of tiles, the coordinate origin is established with the upper left corner of the reference tile, and the long side is used as the X-axis of the coordinate system. At the same time, the tile-paved plane below the field of view of the three-dimensional vision sensor is fitted, and the three-dimensional information of the area to be laid above the field of view of the three-dimensional vision sensor is extracted, so as to obtain a target brick area according to the relative position segmentation; If it is not the first row of tiles, but the first row of tiles, then the coordinate far point is established with the lower right corner or lower left corner of the laid tiles in the left or right column, and the short side is used as the Y-axis of the coordinate system. At the same time, plane fitting and comparison stitching are performed on the overlapping area of the three-dimensional sensor's field of view close to the side of the laid tiles, and three-dimensional information is extracted from the area to be laid in the three-dimensional vision sensor's field of view, and the two target brick areas are divided according to their relative positions with the adjacent areas.
2. The method according to claim 1, characterized in that The method of controlling the tile paving robot to perform a paving action on the tile to be paved after applying glue according to the current amount of glue applied includes: The compensation value of the six-axis robotic arm is determined according to the conversion relationship between the coordinates of the three-dimensional vision sensor and the end tool coordinates of the six-axis robotic arm of the tile laying robot.
3. The method according to claim 2, characterized in that The step of determining the compensation value of the six-axis robot arm according to the conversion relationship between the coordinates of the three-dimensional vision sensor and the end tool coordinates of the six-axis robot arm of the tile laying robot comprises: The degrees of freedom of movement in the X and Y directions and rotation in the Z direction are determined according to the two-dimensional information of the point cloud, and the degrees of freedom of rotation in the X and Y directions and movement in the Z direction are determined according to the depth information of the point cloud.
4. A paving device for a tile paving robot, characterized in that: A three-dimensional visual sensor is arranged on a vertical lifting platform with a fixed relative position of the six-axis mechanical arm of the tile laying robot, wherein the device comprises: A collection module, used to collect point cloud data of adjacent laid tiles using the three-dimensional visual sensor; an acquisition module, for identifying the upper edge of the laid tiles according to the point cloud data of the adjacent laid tiles, and determining the tile gaps in combination with the preset spacing to perform area cutting, and obtaining the wall depth information of the current tile to be laid relative to the paving area; and A control module, used to determine the current glue application amount according to the wall depth information, and control the tile paving robot to perform a paving action on the tile to be laid after applying glue according to the current glue application amount; The acquisition module comprises: A detection unit, used for detecting whether the tiles currently to be laid are tiles in the first row and / or first column; The first segmentation unit is used to establish a coordinate origin with the upper left corner of the reference tile if it is the first row of tiles, or is not the first row of tiles and is not the first row of tiles, and use the long side as the X-axis of the coordinate system, and at the same time fit the tile-paved plane below the field of view of the three-dimensional vision sensor, and extract three-dimensional information of the area to be laid above the field of view of the three-dimensional vision sensor, so as to obtain a target brick area according to the relative position segmentation; The second segmentation unit is used to establish a coordinate far point with the lower right corner or lower left corner of the laid tiles in the left or right column if it is not the first column of tiles and is the first row of tiles, and use the short side as the Y-axis of the coordinate system, and at the same time perform plane fitting and comparison stitching on the overlapping area of the field of view of the three-dimensional sensor close to the side of the laid tiles, and extract three-dimensional information from the area to be laid in the field of view of the three-dimensional vision sensor, and segment the two target brick areas according to their relative positions with adjacent areas.
5. The device according to claim 4, characterized in that The control module comprises A determination unit is used to determine the compensation value of the six-axis robotic arm according to the conversion relationship between the coordinates of the three-dimensional vision sensor and the end tool coordinates of the six-axis robotic arm of the tile laying robot.
6. The device according to claim 5, characterized in that The determining unit comprises: The degrees of freedom of movement in the X and Y directions and rotation in the Z direction are determined according to the two-dimensional information of the point cloud, and the degrees of freedom of rotation in the X and Y directions and movement in the Z direction are determined according to the depth information of the point cloud.
7. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the paving method of the tile paving robot as described in any one of claims 1 to 3.
8. A computer-readable storage medium having a computer program stored thereon, characterized in that: The program is executed by a processor to implement the paving method of the tile paving robot as described in any one of claims 1-3.
