Gluing path correction method, robot, visual device, system and storage medium

Through the cooperation of flexible grippers and visual devices, the glue coating path of the robot arm is corrected by using the posture correction value, which solves the high cost and site occupation of fixed tool equipment in the glue coating operations of various automobile models, achieving high efficiency and saving Cost glue application.

CN119057787APending Publication Date: 2024-12-03SAIC GM WULING AUTOMOBILE CO LTD

Patent Information

Application Number
CN202411295850.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-14
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

In the prior art, coating the outer panels of various models of automobiles requires the manufacture of multiple sets of fixed tooling equipment, resulting in large site occupation and high manufacturing costs.

Method used

The glue-coating path correction method is used to combine a flexible gripper and visual device. By obtaining the attitude correction value between the current attitude of the material and the desired attitude, the glue-coating path of the robot arm is corrected, and the grabbing and coating of various vehicle models is realized. Operation.

Benefits of technology

The number of robots used is reduced, efficiency and cost-effectiveness is improved, the glue coating path correction algorithm is simplified, real-time path offset calculation is avoided, and the glue coating accuracy is ensured.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119057787A_ABST
    Figure CN119057787A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a gluing path correction method, a robot, a visual device, a system and a storage medium. The gluing path correction method comprises the steps that a gripper is controlled to grab materials from a material frame; obtaining an attitude correction value of the material, wherein the attitude correction value is used for representing a deviation value between a current attitude and an expected attitude of the material; the gluing path of the mechanical arm is corrected according to the posture correction value, and the corrected gluing path is obtained; and the mechanical arm is controlled to move the materials to the target gluing position according to the corrected gluing path. The robot can control the gripper to directly grab the materials from the material frame, and the gripper is flexible, so that one robot can grab the materials of various vehicle types, the use number of robots is reduced, the efficiency of the robot is improved, the cost is saved, the gluing path is corrected through the posture correction value, the offset of the gluing path does not need to be calculated in real time, and the gluing efficiency is improved. The algorithm is simplified, and the gluing path correction efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of path correction, and in particular to a gluing path correction method, a robot, a visual device, a system and a storage medium. Background Art

[0002] As the outermost protective cover of the car, the car outer panel can not only block the internal structure of the car body so that the vehicle can operate normally, but also protect the car body and the internal passengers. It is understandable that in rainy and snowy weather, the car outer panel can prevent rainwater from flowing into the interior of the car, and the car outer panel can resist the impact of external forces such as collisions, impacts or falls, and protect the safety of the internal parts of the car and the passengers. When processing the car outer panel, various parts need to be installed on it. If only spot welding is used for connection, it will not play a sealing role. In order to prevent rainwater from flowing into the interior of the car, during the production process, it is necessary to apply glue to the designated parts of the car outer panel.

[0003] In the related art, the material (automobile outer panel) to be coated with glue is placed on a fixed tooling equipment, a robot accurately grabs the material from the fixed tooling equipment, and moves the material to the gluing position under the gluing device to realize the gluing operation in the air.

[0004] However, using fixed tooling equipment to place materials requires high manufacturing costs, because each tooling equipment can only place materials of one type of vehicle, and the robot can only grab materials from one fixed tooling equipment at a time. If you need to glue materials of multiple types of vehicles, you need to manufacture multiple sets of fixed tooling equipment, which will occupy a large area and have high manufacturing costs.

[0005] It should be pointed out that the information disclosed in the background technology section of this application is only intended to deepen the understanding of the general background technology of this application, and should not be regarded as an admission or suggestion in any form that the information constitutes prior art already known to those skilled in the art. Summary of the invention

[0006] In view of this, the present application provides a gluing path correction method, robot, visual device, system and storage medium, so as to solve the problem in the prior art that if gluing operations are required for materials of various types of vehicles, multiple sets of fixed tooling equipment need to be manufactured, which will occupy a large site and have high manufacturing costs.

[0007] In a first aspect, an embodiment of the present application provides a method for correcting a gluing path, which is applied to a robot, wherein the robot includes a gripper and a mechanical arm, and the method includes:

[0008] Control the gripper to grab materials from the material frame;

[0009] Acquire a posture correction value of the material, where the posture correction value is used to represent a deviation value between a current posture of the material and an expected posture;

[0010] Correcting the gluing path of the robot arm according to the posture correction value to obtain a corrected gluing path;

[0011] The robot arm is controlled to move the material to a target gluing position according to the corrected gluing path.

[0012] In an embodiment of the present application, the robot can control the gripper to grab materials directly from the material frame, and the gripper is a flexible gripper, so one robot can grab materials of multiple models, reducing the number of robots used, improving robot efficiency, and saving costs. However, when the robot's flexible gripper grabs materials in the material frame, it is difficult to ensure that the current posture of the material is exactly the same as the expected posture, so an embodiment of the present application also provides a method for correcting the gluing path, which corrects the gluing path of the robotic arm by the posture correction value between the current posture of the material and the expected posture. It can be understood that correcting the gluing path of the robotic arm by the posture correction value means calculating the posture correction value before the robotic arm moves, and during the movement of the robotic arm, it is only necessary to compensate the gluing path according to the calculated posture correction value, and there is no need to calculate the gluing path offset in real time, which simplifies the algorithm and improves the efficiency of the gluing path correction.

[0013] In a possible implementation, obtaining the posture correction value of the material includes:

[0014] Controlling the robotic arm to move the material to a first position;

[0015] Controlling the robotic arm to move the material to a second position;

[0016] Receive the posture correction value of the material sent by the visual device.

[0017] In an embodiment of the present application, the robot controls the robotic arm to move the material to a first position for the visual device to capture the image and obtain a first image. After a preset time, the robot controls the robotic arm to move the material to a second position for the visual device to capture the image and obtain a second image, and receives the posture correction value sent by the visual device.

[0018] In a possible implementation manner, after controlling the mechanical arm to move the material to the first position, the method further includes:

[0019] A first control signal is sent to the visual device, where the first control signal is used to instruct the visual device to capture an image of the material to obtain a first image.

[0020] In the embodiment of the present application, after the robot moves the material to the first position, a first control signal is sent to the visual device to instruct the visual device to capture an image of the material to obtain a first image. It can be understood that by sending the first control signal to the visual device, the visual device can determine the position of the material, thereby performing image capture and improving the efficiency of correcting the gluing path.

[0021] In a possible implementation manner, after controlling the mechanical arm to move the material to the second position, the method further includes:

[0022] A second control signal is sent to the visual device, where the second control signal is used to instruct the visual device to capture an image of the material to obtain a second image.

[0023] In an embodiment of the present application, after the robot moves the material to the second position, a second control signal is sent to the visual device to instruct the visual device to capture an image of the material and obtain a second image. In a possible implementation, after the robot moves the material to the first position, it waits for a preset time interval for the visual device to capture an image and obtain a first image; then the material is moved to the second position, and a preset time interval is waited for the visual device to capture an image and obtain a second image. And after the visual device acquires the first image, it acquires the second image at a preset time interval. Because the time required for the visual device to capture an image is not fixed, the preset time interval must be greater than or equal to the maximum time required for the visual device to capture an image. If the robot does not send the second control signal to the visual device after moving the material to the second position, it may cause the visual device to wait for a long time after acquiring the first image. It can be understood that by sending the second control signal to the visual device, the waiting time after the visual device acquires the first image can be avoided to be too long, and the information interaction between the robot and the visual device is more helpful to improve the efficiency of correcting the gluing path.

[0024] In a possible implementation, before controlling the mechanical arm to move the material to the second position, the method further includes:

[0025] A feedback signal sent by the visual device is received, where the feedback signal is used to instruct the visual device to complete the acquisition of the first image.

[0026] In the embodiment of the present application, when the visual device completes image acquisition and obtains the first image, a feedback signal is sent to the robot to instruct the visual device to complete the acquisition of the first image. It can be understood that by sending a feedback signal to the robot, the robot can avoid waiting too long at the first position, and the information interaction between the robot and the visual device can further help improve the efficiency of correcting the gluing path.

[0027] In a possible implementation, the step of correcting the gluing path of the robot arm according to the posture correction value to obtain the corrected gluing path includes:

[0028] If the posture correction value is less than a preset correction value threshold, the gluing path of the robot arm is corrected according to the posture correction value to obtain a corrected gluing path.

[0029] In the embodiment of the present application, after the robot obtains the posture correction value, it determines whether the posture correction value is less than a preset correction value threshold, and only when the posture correction value is less than the preset correction value threshold, the robot corrects the gluing path of the robot arm according to the posture correction value. It can be understood that judging in advance whether the posture correction value is less than the preset correction value threshold can avoid the collision of materials with other devices caused by correcting the gluing path of the robot arm with a larger posture correction value.

[0030] In a possible implementation, the method further includes:

[0031] If the posture correction value is greater than or equal to a preset correction value threshold, the robot arm is controlled to stop moving and an alarm message is output.

[0032] In the embodiment of the present application, when the posture correction value is greater than or equal to the preset correction value threshold, it means that the deviation value of the material grasped by the gripper is large, and it may not be possible to eliminate the deviation value by correcting the gluing path. When the posture correction value is greater than or equal to the preset correction value threshold, the robot arm is controlled to stop moving and output an alarm message, which can avoid collision between the material and other devices.

[0033] In a second aspect, an embodiment of the present application provides a method for correcting a gluing path, which is applied to a visual device, and the method includes:

[0034] Capturing an image of the material moved to the first position to obtain a first image;

[0035] Capturing an image of the material moved to the second position to obtain a second image;

[0036] Obtaining a current posture of the material according to the first image and the second image;

[0037] Calculating a posture correction value according to the current posture and the expected posture of the material;

[0038] The posture correction value is sent to the robot.

[0039] In the embodiment of the present application, the visual device acquires images of two positions of the material to obtain a first image and a second image, and acquires the current posture of the material through the two images, and calculates the posture correction value according to the current posture and the expected posture. It can be understood that the visual device acquires and analyzes images to obtain the posture correction value, and can obtain accurate posture correction values, thereby improving the efficiency of glue coating path correction.

[0040] In a possible implementation, capturing an image of the material moved to the first position to obtain a first image includes:

[0041] receiving a first control signal sent by the robot, wherein the first control signal is used to instruct the visual device to capture an image of the material to obtain a first image;

[0042] An image is captured of the material moved to the first position to obtain a first image.

[0043] In the embodiment of the present application, after the visual device receives the first control signal sent by the robot, it performs image acquisition to obtain the first image. It can be understood that by receiving the first control signal sent by the robot, the visual device can determine the position of the material, thereby performing image acquisition and improving the efficiency of correcting the gluing path.

[0044] In a possible implementation, capturing an image of the material moved to the second position to obtain a second image includes:

[0045] receiving a second control signal sent by the robot, wherein the second control signal is used to instruct the visual device to capture an image of the material to obtain a second image;

[0046] An image is captured of the material moved to the second position to obtain a second image.

[0047] In the embodiment of the present application, after the visual device receives the second control signal sent by the robot, it performs image acquisition to obtain the second image. It can be understood that by receiving the second control signal sent by the robot, it is possible to avoid the visual device from having to wait too long after obtaining the first image, and the information interaction between the robot and the visual device is more helpful to improve the efficiency of correcting the gluing path.

[0048] In a possible implementation manner, after capturing an image of the material moved to the first position to obtain the first image, the method further includes:

[0049] A feedback signal is sent to the robot, where the feedback signal is used to instruct the visual device to complete the acquisition of the first image.

[0050] In the embodiment of the present application, after the visual device completes the acquisition of the first image, the visual device sends a feedback signal to the robot. It can be understood that by sending a feedback signal to the robot, the robot can avoid waiting too long at the first position, and the information interaction between the robot and the visual device can further help improve the efficiency of correcting the gluing path.

[0051] In a third aspect, an embodiment of the present application provides a robot, comprising:

[0052] A gripper, the gripper is used to grab materials from the material frame;

[0053] A mechanical arm, wherein the mechanical arm is used to move the material;

[0054] A first controller, the first controller is used to control the gripper to grab materials from the material frame; obtain a posture correction value of the material, the posture correction value is used to characterize the deviation value between the current posture of the material and the expected posture; correct the gluing path of the robot arm according to the posture correction value to obtain the corrected gluing path; control the robot arm to move the material to the target gluing position according to the corrected gluing path.

[0055] In a fourth aspect, an embodiment of the present application provides a visual device, including:

[0056] An image acquisition unit, wherein the image acquisition unit is used to acquire a first image and a second image;

[0057] The second controller is used to calculate a posture correction value according to the current posture and the expected posture of the material; and send the posture correction value to the robot.

[0058] In a fifth aspect, an embodiment of the present application provides a gluing path correction system, including:

[0059] The robot according to the third aspect;

[0060] The visual device described in the fourth aspect.

[0061] In the sixth aspect, an embodiment of the present application provides a computer-readable storage medium, characterized in that the computer-readable storage medium includes a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute any one of the methods described in the first aspect and the second aspect.

[0062] It is understandable that the robot provided in the third aspect, the visual device provided in the fourth aspect, the gluing path correction system provided in the fifth aspect, and the computer-readable storage medium provided in the sixth aspect are used to execute the method provided in the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods, which will not be repeated here.

[0063] In an embodiment of the present application, the robot can control the gripper to grab materials directly from the material frame, and the gripper is a flexible gripper, so one robot can grab materials of multiple models, reducing the number of robots used, improving robot efficiency, and saving costs. However, when the robot's flexible gripper grabs materials in the material frame, it is difficult to ensure that the current posture of the material is exactly the same as the expected posture, so an embodiment of the present application also provides a method for correcting the gluing path, which corrects the gluing path of the robotic arm by the posture correction value between the current posture of the material and the expected posture. It can be understood that correcting the gluing path of the robotic arm by the posture correction value means calculating the posture correction value before the robotic arm moves, and during the movement of the robotic arm, it is only necessary to compensate the gluing path according to the calculated posture correction value, and there is no need to calculate the gluing path offset in real time, which simplifies the algorithm and improves the efficiency of the gluing path correction. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0065] Figure 1 A schematic diagram of the structure of a flexible gripper provided in an embodiment of the present application;

[0066] Figure 2 A schematic diagram of an application scenario provided for an embodiment of the present application;

[0067] Figure 3 A schematic diagram of a process flow of a method for correcting a gluing path provided in an embodiment of the present application;

[0068] Figure 4 A schematic flow chart of another method for correcting a gluing path provided in an embodiment of the present application;

[0069] Figure 5 A schematic flow chart of another method for correcting a gluing path provided in an embodiment of the present application;

[0070] Figure 6 A schematic diagram of the structure of a robot provided in an embodiment of the present application;

[0071] Figure 7 A schematic diagram of the structure of a visual device provided in an embodiment of the present application;

[0072] Figure 8 A schematic flow chart of another method for correcting a gluing path provided in an embodiment of the present application. DETAILED DESCRIPTION

[0073] In order to better understand the technical solution of the present application, the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0074] It should be clear that the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0075] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0076] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0077] In order to prevent rainwater from flowing into the interior of the car, it is necessary to apply glue to the designated parts of the car's outer panels during the production process. In the related art, the material to be applied with glue (car outer panels) is placed on a fixed tooling device, and a robot accurately grabs the material from the fixed tooling and moves the material to the gluing position under the gluing device to achieve aerial gluing.

[0078] However, using fixed tooling equipment to place materials requires high manufacturing costs, because each tooling equipment can only place materials of one type of vehicle, and the robot can only grab materials from one fixed tooling equipment at a time. If you need to glue materials of multiple types of vehicles, you need to manufacture multiple sets of fixed tooling equipment, which will occupy a large area and have high manufacturing costs.

[0079] In view of the above problems, the present application provides a method for correcting the gluing path, in which the robot can control the gripper to directly grab the material from the material frame, and the gripper is a flexible gripper, so one robot can grab materials of various types of vehicles, reducing the number of robots used, improving the efficiency of the robot, and saving costs. The method is described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0080] For ease of understanding, the flexible gripper provided in the present application is described in detail below using the side outer panel of a car as an example.

[0081] See also Figure 1, is a schematic diagram of the structure of a flexible gripper provided in an embodiment of the present application. Figure 1 The side outer panel 104 and the flexible gripper are shown in the figure. The side outer panel 104 includes an A-pillar 1041, a B-pillar 1042 and a C-pillar 1043. Of course, the side outer panel 104 is only an exemplary description. In actual applications, the side outer panel may also include a D-pillar, which is not limited in the embodiments of the present application. And for the side outer panel including the D-pillar, the flexible gripper in the embodiment of the present application can also be directly grabbed from the material frame. The flexible gripper includes an image acquisition system 101, an intelligent gripper 102 and an adaptive curved surface fixture 103, wherein the intelligent gripper 102 includes a first gripper 1021, a second gripper 1022, a third gripper 1023 and a fourth gripper 1024, and the four grippers are connected by a servo harness (ServoHarness). It should be pointed out that the flexible gripper of the robot provided in the embodiment of the present application is only an exemplary description, and those skilled in the art can set the gripper to other types of flexible grippers according to actual needs.

[0082] When the robot receives the grasping instruction, it moves the flexible gripper to a position in the material frame that matches the side panel 104 according to the grasping instruction, and controls the flexible gripper to grasp the side panel 104 from the material frame. Specifically, the image acquisition system determines the placement posture of the side panel 104 in the material frame by judging the characteristic hole position of the B-pillar 1042 on the side panel 104. After the robot determines the placement posture of the side panel 104, it grasps the side panel 104 from the material frame through four intelligent grippers (the first gripper 1021, the second gripper 1022, the third gripper 1023 and the fourth gripper 1024). When the side panel 104 completely leaves the material frame, the A-pillar 1041 of the side panel 104 is clamped by the adaptive curved clamp 103.

[0083] It can be understood that by using the robot's flexible gripper to intelligently grab materials from the material frame, one robot can grab automobile exterior panels of multiple different models, reducing the number of robots used, improving robot efficiency and saving costs.

[0084] However, since the robot's flexible gripper grabs materials directly from the material frame, and the materials in the material frame are usually not arranged neatly, it cannot be guaranteed that the materials grabbed by the robot's flexible gripper are strictly in line with expectations every time. At this time, if the robot's mechanical arm moves the material to the gluing position according to the preset gluing trajectory, it may cause the material gluing position to be incorrect, affecting the accuracy of the material gluing.

[0085] In order to solve the above problems, the embodiment of the present application also provides a method for correcting the gluing path, which corrects the gluing path of the robot arm by the posture correction value between the current posture of the material and the expected posture. It can be understood that the gluing path of the robot arm is corrected by the posture correction value, that is, the posture correction value is calculated before the robot arm moves. During the movement of the robot arm, it is only necessary to compensate the gluing path according to the calculated posture correction value, and there is no need to calculate the offset of the gluing path in real time, which simplifies the algorithm and improves the efficiency of the gluing path correction. The method is described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0086] For ease of understanding, the application scenario of the present application is described in detail below by taking the side outer panel of a car as an example.

[0087] See also Figure 2 , is a schematic diagram of an application scenario provided by an embodiment of the present application. Figure 2 As shown, the application scenario shows a visual device 201, an intelligent gripper 102, a flange 202, a fixing module 203 and a side panel 104. The visual device 201 is used to capture images of the side panel 104, and the intelligent gripper 102 is used to capture images of the side panel 104. Figure 1 In the intelligent gripper shown in the figure, the flange 202 is connected to the 6th axis of the robot, and the fixing module 203 is used to fix the side outer panel 104. Because the side outer panel 104 may need to be rotated 90° during the gluing process, the fixing module 203 can more firmly grasp the side outer panel 104, which includes an A-pillar 1041, a B-pillar 1042 and a C-pillar 1043.

[0088] After the intelligent gripper grabs the side outer panel 104 from the material frame, the robot's mechanical arm drives the intelligent gripper to move the side outer panel 104 to the first position (such as Figure 2 As shown in a in the figure, the A-pillar 1041 of the side outer panel 104 corresponds to the position of the image acquisition area of ​​the visual device 201), the visual device 201 obtains the first image, and then the robot's mechanical arm drives the intelligent gripper to move the side outer panel 104 to the second position (as shown in a in the figure). Figure 2 As shown in b, the side outer panel 104 (the C-pillar 1043 of the side outer panel 104 is at a position corresponding to the image acquisition area of ​​the visual device 201), the visual device 201 obtains the second image, and the visual device 201 obtains the current posture of the side outer panel 104 through the first image and the second image, and calculates the deviation between the current posture of the side outer panel 104 and the expected posture, and obtains the posture correction value. The robot corrects the gluing path of the robotic arm according to the posture correction value.

[0089] The specific implementation of the above embodiment is described below with reference to the accompanying drawings and specific embodiments.

[0090] See also Figure 3 , is a flow chart of a method for correcting a gluing path provided in an embodiment of the present application. The method can be applied to a robot, and mainly includes the following steps.

[0091] Step S301: Control the gripper to grab materials from the material frame.

[0092] Specifically, the robot includes a controller and a gripper. The controller controls the gripper to grab materials from the material frame. Figure 1 and Figure 2 The specific method of the intelligent gripper 102 in the embodiment shown in FIG. 1 is to grasp the material from the material frame. Figure 1 The illustrated embodiments are described in detail, which will not be elaborated here for the sake of brevity.

[0093] Step S302: Obtain the posture correction value of the material.

[0094] In the embodiment of the present application, the robot controller obtains the posture correction value of the material sent by the visual device, and the posture correction value is used to characterize the deviation value between the current posture of the material and the expected posture. It can be understood that the visual device obtains the current posture of the material through the first image and the second image, calculates the posture correction value according to the current posture of the material and the expected posture, and sends the posture correction value to the robot.

[0095] Step S303: Correcting the gluing path of the robot arm according to the posture correction value to obtain a corrected gluing path.

[0096] Specifically, the posture correction value is added to the gluing path of the robot arm to obtain the corrected gluing path. Since the gluing path of the robot arm corresponds to the expected posture of the material, the correction value of the gluing path of the robot arm can be determined according to the deviation value between the current posture of the material and the expected posture.

[0097] For example, assuming that the posture correction value of the material in other axes is 0, but the posture correction value of the material in the x-axis is -0.1mm, then according to the posture correction value, the gluing path of the robot arm is moved +0.1mm in the x-axis direction; similarly, if the posture correction value of the material in the x-axis is +0.1mm, then according to the posture correction value, the gluing path of the robot arm is moved -0.1mm in the x-axis direction. Of course, this is just an ideal situation. In actual applications, the material usually has a certain offset in the six axes. Similar to the above example, the gluing path of the robot arm is corrected according to the posture correction value of the material in the six axes.

[0098] In actual applications, in order to save space, the positions of various devices are usually compact. When the posture correction value of the material is large, if the same method is still used to correct the gluing path of the robot arm, the material or the robot arm may touch the visual device or the gluing device, resulting in damage to the material or the device, causing unnecessary economic losses.

[0099] In order to avoid this problem, in the embodiment of the present application, before correcting the gluing path of the robot arm, it is first determined whether the posture correction value is less than the preset correction value threshold. If the posture correction value is less than the preset correction value threshold, the gluing path of the robot arm is corrected according to the posture correction value to obtain the corrected gluing path; if the posture correction value is greater than or equal to the preset correction value threshold, the robot arm is controlled to stop moving and an alarm message is output to prompt the staff to adjust the posture of the material or adjust the gluing path. In the embodiment of the present application, the preset correction value threshold is ±0.25mm.

[0100] Step S304: Control the robot arm to move the material to the target gluing position according to the corrected gluing path.

[0101] Specifically, the controller controls the robot arm to move the material to the target gluing position according to the corrected gluing path. The target gluing position, that is, the position where the material needs to be glued, is located directly below the gluing device.

[0102] Corresponding to the above-mentioned embodiment, the embodiment of the present application also provides another method for correcting the gluing path, which is described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0103] See also Figure 4 , is a flow chart of another method for correcting the gluing path provided in an embodiment of the present application. Figure 4 As shown, this method can be applied to Figure 2 The application scenario shown mainly includes the following steps.

[0104] Step S401: The robot controls the gripper to grab materials from the material frame.

[0105] Step S402: The robot controls the mechanical arm to move the material to the first position.

[0106] Specifically, the robot controller controls the robot arm to move the material to a first position for the visual device to perform a first image acquisition.

[0107] Step S403: The visual device captures an image of the material moved to the first position to obtain a first image.

[0108] Specifically, when the visual device senses that the material has moved to the first position, it captures an image of the material to obtain a first image.

[0109] Step S404: the robot controls the mechanical arm to move the material to the second position.

[0110] Specifically, after a preset time interval, the robot controls the mechanical arm to move the material to a second position for the visual device to perform a second image acquisition. In a possible implementation, the time for the visual device to perform image acquisition is 4s-8s, so the preset time interval can be 8s.

[0111] Step S405: The visual device captures an image of the material moved to the second position to obtain a second image.

[0112] Specifically, when the visual device senses that the material has moved to the second position, it captures an image of the material to obtain a second image.

[0113] Step S406: The visual device obtains the current posture of the material according to the first image and the second image.

[0114] Specifically, the visual device can determine the current posture of the material based on the two images at two positions of the material. It can be understood that the material fixed by the gripper can be approximately regarded as a rigid material, and the current posture of the entire material can be determined through the images at two positions.

[0115] Step S407: The visual device calculates a posture correction value according to the current posture and the expected posture of the material.

[0116] Specifically, the desired posture of the material is stored in the visual device, and the posture correction value can be obtained by calculating the deviation value between the current posture of the material and the desired posture. In one possible implementation, the movement of the robot gripper grabbing the material is simulated by a model, and the desired posture of the material is calculated by the model. However, calculating the expected posture of the material by the model may cause deviations in the expected posture, which cannot completely match the actual posture of the material grabbed by the gripper. Therefore, in one possible implementation, the expected posture is obtained by the actual posture of the material grabbed by the robot gripper. Specifically, after the robot gripper grabs the first material, it moves to the first position and the second position respectively, and the visual device determines the expected posture and the correction value threshold by the current posture of the first material.

[0117] Step S408: The visual device sends a posture correction value to the robot.

[0118] Step S409: the robot corrects the gluing path of the robot arm according to the posture correction value to obtain a corrected gluing path.

[0119] Step S410: the robot controls the mechanical arm to move the material to the target gluing position according to the calibrated gluing path.

[0120] For specific contents involved in the embodiments of this application, please refer to the above Figure 3 The description in the illustrated embodiment will not be repeated for the sake of brevity.

[0121] By acquiring the image captured by the visual device, the current posture of the material is obtained, and the gluing path of the robot arm is corrected according to the deviation value between the current posture of the material and the expected posture, automatic gluing compensation can be achieved, thereby improving the working efficiency of the robot.

[0122] However, as mentioned above, the time for the visual device to collect images is not a fixed value. If the material is moved from a first position to a second position at a preset time interval, the waiting time of the robot arm may be greater than the time for the visual device to collect images, resulting in a longer waiting time for the robot arm and affecting the work efficiency of the robot.

[0123] In order to solve this problem, the embodiment of the present application provides another method for correcting the gluing path, which increases the information interaction between the robot and the visual device, so that the robot's mechanical arm does not need to wait for a preset time interval, thereby improving the robot's working efficiency. Detailed description is given below in conjunction with the accompanying drawings and specific embodiments.

[0124] See also Figure 5 , is a flow chart of another method for correcting the gluing path provided in an embodiment of the present application. Figure 5 As shown, this method can be applied to Figure 2 The application scenario shown in Figure 4 The following steps are added based on .

[0125] Step S501: The robot sends a first control signal to the visual device.

[0126] Specifically, after the robot controls the mechanical arm to move the material to the first position, the robot sends a first control signal to the visual device, and the first control signal is used to instruct the visual device to capture an image of the material to obtain a first image. So that after receiving the first control signal, the visual device captures an image of the material moved to the first position to obtain the first image.

[0127] Step S502: The visual device sends a feedback signal to the robot.

[0128] Specifically, after the visual device obtains the first image, a feedback signal is sent to the robot, and the feedback signal is used to indicate that the visual device has completed the acquisition of the first image, so that the robot controls the mechanical arm to move the material to the second position after receiving the feedback signal.

[0129] Step S503: The robot sends a second control signal to the visual device.

[0130] Specifically, after the robot controls the mechanical arm to move the material to the second position, the robot sends a second control signal to the visual device, and the second control signal is used to instruct the visual device to capture an image of the material to obtain a second image. So that after receiving the second control signal, the visual device captures an image of the material moved to the second position to obtain a second image.

[0131] In summary, through the information interaction between the robot and the visual device, the robot's mechanical arm does not need to wait for a preset time interval, thereby improving the robot's working efficiency.

[0132] Corresponding to the above embodiments, the present application also provides a robot.

[0133] See also Figure 6 , is a schematic diagram of the structure of a robot provided in an embodiment of the present application. Figure 6 As shown, the robot 600 may include: a gripper 601, a mechanical arm 602 and a first controller 603. These components communicate through one or more buses. Those skilled in the art can understand that the structure of the electronic device shown in the figure does not constitute a limitation on the embodiments of the present application. It can be a bus structure or a star structure, and can also include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0134] The gripper 601 is used to grab materials from the material frame.

[0135] The mechanical arm 602 is used to move the material.

[0136] The first controller 603 is used to control the gripper to grab materials from the material frame; obtain a posture correction value of the material, wherein the posture correction value is used to characterize a deviation value between the current posture of the material and the expected posture; correct the gluing path of the robotic arm according to the posture correction value to obtain a corrected gluing path; and control the robotic arm to move the material to a target gluing position according to the corrected gluing path.

[0137] In addition, corresponding to the above embodiments, the present application also provides a visual device.

[0138] See also Figure 7 , is a schematic diagram of the structure of a visual device provided in an embodiment of the present application. Figure 7As shown, the visual device 700 may include: an image acquisition unit 701 and a second controller 702. These components communicate via one or more buses. Those skilled in the art will appreciate that the structure of the electronic device shown in the figure does not limit the embodiments of the present application. It may be a bus structure or a star structure, and may include more or fewer components than shown in the figure, or combine certain components, or arrange components differently.

[0139] The image acquisition unit 701 is used to acquire a first image and a second image.

[0140] The second controller 702 is used to calculate a posture correction value according to the current posture and the expected posture of the material; and send the posture correction value to the robot.

[0141] In addition, corresponding to the above embodiment, the present application also provides a gluing path correction system. The gluing path correction system may include a robot 600 and a visual device 700 .

[0142] Corresponding to the gluing path correction system, the present application also provides another gluing path correction method.

[0143] See also Figure 8 , is a flow chart of another method for correcting the gluing path provided in an embodiment of the present application. Figure 8 As shown, the method can be applied to a gluing path correction system, which mainly includes the following steps.

[0144] Step S801: The robot controls the gripper to grab materials from the material frame.

[0145] Step S802: The robot controls the mechanical arm to move the material to the first position and sends a first control signal to the visual device.

[0146] Step S803: After receiving the first control signal, the visual device captures an image of the material, obtains a first image, and sends a feedback signal to the robot.

[0147] Step S804: After receiving the feedback signal, the robot controls the robotic arm to move the material to the second position and sends a second control signal to the visual device.

[0148] Step S805: After receiving the second control signal, the visual device captures an image of the material to obtain a second image.

[0149] Step S806: The visual device determines the current posture of the material according to the first image and the second image of the material.

[0150] Step S807: The visual device calculates the posture correction value according to the current posture and expected posture of the material, and sends the posture correction value to the robot.

[0151] Step S808: The robot corrects the gluing path of the robotic arm according to the posture correction value, and controls the robotic arm to move the material to the target gluing position according to the corrected gluing path.

[0152] Step S809: The robot controls the mechanical arm to place the material on the tooling.

[0153] Specifically, after the material is coated with glue, it needs to enter the next process. Therefore, when the robot detects that the material has been coated with glue, it controls the robotic arm to place the material on the tooling so that the material can enter the next process.

[0154] For specific contents involved in the embodiments of this application, please refer to the above Figure 3 , Figure 4 and Figure 5 The description in the illustrated embodiment will not be repeated for the sake of brevity.

[0155] In a specific implementation, the embodiment of the present application further provides a computer storage medium, wherein the computer storage medium may store a program, and when the program is executed, the program may include some or all of the steps in each embodiment of the simulation scene generation method provided in the embodiment of the present application. The storage medium may be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0156] In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0157] Those of ordinary skill in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented in a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0158] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0159] In several embodiments provided in the present application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc., various media that can store program codes.

[0160] In this specification, the same or similar parts between the various embodiments can be referred to each other. In particular, for the device embodiment and the terminal embodiment, since they are basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description in the method embodiment.

Claims

1. A method for correcting a gluing path, characterized in that: Applied to a robot, the robot comprising a gripper and a mechanical arm, the method comprising: Control the gripper to grab materials from the material frame; Acquire a posture correction value of the material, where the posture correction value is used to represent a deviation value between a current posture of the material and an expected posture; Correcting the gluing path of the robot arm according to the posture correction value to obtain a corrected gluing path; The robot arm is controlled to move the material to a target gluing position according to the corrected gluing path.

2. The method according to claim 1, characterized in that The obtaining of the posture correction value of the material includes: Controlling the robotic arm to move the material to a first position; Controlling the robotic arm to move the material to a second position; Receive the posture correction value of the material sent by the visual device.

3. The method according to claim 2, characterized in that After controlling the mechanical arm to move the material to the first position, the method further includes: A first control signal is sent to the visual device, where the first control signal is used to instruct the visual device to capture an image of the material to obtain a first image.

4. The method according to claim 2, characterized in that: After controlling the robot arm to move the material to a second position, the method further includes: A second control signal is sent to the visual device, where the second control signal is used to instruct the visual device to capture an image of the material to obtain a second image.

5. The method according to claim 2, characterized in that: Before controlling the mechanical arm to move the material to the second position, the method further includes: A feedback signal sent by the visual device is received, where the feedback signal is used to instruct the visual device to complete the acquisition of the first image.

6. The method according to claim 1, characterized in that The step of correcting the gluing path of the robot arm according to the posture correction value to obtain the corrected gluing path includes: If the posture correction value is less than a preset correction value threshold, the gluing path of the robot arm is corrected according to the posture correction value to obtain a corrected gluing path.

7. The method according to claim 6, characterized in that The method further comprises: If the posture correction value is greater than or equal to a preset correction value threshold, the robot arm is controlled to stop moving and an alarm message is output.

8. A method for correcting a gluing path, characterized in that: Applied to a visual device, the method comprises: Capturing an image of the material moved to the first position to obtain a first image; Capturing an image of the material moved to the second position to obtain a second image; Obtaining a current posture of the material according to the first image and the second image; Calculating a posture correction value according to the current posture and the expected posture of the material; The posture correction value is sent to the robot.

9. The method according to claim 8, characterized in that The step of capturing an image of the material moved to the first position to obtain a first image includes: receiving a first control signal sent by the robot, wherein the first control signal is used to instruct the visual device to capture an image of the material to obtain a first image; An image is captured of the material moved to the first position to obtain a first image.

10. The method according to claim 8, characterized in that The step of capturing an image of the material moved to the second position to obtain a second image includes: receiving a second control signal sent by the robot, wherein the second control signal is used to instruct the visual device to capture an image of the material to obtain a second image; An image is captured of the material moved to the second position to obtain a second image.

11. The method according to claim 8, characterized in that After capturing an image of the material moved to the first position to obtain the first image, the method further includes: A feedback signal is sent to the robot, where the feedback signal is used to instruct the visual device to complete the acquisition of the first image.

12. A robot, characterized in that: include: A gripper, the gripper is used to grab materials from the material frame; A mechanical arm, wherein the mechanical arm is used to move the material; A first controller, the first controller is used to control the gripper to grab materials from the material frame; obtain a posture correction value of the material, the posture correction value is used to characterize the deviation value between the current posture of the material and the expected posture; correct the gluing path of the robot arm according to the posture correction value to obtain the corrected gluing path; control the robot arm to move the material to the target gluing position according to the corrected gluing path.

13. A visual device, characterized in that: include: An image acquisition unit, wherein the image acquisition unit is used to acquire a first image and a second image; The second controller is used to calculate a posture correction value according to the current posture and the expected posture of the material; and send the posture correction value to the robot.

14. A gluing path correction system, characterized in that: include: The robot according to claim 12; The visual device of claim 13.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 11.

Citation Information

Patent Citations

  • Automobile roof coating robot sucker claw

    CN101954341A

  • Visual implementation method for measuring assembly height and inclination degree of device in automobile fuse box

    CN113624145A

  • External drive and measurement intelligent positioning system and method

    CN114434428A

  • Method for controlling industrial robot

    JP1989161401A

Cited By

  • Motor cleaning posture calibration method based on image recognition technology

    CN120912675A