Teaching program generation device

By obtaining the shape, size and initial posture information of the robot tool, generating tracks that adapt to different tools and initial states, the problem of inappropriate tracks in the existing technology is solved, the robot's ability to avoid interference is improved, and the accuracy of the movement is ensured. Security.

CN119057769APending Publication Date: 2024-12-03DAIHEN CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311156875.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-31
Filing Date
2023-09-06
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The existing teaching technology fails to effectively utilize the shape, size or inertia information of the robot tool, as well as the initial posture and position information of the robot, resulting in the generated tracks not suitable enough when the tool exchanges or position changes, affecting the robot's ability to avoid interference.

Method used

By obtaining tool shape, size, initial posture and position information from the robot control device, a track is generated that is adapted to different tools and initial states, and the action planning is performed using three-dimensional models and point group data to ensure the accuracy and flexibility of the track.

Benefits of technology

It realizes the generation of appropriate tracks based on different tools and initial states, improves the robot's ability to avoid interference when tool exchange or position changes, and ensures the accuracy and safety of the action.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119057769A_ABST
    Figure CN119057769A_ABST
Patent Text Reader

Abstract

The invention relates to a teaching program generation device. A trajectory of a robot is generated for the robot to perform a certain operation while avoiding interference. A teaching program generation device generates a teaching program for teaching a predetermined operation to a robot on the basis of information about the robot and the surroundings thereof. The teaching program generation device is provided with: an acquisition unit (111) for acquiring, from a robot control device for controlling the driving of the robot, information for the robot to perform the predetermined operation while avoiding interference; and a teaching program creation unit (112) that generates, on the basis of the information, a trajectory along which the robot moves in order to avoid interference and perform a predetermined operation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a teaching program generating device. Background Art

[0002] In the field of factory automation, a process of pre-creating a program that describes the content of a certain action for a robot to perform is called teaching. The robot moves according to the program pre-created by teaching, and repeatedly performs the certain action. As such teaching, for example, Patent Document 1 describes a method of generating a trajectory for a robot to move while avoiding obstacles.

[0003] Prior Art Literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2021-65939

[0006] However, in the existing teaching, since information about the tool mounted on the robot (for example, information about any one of the shape, size or inertia of the tool) is not used as information for generating a trajectory of the robot for the robot to avoid interference and perform certain actions while the robot is equipped with a tool, when the tool mounted on the robot is replaced, the shape, size or inertia of the tool which is different for each tool cannot be taken into consideration to generate a trajectory of the robot for the robot to avoid interference and perform certain actions while the robot is equipped with a tool.

[0007] Furthermore, in the existing teaching, since the correct information of the initial posture or initial position of the robot when the robot starts a given action is not used as information for generating the trajectory of the robot for performing a certain action while avoiding interference, the trajectory of the robot for performing a certain action while avoiding interference cannot be generated by taking the correct information of the initial posture or initial position of the robot into consideration.

[0008] In addition, in the existing method, images of the robot and objects in the environment around it are captured, and the distances to the robot and objects in the environment around it are measured. Based on the captured images and the measured distances, the relative positional relationship between the robot and objects in the environment around it is calculated, and based on the calculation results, a teaching program for teaching the robot's actions is created. In this existing method, the operator is required to input initial setting values ​​(for example, the initial position or initial posture when the robot starts to move, or the type of tool installed on the robot, etc.). Therefore, at the time of starting to create a teaching program for teaching a given action to the robot, when the position or posture of the robot changes, or when the tool is replaced, there is a problem that the initial setting values ​​entered by the operator are not necessarily correct information. Summary of the invention

[0009] Therefore, the present invention solves such a problem, and the problem is to appropriately generate a trajectory of a robot for performing a certain operation while avoiding interference.

[0010] In order to solve the above-mentioned problems, the teaching program generation device related to the present invention generates a teaching program for teaching a robot a given action based on information about the robot and its surroundings, and the teaching program generation device comprises: an acquisition unit for acquiring information for the robot to avoid interference and perform a given action from a robot control device that controls the drive of the robot; and a teaching program creation unit for generating a trajectory for the robot to move in order to avoid interference and perform a given action based on the above-mentioned information. By acquiring information for the robot to avoid interference and perform a given action from the robot control device, a trajectory of the robot for the robot to avoid interference and perform a certain action can be appropriately generated. In addition, the information about the robot and its surroundings can be, for example, an image obtained by photographing the robot and its surroundings, or can also be point group data of the robot and its surroundings.

[0011] Here, the information obtained from the robot control device may include, for example, information on any one of the shape, size, or inertia of the tool that can be interchangeably mounted on the robot. Thus, when the tool mounted on the robot is interchangeable, a trajectory of the robot for performing a certain action while avoiding interference can be generated taking into account the shape, size, or inertia of the tool that differs for each tool.

[0012] In addition, the information obtained from the robot control device may include, for example, information about the posture or position of the robot when the robot starts a given action. Thus, it is possible to generate a trajectory of the robot for the robot to perform a certain action while avoiding interference, taking into account the correct information about the initial posture or initial position of the robot when the robot starts a given action.

[0013] Furthermore, the information obtained from the robot control device may include information indicating the type of the robot. Thus, when replacing the robot to be taught, the teaching program generation device can grasp the correct type of the robot.

[0014] In addition, the information obtained from the robot control device may include, for example, information indicating the type of the robot and information indicating the type of the tool that can be interchangeably mounted on the robot. The teaching program generation device includes: a storage unit that stores three-dimensional models of multiple types of robots and three-dimensional models of multiple types of tools that can be interchangeably mounted on the robot; and a display unit that reads out the three-dimensional model of the robot corresponding to the type of the robot and the three-dimensional model of the tool corresponding to the type of the tool from the storage unit and displays the read three-dimensional model of the robot and the three-dimensional model of the tool. In this way, when the robot or the tool is exchanged, by displaying the three-dimensional model corresponding to the type of the robot or the type of the tool after the exchange, the operator can visually confirm that the robot or the tool has been exchanged.

[0015] Effects of the Invention

[0016] According to the present invention, it is possible to appropriately generate a trajectory of a robot for performing a certain motion while avoiding interference. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a diagram showing the configuration of a robot system according to an embodiment of the present invention.

[0018] Figure 2 It is a diagram showing the configuration of a robot control device according to an embodiment of the present invention.

[0019] Figure 3 This is a functional block diagram of a control unit of a terminal device according to an embodiment of the present invention.

[0020] Figure 4 This is a flowchart showing the flow of a process for generating a movement trajectory of a robot according to an embodiment of the present invention. DETAILED DESCRIPTION

[0021] Hereinafter, the embodiments of the present invention will be described with reference to the accompanying drawings. Here, the same reference numerals represent the same components, and repeated descriptions are omitted.

[0022] Figure 1The structure of the robot system 100 involved in the embodiment of the present invention is shown. The robot system 100 includes, for example, a terminal device 1, a robot control device 2, and a robot (manipulator) 3. The terminal device 1 and the robot control device 2, and the robot control device 2 and the robot 3 are connected via a network. The terminal device 1 and the robot control device 2 are connected, for example, via wireless communication such as WiFi (Wireless Fidelity), and the robot control device 2 and the robot 3 are connected, for example, via a communication cable. In addition, the network can be wired (including a communication cable) or wireless.

[0023] The robot 3 includes: a multi-joint arm provided on a base member fixed to the floor of a factory, etc.; and a tool 31 mounted on the front end of the multi-joint arm. The tool 31 can be mounted on the robot 3 in an interchangeable manner. By using, for example, a welding torch as the tool 31, the robot 3 can perform arc welding on the workpiece W as a welding target according to the command from the robot control device 2. In addition, by using, for example, an end effector as the tool 31, the robot 3 can move the workpiece W in a state of holding the workpiece W according to the command from the robot control device 2. Any tool selected from a plurality of types of tools can be mounted on the robot 3 in an interchangeable manner.

[0024] The robot 3 is provided with a marker M. The marker M is an identifier that enables the terminal device 1 to recognize the presence of the marker M in the workspace, such as an AR marker. When the AR marker existing in the workspace is recognized by the terminal device 1 by using the AR marker, it is possible to easily realize the overlapping display of the user coordinate system with the AR marker as the origin and the actual image.

[0025] like Figure 2 As shown, the robot control device 2 is a control unit that controls the driving of the robot 3. The robot control device 2 includes a control unit 21, a storage unit 22, and a communication unit 23, for example.

[0026] The control unit 21 is a processor, and controls the robot 3 by executing a program stored in the storage unit 22 .

[0027] The communication unit 23 is a communication interface, and controls communication with the terminal device 1 and the robot 3 connected via the network.

[0028] The terminal device 1 functions as a teaching program generating device for generating a teaching program for teaching a given action to the robot 3. The terminal device 1 is, for example, a portable terminal with a digital camera. The portable terminal includes, for example, a tablet terminal, a smart phone, a portable information terminal (PDA), a notebook PC (personal computer), and other portable terminals.

[0029] The terminal device 1 includes, for example, a control unit 11 , a storage unit 12 , a communication unit 13 , a photographing unit 14 , a distance measuring unit 15 , and a display unit 16 .

[0030] The control unit 11 is a processor, and controls each unit of the terminal device 1 by executing a program stored in the storage unit 12 .

[0031] The storage unit 12 is a computer-readable recording medium, and stores programs for realizing various functions of the terminal device 1 and various data used in the programs, etc. The various data stored in the storage unit 12 include, for example, three-dimensional models of each of the multiple types of robots 3 and three-dimensional models of each of the multiple types of tools 31 interchangeably mounted on the robot 3.

[0032] The communication unit 13 is a communication interface, and controls communication with the robot control device 2 connected via a network.

[0033] The imaging unit 14 is, for example, a 2D camera including a lens and an image sensor (imaging element), and converts light of a subject received by the lens into an electrical signal (digital image data). The imaging unit 14 captures images of the robot and its surroundings in response to instructions from an operator.

[0034] The distance measuring unit 15 is, for example, a 3D camera equipped with a distance measuring sensor. The distance measuring sensor is a sensor that can measure the distance to an object. As a distance measuring sensor, for example, a LiDAR (Light Detection and Ranging) sensor, a millimeter wave sensor, an ultrasonic sensor, etc. can be used. LiDAR collects three-dimensional information of objects existing around it as point group data. The point group data has a data format in which each pulse reflected from the surrounding objects detected by the LiDAR is represented as a point. The distance measuring sensor responds to instructions from the operator to collect point group data of the robot and its surroundings.

[0035] The display unit 16 is a display having a touch panel, for example, and displays the image of the subject captured by the imaging unit 14 and receives inputs such as operation instructions from an operator.

[0036] Figure 3 1 is a functional block diagram of the control unit 11 of the terminal device 1. The control unit 11 executes a program stored in the storage unit 12, thereby realizing functions as an acquisition unit 111 and a teaching program creation unit 112.

[0037] The acquisition unit 111 acquires the following information (a) to (d) from the robot control device 2 for the robot 3 to perform a predetermined operation while avoiding interference.

[0038] (a) Information indicating the type of the robot 3.

[0039] (b) Information indicating the type of the tool 31 replaceably mounted on the robot 3 .

[0040] (c) Information on any one of the shape, size, or inertia of the tool 31 that is interchangeably mounted on the robot 3 .

[0041] (d) Information on the posture or position of the robot 3 when the robot 3 starts a given motion.

[0042] In addition, as the information (d), an output value from an encoder that detects the angle of each joint of the multi-joint arm attached to the robot 3 can be used.

[0043] Furthermore, as information for enabling the robot 3 to perform a predetermined operation while avoiding interference, version information of a program stored in the storage unit 22 of the robot control device 2 may be used in addition to the above-mentioned information (a) to (d).

[0044] The teaching program creation unit 112 sets a three-dimensional user coordinate system based on the marker M included in the image captured by the imaging unit 14. Figure 1 As shown, the image captured by the imaging unit 14 includes, for example, the robot 3 and the workpiece W existing in the space where the robot 3 performs operations. A marker M is attached to the front end of the robot 3. The teaching program creation unit 112 sets a three-dimensional user coordinate system with a specific position of the marker M (e.g., a corner of the marker, the center of the marker, etc.) as the origin.

[0045] In addition, the origin of the user coordinate system is not limited to the specific position of the mark M, and may be the origin of the robot coordinate system determined based on the specific position of the mark M. For example, by fixing the position of the mark M relative to the robot 3, the specific position of the mark M can be determined on the robot coordinate system, and therefore, the origin of the robot coordinate system can be determined based on the specific position of the mark M. In this case, the user coordinate system becomes the robot coordinate system.

[0046] The teaching program creation unit 112 assigns coordinates of a user coordinate system to the point group data obtained by the distance measurement unit 15, wherein the distance measurement unit 15 measures the distance to an object contained in the image captured by the photographic unit 14. For example, the teaching program creation unit 112 sets a specific position of a mark M based on the image captured by the photographic unit 14, and sets the specific position of the detected mark on the point group data obtained by the distance measurement unit 15. The teaching program creation unit 112 assigns coordinates of a user coordinate system with the specific position of the mark set on the point group data as the origin (reference) to the point group data. Thus, the point group data is depicted in the user coordinate system. Regarding the specific position of the mark set on the point group data, for example, the specific position of the mark on the point group data can be automatically identified by data analysis, or the specific position of the mark on the point group data can be specified by an operator pointing it out.

[0047] The teaching program creation unit 112 reads the three-dimensional model of the robot 3 corresponding to the type of the robot 3 and the three-dimensional model of the tool 31 corresponding to the type of the tool 31 from the storage unit 12. The teaching program creation unit 112 uses the read three-dimensional model of the robot 3 and the three-dimensional model of the tool 31 to calculate the robot area on the user coordinate system corresponding to the robot 3 and the tool 31 based on the above information (a) to (d). The robot area is a virtual three-dimensional area occupied by the robot 3 and the tool 31 on the user coordinate system.

[0048] In addition, the initial posture or initial position of the robot 3 when the robot 3 starts a predetermined operation may be, for example, the posture or position of the robot 3 when the image is captured by the imaging unit 14 .

[0049] The teaching program generator 112 generates a trajectory for the robot 3 to move in order to perform a given motion so that the robot area does not interfere with the point cloud data of the surrounding objects. Interference refers to the robot 3 or the tool 31 contacting with the surrounding objects, thereby hindering the normal motion of the robot 3.

[0050] In this way, if a trajectory for the robot 3 to move is generated so that the robot area does not interfere with the point group data of objects existing around it, the teaching program creation unit 112 transforms the movement trajectory of the robot 3 in the user coordinate system into the movement trajectory of the robot 3 in the robot coordinate system to generate a teaching program for teaching the robot 3 a given action.

[0051] The display unit 16 of the terminal device 1 displays a three-dimensional model of the robot 3 corresponding to the type of the robot 3 and a three-dimensional model of the tool 31 corresponding to the type of the tool 31. Thus, the operator can understand what trajectory the robot 3 and the tool 31 follow to move while avoiding interference from the movements of their three-dimensional models without actually driving the robot 3 and the tool 31.

[0052] The display unit 16 of the terminal device 1 can change the graphical user interface for receiving input of an action instruction for causing the robot 3 to perform a given action from the operator in accordance with the above-mentioned information (a) to (b). For example, when a welding torch is used as the tool 31, the display unit 16 can display a graphical user interface for receiving input of an instruction for designating a welding portion of the workpiece W from the operator. In addition, for example, when an end effector is used as the tool 31, the display unit 16 can display a graphical user interface for receiving input of an instruction for designating a portion at which the workpiece W is held from the operator.

[0053] Figure 4 This is a flowchart showing the flow of processing for generating the movement trajectory of the robot 3 .

[0054] The operator operates the terminal device 1 to capture an image through the imaging unit 14 (step 401). The control unit 11 of the terminal device 1 sets a three-dimensional user coordinate system based on the mark M included in the image captured by the imaging unit 14, and assigns coordinates of the user coordinate system to the point group data obtained by the distance measuring unit 15, wherein the distance measuring unit 15 measures the distance to the object included in the image captured by the imaging unit 14.

[0055] The control unit 11 of the terminal device 1 requests the robot control device 2 to obtain the above-mentioned information (a) to (d) from the robot control device 2 (step 402 ).

[0056] When the above request is permitted by the robot control device 2 (step 403 ; Yes), the control unit 11 of the terminal device 1 acquires the above information (a) to (d) from the robot control device 2 (step 404 ).

[0057] When the request is not permitted by the robot control device 2 (step 403 ; No), the control unit 11 of the terminal device 1 reads information preset as default values ​​of the information (a) to (d) from the storage unit 12 (step 405 ).

[0058] The control unit 11 of the terminal device 1 uses the information (a) to (d) obtained in step 404 or the default value read from the storage unit 12 in step 405 to calculate the robot area on the user coordinate system corresponding to the robot 3 and the tool 31, and generates a trajectory for the robot 3 to move so that the robot area does not interfere with the point group data of the object existing around it. The control unit 11 of the terminal device 1 converts the movement trajectory of the robot 3 in the user coordinate system into the movement trajectory of the robot 3 in the robot coordinate system, and generates a teaching program for teaching a given action to the robot 3 (step 406).

[0059] The control unit 11 of the terminal device 1 transmits the teaching program to the robot control device 2 (step 407).

[0060] According to an embodiment of the present invention, since the above-mentioned information (b) to (c) is used as information for generating a trajectory of the robot 3 for performing a certain action while avoiding interference on the robot 3 equipped with a tool 31, when the tool 31 installed on the robot 3 is replaced, the trajectory of the robot 3 for performing a certain action while avoiding interference can be generated by taking into account the shape, size or inertia of the tool 31 which is different for each tool 31.

[0061] In addition, according to an embodiment of the present invention, since the above-mentioned information (d) is used as information for generating a trajectory of robot 3 for performing a certain action while avoiding interference, the trajectory of robot 3 for performing a certain action while avoiding interference can be generated by taking into account correct information on the initial posture or initial position of robot 3 when robot 3 starts a given action.

[0062] Furthermore, according to an embodiment of the present invention, when the robot 3 or the tool 31 is replaced, the operator can visually confirm that the robot 3 or the tool 31 has been replaced by displaying a three-dimensional model corresponding to the type of the replaced robot 3 or the type of the tool 31 .

[0063] In addition, the above-described embodiments are used to facilitate the understanding of the present invention and do not limit the interpretation of the present invention. The present invention can be changed or improved without departing from its purpose, and its equivalent is also included in the present invention. That is, as long as the solution obtained by those skilled in the art in the embodiment by adding appropriate design changes has the characteristics of the present invention, it is included in the scope of the present invention. In addition, the various elements possessed by the embodiment can be combined as much as possible technically, and as long as the solution obtained by combining them includes the characteristics of the present invention, it is included in the scope of the present invention.

Claims

1. A teaching program generating device, which generates a teaching program for teaching a robot a given action based on information about the robot and its surroundings, The teaching program generating device comprises: an acquisition unit that acquires information used for the robot to perform the given action while avoiding interference from a robot control device that controls driving of the robot; and A teaching program creation unit generates, based on the information, a trajectory for the robot to move so that the robot can perform the given action while avoiding interference.

2. The teaching program generating device according to claim 1, in, The information includes any one of the shape, size, or inertia of a tool that can be interchangeably mounted on the robot.

3. The teaching program generating device according to claim 1, in, The information includes information on the posture or position of the robot when the robot starts the given action.

4. The teaching program generating device according to claim 1, in, The information includes information indicating the type of the robot.

5. The teaching program generating device according to claim 1, in, The information includes: information indicating the type of the robot; and information indicating the type of a tool that can be interchangeably mounted on the robot. The teaching program generating device comprises: a storage unit storing three-dimensional models of a plurality of types of robots and three-dimensional models of a plurality of types of tools that can be interchangeably mounted on the robots; and A display unit reads out the three-dimensional model of the robot corresponding to the type of the robot and the three-dimensional model of the tool corresponding to the type of the tool from the storage unit, and displays the read three-dimensional model of the robot and the three-dimensional model of the tool.