Robot control device, robot control method, and program
The robot control device simplifies parameter setting by automating coordinate transformations within the system, addressing the complexity of coordinate system relationships in conventional methods and enhancing operational convenience.
Patent Information
- Application Number
- PCT/JP2024/012554
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-24
- Filing Date
- 2024-03-28
- Publication Date
- 2024-11-28
AI Technical Summary
Conventional robot control systems require users to have extensive knowledge and proficiency in setting parameters, as they need to consider the complex relationships between multiple coordinate systems, making the process cumbersome and inconvenient.
A robot control device and method that includes an input unit for receiving position information and setting information, an acquisition unit for retrieving parameters and coordinate transformation frames from a database, and a generation unit for creating a conversion table to convert position information between coordinate systems, allowing the system to perform coordinate transformations automatically, thereby simplifying parameter setting.
This approach simplifies the parameter setting process for robot control, reducing the user's burden and improving the convenience of the system by eliminating the need for manual coordinate transformation considerations, making it easier to configure and operate robots.
Smart Images

Figure JP2024012554_28112024_PF_FP_ABST
Abstract
Description
Robot control device, robot control method, and program
[0001] The present disclosure relates to a robot control device, a robot control method, and a program.
[0002] Conventionally, systems that use devices such as robots to perform various operations on behalf of humans, such as transporting luggage, have become widespread. In such systems, parameters related to the robot's operations are set by a user in consideration of the configuration of the robot. For example, Patent Literature 1 discloses a configuration that makes it easy to rewrite and select control variable and coordinate transformation data related to the control of a robot device.
[0003] Japanese Patent Application Publication No. 5-324051
[0004] The present disclosure has been devised in view of the above-described conventional circumstances, and aims to facilitate parameter setting related to robot control and improve the convenience of systems including robot devices compared to conventional systems.
[0005] The present disclosure provides a robot control device having an input unit that receives position information in a first coordinate system of an object to be operated by a robot device, setting information for parts of the robot device, and name information for the parts; an acquisition unit that acquires, from a database that stores parameters and coordinate transformation frames for the parts in association with name information for the parts of the robot device, parameters for the parts and coordinate transformation frames for the parts corresponding to the name information received by the input unit; a generation unit that specifies a correction value that is a difference value between the first coordinate system and a second coordinate system corresponding to the part from the coordinate transformation frame acquired by the acquisition unit, and generates a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the setting information for the part received by the input unit, the parameters for the part acquired by the acquisition unit, and the specified correction value; and a control unit that uses the conversion table generated by the generation unit to convert the position information in the first coordinate system into position information in the second coordinate system, and generates a control command for the part of the robot device using the position information in the second coordinate system.
[0006] The present disclosure also provides a robot control method that receives position information in a first coordinate system of an object to be operated by a robot device, setting information of parts constituting the robot device, and name information of the parts, acquires parameters of the part and a coordinate transformation frame corresponding to the received name information from a database that stores parameters and coordinate transformation frames of the parts in association with the name information of the parts constituting the robot device, identifies a correction value that is a difference value between the first coordinate system and a second coordinate system corresponding to the part from the acquired coordinate transformation frame, generates a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the received setting information of the part, the acquired parameters of the part, and the identified correction value, converts the position information in the first coordinate system into position information in the second coordinate system using the generated conversion table, and generates a control command for the part constituting the robot device using the position information in the second coordinate system.
[0007] The present disclosure also provides a program for causing a computer to execute a robot control method, the program comprising: receiving position information in a first coordinate system of an object to be operated by a robot device, setting information for parts of the robot device, and name information for the parts; acquiring parameters and a coordinate transformation frame for the parts corresponding to the received name information from a database that stores parameters and coordinate transformation frames for the parts in association with the name information of the parts of the robot device; specifying, from the acquired coordinate transformation frame, a correction value that is a difference value between the first coordinate system and a second coordinate system corresponding to the part; generating a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the received setting information for the part, the acquired parameters for the part, and the specified correction value; converting the position information in the first coordinate system into position information in the second coordinate system using the generated conversion table; and generating a control command for the parts of the robot device using the position information in the second coordinate system.
[0008] The present disclosure also provides a robot control device having: an input unit that receives input of position information in a first coordinate system of an object to be operated by a robot device and operation settings of parts that constitute the robot device; an acquisition unit that acquires parameters of the parts that constitute the robot device and correction values for coordinate conversion between the first coordinate system and a second coordinate system corresponding to the parts that constitute the robot device based on the operation settings; a generation unit that generates a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the correction values, the parameters, and the operation settings; and a control unit that converts the position information in the first coordinate system into position information in the second coordinate system using the conversion table, and generates control commands for the parts that constitute the robot device using the position information in the second coordinate system.
[0009] The present disclosure also provides a robot control method that receives input of position information in a first coordinate system of an object to be operated by a robot device and operation settings of parts of the robot device, acquires parameters of the parts of the robot device and correction values for coordinate conversion between the first coordinate system and a second coordinate system corresponding to the parts of the robot device based on the operation settings, generates a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the correction values, the parameters, and the operation settings, converts the position information in the first coordinate system into position information in the second coordinate system using the conversion table, and generates a control command for the parts of the robot device using the position information in the second coordinate system.
[0010] The present disclosure also provides a program for causing a computer to execute a robot control method, which includes receiving input of position information in a first coordinate system of an object to be operated by a robot device and operation settings of parts of the robot device, acquiring parameters of the parts of the robot device and correction values for coordinate conversion between a second coordinate system corresponding to the parts of the robot device and the first coordinate system based on the operation settings, generating a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the correction values, the parameters, and the operation settings, converting the position information in the first coordinate system into position information in the second coordinate system using the conversion table, and generating a control command for the parts of the robot device using the position information in the second coordinate system.
[0011] Any combination of the above components, and conversion of the present disclosure into a method, device, system, storage medium, computer program, etc., are also valid aspects of the present disclosure.
[0012] According to the present disclosure, parameter setting related to robot control can be made easier than ever before, and the convenience of a system including a robot device can be improved more than ever before.
[0013] Schematic diagram for explaining coordinate transformation in setting parameters of a robot. Block diagram showing an example of a system configuration according to an embodiment of the present invention. Sequence diagram showing the operation of a system according to an embodiment of the present invention. Flowchart of processing by a control system according to an embodiment of the present invention. Schematic diagram showing an example of the configuration of a setting screen according to an embodiment of the present invention. Schematic diagram showing an example of the configuration of a setting screen according to an embodiment of the present invention. Schematic diagram showing an example of the configuration of a setting screen according to an embodiment of the present invention.
[0014] (Background to the present disclosure) Conventionally, systems that use robots to perform various operations instead of humans have become widespread. In controlling the robot, users pre-set the robot's movement position and the position information of the target on which the robot is to perform work. A single robot can provide various ranges of motion and operations depending on its configuration and the functional unit (hereinafter also referred to as an end effector) provided at the tip of the robot. Furthermore, multiple robots may work in cooperation with one another on a single target. In such systems, multiple coordinate systems are defined depending on the configuration and number of robots, and values are converted between these coordinate systems. Users must set parameters for controlling the robot while taking into account the relationships between the coordinate systems, which requires a high level of knowledge and proficiency in setting the parameters. For example, in Patent Document 1, operability that takes into account the relationships between the coordinate systems is not fully considered when users set the parameters.
[0015] Hereinafter, with reference to the accompanying drawings as appropriate, embodiments specifically disclosing a robot control method, a robot control device, and a program according to the present disclosure will be described in detail. However, more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters or redundant descriptions of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure and are not intended to limit the subject matter recited in the claims.
[0016] <First Embodiment> [Example of Coordinate Transformation] Fig. 1 is a schematic diagram for explaining a conventional configuration and coordinate transformation according to an embodiment of the present invention. Here, an example is shown in which a robot device has a robot hand as an example of an end effector provided at the tip of a robot arm. Fig. 1(a) shows an example of conventional coordinate transformation, and Fig. 1(b) shows an example of coordinate transformation according to an embodiment of the present invention.
[0017] The robot device 1 includes a robot arm 2 and a robot hand 3. The robot arm 2 has, for example, six axes. The robot hand 3 is configured to be able to grasp an object, and in this embodiment, an example is shown in which the robot hand 3 has two fingers. The configuration of the robot hand 3 is not particularly limited, and the number of fingers may be three or more, or the fingers may have joints. Furthermore, the end effector provided at the tip of the robot arm 2 is not limited to a robot hand, and may be a rod-shaped part or may have other functions such as a camera. Furthermore, an object 4 will be described as an example of an object to be manipulated by the robot device 1.
[0018] In the example of the robot device 1 shown in FIG. 1 , four coordinate systems C1, C2, C3, and C4 are defined corresponding to the respective components. The coordinate system C1 is a coordinate system at the reference position of the robot arm 2 and is also referred to as the "arm reference coordinate system." The coordinate system C2 is a coordinate system at the tip position of the robot arm 2 and is also referred to as the "arm tip coordinate system." The coordinate system C3 is a coordinate system at the reference position of the robot hand 3 and is also referred to as the "hand reference coordinate system." The coordinate system C4 is a coordinate system at the target position of the robot hand 3 (e.g., the position where an operation is performed) and is also referred to as the "hand target coordinate system." The coordinate systems here are three-dimensional coordinate systems consisting of three axes: x-axis, y-axis, and z-axis, and the parameters of each coordinate system are assumed to be mutually convertible.
[0019] Although not shown in FIG. 1 , when multiple robotic devices are used, a coordinate system C0 is also defined that is set for the entire space in which they are installed. The coordinate system C0 is also referred to as a "system coordinate system." Note that the above-described coordinate system settings are merely an example, and more coordinate systems may be defined depending on the configuration, placement, etc. of the robotic devices. Furthermore, some of the coordinate systems may be the same.
[0020] 1A, for example, the position coordinates of an object 4 to be operated by the robot device 1 are represented by the parameter Target_pose. The parameter Target_pose may specify the coordinates of each axis and the values of roll, pitch, and yaw. Here, as an example, the parameter Target_pose will be described as a parameter in a system coordinate system.
[0021] In conventional techniques, when setting control parameters for each part of the robot device 1 corresponding to the parameter Target_pose in the system coordinate system, it is necessary to identify the origin position of each coordinate system and then perform coordinate transformations on the parameter Target_pose in the order of coordinate systems C4 → C3 → C2 → C1. Therefore, to convert the parameter Target_pose into a control parameter for coordinate system C1, a total of four coordinate transformations are required, as shown by coordinate transformations T1, T2, T3, and T4. In other words, the user must set control parameters transformed to correspond to each coordinate system, taking into account the relationships between the coordinate systems. In this case, the order in which the transformation matrices are applied changes because the definitions and relationships of the coordinate systems differ depending on the configuration of the robot arm and the attachment method of the end effector. As a result, parameter setting for a robot device requires a certain level of knowledge and proficiency in robot configuration and parameter setting.
[0022] In contrast, in one embodiment of the present invention shown in FIG. 1B, for example, when a user specifies a parameter Target_pose in a system coordinate system, the system performs a desired coordinate transformation, thereby eliminating the need for the user to take into account the relationship between coordinate systems as in the past. For example, the system performs a single coordinate transformation T1 so that the parameter Target_pose in the system coordinate system becomes a value in coordinate system C1. In other words, a configuration is realized in which the user sets position information of an operation target without considering the configuration of the robot device 1, eliminating the need for user-initiated coordinate transformation.
[0023] 2 is a schematic diagram showing an example of a system configuration according to Embodiment 1 of the present invention. The system according to this embodiment includes a robot control device 100, robot devices 200 and 210, and a database device 300.
[0024] The robot controller 100 cooperates with a database device 300, which is an external device, to control the operations of the robot devices 200 and 210. The robot controller 100 may be configured, for example, as a personal computer (hereinafter referred to as PC) or a dedicated device. The robot controller 100 includes a processing unit 101, a storage unit 102, an external IF (Interface) 103, an operation unit 104, a display unit 105, and a communication unit 106. The components of the robot controller 100 may be configured to be able to communicate with each other via an internal bus (not shown).
[0025] The processing unit 101 executes various functions described below by reading and executing various programs and data stored in the storage unit 102. The processing unit 101 may be configured using, for example, a Central Processing Unit (hereinafter referred to as CPU), a Micro Processing Unit (hereinafter referred to as MPU), a Digital Signal Processor (hereinafter referred to as DSP), a Graphical Processing Unit (hereinafter referred to as GPU), or a Field Programmable Gate Array (hereinafter referred to as FPGA).
[0026] The memory unit 102 is a memory area for storing and holding various data, and may be composed of, for example, a non-volatile memory area such as a Read Only Memory (hereinafter referred to as ROM) or a Hard Disk Drive (hereinafter referred to as HDD), or a volatile memory area such as a Random Access Memory (hereinafter referred to as RAM).
[0027] The external IF 103 is an interface connected to the robot devices 200 and 210 and configured to enable transmission and reception of various data. The connection via the external IF 103 may be wired or wireless, and any communication standard may be used. The operation unit 104 is composed of a mouse, keyboard, etc., and is used to accept instructions and data input by the user. The display unit 105 displays various data, processing results, etc.
[0028] The communication unit 106 communicates with external devices via a wired / wireless network 400, transmitting and receiving various data and signals. The communication method used by the communication unit 106 is not particularly limited, and multiple communication methods may be supported. For example, a wide area network (hereinafter referred to as WAN), a local area network (hereinafter referred to as LAN), power line communication, or short-range wireless communication (e.g., Bluetooth (registered trademark) or Wi-Fi (registered trademark)) may be used. In this embodiment, the communication unit 106 is connected to the database device 300 at least via the network 400.
[0029] The robotic devices 200 and 210 are systems capable of performing arbitrary operations on an object, and have a configuration such as that shown in FIG. 1 . The robotic device 200 includes a robot arm 201 and a robot hand 202, which is an example of an end effector. Similarly, the robotic device 210 includes a robot arm 211 and a robot hand 212, which is an example of an end effector. Although two robotic devices 200 and 210 are shown in this embodiment, more robotic devices may be provided. Furthermore, although the robotic devices 200 and 210 are described as having the same configuration in this example, they may have different functions. For example, a camera that can be configured on a setting screen (described later) or a detector capable of touch-sensing operation may be used as an end effector. Furthermore, two or more end effectors may be provided at the tip of one robot arm. Furthermore, although the present embodiment illustrates an example in which multiple robotic devices are controlled by one robot control device 100, a configuration in which one robotic device is controlled by one robot control device may also be used.
[0030] The database device 300 stores and manages various data related to the control of the robot device. In this embodiment, the database device 300 manages data based on the configuration of each of the robot devices 200 and 210, and provides the data in response to a request from the robot control device 100. The database device 300 may be configured as a server device on the cloud.
[0031] The network 400 is configured, for example, by the Internet, and serves as a path for transmitting and receiving data between the robot control device 100 and the database device 300. Note that the connection between the robot control device 100 and each robot device may be made via the network 400.
[0032] 3 is a diagram showing a processing sequence between the devices in the system according to this embodiment. Here, the robot device 200 will be described as an example out of the plurality of controllable robot devices.
[0033] The robot controller 100 receives a system startup instruction from the user via the operation unit 104 (step S301). This instruction may be received via a screen generated by the processing unit 101.
[0034] The robot controller 100 acquires information about the connection status from the robot device 200 (step S302). The acquired information may include information about the configuration and functions of the connected robot device 200. The robot device 200 may transmit various pieces of information in response to a request from the robot controller 100, or the robot device 200 may monitor the robot controller 100 and transmit various pieces of information at predetermined times.
[0035] The robot control device 100 displays a setting screen for the robot information on the display unit 105 based on the information of the connected robot device 200 (step S303). The setting screen displayed here may be, for example, a top screen (not shown) for transitioning to various setting screens described using Figures 5 to 9.
[0036] The robot control device 100 receives an instruction to start setting via the operation unit 104 (step S304).
[0037] In response to the instruction received in step S304, the robot controller 100 requests the database device 300 for a list of configurable devices based on the information about the robot controller received in step S302 (step S305).
[0038] In response to a request from the robot controller 100, the database device 300 provides the robot controller 100 with a list of configurable devices (step S306). The list may include information such as configurable parts of the connected robot device, their setting items, and predefined parameter sets (including fixed values / variable values).
[0039] The robot controller 100 creates a setting screen based on the list acquired in step S306 and displays it on the display unit 105 (step S307).
[0040] The robot control device 100 accepts settings for each part of the robot device 200 via the operation unit 104 on the setting screen displayed in step S307 (step S308). The settings here are performed, for example, by selecting a "Settings" button on the setting screen, as shown in Figures 7 to 9, and then selecting a desired part from a list. Examples of settings will be described later together with the setting screen.
[0041] The robot control device 100 receives an instruction to start creating a motion via the operation unit 104 (step S309). The instruction to start creating a motion is given by selecting a "Create Motion" button provided on the setting screen, for example, as shown in Figures 5 and 6.
[0042] The robot controller 100 creates a setting screen based on the instruction to start creating the motion received in step S309, and displays it on the display unit 105 (step S310). A specific example of the setting screen will be described later with reference to FIGS.
[0043] The robot control device 100 receives input of various settings such as the robot name and the robot operation via the operation unit 104 (step S311). Specific examples of settings will be described later together with the setting screen.
[0044] The robot control device 100 receives an instruction to start the operation of the robot device based on the input settings via the operation unit 104 (step S312). The instruction to start the operation is given by, for example, selecting an "Execute" button provided on the setting screen as shown in FIG.
[0045] The robot control device 100 configures a setting screen based on the instruction to start the operation received in step S312, and displays it on the display unit 105 (step S313). The display screen here may be a screen (not shown) indicating that the operation is being executed.
[0046] Based on the input settings, the robot control device 100 retrieves coordinate transformation frames and robot parameters from the database device 300. The coordinate transformation frame is data that defines a coordinate system specified in accordance with the configuration of the robot device and indicates the relationship between the coordinate systems. More specifically, the coordinate transformation frame information indicates the names of the various coordinate systems described above, and by specifying the coordinate transformation frame, it is possible to identify in which coordinate system the obtained coordinate values are values. The robot parameters are information that indicates the dimensions (size), range of motion, constraints, etc. of each part that constitutes the robot device. Specific examples of coordinate transformation frames and robot parameters will be described later using Figures 5 to 9.
[0047] In response to a request from the robot controller 100, the database device 300 provides the coordinate transformation frame and the robot parameters to the robot controller 100 (step S315).
[0048] The robot controller 100 uses the various data acquired in steps S315 and S311 to generate a command for the robot device 200. Furthermore, the robot controller 100 transmits the generated command to the robot device 200 to command the robot device 200 to perform an operation (step S316).
[0049] The robot device 200 executes the operation in accordance with the command from the robot controller 100. After that, the robot device 200 completes the operation and notifies the robot controller 100 of the completion of the operation (step S317).
[0050] The robot control device 100 creates a screen based on the notification from the robot device 200, and displays that the operation of the robot device 200 has been completed (step S318). The display screen here may be a screen (not shown) that shows the result of the operation (including normal completion, abnormal completion, interruption, etc.).
[0051] 3 may be executed at a different timing, or the order of the processes may be changed. For example, some of the processes in steps S314 and S315 may be executed integrally with steps S305 and S306.
[0052] [Processing Flow] Figure 4 is a flowchart of processing by the robot control device 100 according to this embodiment, and corresponds to a part of the sequence shown in Figure 3. This processing flow may be implemented, for example, by the processing unit 101 of the robot control device 100 reading and executing various programs and data stored in the storage unit 102. For ease of explanation, the processing will be collectively described as being performed by the robot control device 100. Note that when this processing flow is disclosed, it is assumed that the processing up to step S306 in Figure 3 has been completed, the robot devices are ready to be set, and the robot devices are ready to operate.
[0053] The robot controller 100 displays a setting screen for the robot device (step S401). This setting screen may be a screen that can transition to the setting screens shown in FIGS.
[0054] The robot controller 100 accepts the setting of control parameters for the robot device via the setting screen displayed in step S401 (step S402). The settings here include, for example, position information of the operation target in the system coordinate system (specifically, the above-mentioned Target_pose parameter) and other control parameters. Specific examples of setting items and setting values will be described later with reference to FIGS. 5 to 9. Furthermore, the robot controller 100 accepts an instruction to start operation, which indicates that the setting of the control parameters has been completed.
[0055] In response to receiving the instruction to start operation, the robot control device 100 calls the coordinate transformation frame and robot parameters corresponding to the robot device corresponding to the settings received in step S402 from the database device 300 (step S403). Then, in response to the call, the robot control device 100 acquires various information from the database device 300.
[0056] The robot controller 100 generates a conversion table for converting values in each coordinate system based on the information input in step S402 and the information acquired in step S403 (step S404). The conversion table is generated by applying the robot parameters and setting information to a predefined coordinate transformation frame and is used for parameter conversion between the coordinate systems defined for each part of the robot device. The coordinate transformation frame may be configured to generate a conversion table between these coordinate systems based on the relationship between the coordinate systems defined for each of the multiple components of the robot device and the system coordinate system, such as the relative distance of the origin position and the orientation of the coordinate axes. Take, for example, coordinate transformation frame A corresponding to coordinate system A before conversion and coordinate transformation frame B corresponding to coordinate system B after conversion. By acquiring coordinate transformation frame A and coordinate transformation frame B, the position of the origin of coordinate transformation frame B in coordinate transformation frame A can be identified. Then, using this identified origin, a correction value, i.e., a difference value between the coordinate systems, is calculated and used for automatically generating the conversion table. The correction values may include differences between the origins on the x-axis, y-axis, and z-axis, and differences in the rotation angles around each axis. Multiple conversion tables may be generated depending on the configuration of the robot device. For example, a conversion table between the system coordinate system and the arm reference coordinate system and a conversion table between the system coordinate system and the hand reference coordinate system may be generated.
[0057] The configuration of the conversion table may vary depending on the setting information, the configuration and state of the specified robot device, etc. Therefore, in this embodiment, the conversion table is not stored in advance in the robot control device 100, but is generated appropriately in response to input setting information. This configuration eliminates the need to store in advance conversion tables that are expected to have various variations depending on the combination of settings, making it possible to prevent storage space from becoming too full. Note that the configuration of the conversion table may not change depending on the series of operations of the robot device or the immediately preceding operation. In such cases, the conversion table may be temporarily stored, and the stored conversion table may be reused instead of the conversion table generation process.
[0058] The robot controller 100 generates a control command for the robot device based on the conversion table generated in step S404 and the settings received in step S402 (step S405).
[0059] The robot controller 100 transmits the control command generated in step S405 to the robot device to be operated, and causes the robot device to perform the operation based on the control command (step S406), and then ends this processing flow.
[0060] [Example of Setting Screen] An example of the configuration of a setting screen related to the operation of the robot device according to this embodiment will be described. Each setting screen shown below is displayed on the display unit 105 of the robot control device 100 in a state that allows the user to operate it. The following screen example assumes a case where multiple robot devices are provided and available for use. Also, as shown in FIG. 2, an example is shown in which the robot device includes at least a robot arm and a robot hand as an example of an end effector.
[0061] 5 and 6 show flowcharts of the operation of each robot device and setting screens for the operation of each part of the robot device included in the flowcharts. These figures are used, for example, in step S309 of the processing sequence shown in FIG. 3. FIGS. 7 to 9 show individual setting screens for the configuration of each part of the robot device. These figures are used, for example, in step S308 of the processing sequence shown in FIG. 3.
[0062] FIG. 5 shows an example of the configuration of a setting screen 500 for setting a series of operations for a robotic device. Here, an example of setting a robotic arm is shown. In area 510, a button 511 for creating an operation is selected. A robotic device can perform one or more operations by operating the robotic arm, robotic hand, or the like. In the setting screen 500, a workflow including one or more such operations can be set. Area 510 displays a list of selectable operations for defining a workflow. In this embodiment, selectable operations include "Move Arm," which indicates the operation of the robotic arm; "Move Hand," which indicates the operation of the robotic hand; "Detect sth," which indicates the operation of the detector; "Branch," which indicates a condition determination; and "Loop Start" and "Loop End," which indicate the start and end of a loop. Note that the items shown here are merely examples and may be changed depending on the configuration of the robotic device.
[0063] Area 520 shows the currently set workflow. In this example, a workflow is defined in which operations are executed in the following order: "Move Arm" → "Move Hand" → "Condition Judgment (Success?)" → "Move Arm" → "Move Hand." In this example, an operation step 521 is selected, which indicates a state in which the operation of the robot arm is set. Note that the condition judgment "Success?" judges whether the operations up to that point have been successful, and if successful, the subsequent operations are executed.
[0064] Since the robot arm operation process 521 is designated as the setting target, setting items for the robot arm are displayed in area 530. Setting item 531 designates the robot arm that will perform the operation. Setting item 532 designates the name of the robot arm that will perform the operation. Setting item 533 sets information about the object to be operated, i.e., the above-mentioned Target_pose (coordinate values of each axis, and values of roll, pitch, and yaw). Setting item 534 sets the movement speed of the robot arm. Setting item 535 sets the acceleration related to the movement of the robot arm. Setting item 536 sets the configuration of the part (here, the robot hand) provided at the tip of the robot arm. In the example shown in FIG. 5 , the name "hand1" that uniquely identifies the robot hand and "hand_tcp" that uniquely identifies the coordinate system corresponding to that robot hand are designated. Specifically, "hand_tcp" corresponds to the origin position of the hand target coordinate system shown in FIG. 1, i.e., the target position to which the robot hand is to be moved as an operation position. Note that the value of each setting item may be uniquely identified and displayed based on other setting items or already registered data. Also, each setting item is an example, and some setting items may be omitted or other setting items may be added depending on the configuration of the robot device.
[0065] 6 shows an example of the configuration of a setting screen 600 for setting a series of operations for a robot device, and here shows an example of setting a robot hand. In the setting screen 600, areas 610 and 620 are the same as areas 510 and 520 shown in FIG. 5. In area 610, a button 611 for creating an operation is selected. In this example, an operation step 621 is selected from the already set workflow, which indicates a state in which the operation of the robot hand is set.
[0066] In response to the robot hand operation process 621 being designated as the setting target, area 630 displays setting items for the robot hand. Setting item 631 specifies the robot hand that will perform the operation. Setting item 632 specifies the name of the robot hand that will perform the operation. Setting item 633 specifies the movement amount of the fingers of the robot hand. For example, in the case of a robot hand such as that shown in FIG. 1, the distance between the fingers may be specified. Setting item 634 specifies the rotation angle of the wrist of the robot hand. Setting item 635 sets the gripping force of the robot hand. Note that the value of each setting item may be uniquely identified and displayed based on other setting items or already registered data. Note that each setting item is merely an example, and some setting items may be omitted or other setting items may be added depending on the configuration of the robot device.
[0067] FIG. 7 shows a list of robot arms provided in the robot device, and for example, the robot arms included in this list can be selected on the setting screen 500 shown in FIG. 5, for example.
[0068] In area 710, button 711 for list setting is selected. Area 710 also shows each list for setting each part of the robot device. In this example, "Arm List" for setting the robot arm, "Hand List" for setting the robot hand, "Detect Tech List" for setting the detector, and "Camera List" for setting the camera can be selected. Here, button 712 is selected. Note that the items shown here are merely examples and may be changed depending on the configuration of the robot device.
[0069] Area 720 shows settings of robot arms that have already been registered. Area 730 shows a list of robot arms that can be set. In this example, selection items 731 to 733 of "Robot A," "Robot B1," and "Robot B2" are shown in area 730 as robot arms that can be set. Furthermore, area 720 shows settings 721 to 723 as settings of robot arms that have already been registered.
[0070] For example, the setting parameters for the robot arm settings 721 include:
[0071] Setting target arm: RobotA Name: arm1 Posture: (0,0,0,0,0,0) Port: 1-10: 1.0 Setting target arm indicates the robot arm to be set. Name indicates the name arbitrarily set for the robot arm. Posture indicates the reference posture of the robot arm. Port indicates information about the port (interface) to which the robot arm is connected. Other settings also include setting parameters of similar items.
[0072] Fig. 8 shows a list of robot hands provided in a robot device, and for example, a robot hand included in this list can be selected on the setting screen 600 shown in Fig. 6. The configuration of an area 810 is similar to that of the area 710 on the setting screen 700 in Fig. 7. In the area 810, a button 811 for setting the list is selected. Furthermore, a button 812 for setting the list of robot hands is selected.
[0073] Area 820 shows the settings of robot hands that have already been registered. Area 830 shows a list of robot hands that can be set. In this example, area 830 shows selection items 831 to 833 for "RobotHandA," "RobotHandB," and "RobotHandC" as robot hands that can be set. Furthermore, area 820 shows settings 821 to 823 as settings of robot hands that have already been registered.
[0074] For example, the setting parameters for the robot hand settings 821 include:
[0075] Setting target hand: RobotHandA Name: hand1 Posture: (0,0,0,0,0,0) Installation destination arm: arm1 / tool_link The setting target hand indicates the robot hand to be set. The name indicates name information arbitrarily set for the robot hand. The posture indicates the reference posture of the robot hand, that is, the posture in which it is installed relative to the robot arm. The installation destination arm indicates information about the robot arm on which the robot hand is installed. Specifically, "arm1" that uniquely indicates the installation destination arm and "tool_link" that uniquely indicates the coordinate system of that robot arm are shown. "tool_link" is specifically position information for specifying the origin position of the arm tip coordinate system shown in Figure 1, that is, the origin position of the hand reference coordinate system on which the robot hand is installed. Other settings include similar setting parameters.
[0076] 9 shows a list of cameras (not shown) equipped in the robot device. The configuration of an area 910 is the same as that of the area 710 of the setting screen 700 in FIG. 7. In the area 910, a button 911 for setting the list is selected. Furthermore, a button 912 for setting the camera list is selected.
[0077] Area 920 shows the settings of cameras that have already been registered. Area 930 shows a list of cameras that can be set. In this example, area 930 shows selection items 931 to 932 for "camera A" and "camera B" as cameras that can be set. Furthermore, area 920 shows settings 921 to 923 as settings of cameras that have already been registered.
[0078] For example, the setting parameters for the camera settings 921 include:
[0079] Camera to be set: cameraA Name: camera1 Posture: (0,0,0.05,0,0,0) Arm to be installed: armA / tool_link The camera to be set indicates the camera to be set. The name indicates name information arbitrarily set for the camera. The posture indicates the reference posture of the camera, that is, the posture at which it is installed relative to the robot arm. The arm to be installed indicates information about the robot arm on which the camera is installed. Specifically, "armA" that uniquely indicates the arm to be installed and "tool_link" that uniquely indicates the coordinate system of that robot arm are shown. "tool_link" specifically corresponds to the arm tip coordinate system shown in Figure 1. Other settings also include similar setting parameters.
[0080] For example, when setting up the operation of a robot device, the user only needs to specify position information (specifically, Target_pose) in the system coordinate system of the operation target, and there is no need to specify control parameters for each coordinate system corresponding to the configuration of the robot device as shown in Fig. 1. Therefore, there is no need for the user to individually perform coordinate conversion according to the system configuration before setting parameters or creating an operation program.
[0081] As described above, according to one example of the present embodiment, the robot control device (e.g., 100) receives position information (e.g., Target_pose) in a first coordinate system (e.g., system coordinate system) of an object to be operated by the robot device (e.g., 200) and operation settings (e.g., 531 to 536, 631 to 635) of parts (e.g., 201, 202) constituting the robot device from input units (e.g., 500, 600, 101, 104, 105), and receives input of parameters of parts (e.g., robot parameters) constituting the robot device and a second coordinate system (e.g., arm parameters) corresponding to the parts constituting the robot device based on the operation settings. a generating unit (e.g., 101) that generates a conversion table (e.g., a conversion table) for converting position information in the first coordinate system into position information in the second coordinate system based on the correction value, parameters, and operation settings; and a control unit (e.g., 101) that converts the position information in the first coordinate system into position information converted into the second coordinate system using the conversion table, and generates control commands for parts that constitute the robot device using the converted position information.
[0082] In another example of the present embodiment, the robot control device includes an input unit that receives position information in a first coordinate system of an object to be operated by the robot device, setting information about parts of the robot device, and name information about the parts; an acquisition unit that acquires the parameters and coordinate transformation frames of the parts corresponding to the name information received by the input unit from a database that stores parameters and coordinate transformation frames of the parts in association with name information of the parts of the robot device; a generation unit that specifies a correction value, which is a difference value between the first coordinate system and a second coordinate system corresponding to the part, from the coordinate transformation frame acquired by the acquisition unit, and generates a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the setting information of the part received by the input unit, the parameters of the part acquired by the acquisition unit, and the specified correction value; and a control unit that uses the conversion table generated by the generation unit to convert the position information in the first coordinate system into position information in the second coordinate system, and generates a control command for the parts of the robot device using the position information in the second coordinate system.
[0083] This makes it easier to set parameters related to robot control than before, and improves the convenience of systems including robot devices. In particular, it eliminates the need for users to set parameters by performing coordinate transformation for each component element in consideration of the configuration of the robot device, thereby reducing the burden of setting.
[0084] The robot device includes a robot arm (e.g., 201) and an end effector (e.g., 202) attached to the tip of the robot arm, and the first coordinate system is a system coordinate system of a system in which the robot device is installed, and the second coordinate system is one of a reference coordinate system of the robot arm, a tip coordinate system of the tip of the robot arm, a reference coordinate system of the end effector, and a target coordinate system with an origin at an arbitrary operation position of the end effector. The end effector is a robot hand or a camera.
[0085] This makes it possible for the system to convert the coordinate information of the system coordinate system into a coordinate system that corresponds to the configuration of the robot device.
[0086] In addition, the acquisition unit acquires parameters of the parts that make up the robot device and information on multiple coordinate systems from an external device (e.g., a database device) for each input by the input unit, and the generation unit generates a conversion table using the parameters of the parts that make up the robot device acquired from the external device and correction values between coordinate systems identified from the information on the multiple coordinate systems.
[0087] This eliminates the need to store a conversion table that can accommodate various possible combinations depending on the operation settings, making it possible to prevent the robot control device from running out of memory.It also makes it possible to appropriately generate and use a conversion table that corresponds to the current combination of operation settings and robot devices.
[0088] Furthermore, each part of the robot device is set with its corresponding posture information in the second coordinate system and its corresponding name information associated therewith, and the input unit receives the motion settings for the part corresponding to the specified name information. Furthermore, multiple pairs of posture information and name information can be set for one part.
[0089] This allows the user to set desired name information and posture information, and when setting the operation of the robot device, parameters can be easily set by simply specifying the name information. Also, various posture information can be set for parts of the same robot device, improving convenience when setting the operation.
[0090] <Other embodiments> Furthermore, the functions of one or more of the above-described embodiments can be realized by supplying a program and an application to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device reading and executing the program.
[0091] Alternatively, the functions may be realized by a circuit that realizes one or more functions (for example, an Application Specific Integrated Circuit (hereinafter, ASIC) or a Field Programmable Gate Array (hereinafter, FPGA)).
[0092] Although various embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to these examples. It is clear to those skilled in the art that various modifications, alterations, substitutions, additions, deletions, and equivalents may be made within the scope of the claims, and it is understood that these also fall within the technical scope of the present disclosure. Furthermore, the components of the various embodiments described above may be combined in any manner without departing from the spirit of the invention.
[0093] The present disclosure is useful as a robot control device, a robot control method, and a program for controlling a robot device including a robot arm.
[0094] REFERENCE SIGNS LIST 100: Robot control device 101: Processing unit 102: Storage unit 103: External IF 104: Operation unit 105: Display unit 106: Communication unit 200, 210: Robot device 201, 211: Robot arm 202, 212: Robot hand 300: Database device 400: Network
Claims
1. A robot control device having: an input unit that accepts position information in a first coordinate system of an object to be operated by a robot device, setting information of parts constituting the robot device, and name information of the parts; an acquisition unit that acquires parameters of the parts and a coordinate transformation frame corresponding to the name information accepted by the input unit from a database in which parameters of the parts and coordinate transformation frames are stored in correspondence with name information of the parts constituting the robot device, and the parameters of the parts and the coordinate transformation frame corresponding to the name information accepted by the input unit; a generation unit that specifies a correction value which is a difference value between the first coordinate system and a second coordinate system corresponding to the part from the coordinate transformation frame acquired by the acquisition unit, and generates a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the setting information of the part accepted by the input unit, the parameters of the part acquired by the acquisition unit, and the specified correction value; and a control unit that uses the conversion table generated by the generation unit to convert the position information in the first coordinate system into position information in the second coordinate system, and generates a control command for the parts constituting the robot device using the position information in the second coordinate system.
2. The robot control device according to claim 1, wherein the robot device is configured to include a robot arm and an end effector provided at the tip of the robot arm, the first coordinate system is a system coordinate system of a system in which the robot device is installed, and the second coordinate system is any one of a reference coordinate system of the robot arm, a tip coordinate system of the tip of the robot arm, a reference coordinate system of the end effector, or a target coordinate system whose origin is any operating position of the end effector.
3. The robot control device according to claim 2, wherein the end effector is a robot hand or a camera.
4. A robot control device as described in claim 1, wherein the database is provided in an external device configured to be able to communicate with the robot control device, and the acquisition unit acquires the parameters of the part and the coordinate transformation frame from the database when the input unit receives the part setting information and the part name information.
5. A robot control device according to claim 1, wherein in the database, posture information in a second coordinate system corresponding to a part constituting the robot device as a parameter of the part is associated with name information of the part.
6. A robot control device according to claim 5, wherein said database stores a plurality of pairs of posture information and name information of each part constituting said robot device.
7. A robot control method comprising: receiving position information in a first coordinate system of an object to be operated by a robot device, setting information of parts constituting the robot device, and name information of the parts; acquiring parameters of the parts and a coordinate transformation frame corresponding to the received name information from a database in which parameters of the parts and coordinate transformation frames are stored in correspondence with name information of the parts constituting the robot device; identifying a correction value which is a difference value between the first coordinate system and a second coordinate system corresponding to the part from the acquired coordinate transformation frame; generating a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the received setting information of the part, the acquired parameters of the part, and the identified correction value; converting the position information in the first coordinate system into position information in the second coordinate system using the generated conversion table, and generating a control command for the parts constituting the robot device using the position information in the second coordinate system.
8. A program for causing a computer to execute a robot control method, the program comprising: receiving position information in a first coordinate system of an object to be operated by a robot device, setting information on parts constituting the robot device, and name information on the parts; acquiring parameters of the parts and a coordinate transformation frame corresponding to the received name information from a database in which parameters of the parts and coordinate transformation frames are stored in correspondence with the name information of the parts constituting the robot device; specifying a correction value which is a difference value between the first coordinate system and a second coordinate system corresponding to the part from the acquired coordinate transformation frame; generating a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the received setting information of the part, the acquired parameters of the part, and the specified correction value; converting the position information in the first coordinate system into position information in the second coordinate system using the generated conversion table, and generating a control command for the parts constituting the robot device using the position information in the second coordinate system.
9. A robot control device having: an input unit that accepts input of position information in a first coordinate system of an object to be operated by a robot device and operation settings of parts that constitute the robot device; an acquisition unit that acquires parameters of the parts that constitute the robot device and correction values for coordinate conversion between a second coordinate system corresponding to the parts that constitute the robot device and the first coordinate system based on the operation settings; a generation unit that generates a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the correction values, the parameters, and the operation settings; and a control unit that converts the position information in the first coordinate system into position information in the second coordinate system using the conversion table, and generates a control command for the parts that constitute the robot device using the position information in the second coordinate system.
10. A robot control device according to claim 9, wherein the robot device is configured to include a robot arm and an end effector provided at the tip of the robot arm, the first coordinate system is a system coordinate system of a system in which the robot device is installed, and the second coordinate system is any one of a reference coordinate system of the robot arm, a tip coordinate system of the tip of the robot arm, a reference coordinate system of the end effector, and a target coordinate system whose origin is any operating position of the end effector.
11. The robot control device according to claim 10, wherein the end effector is a robot hand or a camera.
12. A robot control device as described in claim 9, wherein the input unit accepts a plurality of the inputs, the acquisition unit acquires parameters of parts constituting the robot device and information on a plurality of coordinate systems from an external device for each of the inputs by the input unit, and the generation unit generates the conversion table using correction values between coordinate systems identified from the parameters of the parts constituting the robot device acquired from the external device and the information on the plurality of coordinate systems.
13. A robot control device as described in claim 9, wherein name information is set to correspond to each part constituting the robot device, and the input unit accepts operation settings for the part corresponding to the name information when the name information is specified.
14. A robot control device according to claim 13, wherein a plurality of pieces of name information can be set for the part.
15. A robot control method comprising: receiving input of position information in a first coordinate system of an object to be operated by a robot device and operation settings of parts of the robot device; acquiring parameters of the parts of the robot device and correction values for coordinate conversion between a second coordinate system corresponding to the parts of the robot device and the first coordinate system based on the operation settings; generating a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the correction values, the parameters, and the operation settings; converting the position information in the first coordinate system into position information in the second coordinate system using the conversion table, and generating a control command for the parts of the robot device using the position information in the second coordinate system.
16. A program for causing a computer to execute a robot control method, the program comprising: receiving input of position information in a first coordinate system of an object to be operated by a robot device and operation settings of parts of the robot device; acquiring parameters of the parts of the robot device and correction values for coordinate conversion between a second coordinate system corresponding to the parts of the robot device and the first coordinate system based on the operation settings; generating a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the correction values, the parameters, and the operation settings; converting the position information in the first coordinate system into position information in the second coordinate system using the conversion table, and generating a control command for the parts of the robot device using the position information in the second coordinate system.
Citation Information
Patent Citations
Control of industrial robot
JP1990303779A
Industrial robot
JP1991131484A
Industrial robot
JP1995205071A
Controller for industrial robot
JP1997311708A
Control device and data structure
JP2019057262A
