Robot control device, robot control method and program
The system automates coordinate transformations in robot control, simplifying parameter setting and enhancing user convenience by handling complex coordinate system relationships automatically.
Patent Information
- Application Number
- JP2023085428
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-24
- Publication Date
- 2024-12-05
- Estimated Expiration
- 2043-05-24
AI Technical Summary
Existing robot control systems require users to have a high level of knowledge and proficiency to set parameters considering the complex relationships between multiple coordinate systems, making the parameter setting process cumbersome and inconvenient.
A system that includes an input unit for positional information and operation settings, an acquisition unit for coordinate transformation parameters, and a generation unit that creates a conversion table to convert position information between coordinate systems, allowing the system to handle coordinate transformations automatically, reducing the need for user intervention.
Eases the parameter setting process for robot control, improving convenience by eliminating the need for users to manually perform complex coordinate transformations and reducing the burden of setting parameters.
Smart Images

Figure 2024168603000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a robot control device, a robot control method, and a program. [Background technology]
[0002] Conventionally, systems that use devices such as robots to perform various operations on behalf of humans, such as carrying luggage, have become widespread. In such systems, parameters related to the robot's operations are set by the user in consideration of the configuration of the robot, etc. For example, Patent Document 1 discloses a configuration for facilitating rewriting and selection of control amount and coordinate transformation data for data related to the control of a robot device. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 5-324051 Summary of the Invention [Problem to be solved by the invention]
[0004] The present disclosure has been devised in consideration of the above-mentioned conventional circumstances, and aims to facilitate parameter setting related to robot control and improve the convenience of a system including a robot device compared to conventional systems. [Means for solving the problem]
[0005] The present disclosure provides a robot control device having an input unit that accepts input of position information in a first coordinate system of an object to be operated by a robot device and operation settings of parts that constitute the robot device; an acquisition unit that acquires parameters of the parts that constitute the robot device and correction values for coordinate conversion between a second coordinate system corresponding to the parts that constitute the robot device and the first coordinate system based on the operation settings; a generation unit that generates a conversion table for converting position information in the first coordinate system into position information in the second coordinate system based on the correction values, the parameters, and the operation settings; and a control unit that uses the conversion table to convert the position information in the first coordinate system into position information converted into the second coordinate system, and generates a control command for the parts that constitute the robot device using the converted position information.
[0006] The present disclosure also provides a robot control method that receives input of position information in a first coordinate system of an object to be operated by a robot device and operation settings of parts of the robot device, acquires parameters of the parts of the robot device and correction values for coordinate conversion between a second coordinate system corresponding to the parts of the robot device and the first coordinate system based on the operation settings, generates a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the correction values, the parameters, and the operation settings, converts the position information in the first coordinate system into position information converted into the second coordinate system using the conversion table, and generates a control command for the parts of the robot device using the converted position information.
[0007] The present disclosure also provides a program for causing a computer to execute a robot control method, which includes receiving input of position information in a first coordinate system of an object to be operated by a robot device and operation settings of parts of the robot device, acquiring parameters of the parts of the robot device and correction values for coordinate conversion between a second coordinate system corresponding to the parts of the robot device and the first coordinate system based on the operation settings, generating a conversion table for converting the position information in the first coordinate system into position information in the second coordinate system based on the correction values, the parameters, and the operation settings, converting the position information in the first coordinate system into position information converted into the second coordinate system using the conversion table, and generating a control command for the parts of the robot device using the converted position information.
[0008] Any combination of the above components, and conversion of the present disclosure into a method, device, system, storage medium, computer program, etc. are also valid aspects of the present disclosure. Effect of the Invention
[0009] According to the present disclosure, parameter setting related to robot control can be made easier than ever before, and the convenience of a system including a robot device can be improved compared to the past. [Brief description of the drawings]
[0010] [Figure 1] Schematic diagram for explaining coordinate transformation in robot parameter setting [Diagram 2] FIG. 1 is a block diagram showing an example of a system configuration according to an embodiment of the present invention. [Diagram 3] A sequence diagram of the operation of a system according to an embodiment of the present invention. [Figure 4] 1 is a flowchart showing a process of a control system according to an embodiment of the present invention. [Diagram 5] FIG. 2 is a schematic diagram showing an example of the configuration of a setting screen according to an embodiment of the present invention; [Figure 6] FIG. 2 is a schematic diagram showing an example of the configuration of a setting screen according to an embodiment of the present invention; [Figure 7] FIG. 2 is a schematic diagram showing an example of the configuration of a setting screen according to an embodiment of the present invention; [Figure 8] FIG. 2 is a schematic diagram showing an example of the configuration of a setting screen according to an embodiment of the present invention; [Figure 9] FIG. 2 is a schematic diagram showing an example of the configuration of a setting screen according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] (Background to this disclosure) Conventionally, systems that use robots to perform various operations instead of humans have been widespread. In controlling a robot, a user sets in advance the moving position of the robot and the position information of the target on which the robot is to perform work. A single robot can provide various movable ranges and operations depending on its configuration and a functional unit (hereinafter also referred to as an end effector) provided at the tip of the robot. Furthermore, there are cases where multiple robots work together on one target. In such a system, multiple coordinate systems are defined depending on the configuration and number of robots, and values between these coordinate systems are converted and used. A user needs to set parameters for controlling the robot while taking into account the relationship between each coordinate system, and high knowledge and proficiency regarding the setting are required. For example, in Patent Document 1, operability that takes into account the relationship between each coordinate system when setting by the user is not fully considered.
[0012] Hereinafter, with reference to the attached drawings as appropriate, an embodiment specifically disclosing a robot control method, a robot control device, and a program according to the present disclosure will be described in detail. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters or duplicate explanation of substantially the same configuration may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the attached drawings and the following explanation are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.
[0013] <Embodiment 1> [Example of coordinate conversion] Fig. 1 is a schematic diagram for explaining a conventional configuration and coordinate transformation according to an embodiment of the present invention. Here, an example is shown in which a robot hand is provided as an example of an end effector at the tip of a robot arm in a robot device. Fig. 1(a) shows an example of conventional coordinate transformation, and Fig. 1(b) shows an example of coordinate transformation according to an embodiment of the present invention.
[0014] The robot device 1 includes a robot arm 2 and a robot hand 3. The robot arm 2 is configured with, for example, six axes. The robot hand 3 is configured to be able to grasp an object, and in this embodiment, an example is shown in which the robot hand 3 has two fingers. The configuration of the robot hand 3 is not particularly limited, and the number of fingers may be three or more, and the fingers may have joints. In addition, the end effector provided at the tip of the robot arm 2 is not limited to a robot hand, and may be a rod-shaped part or may have other functions such as a camera. In addition, an object 4 is taken as an example of an object to be operated by the robot device 1 and will be described.
[0015] In the example of the robot device 1 shown in FIG. 1, four coordinate systems C1, C2, C3, and C4 are defined corresponding to the respective components. The coordinate system C1 is a coordinate system at the reference position of the robot arm 2, and is also called the "arm reference coordinate system." The coordinate system C2 is a coordinate system at the tip position of the robot arm 2, and is also called the "arm tip coordinate system." The coordinate system C3 is a coordinate system at the reference position of the robot hand 3, and is also called the "hand reference coordinate system." The coordinate system C4 is a coordinate system at the target position of the robot hand 3 (for example, the position where an operation is performed), and is also called the "hand target coordinate system." The coordinate systems here are three-dimensional coordinate systems consisting of three axes, the x-axis, the y-axis, and the z-axis, and the parameters of each coordinate system are mutually convertible.
[0016] Although not shown in FIG. 1, when multiple robot devices are used, a coordinate system C0 is also defined that is set for the entire space in which they are installed. The coordinate system C0 is also called a "system coordinate system." Note that the above coordinate system settings are just an example, and more coordinate systems may be defined depending on the configuration, arrangement, etc. of the robot devices. Also, some of the coordinate systems may be the same.
[0017] In the conventional configuration shown in Fig. 1(a), for example, it is assumed that the position coordinates of an object 4 to be operated by the robot device 1 are indicated by the parameter Target_pose. The parameter Target_pose may specify the coordinates of each axis and the values of roll, pitch, and yaw. Here, as an example, the parameter Target_pose will be described as a parameter in the system coordinate system.
[0018] In the conventional method, when setting the control parameters of each part of the robot device 1 corresponding to the parameter Target_pose of the system coordinate system, it is necessary to identify the origin position of each coordinate system and then perform coordinate transformation of the parameter Target_pose in the order of coordinate systems C4 → C3 → C2 → C1. Therefore, in order to make the parameter Target_pose a control parameter of the coordinate system C1, a total of four coordinate transformations are required, as shown by coordinate transformations T1, T2, T3, and T4. In other words, the user needs to set the control parameters transformed corresponding to each coordinate system, taking into consideration the relationship between the coordinate systems. At this time, the order of application of the transformation matrices changes because the definition and relationship of the coordinate systems differ depending on the configuration of the robot arm and the mounting method of the end effector. As a result, a certain degree of knowledge and proficiency in the configuration of the robot and parameter setting is required for parameter setting of the robot device.
[0019] In contrast, in one embodiment of the present invention shown in Fig. 1(b), for example, when a user specifies a parameter Target_pose in a system coordinate system, the system performs a desired coordinate conversion, thereby eliminating the need for the user to take into account the relationship between coordinate systems when making settings, as in the past. For example, the system performs one coordinate conversion T1 so that the parameter Target_pose in the system coordinate system becomes a value in coordinate system C1. In other words, a user sets position information of an operation target without considering the configuration of the robot device 1, realizing a configuration that does not require coordinate conversion by the user.
[0020] [Device configuration] 2 is a schematic diagram showing an example of a system configuration according to the first embodiment of the present invention. The system according to the present embodiment includes a robot control device 100, robot devices 200 and 210, and a database device 300.
[0021] The robot control device 100 cooperates with a database device 300, which is an external device, to control the operations of the robot devices 200, 210. The robot control device 100 may be configured, for example, as a personal computer (hereinafter, PC) or a dedicated device. The robot control device 100 includes a processing unit 101, a storage unit 102, an external IF (Interface) 103, an operation unit 104, a display unit 105, and a communication unit 106. Each unit of the robot control device 100 may be configured to be able to communicate with each other via an internal bus (not shown).
[0022] The processing unit 101 executes various functions described below by reading and executing various programs and data stored in the storage unit 102. The processing unit 101 may be configured using, for example, a Central Processing Unit (hereinafter, CPU), a Micro Processing Unit (hereinafter, MPU), a Digital Signal Processor (hereinafter, DSP), a Graphical Processing Unit (hereinafter, GPU), or a Field Programmable Gate Array (hereinafter, FPGA).
[0023] The memory unit 102 is a memory area for storing and retaining various data, and may be composed of, for example, a non-volatile memory area such as a Read Only Memory (hereinafter, ROM) or a Hard Disk Drive (hereinafter, HDD), or a volatile memory area such as a Random Access Memory (hereinafter, RAM).
[0024] The external IF 103 is an interface that is connected to the robot devices 200 and 210 and is configured to be capable of transmitting and receiving various types of data. The connection by the external IF 103 may be wired or wireless and may use any communication standard. The operation unit 104 is composed of a mouse, a keyboard, etc., and is used to accept instructions and data input by a user. The display unit 105 displays various types of data, processing results, etc.
[0025] The communication unit 106 communicates with an external device via a network 400, such as a wired or wireless network, and transmits and receives various data and signals. The communication method used by the communication unit 106 is not particularly limited, and may be compatible with a plurality of communication methods. For example, a wide area network (hereinafter, WAN), a local area network (hereinafter, LAN), power line communication, short-distance wireless communication (e.g., Bluetooth (registered trademark) and Wi-Fi (registered trademark)), etc. may be used. In this embodiment, the communication unit 106 is connected to the database device 300 at least via the network 400.
[0026] The robot devices 200 and 210 are systems capable of performing arbitrary operations on an object, and have a configuration as shown in FIG. 1, for example. The robot device 200 includes a robot arm 201 and a robot hand 202, which is an example of an end effector. Similarly, the robot device 210 includes a robot arm 211 and a robot hand 212, which is an example of an end effector. In this embodiment, two robot devices 200 and 210 are shown, but more robot devices may be provided. In this example, the robot devices 200 and 210 are described as having the same configuration, but they may have different functions. For example, a camera that can be set on a setting screen described later or a detector capable of touch sensing operation may be used as an end effector. Furthermore, two or more end effectors may be provided at the tip of one robot arm. In this embodiment, an example in which multiple robot devices are controlled by one robot control device 100 is shown, but a configuration in which one robot device is controlled by one robot control device may also be used.
[0027] The database device 300 holds and manages various data related to the control of the robot device. In this embodiment, the database device 300 manages data based on the configurations of the robot devices 200 and 210, and provides the data in response to a request from the robot control device 100. The database device 300 may be configured as a server device on a cloud.
[0028] The network 400 is configured, for example, by the Internet, and serves as a path for transmitting and receiving data between the robot control device 100 and the database device 300. Note that the connection between the robot control device 100 and each robot device may be made via the network 400.
[0029] [Processing sequence] 3 is a diagram showing a processing sequence between the devices in the system according to the present embodiment. Here, of the multiple controllable robot devices, robot device 200 will be taken as an example for explanation.
[0030] The robot control device 100 receives an instruction to start the system from a user via the operation unit 104 (step S301). This instruction may be received via a screen generated by the processing unit 101.
[0031] The robot controller 100 acquires information on the connection status from the robot controller 200 (step S302). The information acquired here may include information on the configuration and functions of the connected robot controller 200. The robot controller 200 may transmit various information in response to a request from the robot controller 100, or may monitor the robot controller 100 from the robot controller 200 side and transmit various information at a predetermined timing.
[0032] The robot control device 100 displays a setting screen for the robot information on the display unit 105 based on the information of the connected robot device 200 (step S303). The setting screen displayed here may be, for example, a top screen (not shown) for transitioning to various setting screens described with reference to Figs. 5 to 9.
[0033] The robot control device 100 receives an instruction to start setting via the operation unit 104 (step S304).
[0034] The robot control device 100, in response to the instruction accepted in step S304, requests the database device 300 for a list of configurable devices based on the robot device information received in step S302 (step S305).
[0035] In response to a request from the robot controller 100, the database device 300 provides the robot controller 100 with a list of configurable devices (step S306). The list may include information such as configurable parts among parts constituting the connected robot device, their setting items, and predefined parameter sets (including fixed values / variable values).
[0036] The robot control device 100 creates a setting screen based on the list acquired in step S306, and displays it on the display unit 105 (step S307).
[0037] The robot control device 100 accepts settings for each part of the robot device 200 via the operation unit 104 on the setting screen displayed in step S307 (step S308). The settings here are performed, for example, by selecting a "Settings" button provided on the setting screen as shown in Figs. 7 to 9, and then selecting a desired part from a list. An example of the settings will be described later together with the setting screen.
[0038] The robot control device 100 receives an instruction to start creating a motion via the operation unit 104 (step S309). The instruction to start creating a motion is given, for example, by selecting a "Create motion" button provided on a setting screen as shown in Fig. 5 and Fig. 6.
[0039] The robot control device 100 creates a setting screen based on the instruction to start creating the motion received in step S309, and displays it on the display unit 105 (step S310). A specific example of the setting screen will be described later with reference to Figs.
[0040] The robot control device 100 receives input of various settings such as the robot name and the robot operation via the operation unit 104 (step S311). Specific examples of settings will be described later together with a setting screen.
[0041] The robot control device 100 receives an instruction to start the operation of the robot device based on the input settings via the operation unit 104 (step S312). The instruction to start the operation is given, for example, by selecting an "Execute" button provided on the setting screen as shown in FIG.
[0042] The robot control device 100 configures a setting screen based on the instruction to start the operation received in step S312, and displays it on the display unit 105 (step S313). The display screen here may be a screen (not shown) indicating that the operation is being executed.
[0043] The robot control device 100 calls the coordinate transformation frame and the robot parameters from the database device 300 based on the input settings. The coordinate transformation frame is data indicating the definition of a coordinate system defined in accordance with the configuration of the robot device and the relationship between the coordinate systems. More specifically, the coordinate transformation frame information indicates the names of various coordinate systems as described above, and by specifying the coordinate transformation frame, it is possible to specify in which coordinate system the obtained coordinate values are values. The robot parameters are information indicating the dimensions (sizes), movable ranges, constraints, etc. of each part constituting the robot device. Specific examples of the coordinate transformation frame and the robot parameters will be described later with reference to Figs. 5 to 9.
[0044] In response to a request from the robot controller 100, the database device 300 provides the coordinate transformation frame and the robot parameters to the robot controller 100 (step S315).
[0045] The robot controller 100 uses the various data acquired in steps S315 and S311 to generate a command for the robot device 200. Furthermore, the robot controller 100 transmits the generated command to the robot device 200 to command the robot device 200 to perform an operation (step S316).
[0046] The robot device 200 executes an operation according to the command from the robot controller 100. After that, the robot device 200 completes the operation and notifies the robot controller 100 of the completion of the operation (step S317).
[0047] The robot control device 100 configures a screen based on the notification from the robot device 200, and displays that the operation of the robot device 200 has been completed (step S318). The display screen here may be a screen (not shown) showing the result of the operation (including normal completion, abnormal completion, interruption, etc.).
[0048] 3 may be executed at a different timing, or may be rearranged. For example, some of the processes in steps S314 and S315 may be executed integrally with steps S305 and S306.
[0049] [Processing flow] Fig. 4 is a flowchart of processing by the robot control device 100 according to this embodiment, and corresponds to a part of the sequence shown in Fig. 3. This processing flow may be realized, for example, by the processing unit 101 of the robot control device 100 reading and executing various programs and data stored in the storage unit 102. For ease of explanation, the processing will be collectively described as being performed by the robot control device 100. Note that, when this processing flow is disclosed, it is assumed that the processing up to step S306 in Fig. 3 has been completed, settings for each robot device are possible, and the robot devices are also in an operable state.
[0050] The robot control device 100 displays a setting screen for the robot device (step S401). The setting screen here may be a screen that can transition to the setting screens in Figs. 5 to 9, for example.
[0051] The robot control device 100 accepts the setting of control parameters for the robot device via the setting screen displayed in step S401 (step S402). The settings here include, for example, position information of the operation target in the system coordinate system (specifically, the above-mentioned Target_pose parameter) and other control parameters. Specific examples of setting items and setting values will be described later with reference to Figs. 5 to 9. Furthermore, the robot control device 100 accepts an instruction to start an operation, which is regarded as an instruction that the setting of the control parameters has been completed.
[0052] In response to receiving the instruction to start the operation, the robot control device 100 calls the coordinate transformation frame and robot parameters corresponding to the robot device corresponding to the settings received in step S402 from the database device 300 (step S403). Then, in response to the call, the robot control device 100 acquires various information from the database device 300.
[0053] The robot control device 100 generates a conversion table for converting values of each coordinate system based on the information input in step S402 and the information acquired in step S403 (step S404). The conversion table is generated by applying the robot parameters and the setting information to a coordinate transformation frame defined in advance, and is used when converting parameters between the coordinate systems defined for each part of the robot device. The coordinate transformation frame may be configured to generate a conversion table between these coordinate systems based on the relationship between the coordinate systems defined for each of the multiple components of the robot device and the system coordinate system, for example, the relative distance of the origin position and the direction of the coordinate axis. Take, for example, a coordinate transformation frame A corresponding to the coordinate system A before conversion and a coordinate transformation frame B corresponding to the coordinate system B after conversion. By acquiring the coordinate transformation frame A and the coordinate transformation frame B, the position of the origin of the coordinate transformation frame B in the coordinate transformation frame A can be specified. Then, a correction value, that is, a difference value between the coordinate systems is calculated using this specified origin, and is used when automatically generating the conversion table. The correction values may include differences between the origins on the x-axis, y-axis, and z-axis, and differences in the rotation angles around each axis. Depending on the configuration of the robot device, multiple conversion tables may be generated. For example, a conversion table between the system coordinate system and the arm reference coordinate system and a conversion table between the system coordinate system and the hand reference coordinate system may be generated.
[0054] The configuration of the conversion table may vary depending on the setting information, the configuration and state of the specified robot device, etc. Therefore, in this embodiment, the conversion table is not stored in advance in the robot control device 100, but is generated appropriately in response to the input of setting information. With this configuration, it is not necessary to store in advance conversion tables that are expected to have various variations depending on the combination of settings, and it is possible to prevent storage area congestion, etc. Depending on the series of operations of the robot device or the immediately preceding operation, the configuration of the conversion table may not change. In such a case, the conversion table may be temporarily stored, and the stored conversion table may be used instead of the conversion table generation process.
[0055] The robot control device 100 generates a control command for the robot device based on the conversion table generated in step S404 and the settings received in step S402 (step S405).
[0056] The robot controller 100 transmits the control command generated in step S405 to the robot device to be operated, and causes the robot device to perform the operation based on the control command (step S406), and then ends this processing flow.
[0057] [Settings screen example] An example of the configuration of a setting screen related to the operation of the robot device according to this embodiment will be described. Each setting screen shown below is displayed on the display unit 105 of the robot control device 100 in a state where the user can operate it. In the example of the screen below, it is assumed that multiple robot devices are provided so that they can be used. Also, as shown in FIG. 2, an example is shown in which the robot device has at least a robot arm and a robot hand as an example of an end effector.
[0058] Figures 5 and 6 show flow charts of the operation of each robot device, and setting screens for the operation of each part of the robot device included in the flow charts. These figures are used, for example, in step S309 of the processing sequence shown in Figure 3. Figures 7 to 9 show individual setting screens relating to the configuration of each part of the robot device. These figures are used, for example, in step S308 of the processing sequence shown in Figure 3.
[0059] FIG. 5 is a configuration example of a setting screen 500 for setting a series of operations for a robot device, and here shows an example of setting for a robot arm. In an area 510, a button 511 for creating an operation is selected. The robot device can perform one or more operations by operating a robot arm, a robot hand, etc. In the setting screen 500, a workflow including one or more such operations can be set. In the area 510, a list of operations for defining a workflow is shown as selectable. In this embodiment, "Move Arm" indicating the operation of the robot arm, "Move Hand" indicating the operation of the robot hand, "Detect sth" indicating the operation of the detector, "Branch" indicating a condition determination, "Loop Start" and "Loop End" indicating the start and end of a loop can be selected. Note that the items shown here are only examples and may be changed according to the configuration of the robot device.
[0060] Area 520 shows the currently set workflow. In this example, a workflow is defined in which operations are executed in the following order: "Move Arm" → "Move Hand" → "Condition Judgment (Success?)" → "Move Arm" → "Move Hand." In this example, operation step 521 is selected, which indicates a state in which the operation of the robot arm is set. Note that "Success?" as a condition judgment judges whether the operations up to that point have been successful, and if successful, the subsequent operations are executed.
[0061] In response to the robot arm operation process 521 being specified as the setting target, the area 530 displays setting items for the robot arm. The setting item 531 specifies the robot arm that performs the operation. The setting item 532 specifies the name of the robot arm that performs the operation. The setting item 533 sets information on the object to be operated, that is, the above-mentioned Target_pose (coordinate values of each axis, and values of roll, pitch, and yaw). The setting item 534 sets the moving speed of the robot arm. The setting item 535 sets the acceleration related to the movement of the robot arm. The setting item 536 sets the configuration of the part (here, the robot hand) provided at the tip of the robot arm. In the case of the example shown in FIG. 5, the name "hand1" that uniquely indicates the robot hand and "hand_tcp" that uniquely indicates the coordinate system corresponding to the robot hand are specified. Specifically, "hand_tcp" corresponds to the origin position of the hand target coordinate system shown in FIG. 1, that is, the target position to which the robot hand is to be moved as the operation position. The value of each setting item may be uniquely identified and displayed based on other setting items or already registered data. Also, each setting item is an example, and some setting items may be omitted or other setting items may be added depending on the configuration of the robot device.
[0062] 6 shows an example of the configuration of a setting screen 600 for setting a series of operations for a robot device, and here shows an example of setting for a robot hand. In the setting screen 600, areas 610 and 620 are similar to areas 510 and 520 shown in FIG. 5. In area 610, a button 611 for creating an operation is selected. In this example, an operation step 621 is selected from among the workflows that have already been set, which shows a state in which the operation of the robot hand is set.
[0063] In response to the robot hand operation process 621 being specified as the setting target, the area 630 displays setting items for the robot hand. The setting item 631 specifies the robot hand that performs the operation. The setting item 632 specifies the name of the robot hand that performs the operation. The setting item 633 specifies the movement amount of the fingers of the robot hand. For example, in the case of the robot hand shown in FIG. 1, the distance between the fingers may be specified. The setting item 634 specifies the rotation angle of the wrist of the robot hand. The setting item 635 sets the gripping force of the robot hand. Note that the value of each setting item may be uniquely specified and displayed based on other setting items or already registered data. Note that each setting item is an example, and some setting items may be omitted or other setting items may be added depending on the configuration of the robot device.
[0064] FIG. 7 shows a list of robot arms provided in a robot device, and for example, the robot arms included in this list can be selected on the setting screen 500 shown in FIG.
[0065] In the area 710, a button 711 for setting a list is selected. In the area 710, each list is shown for setting each part of the robot device. In this example, an "Arm List" for setting the robot arm, a "Hand List" for setting the robot hand, a "Detect Tech List" for setting the detector, and a "Camera List" for setting the camera can be selected. Here, a button 712 is selected. Note that the items shown here are merely examples and may be changed depending on the configuration of the robot device.
[0066] Area 720 shows settings of robot arms that have already been registered. Area 730 shows a list of robot arms that can be set. In this example, selection items 731 to 733 of "RobotA", "RobotB1", and "RobotB2" are shown in area 730 as robot arms that can be set. Furthermore, area 720 shows settings 721 to 723 as settings of robot arms that have already been registered.
[0067] For example, the configuration parameters for the robot arm settings 721 include: Setting target arm: RobotA Name: arm1 Posture: (0,0,0,0,0,0) Port:1-10:1.0
[0068] The setting target arm indicates the robot arm to be set. The name indicates the name arbitrarily set for the robot arm. The posture indicates the reference posture of the robot arm. The port indicates information on the port (interface) to which the robot arm is connected. Other settings also include setting parameters of similar items.
[0069] Fig. 8 shows a list of robot hands equipped in a robot device, and for example, a robot hand included in this list can be selected on, for example, the setting screen 600 shown in Fig. 6. The configuration of an area 810 is similar to that of the area 710 on the setting screen 700 in Fig. 7. In the area 810, a button 811 for setting the list is selected. Furthermore, a button 812 for setting the list of robot hands is selected.
[0070] In area 820, settings of robot hands that have already been registered are shown. In area 830, a list of robot hands that can be set is shown. In this example, selection items 831 to 833 of "RobotHandA", "RobotHandB", and "RobotHandC" are shown in area 830 as robot hands that can be set. Furthermore, in area 820, settings 821 to 823 are shown as settings of robot hands that have already been registered.
[0071] For example, the setting parameters for the robot hand settings 821 include the following: Setting target hand: RobotHandA Name: hand1 Posture: (0,0,0,0,0,0) Installation arm:arm1 / tool_link
[0072] The setting target hand indicates the robot hand to be set. The name indicates name information arbitrarily set for the robot hand. The posture indicates the reference posture of the robot hand, that is, the posture in which it is installed with respect to the robot arm. The installation destination arm indicates information on the robot arm on which the robot hand is installed. Specifically, "arm1" that uniquely indicates the installation destination arm and "tool_link" that uniquely indicates the coordinate system of that robot arm are indicated. Specifically, "tool_link" is position information for specifying the origin position of the arm tip coordinate system shown in FIG. 1, that is, the origin position of the hand reference coordinate system on which the robot hand is installed. Other settings include similar setting parameters.
[0073] Fig. 9 shows a list of cameras (not shown) equipped in the robot device. The configuration of an area 910 is similar to that of the area 710 of the setting screen 700 in Fig. 7. In the area 910, a button 911 for setting the list is selected. Furthermore, a button 912 for setting the camera list is selected.
[0074] Area 920 shows settings of cameras that have already been registered. Area 930 shows a list of cameras that can be set. In this example, selection items 931-932 of "camera A" and "camera B" are shown in area 930 as cameras that can be set. Furthermore, area 920 shows settings 921-923 as settings of cameras that have already been registered.
[0075] For example, the setting parameters for the camera 921 include: Setting target camera: cameraA Name:camera1 Posture: (0,0,0.05,0,0,0) Installation arm: armA / tool_link
[0076] The setting target camera indicates the camera to be set. The name indicates name information arbitrarily set for the camera. The posture indicates the reference posture of the camera, that is, the posture in which it is installed with respect to the robot arm. The installation arm indicates information on the robot arm on which the camera is installed. Specifically, "armA" that uniquely indicates the installation target arm and "tool_link" that uniquely indicates the coordinate system of that robot arm are shown. Specifically, "tool_link" corresponds to the arm tip coordinate system shown in Figure 1. Other settings also include similar setting parameters.
[0077] For example, when setting the operation of a robot device, the user only needs to specify position information (specifically, Target_pose) in the system coordinate system of the operation target, and there is no need to specify control parameters of each coordinate system corresponding to the configuration of the robot device as shown in Fig. 1. Therefore, there is no need for the user to perform individual coordinate conversion according to the system configuration before setting parameters and creating an operation program.
[0078] As described above, according to this embodiment, the robot control device (e.g., 100) has an input unit (e.g., 500, 600, 101, 104, 105) that receives position information (e.g., Target_pose) in a first coordinate system (e.g., system coordinate system) of an object to be operated by the robot device (e.g., 200) and operation settings (e.g., 531 to 536, 631 to 635) of parts (e.g., 201, 202) constituting the robot device, and based on the operation settings, calculates parameters (e.g., robot parameters) of the parts constituting the robot device and a second coordinate system (e.g., arm reference) corresponding to the parts constituting the robot device. the first coordinate system) to the second coordinate system; a generation unit (e.g., 101) that generates a conversion table (e.g., a conversion table) for converting position information in the first coordinate system to position information in the second coordinate system based on the correction value, parameters, and operation settings; and a control unit (e.g., 101) that converts the position information in the first coordinate system into position information converted into the second coordinate system using the conversion table, and generates control commands for parts that constitute the robot device using the converted position information.
[0079] This makes it possible to set parameters related to robot control more easily than ever before, and to improve the convenience of the system including the robot device more than ever before. In particular, it becomes unnecessary for the user to set parameters by performing coordinate conversion for each component element in consideration of the configuration of the robot device, and it becomes possible to reduce the burden of setting.
[0080] The robot device includes a robot arm (e.g., 201) and an end effector (e.g., 202) provided at the tip of the robot arm, the first coordinate system being a system coordinate system of a system in which the robot device is installed, and the second coordinate system being any one of a reference coordinate system of the robot arm, a tip coordinate system of the tip of the robot arm, a reference coordinate system of the end effector, and a target coordinate system with an arbitrary operation position of the end effector as the origin. The end effector is a robot hand or a camera.
[0081] This makes it possible for the system to convert the coordinate information in the system coordinate system into a coordinate system that corresponds to the configuration of the robot device.
[0082] In addition, the acquisition unit acquires parameters of parts constituting the robot device and information on multiple coordinate systems from an external device (e.g., a database device) for each input by the input unit, and the generation unit generates a conversion table using the parameters of parts constituting the robot device acquired from the external device and correction values between coordinate systems identified from the information on the multiple coordinate systems.
[0083] This eliminates the need to store a conversion table that can accommodate a variety of possible combinations depending on the operation settings, making it possible to prevent the robot control device from becoming overloaded in memory. It also makes it possible to appropriately generate and use a conversion table that corresponds to the combination of operation settings and robot devices at that time.
[0084] In addition, the parts constituting the robot device are set in association with the posture information in the second coordinate system corresponding to the part and the name information, and the input unit receives the operation setting of the part corresponding to the name information by specifying the name information. In addition, multiple pairs of posture information and name information can be set for one part.
[0085] This allows the user to set desired name information and posture information, and when setting the operation of the robot device, parameters can be easily set by simply specifying the name information. Also, various posture information can be set for parts of the same robot device, which improves convenience when setting the operation.
[0086] <Other embodiments> In addition, programs and applications for realizing the functions of one or more of the above-mentioned embodiments can be supplied to a system or device via a network or storage medium, and the programs can be read and executed by one or more processors in a computer of the system or device.
[0087] Moreover, it may be realized by a circuit that realizes one or more functions (for example, an Application Specific Integrated Circuit (hereinafter, ASIC) or a Field Programmable Gate Array (hereinafter, FPGA)).
[0088] Although various embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to the examples. It is clear to a person skilled in the art that various modifications, corrections, substitutions, additions, deletions, and equivalents may be made within the scope of the claims, and it is understood that these also naturally belong to the technical scope of the present disclosure. In addition, the components in the various embodiments described above may be arbitrarily combined within the scope of the invention. [Industrial Applicability]
[0089] The present disclosure is useful as a robot control device, a robot control method, and a program for controlling a robot device including a robot arm. [Explanation of symbols]
[0090] 100...Robot control device 101... Processing section 102...Storage section 103…External IF 104...Operation unit 105...Display section 106…Communications Department 200, 210...Robot device 201, 211...Robot arms 202, 212...Robot Hand 300...Database device 400…Network
Claims
1. an input unit that receives position information in a first coordinate system of an object to be operated by the robot device and input of operation settings of parts constituting the robot device; an acquisition unit that acquires parameters of parts constituting the robot apparatus and correction values for coordinate conversion between a second coordinate system corresponding to the parts constituting the robot apparatus and the first coordinate system based on the operation settings; a generating unit that generates a conversion table for converting position information in the first coordinate system into position information in the second coordinate system based on the correction value, the parameter, and the operation setting; a control unit that converts position information in the first coordinate system into position information converted into the second coordinate system using the conversion table, and generates control commands for components of the robot apparatus using the converted position information; A robot control device having the above configuration.
2. The robot device includes a robot arm and an end effector provided at a tip end of the robot arm, the first coordinate system is a system coordinate system of a system in which the robot device is installed; the second coordinate system is any one of a reference coordinate system of the robot arm, a tip coordinate system of a tip portion of the robot arm, a reference coordinate system of the end effector, and a target coordinate system having an origin at an arbitrary operation position of the end effector; The robot control device according to claim 1 .
3. The robot control device according to claim 2 , wherein the end effector is a robot hand or a camera.
4. the acquisition unit acquires, for each input by the input unit, parameters of parts constituting the robot apparatus and information on a plurality of coordinate systems from an external device; the generation unit generates the conversion table using parameters of parts constituting the robot apparatus acquired from the external device and correction values between the coordinate systems identified from information on the plurality of coordinate systems. The robot control device according to claim 1 .
5. a position of each part of the robot apparatus is set in association with name information and posture information in a second coordinate system corresponding to the position of each part; The robot control device according to claim 1 , wherein the input unit receives the name information, and thereby accepts the operation setting of the part corresponding to the name information.
6. The robot control device according to claim 5 , wherein a plurality of pairs of posture information and name information can be set for one part.
7. receiving input of position information in a first coordinate system of an object to be operated by the robot device and operation settings of parts constituting the robot device; acquiring parameters of parts constituting the robot apparatus and correction values for coordinate conversion between a second coordinate system corresponding to the parts constituting the robot apparatus and the first coordinate system based on the operation settings; generating a conversion table for converting position information in the first coordinate system into position information in the second coordinate system based on the correction value, the parameter, and the operation setting; converting position information in the first coordinate system into position information converted into the second coordinate system using the conversion table, and generating a control command for a component of the robot apparatus using the converted position information. A method for controlling a robot.
8. On the computer, receiving input of position information in a first coordinate system of an object to be operated by the robot device and operation settings of parts constituting the robot device; acquiring parameters of parts constituting the robot apparatus and correction values for coordinate conversion between a second coordinate system corresponding to the parts constituting the robot apparatus and the first coordinate system based on the operation settings; generating a conversion table for converting position information in the first coordinate system into position information in the second coordinate system based on the correction value, the parameter, and the operation setting; converting position information in the first coordinate system into position information converted into the second coordinate system using the conversion table, and generating a control command for a component of the robot apparatus using the converted position information. A program for executing a robot control method.
Citation Information
Patent Citations
Control of industrial robot
JP1990303779A
Industrial robot
JP1991131484A
Industrial robot
JP1995205071A
Controller for industrial robot
JP1997311708A
Control device and data structure
JP2019057262A
