Robot Control Device

Abstract

To enhance accuracy in determining whether a part of a robot collides with another part or another object.SOLUTION: A robot control device 1 comprises an operation information reception part 141 for receiving operation information from an operation device 2 which generates the operation information for operating a robot 3 in accordance with a motion of an operator U for operating the robot 3, an object creation part 142 for creating an object B which performs a motion corresponding to movement of the operator on the basis of the operation information, and a robot control part 143 for controlling the robot 3 on the basis of the operation information. The robot control part 143 stops control on the robot 3 based on the operation information, when the object B, which is created by the object creation part 142 on the basis of the operation information received by the operation information reception part 141, is determined to become a predetermined state.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a robot control device, a robot control method, and a program for controlling a robot. [Background technology]

[0002] Conventionally, there are known techniques for preventing a robot from colliding with an object. Patent Document 1 discloses a technique for determining whether or not a robot will collide with another object based on whether or not an object is present on an extension line of a motion vector of a part of the robot. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-202354 A Summary of the Invention [Problem to be solved by the invention]

[0004] When a robot part moves linearly, it is possible to appropriately determine whether or not the robot will collide with another object based on whether or not an object is present on an extension line of the motion vector of the robot part. However, when a robot part does not move linearly, there is a problem in that the accuracy of determining whether or not the robot will collide with another object is insufficient simply by using the motion vector of the robot part.

[0005] The present invention has been made in consideration of these points, and has an object to improve the accuracy of determining whether or not a part of a robot will collide with another part or another object. [Means for solving the problem]

[0006] A robot control device of a first aspect of the present invention has an operation information receiving unit that receives operation information from an operation device that generates operation information for operating the robot in response to actions of an operator operating the robot, an object creation unit that creates an object that performs an action corresponding to the movement of the operator based on the operation information, and a robot control unit that controls the robot based on the operation information, and when the robot control unit determines that the object created by the object creation unit based on the operation information received by the operation information receiving unit will reach a predetermined state, it stops control of the robot based on the operation information.

[0007] The object creation section may change a state of the object by moving at least a part of the object based on the operation information.

[0008] The robot control unit may stop control of the robot based on the operation information when it determines, based on the operation information, that the object will be in a state where it cannot move or that the object will be in a state where it will fall over.

[0009] The robot control unit may stop control of the robot based on the operation information when it determines that changing the state of the object based on the operation information will cause one or more parts of the object to come into contact with other parts of the object or an external object.

[0010] The robot control unit may determine whether or not the contact state occurs based on a distance between the one or more parts and the other parts or the external object.

[0011] The robot control unit may determine whether or not the contact state will occur based on a movement direction of the one or more parts corresponding to the operation information and a positional relationship between the one or more parts and the other parts or the external object.

[0012] The robot control unit may determine whether or not the contact state will occur based on a positional relationship between the one or more parts and the other parts or the external object after a predetermined time period determined based on at least one of the movement speed or movement acceleration of the one or more parts corresponding to the operation information.

[0013] The robot control unit may determine whether or not the one or more parts will be in a contact state based on the position of the other part or the external object with which the one or more parts come into contact, or the acceleration of the one or more parts at the time when the one or more parts come into contact with the other part or the external object.

[0014] The robot control device may further have a display processing unit that displays the object on a display unit visible to the operator, and the display processing unit may display parts of the object that move based on the operation information in a color different from other parts.

[0015] The robot control device further has a display processing unit that displays the object on a display unit visible to the operator, and when the display processing unit predicts that one or more parts of the object moving based on the operation information will be within a predetermined distance from other parts of the object, it may cause information indicating a direction in which the one or more parts will move away from the other parts to be displayed on the display unit.

[0016] The robot control unit may switch between stopping and resuming control of the robot based on the operation information, based on a change in operation content indicated by the operation information.

[0017] A robot control method according to a second aspect of the present invention includes the steps of receiving operation information from an operation device that creates operation information for operating a robot in response to movements of an operator operating the robot, creating an object that performs an action corresponding to the movement of the operator based on the operation information, determining whether or not one or more parts of the object will be in a predetermined state based on the received operation information, and stopping control of the robot based on the operation information when it is determined that one or more parts of the object will be in a predetermined state.

[0018] A program of a third aspect of the present invention causes a computer to execute the steps of receiving operation information from an operation device that creates operation information for operating a robot in response to actions of an operator operating the robot; creating an object that performs an action corresponding to the movement of the operator based on the operation information; determining whether or not one or more parts of the object will be in a predetermined state based on the received operation information; and stopping control of the robot based on the operation information when it is determined that one or more parts of the object will be in a predetermined state. Effect of the Invention

[0019] According to the present invention, it is possible to improve the accuracy of determining whether or not a part of a robot will collide with another part or another object. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 is a diagram illustrating an overview of a robot control system. [Diagram 2] FIG. 2 is a diagram illustrating a functional configuration of a robot control device. [Diagram 3] FIG. 4 is a diagram showing an operation sequence of the robot control system. [Figure 4] FIG. 4 is a flowchart showing the operation of the robot control device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] [Outline of Robot Control System S] Fig. 1 is a diagram showing an overview of a robot control system S. The robot control system S is a system that provides a telexistence environment in which an operator U can operate a remote object in real time while making the user U feel as if the object is nearby.

[0022] The robot control system S includes a robot control device 1, an operation device 2, and a robot 3. The robot control device 1 is a device, such as a computer, that outputs control data for controlling the robot 3 in response to the operation of an operator U. The robot control device 1 transmits and receives data between the operation device 2 and the robot 3 via a communication channel.

[0023] The robot control device 1 is provided, for example, on the robot 3, but the robot control device 1 may be provided in a location different from the robot 3, or may be provided near the operation device 2. When the robot control device 1 is provided on the robot 3, the robot control device 1 transmits and receives data to and from the operation device 2, for example, via the Internet. When the robot control device 1 is provided near the operation device 2, the robot control device 1 transmits and receives data to and from the robot 3, for example, via the Internet.

[0024] The operation device 2 is a device worn by the operator U, and includes a display device 21 and an operation device 22. The display device 21 is a display device having a display visible to the operator U, and is, for example, a goggle-type display device.

[0025] The operation device 22 is a device used by the operator U to operate the robot 3. The operation device 22 has, for example, an acceleration sensor for detecting the movement of the body parts (e.g., hands and arms) of the operator U, and generates operation information indicating the movement of the body parts of the operator U.

[0026] The operation information includes at least any of the following motion information: position information indicating the relative position of each part of the operator U's fingers, hands, arms, head, feet, etc. relative to a reference position; speed information indicating the speed of each part; and acceleration information indicating the acceleration of each part. The reference position is, for example, the position of each part in a state in which the operator U takes a predetermined posture (for example, a posture in which the arms are stretched out and placed on both sides of the torso) at the time when the operator U starts operating the robot 3. The operation device 22 also has an element for generating heat, pressure, vibration, etc. corresponding to the state of the robot 3 so that the operator U can sense the state of the robot 3.

[0027] The robot 3 operates based on control data received from the robot control device 1. The robot 3 also has a camera capable of photographing the surroundings, and transmits captured image data generated by the camera to the robot control device 1. Furthermore, the robot 3 transmits at least any of robot status data to the robot control device 1, including tactile data indicating tactile sensations detected by the robot 3, sound data indicating sounds collected by the robot 3, and joint status data indicating the status of the joints of the robot 3.

[0028] The robot control device 1 displays an image based on the captured image data received from the robot 3 on the display device 21. The robot control device 1 also heats or vibrates the operation device 22 based on the robot state data received from the robot 3. With these configurations, the operator U can experience the environment around the robot 3 from a location away from the robot 3, as if he or she were inside the robot 3.

[0029] Furthermore, the robot control device 1 creates control data for operating the robot 3 based on operation information transmitted from the operation device 22, and controls the operation of the robot 3 by transmitting the created control data to the robot 3. The robot control device 1 is characterized in that, before transmitting the control data to the robot 3, it creates an object B that performs an action corresponding to the movement of the operator U indicated by the operation information, and determines whether or not to operate the robot 3 based on the operation information, based on the state of the created object B. The object B is, for example, configured by three-dimensional computer graphics image data that represents a shape equivalent to that of the robot 3, but the form of the object B does not have to be the same as the shape of the robot.

[0030] Based on the movement of object B, the robot control device 1 judges whether or not a part of the robot 3 will collide with another part of the robot 3 or another object, the robot 3 will lose balance and fall, or the robot 3 will become unable to operate, if the robot control device 1 operates the robot 3 based on the operation information. If the robot control device 1 judges that the robot 3 may be in such a state, it does not operate the robot 3 based on the operation information. Iko In this way, it is possible to prevent the robot 3 from breaking down or destroying other objects. The configuration and operation of the robot control device 1 will be described in detail below.

[0031] [Configuration of robot control device 1] 2 is a diagram showing the functional configuration of the robot control device 1. The robot control device 1 has a first communication unit 11, a second communication unit 12, a storage unit 13, and a control unit 14. The control unit 14 has an operation information receiving unit 141, an object creating unit 142, a robot control unit 143, and a display processing unit 144.

[0032] The first communication unit 11 has a communication controller for transmitting and receiving various data to and from the operation device 2. The first communication unit 11 receives operation information transmitted by the operation device 2, and inputs the received operation information to the operation information receiving unit 141. In addition, the first communication unit 11 transmits display data input from the display processing unit 144 to the operation device 2.

[0033] The second communication unit 12 has a communication controller for transmitting and receiving various data to and from the robot 3. The second communication unit 12 transmits control data generated by the robot control unit 143 based on operation information to the robot 3. The second communication unit 12 also receives captured image data transmitted by the robot 3, and inputs the received captured image data to the display processing unit 144.

[0034] The storage unit 13 includes storage media such as a ROM (Read Only Memory), a RAM (Random Access Memory), and a hard disk. The storage unit 13 stores a program executed by the control unit 14. The storage unit 13 also stores various data necessary for the control unit 14 to operate the robot 3.

[0035] The control unit 14 has, for example, a CPU (Central Processing Unit). The control unit 14 executes the programs stored in the storage unit 13 to function as an operation information receiving unit 141, an object creating unit 142, a robot control unit 143, and a display processing unit 144.

[0036] The operation information receiving unit 141 receives operation information from the operation device 2 that generates operation information for operating the robot 3 in accordance with the action of an operator U operating the robot 3, via the first communication unit 11. The operation information receiving unit 141 inputs the received operation information to the object creating unit 142 and the robot control unit 143.

[0037] Based on the operation information, the object creation unit 142 creates an object B that performs an action corresponding to the movement of the operator U. The object creation unit 142 changes the state of the object B by moving at least a part of the object B based on the operation information.

[0038] The object creation unit 142 changes the position of each part of the object B, such as the fingers, hands, arms, head, or feet, based on the position, speed, or acceleration of each part of the operator U, such as the fingers, hands, arms, head, or feet, indicated by the operation information. The object creation unit 142 notifies the robot control unit 143 of information indicating the position of each part of the object B after the change. Specifically, the object creation unit 142 calculates the coordinates of multiple positions on the surface of each part of the object B after the change, and notifies the robot control unit 143 of the calculated coordinates. The object creation unit 142 may notify the robot control unit 143 of coordinates indicating the position of the object corresponding to the shape and position of an object present in the vicinity of the robot 3.

[0039] The coordinates calculated by the object creation unit 142 are coordinates in a virtual three-dimensional space. In the three-dimensional space, the positional relationship of each part of the object B in the initial state is equivalent to the positional relationship of each part of the robot 3 in the initial state (e.g., in an upright state) of the robot 3 in the real space.

[0040] Details of object B created by object creation unit 142 will be described below. Until an instruction is given by operator U, object creation unit 142 creates object B in the same posture as robot 3. For example, when robot control device 1 is powered on, object creation unit 142 receives posture information of robot 3 and creates object B in the posture indicated by the received posture information. When operation information receiving unit 141 receives operation information based on the operation of operator U, object creation unit 142 creates object B that moves in the same manner as the movement of operator U based on the received operation information.

[0041] The object creation unit 142 may acquire information indicating the movement or posture of the robot 3 from the second communication unit 12, and create an object B reflecting the movement or posture of the robot 3 based on the acquired information. In this case, a delay may occur before the movement or posture of the robot 3 is reflected in the object B. Therefore, while the object creation unit 142 is unable to receive information indicating the movement or posture of the robot 3, the object creation unit 142 may instruct the display processing unit 144 to display the corresponding part in a color different from other parts, or to display the movement of the robot 3 as a ghost in a light color.

[0042] The robot control unit 143 controls the robot 3 based on the operation information input from the operation information receiving unit 141. Specifically, first, the robot control unit 143 creates control data for moving each part of the robot 3 to a relative position with respect to the reference position of each part of the robot 3 based on the relative position of each part of the operator U, such as the fingers, hands, arms, head, or feet, indicated by the operation information, with respect to the reference position. The robot control unit 143 controls the robot 3 by transmitting the created control data to the robot 3 via the second communication unit 12. The robot control unit 143 may create control data including data for moving each part of the robot 3 based on the moving speed or moving acceleration of each part of the operator U indicated by the operation information.

[0043] The robot control unit 143 creates control data based on information indicating the positions of each part of object B notified by the object creation unit 142, so that when each part of the robot 3 is moved, the each part of the robot 3 does not collide with other parts of the robot 3 or other objects, and the robot 3 does not lose balance and fall over.

[0044] For example, when the robot control unit 143 determines that the object B created by the object creation unit 142 will be in a predetermined state based on the operation information received by the operation information receiving unit 141, the robot control unit 143 stops the control of the robot 3 based on the operation information. Specifically, when the robot control unit 143 determines that the object B will be in an inoperable state based on the operation information, the robot control unit 143 does not create control data based on the operation information and stops the control of the robot 3 based on the operation information.

[0045] The robot control unit 143 stops the control of the robot 3 based on the operation information, for example, when it is determined that one or more parts of the object B will come into contact with other parts of the object B when the state of the object B is changed based on the operation information. The robot control unit 143 determines whether or not the one or more parts will come into contact with other parts based on the distance between the one or more parts and the other parts, for example.

[0046] 1, when the operator U brings his / her left hand closer to his / her face, causing the distance between the tip of the left hand of object B and the face to become equal to or smaller than a threshold, it is determined that the left hand of the robot 3 will come into contact with the face. The threshold is determined based on the difference between the shape of object B and the shape of robot 3, and the smaller the difference between the shape of object B and the shape of robot 3, the smaller the threshold is set, thereby improving the accuracy of determination by the robot control unit 143.

[0047] The robot control unit 143 may determine whether or not one or more parts will come into contact with another part, based on the moving direction of the one or more parts corresponding to the operation information and the positional relationship between the one or more parts and the other part. For example, when a first part (e.g., the tip of the left hand) of object B is moving in a direction away from a second part (e.g., the face), the robot control unit 143 determines that the first part and the second part will not come into contact with each other.

[0048] On the other hand, the robot control unit 143 determines that there will be contact when the distance between the first part and the second part of the object B is within a predetermined range and the first part is moving in a direction approaching the second part. By operating in this manner, the robot control unit 143 can determine whether or not one or more parts will come into contact with other parts before the operator U operates the robot 3, thereby further reducing the probability that one or more parts of the robot 3 will come into contact with other parts.

[0049] The robot control unit 143 may determine whether or not one or more parts will come into contact with another part or an external object based on a positional relationship between the one or more parts and another part or an external object after a predetermined time specified based on at least one of the moving speed or the moving acceleration of the one or more parts corresponding to the operation information. The robot control unit 143 predicts the position of the first part and the position of the second part at a future time after the predetermined time based on, for example, the position of the first part and the position of the second part at a certain time and the moving speed or the moving acceleration of those parts. The predetermined time is determined based on the time required to stop the operation of the robot 3, and is, for example, one second. The robot control unit 143 determines that one or more parts of the robot 3 will come into contact with another part when the distance between the predicted position of the first part and the position of the second part is equal to or less than a threshold value.

[0050] Similarly, the robot control unit 143 identifies the position of one or more parts of object B at a future time based on the position of the part at a certain time and the moving speed or moving acceleration of the part. When the distance between the identified position and the external object is equal to or less than a threshold, the robot control unit 143 determines that one or more parts of the robot 3 will come into contact with the external object.

[0051] The robot control unit 143 may determine whether or not one or more parts will come into contact with other parts, based on the positions of other parts or external objects with which the one or more parts come into contact, or the acceleration of the one or more parts at the time when the one or more parts come into contact with the other parts or external objects. When the positions of other parts or external objects with which the one or more parts of the robot 3 come into contact are positions (e.g., soft positions) that will not lead to failure of the one or more parts of the robot 3, other parts, or external objects, the robot control unit 143 determines that the one or more parts will not come into contact with the other parts or external objects, even if they may come into contact with the other parts or external objects.

[0052] Furthermore, when the acceleration of one or more parts at the time of contact is smaller than a predetermined value and is an acceleration that does not lead to failure of one or more parts, other parts, or an external object, the robot control unit 143 determines that even if one or more parts may come into contact with other parts or an external object, they will not be in a contact state. By the robot control unit 143 operating in this manner, it is possible to prevent the robot 3 from frequently stopping its operation even when there is no risk of failure.

[0053] When the robot control unit 143 determines that moving each part of object B based on the operation information will cause object B to fall over (i.e., the robot 3 will fall over), the robot control unit 143 may stop the control of the robot 3 based on the operation information. For example, the robot control unit 143 calculates the position of the center of gravity when each part of object B is moved based on the operation information, and determines that object B will fall over if the position of the center of gravity is outside the position of the feet of object B.

[0054] For example, when the operator U moves his / her head or hand too far to the right while standing on only the right leg, the robot control unit 143 determines that the object B will fall over. By the robot control unit 143 operating in this manner, it is possible to prevent the robot 3 from breaking down due to the robot 3 falling over, or to prevent an external object that the robot 3 collides with from being damaged due to the robot 3 falling over.

[0055] While the operation information receiving unit 141 is receiving the operation information, the robot control unit 143 constantly determines whether it is OK to move object B, and controls the robot 3 based on the operation information while there are no problems such as contact between parts of the robot 3. When the robot control unit 143 determines that moving object B based on the operation information would cause parts of object B to come into contact with each other, it stops the movement of the robot 3 based on the operation information. In this way, when there is a part of the robot 3 that is not controlled according to the operation information, the robot control unit 143 may instruct the object creation unit 142 to show that part of object B in a color different from other parts.

[0056] The robot control unit 143 may switch between stopping and resuming the control of the robot 3 based on the operation information, based on a change in the operation content indicated by the operation information. As described above, the robot control unit 143 stops the control of the robot 3 when each part of the object B comes into contact with another part or an external object when the object B is operated based on the operation information. The robot control unit 143 resumes the control of the robot 3 when each part of the object B changes to a state where it is not in contact with another part or an external object after stopping the control of the robot 3. The robot control unit 143 resumes the control of the robot 3 when it can be determined that each part of the object B does not come into contact with another part or an external object based on at least one of the positions of each part of the object B and the moving direction, moving speed, or moving acceleration of each part of the object B after stopping the control of the robot 3.

[0057] The display processing unit 144 displays various information on the display device 21 so that it can be visually recognized by the operator U. For example, the display processing unit 144 displays an object B on the display device 21 so that it can be visually recognized by the operator U. At this time, the display processing unit 144 may display a part of the object B that moves based on the operation information in a color different from that of other parts. By operating the display processing unit 144 in this manner, the operator U can operate the robot 3 while imagining how the robot 3 will move due to his or her own actions, and it becomes easier to operate the robot 3 so that each part does not come into contact with other parts or external objects.

[0058] When predicting that one or more parts of object B moving based on the operation information will be within a predetermined distance from other parts, the display processing unit 144 may display information indicating a direction in which the one or more parts move away from the other parts on the display device 21. For example, in the example shown in FIG. 1, when predicting that the left hand of object B will touch the face, the display processing unit 144 displays object B on the display device 21 and also displays an arrow on the display device 21 in a direction in which the left hand moves away from the face, or displays text such as "Please move your left hand away from your face" on the display device 21. The display processing unit 144 may display object B corresponding to a state in which the robot 3 is viewed from behind on the display device 21, in order to make it easier for the operator U to operate the robot 3 based on object B viewed on the display device 21.

[0059] The display processing unit 144 may create a three-dimensional map with the robot 3 at its center based on an image captured by a camera held by the robot 3, and display the state of obstacles around the robot 3 on the three-dimensional map on the display device 21. The display processing unit 144 may also create a three-dimensional map around the object B based on the created three-dimensional map, and display an image of the same environment as around the robot 3 around the object B. By displaying such an image on the display device 21 by the display processing unit 144, the operator U can determine whether the movement of the object B will cause contact with surrounding objects.

[0060] [Operation sequence of robot control system S] FIG. 3 is a diagram showing an operation sequence of the robot control system S. When the operator U moves each part of his / her body, the operation device 22 creates operation information (S1) and transmits it to the robot control device 1. The robot control device 1 creates an object B based on the received operation information (S2). The robot control device 1 judges whether it is OK to operate the robot 3 based on the operation information based on whether each part of the created object B contacts other parts or external objects (S3). The robot control device 1 always performs the judgment of step S3 while the power is on. If it is judged that there is no problem, the robot control device 1 transmits normal control data based on the operation information to the robot 3, and the robot 3 executes an operation based on the control data (S4).

[0061] On the other hand, if the robot control device 1 determines in step S3 that there is a problem because one or more parts of the object B come into contact with other parts or an external object, it transmits control data for stopping the operation of the robot 3 to the robot 3. Upon receiving the control data, the robot 3 stops its operation (S5).

[0062] [Operation flow chart of robot control device 1] Fig. 4 is a diagram showing a flowchart of the operation of the robot control device 1. The flowchart shown in Fig. 4 starts from the point when the operator U starts operating the robot 3. When the operator U starts the operation, the operation information receiving unit 141 receives operation information from the operation device 22 (S11), and the object creating unit 142 creates an object B based on the operation information (S12). The robot control unit 143 identifies the position of each part of the object B created by the object creating unit 142 (S13), and judges whether or not the object B is in a predetermined state (for example, a state in which parts are in contact with each other) (S14).

[0063] When the robot control unit 143 determines that the object B will not be in a predetermined state (NO in S14), it transmits control data based on the operation information to the robot 3, thereby operating the robot 3 based on the operation information (S15). On the other hand, when the robot control unit 143 determines that the object B will be in a predetermined state (YES in S14), it transmits control data for stopping the robot 3 to the robot 3, thereby stopping the operation of the robot 3 (S16).

[0064] The control unit 14 repeats the processes from S11 to S16 until the operator U ends the operation (for example, while the operation information is received at regular time intervals) (NO in S17). When the control unit 14 stops receiving the operation information from the operation device 22 (YES in S17), the control unit 14 ends the processes.

[0065] [Variations] In the above description, a case has been exemplified in which the robot control unit 143 stops the control of the robot 3 based on the operation information when it determines that the distance between one or more parts of the object B and another part or another object is within a threshold value. Even if the object B has a similar shape to the robot 3, the object B is not completely the same shape, and therefore the robot control unit 143 may make an erroneous determination.

[0066] Therefore, the object creation unit 142 may create object B using a machine learning model that outputs the positions of each part of object B when operation information is input, thereby reducing the probability of erroneous determination by the robot control unit 143. The machine learning model is a model created by machine learning using as training data the results of the robot control unit 143 controlling the robot 3 based on object B created based on a large amount of operation information.

[0067] The machine learning model learns by using the relationship between operation information and the positions of each part of object B in the following cases as positive training data. (1) The robot control unit 143 determines that it is necessary to stop the robot 3 based on the state of object B, but if the robot 3 were to be operated without stopping it, it is assumed that one or more parts of the robot 3 would come into contact with other parts or other objects. (2) The robot control unit 143 determines that there is no need to stop the robot 3 based on the state of object B, and one or more parts of the robot 3 do not actually come into contact with other parts or other objects.

[0068] In addition, the machine learning model learns by using the relationship between the operation information and the positions of each part of object B in the following cases as negative training data. (1) The robot control unit 143 determines that it is necessary to stop the robot 3 based on the state of object B, but it is assumed that if the robot 3 were operated without being stopped, one or more parts of the robot 3 would not have come into contact with other parts or other objects. (2) When the robot control unit 143 determines that there is no need to stop the robot 3 based on the state of object B, but one or more parts of the robot 3 come into contact with other parts or other objects.

[0069] When the object creation unit 142 acquires operation information, it inputs the acquired operation information into the above-mentioned machine learning model, and creates object B based on the positions of each part of object B output from the machine learning model. A machine learning model is created for each type of robot 3, and the object creation unit 142 creates object B using a machine learning model corresponding to the type of robot 3 to which the robot control unit 143 transmits control data. By the object creation unit 142 creating object B in this manner, it is possible to reduce the probability of erroneous determination by the robot control unit 143.

[0070] [Effects of robot control device 1] As described above, the object creation unit 142 creates the object B that performs an action corresponding to the movement of the operator U based on the operation information received from the operation device 22, and the robot control unit 143 stops the control of the robot 3 based on the operation information when it is determined that the object B is in a predetermined state. By the object creation unit 142 and the robot control unit 143 operating in this manner, the movement of each part of the robot 3 based on the operation information can be predicted with high accuracy, and therefore the accuracy of determining whether or not a part of the robot 3 will collide with an object can be improved.

[0071] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by distributing or integrating functionally or physically in any unit. In addition, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment resulting from the combination combines the effect of the original embodiment. [Explanation of symbols]

[0072] 1 Robot control device 2 Control device 3. Robot 11 First Communications Department 12 2nd Communications Department 13 Storage section 14 Control section 21 Display Devices 22 Operation Device 141 Operation information receiving unit 142 Object Creation Section 143 Robot Control Unit 144 Display processing unit

Claims

1. an operation information receiving unit that receives operation information from an operation device that generates operation information for operating the robot in response to a motion of an operator operating the robot; an object creation unit that creates an object that performs the same movement as the movement of the robot operated in response to the movement of the operator, based on the operation information; a robot control unit that controls the robot based on the operation information; having when it is determined that the object created by the object creation unit will be in a state where it cannot move or will fall over based on the operation information received by the operation information receiving unit, the robot control unit stops the operation of the robot based on the operation information; a display processing unit that displays the object on a display unit visible to the operator; the display processing unit displays a part of the object that moves based on the operation information in a color different from other parts of the object. Robot control device.

2. An operation information receiving unit that receives operation information from an operation device that generates operation information for operating a robot in response to a motion of an operator operating the robot; an object creation unit that creates an object that performs the same movement as the movement of the robot operated in response to the movement of the operator, based on the operation information; a robot control unit that controls the robot based on the operation information; having when it is determined that the object created by the object creation unit will be in a state where it cannot move or will fall over based on the operation information received by the operation information receiving unit, the robot control unit stops the operation of the robot based on the operation information; a display processing unit that displays the object on a display unit visible to the operator; when predicting that one or more parts of the object moving based on the operation information will be within a predetermined distance from another part of the object, the display processing unit causes information indicating a direction in which the one or more parts move away from the other part to be displayed on the display unit. Robot control device.

3. An operation information receiving unit that receives operation information from an operation device that generates operation information for operating a robot in response to a motion of an operator operating the robot; an object creation unit that creates an object that performs the same movement as the movement of the robot operated in response to the movement of the operator, based on the operation information; a robot control unit that controls the robot based on the operation information; having when it is determined that the object created by the object creation unit will be in a state where it cannot move or will fall over based on the operation information received by the operation information receiving unit, the robot control unit stops the operation of the robot based on the operation information; The robot control unit switches between stopping and restarting the operation of the robot based on the operation information, based on a change in the operation content indicated by the operation information. Robot control device.

4. the object creation unit changes a state of the object by moving at least a part of the object based on the operation information; The robot control device according to any one of claims 1 to 3.

5. when it is determined that one or more parts of the object will come into contact with another part of the object or an external object when a state of the object is changed based on the operation information, the robot control unit stops an operation of the robot based on the operation information. The robot control device according to any one of claims 1 to 3.

6. the robot control unit determines whether or not the contact state is reached based on a distance between the one or more parts and the other parts or the external object. The robot control device according to claim 5.

7. the robot control unit determines whether or not the contact state is to occur based on a moving direction of the one or more parts corresponding to the operation information and a positional relationship between the one or more parts and the other parts or the external object; The robot control device according to claim 5.

8. the robot control unit determines whether or not the contact state will occur based on a positional relationship between the one or more parts and the other parts or the external object after a predetermined time period specified based on at least one of a moving speed or a moving acceleration of the one or more parts corresponding to the operation information; The robot control device according to claim 5.

9. the robot control unit determines whether or not the one or more parts will be in the contact state based on a position of the other part or the external object with which the one or more parts are in contact, or an acceleration of the one or more parts at a time when the one or more parts are in contact with the other part or the external object; The robot control device according to claim 5.

Images