Remote control system, remote control method, and remote control program

By introducing a tactile prompter into the remote control system, combining force control and prompt control, the problem of inaccurate reaction force prompt of robot contact in the prior art is solved, and the accurate prompt and operation stability improvement of robot contact is achieved.

CN119031998APending Publication Date: 2024-11-26KAWASAKI JUKOGYO KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202380033854.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-04-15
Filing Date
2023-04-14
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

When the existing remote control system comes into contact with an object, it is difficult for the operator to accurately prompt the operator's reaction force, resulting in the instability of the force control of the operating device, and it is difficult for the operator to sense the occurrence of the robot's contact in a timely manner.

Method used

A remote control system is designed, including an operating device, a robot, a haptic prompter and a control device, through which the haptic prompt provides tactile feedback to the operator when the robot touches an object, and combines force control and prompt control to ensure the operating device and The bidirectional force control between the robot prompts the operator to generate robot contact.

Benefits of technology

It realizes accurate prompts generated by robot contact, improves operation stability and reaction force perception, ensures that the operator can adjust operations in a timely manner, and improves the accuracy and safety of remote control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119031998A_ABST
    Figure CN119031998A_ABST
Patent Text Reader

Abstract

The invention provides a remote control system. A remote control system (100) is provided with an operation device (4) that is operated by an operator, a robot (1) that operates in response to the operation of the operation device (4), a tactile presentation device (8) that presents the operator with the generation of contact of the robot (1) with an object, and a control device (5) that controls the operation device (4) and the robot (1) to operate in response to the operation of the operation device (4). The control device (5) executes force control for operating the robot (1) in response to an operation force applied from an operator to the operation device (4) and for operating the operation device (4) in response to a reaction force received from the outside by the robot (1), and presentation control for presenting the operation device (4) in response to a reaction force received from the outside by the robot (1). When the robot (1) comes into contact with an object, the generation of contact is presented to an operator via a tactile presentation device (8).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to a remote control system, a remote control method and a remote control program. Background Art

[0002] A remote control system that performs force control in which a robot is operated in response to an operating force applied from an operator to an operating device and an operating device is operated in response to a reaction force received by the robot from the outside is well known. In such a remote control system, since the operator can sense the reaction force acting on the robot via the operating device, the operator can operate the operating device while adjusting the reaction force acting on the robot.

[0003] Patent Document 1: Japanese Patent Application Publication No. 2020-131411 Summary of the invention

[0004] The remote control system described above is designed to achieve appropriate force control centered on the reaction force in response to the assumed operation. Therefore, it is sometimes difficult to achieve appropriate force control for the reaction force outside the assumed range, or the reaction force within the assumed range but close to the boundary of the range.

[0005] For example, when the robot contacts another object during operation and a small contact force acts on the robot as a reaction force, the force control of the operating device may not be achieved with the desired responsiveness or stability. At that time, the occurrence of the robot's contact is not properly notified to the operator.

[0006] In view of the above, an object of the present invention is to appropriately perform bidirectional force control between an operating device and a robot, and to appropriately notify an operator of the occurrence of contact by the robot.

[0007] The remote control system of the present invention includes an operating device, a robot, a tactile prompter and a control device, wherein the operating device is operated by an operator, the robot moves in response to the operation of the operating device, the tactile prompter prompts the operator of the robot's contact with an object, and the control device performs force control and prompt control. In the force control, the robot moves in response to the operating force applied from the operator to the operating device and moves in response to the reaction force received by the robot from the outside. In the prompt control, when the robot contacts the object, the contact is prompted to the operator via the tactile prompter.

[0008] The remote control method of the present invention is a remote control method for controlling a robot via an operating device, which includes the steps of performing force control and notifying an operator of the occurrence of contact via a tactile prompter when the robot contacts an object. In the force control, the robot is moved in response to an operating force applied from the operator to the operating device and the operating device is moved in response to a reaction force received by the robot from the outside.

[0009] The remote control program of the present invention is a remote control program for enabling a computer to realize a function of controlling a remote control system, the remote control system including an operating device and a robot, the operating device being operated by an operator, the robot performing an action in response to an operation on the operating device. The remote control program is used to enable a computer to realize a function of executing force control in which the robot is caused to act in response to an operating force applied from an operator to the operating device and in which the robot is caused to act in response to a reaction force received from the outside, and a function of notifying the operator of the occurrence of the contact via a tactile prompter when the robot contacts an object.

[0010] (Effects of the Invention)

[0011] According to the remote control system, it is possible to appropriately perform bidirectional force control between the operating device and the robot, and appropriately notify the operator of the occurrence of contact by the robot.

[0012] According to the remote control method, it is possible to appropriately perform bidirectional force control between the operating device and the robot, and appropriately notify the operator of the occurrence of contact by the robot.

[0013] According to the remote control program, it is possible to appropriately perform bidirectional force control between the operating device and the robot, and appropriately notify the operator of the occurrence of contact by the robot. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 is a schematic diagram showing the structure of a remote control system.

[0015] Figure 2 It is a schematic front view of the hand.

[0016] Figure 3 It is a schematic side view of the operating unit.

[0017] Figure 4 : is a diagram showing a schematic hardware configuration of a control device.

[0018] Figure 5 It is a functional block diagram of the control device.

[0019] Figure 6is a flowchart showing the operation of the remote control system. DETAILED DESCRIPTION

[0020] Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings. Figure 1 is a schematic diagram showing the structure of the remote control system 100 .

[0021] The remote control system 100 includes an operating device 4, a robot 1, a tactile prompter 8, and a control device 5. The operating device 4 is operated by an operator, the robot 1 moves in response to the operation of the operating device 4, the tactile prompter 8 prompts the operator that the robot 1 is in contact with an object, and the control device 5 controls the robot 1 and the operating device 4. The operating device 4 and the tactile prompter 8 are arranged at a first station S1 where the operator is located. The robot 1 is arranged at a second station S2 different from the first station S1. The control device 5 implements remote control between the operating device 4 and the robot 1. The control device 5 performs force control and prompt control. In the force control, the robot 1 moves in response to the operating force applied from the operator to the operating device 4 and the operating device 4 moves in response to the reaction force received by the robot 1 from the outside. In the prompt control, when the robot 1 contacts the object, the tactile prompter 8 prompts the operator that the contact is made.

[0022] The remote control system 100 may also include a camera 91 and a display device 92, wherein the camera 91 takes a picture of the robot 1, and the display device 92 displays the image of the robot 1 to the operator. The camera 91 is configured at the second station S2. The camera 91 is fixedly configured at the second station S2. The camera 91 outputs the captured image to the control device 5. It should be noted that the camera 91 may also be installed on the robot arm 11.

[0023] The display device 92 is arranged at the first station S1. The display device 92 is arranged at a position where the operator can see while operating the operating device 4. The display device 92 displays the image captured by the camera device 91 and sent from the control device 5. The display device 92 assists the operator who operates the operating device 4 by displaying the captured image of the robot 1.

[0024] According to the remote control system 100, the operator remotely operates the robot 1 via the operating device 4 to make the robot 1 perform a predetermined task. At this time, the camera 91 captures the image of the robot 1, and the display device 91 displays the captured image. The operator operates the operating device 4 while confirming the image of the robot 1 displayed on the display device 92. In addition, when the robot 1 contacts an object, the operator is informed of the contact of the robot 1 via the tactile prompter 8. The operator remotely operates the robot 1 via the operating device 4 while accurately recognizing the occurrence of the contact of the robot 1.

[0025] It should be noted that the work performed by the robot 1 does not include teaching work and teaching confirmation and correction work. Therefore, the operating device 4 does not include a teaching pendant.

[0026] [robot]

[0027] The robot 1 is an industrial robot. The robot 1 has a robot arm 11 and a hand 2. The hand 2 is provided with fingers 22 for opening and closing and is connected to the robot arm 11. A robot coordinate system of three orthogonal axes is defined in the robot 1. For example, a Z axis is set in the vertical direction, and an X axis and a Y axis are set in the horizontal direction to be orthogonal to each other.

[0028] The robot arm 11 changes the position and posture of the hand 2. The robot arm 11 is a vertical multi-joint robot arm. The robot arm 11 has a plurality of links 12, joints 13, and servo motors 14 (see Figure 4 ) and encoder 31 (refer to Figure 4 ), the joint 13 connects a plurality of connecting rods 12, the servo motor 14 rotationally drives the plurality of joints 13, and the encoder 31 detects the rotation position of the servo motor 14. For example, the connecting rod 12 at one end of the robot arm 11 is rotatably connected to the base 10 around a rotation axis extending in a vertical direction via the joint 13. It should be noted that the robot arm 11 can also be a horizontal multi-joint robot arm, a parallel link robot arm, a rectangular coordinate robot arm, a polar coordinate robot arm, etc.

[0029] The hand 2 is the end effector of the robot arm 11. The hand 2 is connected to the front end of the robot arm 11. Specifically, the hand 2 is connected to the end of the link 12 on the opposite side of the link 12 connected to the base 10 among the plurality of links 12. The hand 2 can be in various postures by the movement of the robot arm 11.

[0030] Figure 2It is a schematic front view of the hand 2. The hand 2 has a hand body 21 and two fingers 22, and the two fingers 22 are provided on the hand body 21. The hand body 21 is rotatably connected to the connecting rod 12 of the robot arm 11 around a predetermined rotation axis A. The two fingers 22 are arranged in a row in a predetermined opening and closing direction B. Specifically, the two fingers 22 are symmetrically arranged with respect to a center axis that is approximately orthogonal to the opening and closing direction B. In this example, the center axis coincides with the rotation axis A. Hereinafter, the rotation axis A is also referred to as the "center axis A". The two fingers 22 perform an opening and closing action in the opening and closing direction B. The fingers 22 extend in a direction intersecting the opening and closing direction B. Specifically, the fingers 22 extend approximately parallel to the center axis A. The hand 2 also has a servo motor 23 and an encoder 32, wherein the servo motor 23 causes the two fingers 22 to perform an opening and closing action, and the encoder 32 detects the rotation position of the servo motor 23.

[0031] The robot 1 has a contact force sensor 33, which detects the contact force acting on the robot 1 from the outside. Figure 2 As shown, the contact force sensor 33 is provided in the hand 2. Specifically, the contact force sensor 33 is provided in the connection portion of the hand 2 with the robot arm 11. It should be noted that the position of the contact force sensor 33 is not limited thereto. The contact force sensor 33 can be configured at any place where the contact force acting on the robot 1 from the outside can be detected. The contact force sensor 33 detects the force in the direction of the central axis A of at least two fingers 22, that is, the direction of the rotation axis A of the hand 2 with respect to the connecting rod 12. The direction of the central axis A is usually the direction of movement when the hand 2 holds the workpiece. In this example, the contact force sensor 33 is a so-called force sensor. More specifically, the contact force sensor 33 is a force sensor that detects forces in three orthogonal axes including the direction of the central axis A of the finger 22 and torques around the three axes.

[0032] The operating device 4 includes an operating portion 41, the operating portion 41 is operated by the operator, and an operating force sensor 42 that detects an operating force applied to the operating portion 41 by the operator. The operating device 4 receives an input for operating the robot 1 by manual operation, and outputs the input information, i.e., operating information, to the control device 5. Specifically, the operator holds the operating portion 41 and operates the operating device 4. The operating force sensor 42 detects the force applied to the operating portion 41 at that time. The operating force detected by the operating force sensor 42 is output to the control device 5 as operating information.

[0033] The operating device 4 may also include a base 40 and a support mechanism 43, wherein the support mechanism 43 is provided on the base 40 and supports the operating unit 41. An operating coordinate system of three orthogonal axes is defined in the operating device 4. The operating coordinate system corresponds to the robot coordinate system. That is, a Z axis is set in the vertical direction, and an X axis and a Y axis that are orthogonal to each other are set in the horizontal direction.

[0034] The support mechanism 43 includes a plurality of links 44, a joint 45, and a servo motor 46 (see Figure 4 ) and encoder 47 (refer to Figure 4 ), the joint 45 connects the plurality of connecting rods 44, the servo motor 46 rotationally drives the plurality of joints 45, and the encoder 47 detects the rotation position of the servo motor 46. The support mechanism 43 supports the operating unit 41 in such a manner that the operating unit 41 can be in any position and posture in a three-dimensional space. The servo motor 46 rotates according to the position and posture of the operating unit 41. The rotation amount, that is, the rotation angle of the servo motor 46 is uniquely determined.

[0035] In this example, the operation force sensor 42 is provided between the operation portion 41 and the support mechanism 43 (specifically, the connection portion between the operation portion 41 and the support mechanism 43). In this example, the operation force sensor 42 is a so-called force sensor. More specifically, the operation force sensor 42 is a force sensor that detects forces in three orthogonal axial directions and moments around the three axes.

[0036] It should be noted that the operating force detection unit is not limited to the operating force sensor 42. For example, the operating force sensor 42 may detect only the force in a single axis, a double axis, or a triaxial direction. Alternatively, the detection unit may be a current sensor for detecting the current of the servo motor 46 of the support mechanism 43 or a torque sensor for detecting the torque of the servo motor 46.

[0037] [Tactile prompter]

[0038] Figure 3 It is a schematic side view of the operating part 41. The tactile prompter 8 prompts the occurrence of contact of the robot 1 with the object by giving stimulation to the operator's tactile sense. In this example, the tactile prompter 8 is provided on the operating device 4. The operating part 41 has a gripping part 41a held by the operator. The tactile prompter 8 is provided on the operating part 41. The tactile prompter 8 is formed into a grippable shape such as a stick. The tactile prompter 8 is arranged in a row with the gripping part 41a so as to be gripped by the operator together with the gripping part 41a. Specifically, from the perspective of the operator, the gripping part 41a is on the front side and the tactile prompter 8 is on the back side, that is, the gripping part 41a is arranged at the rear and the tactile prompter 8 is arranged at the front.

[0039] The tactile prompter 8 has a rod-shaped body 80 and a vibration actuator 81, which is provided on the body 80 and generates vibration. For example, the vibration actuator 81 is a voice coil motor. The tactile prompter 81 imparts stimulation to the operator's sense of touch through the vibration of the vibration actuator 81. The vibration actuator 81 is an example of a vibration source.

[0040] The vibration actuator 81 includes a first vibration actuator 82 and a second vibration actuator 83. The first vibration actuator 82 and the second vibration actuator 83 are arranged at different positions of the main body 80. Specifically, the first vibration actuator 82 is arranged at a portion of the main body 80 on the opposite side of the gripping portion 41a, that is, the portion of the main body 80 farthest from the gripping portion 41a. The second vibration actuator 83 is arranged at a position in the main body 80 that is approximately 90 degrees different from the first vibration actuator 82 in the circumferential direction centered on the axis of the main body 80.

[0041] By arranging the first vibration actuator 82 and the second vibration actuator 83 at different positions from each other, the vibration of the first vibration actuator 82 and the vibration of the second vibration actuator 83 can be presented to the operator in a distinguishable manner.

[0042] In addition, the tactile prompter 8 can change the vibration mode. The vibration mode includes vibration, frequency, and repetition period or rhythm, etc. For example, the tactile prompter 8 can adjust the amplitude, that is, the size of the vibration, by adjusting the current applied to the vibration actuator 81. The tactile prompter 8 can adjust the size of the vibration in two stages. The tactile prompter 8 can selectively generate a first vibration with a smaller vibration and a second vibration greater than the first vibration. The first vibration and the second vibration can be either continuous vibrations or intermittent vibrations. The vibration modes of the first vibration and the second vibration other than the amplitude can be unified or different from each other. It should be noted that the tactile prompter 8 can also adjust the frequency of the vibration in addition to the amplitude, or can also adjust the frequency of the vibration instead of the amplitude.

[0043] [Control device]

[0044] The robot 1, the contact force sensor 33, the operating device 4, the camera 91, the display device 92, and the tactile prompter 8 are connected to the control device 5. The control device 5 controls the entire remote control system 100 and performs motion control of the robot 1 and the operating device 4. Specifically, the control device 5 performs master-slave control between the robot 1 and the operating device 4, and specifically, the control device 5 performs bilateral control between the robot 1 and the operating device 4. The control device 5 performs a first control and a second control. In the first control, the motion of the robot 1 is controlled in response to the motion of the operating device 4 caused by the operator's operation, and in the second control, the motion of the operating device 4 is controlled to prompt the operator with the reaction force in response to the detection result of the contact force sensor 33. For example, the robot 1 is caused to perform a task by the first control, and the reaction force during the task is prompted to the operator via the operating device 4 by the second control.

[0045] Figure 4 1 is a diagram showing a schematic hardware structure of the control device 5. The control device 5 includes a main control device 50, an operation control device 6, and a robot control device 7. The main control device 50 sends and receives information, commands, and data to and from the operation control device 6 and the robot control device 7. The operation control device 6 controls the entire operation device 4. The robot control device 7 controls the entire robot 1.

[0046] In the first control, the operation control device 6 receives the detection signal of the operation force sensor 42 and outputs the detection signal to the main control device 50. The main control device 50 generates a command based on the detection signal from the operation control device 6 and outputs the generated command to the robot control device 7. The robot control device 7 controls the servo motor 14 or the servo motor 23 based on the command from the main control device 50 to operate the robot 1. The robot control device 7 receives a signal from the encoder 31 or the encoder 32 and performs feedback control on the servo motor 14 or the servo motor 23.

[0047] In the second control, the robot control device 7 receives the detection signal of the contact force sensor 33 and outputs the detection signal to the main control device 50. The main control device 50 generates a command based on the detection signal from the robot control device 7 and outputs the generated command to the operation control device 6. The operation control device 6 controls the servo motor 46 based on the command from the main control device 50 to operate the support mechanism 43 so that the operator can feel the reaction force. The operation control device 6 receives a signal from the encoder 47 and performs feedback control on the servo motor 46.

[0048] In parallel with the control of the robot 1 and the operating device 4, the main control device 50 controls the tactile prompter 8 in response to the status of the robot 1. Specifically, the main control device 50 determines the occurrence of contact of the robot 1 with another object based on the detection signal of the contact force sensor 33, and prompts the occurrence of the contact of the robot 1 to the tactile sense of the operator via the tactile sensor 8. In addition, the main control device 50 sends the captured image from the camera 91 to the display device 92.

[0049] In this way, the control device 5 executes the control of the robot 1 and the operating device 4 , the presentation of the captured image, and the control of the tactile presenter 8 in parallel.

[0050] The main control device 50 has a control unit 51, a storage unit 52, and a memory 53. The operation control device 6 has a control unit 61, a storage unit 62, and a memory 63. The robot control device 7 has a control unit 71, a storage unit 72, and a memory 73.

[0051] The control unit 51 controls the entire main control device 50. The control unit 61 controls the entire operation control device 6. The control unit 71 controls the entire robot control device 7. The control unit 51, the control unit 61, and the control unit 71 perform various calculations, respectively. For example, each of the control unit 51, the control unit 61, and the control unit 71 is formed by a processor such as a CPU (central processing unit). Each of the control unit 51, the control unit 61, and the control unit 71 can also be formed by an MCU (microcontroller unit), an MPU (microprocessor unit), an FPGA (field programmable gate array), a PLC (programmable logic controller), a system LSI, etc.

[0052] The storage unit 52 stores programs and various data executed by the control unit 51. The storage unit 62 stores programs and various data executed by the control unit 61. The storage unit 72 stores programs and various data executed by the control unit 71. Specifically, the storage unit 52 stores a remote control program 52a. Each of the storage unit 52, the storage unit 62, and the storage unit 72 is formed with a nonvolatile memory, an HDD (hard disk drive), an SSD (solid state drive), or the like.

[0053] The memory 53, the memory 63, and the memory 73 each temporarily stores data, etc. For example, each of the memory 53, the memory 63, and the memory 73 is formed of a volatile memory.

[0054] Figure 5 6 is a functional block diagram of the control device 5. The control unit 61 of the operation control device 6 realizes various functions by reading and developing programs from the storage unit 62 into the memory 63. Specifically, the control unit 61 functions as an input processing unit 64 and an operation control unit 65.

[0055] The input processing unit 64 outputs information, data, and commands received from the operation force sensor 42 to the main control device 50. Specifically, the input processing unit 64 receives detection signals of the six-axis forces from the operation force sensor 42, and outputs the detection signals to the main control device 50. In addition, the input processing unit 64 receives detection signals of the encoder 47 from the servo motor 46. The input processing unit 64 outputs the detection signals to the motion control unit 65 for feedback control of the support mechanism 43 by the motion control unit 65.

[0056] The motion control unit 65 receives the command position xdm from the main control device 50, and generates a control command for moving the support mechanism 43 according to the command position xdm. The motion control unit 65 outputs the control command to the servo motor 46 to move the support mechanism 43 and move the operating unit 41 to a position corresponding to the command position. At this time, the motion control unit 65 performs feedback control on the movement of the support mechanism 43 based on the detection signal of the encoder 47 from the input processing unit 64. In this way, a reaction force is provided to the operating force applied to the operating unit 41 by the operator. As a result, the operator can operate the operating unit 41 while seemingly feeling the reaction force received by the robot 1 from the operating unit 41.

[0057] The control unit 71 of the robot control device 7 realizes various functions by reading and developing a program from the storage unit 72 into the memory 73 . Specifically, the control unit 71 functions as an input processing unit 74 and an operation control unit 75 .

[0058] The input processing unit 74 outputs information, data, and commands received from the encoder 31, the encoder 32, and the contact force sensor 33 to the main control device 50. Specifically, the input processing unit 74 receives a detection signal of the force of six axes (hereinafter referred to as a "sensor signal") from the contact force sensor 33, and outputs the sensor signal to the main control device 50. In addition, the output processing unit 74 receives the detection signal of the encoder 31 and the encoder 32. The input processing unit 74 outputs the detection signal to the motion control unit 75 for the feedback control of the robot arm 11 by the motion control unit 75. In addition, the input processing unit 74 outputs the detection signal to the main control device 50 as the position information of the robot arm 11.

[0059] The motion control unit 75 receives the command position xds from the main control device 50, and generates a control command for moving the robot arm 11 according to the command position xds. The motion control unit 75 outputs a control command to the servo motor 14 to move the robot arm 11 and move the hand 2 to a position corresponding to the command position. At this time, the motion control unit 75 performs feedback control on the movement of the robot arm 11 based on the detection signal from the encoder 31 of the input processing unit 74. In addition, the motion control unit 75 outputs a control command to the servo motor 23 of the hand 2 to open and close the finger 22.

[0060] The control unit 51 of the main control device 50 realizes various functions by reading and developing a program (specifically, a remote control program 52a) from the storage unit 52 into the memory 53. Specifically, the control unit 51 functions as an operation force acquisition unit 54, a contact force acquisition unit 55, an addition unit 56, a force / speed conversion unit 57, a first speed / position conversion unit 58, a second speed / position conversion unit 59, an image processing unit 510, and a prompt control unit 511.

[0061] The operation force acquisition unit 54 receives the detection signal of the contact force sensor 42 via the input processing unit 64 , and acquires the operation force fm based on the detection signal. The operation force acquisition unit 54 inputs the operation force fm to the adding unit 56 .

[0062] Contact force acquisition unit 55 receives the sensor signal of contact force sensor 33 via input processing unit 74 and acquires contact force fs based on the sensor signal. Contact force acquisition unit 55 inputs contact force fs to adder 56. In addition, contact force acquisition unit 55 outputs the sensor signal to presentation control unit 511.

[0063] The adding unit 56 calculates the sum of the operating force fm input from the operating force acquiring unit 54 and the contact force fs input from the contact force acquiring unit 55. Here, since the operating force fm and the contact force fs are forces in opposite directions, the positive and negative signs of the operating force fm and the contact force fs are different. The adding unit 56 outputs the sum of the operating force fm and the contact force fs, that is, the resultant force fm+fs, to the force / speed conversion unit 57.

[0064] The force / speed conversion unit 57 converts the input resultant force fm+fs into a command speed xd'. The force / speed conversion unit 57 calculates the command speed xd' using a motion model based on a motion equation including an inertia coefficient, a viscosity coefficient (damping coefficient), and a stiffness coefficient (spring coefficient). Specifically, the force / speed conversion unit 57 calculates the command speed xd' according to the following motion equation.

[0065] [Formula 1]

[0066] md·xd″+cd·xd′+kd·xd=fm+fs…(1)

[0067] Here, xd is the command position. md is the inertia coefficient. cd is the viscosity coefficient. kd is the stiffness coefficient. fm is the operating force. fs is the contact force. In addition, "'" indicates a single derivative, and """ indicates a double derivative.

[0068] Equation (1) is a linear differential equation. When equation (1) is solved for xd', equation (2) is obtained.

[0069] [Formula 2]

[0070] xd′=A…(2)

[0071] Here, A is an item represented by fm, fs, md, cd, kd, etc.

[0072] The equation (2) is stored in the storage unit 52. The force / speed conversion unit 57 reads the equation (2) from the storage unit 52 to obtain the command speed xd′, and outputs the obtained command speed xd′ to the first speed / position conversion unit 58 and the second speed / position conversion unit 59.

[0073] The first speed / position conversion unit 58 converts the command speed xd' after coordinate conversion into the command position xds for the robot 1, using the robot coordinate system as a reference. For example, when there is a ratio of the movement amount of the robot 1 to the movement amount of the operating device 4, the first speed / position conversion unit 58 multiplies the command position xd obtained from the command speed xd' according to the movement ratio to obtain the command position xds. The first speed / position conversion unit 58 outputs the obtained command position xds to the robot control device 7, specifically, to the motion control unit 75. As described above, the motion control unit 75 causes the robot arm 11 to move according to the command position xds.

[0074] The second speed / position conversion unit 59 converts the command speed xd' into a command position xdm for the operating device 4 based on the operation coordinate system. The second speed / position conversion unit 59 outputs the obtained command position xdm to the operation control device 6, specifically, to the motion control unit 65. As described above, the motion control unit 65 operates the support mechanism 43 according to the command position xdm.

[0075] The image processing unit 510 transmits the captured image received from the imaging device 91, that is, the image signal, to the display device 92. At this time, the image processing unit 510 may perform predetermined image processing on the captured image.

[0076] The prompt control unit 511 performs prompt control, in which when the robot 1 contacts an object, the occurrence of contact is notified to the operator via the tactile prompter 8. The prompt control unit 511 determines the occurrence of contact by the robot 1 based on the contact force detected by the contact force sensor 33. The prompt control unit 511 performs prompt control when the contact force detected by the contact force sensor 33 is below a prescribed upper limit value, and stops prompt control when the contact force detected by the contact force sensor 33 exceeds the upper limit value. It should be noted that force control is performed even in a range exceeding the upper limit value.

[0077] Specifically, when the contact force is greater than the noise level and below the upper limit, the prompt control unit 511 outputs the action signal of the vibration actuator 81 to the tactile prompter 8. On the other hand, when the contact force is greater than the upper limit, the prompt control unit 511 does not output the action signal of the vibration actuator 81. The action signal is a signal that causes the vibration actuator 81 to act. For example, when the vibration actuator 81 is a voice coil motor, the action signal is a current provided to the voice coil motor. In addition, the prompt control unit 511 distinguishes between the first action signal and the second action signal used as the action signal in response to the size of the contact force. Specifically, the prompt control unit 511 outputs the first action signal when the contact force is below the threshold, and outputs the second action signal when the contact force is greater than the threshold and below the upper limit. The threshold is a value less than the upper limit. The first action signal is a command to generate a smaller vibration. The second action signal is a command to generate a vibration larger than the vibration of the first action signal.

[0078] When the hand 2 holds the workpiece W, the prompt control unit 511 performs prompt control when the increase in contact force from when the workpiece W was held is less than an upper limit, and stops prompt control when the increase exceeds the upper limit.

[0079] Specifically, the prompt control unit 511 uses the contact force as a reference value when the contact force is approximately constant during a specified period, and compares the increase in the contact force from the reference value with the upper limit value. For example, when the change in the contact force during the specified time period traced back from this moment is below a specified amplitude, it may be determined that the contact force is approximately constant during the specified period. The latest contact force at that time is used as the reference value. Alternatively, when the change amplitude of the moving average of the contact force is below a specified amplitude, it may be determined that the contact force is approximately constant during the specified period. The moving average value at that time is used as the reference value. It should be noted that the determination of whether the contact force is approximately constant during a specified period is not limited to these.

[0080] For example, when the hand 2 holds the workpiece W, the gravity of the workpiece W is used as an external force on the robot 1, which may be detected as a contact force. As long as the workpiece W is held, the detection of the contact force continues. When the contact force at this time exceeds the upper limit, the prompt control is not performed. For example, when the robot arm 11, the hand 2 or the workpiece W contacts an object during the transportation of the workpiece W, and the robot 1 receives the contact force, the occurrence of such contact is not prompted to the operator. When the contact force is approximately constant, the occurrence of contact is determined by comparing the increase in the contact force with the upper limit, etc., not based on the absolute value of the contact force, but based on the change in the contact force. For example, when the robot 1 receives the contact force while holding the workpiece W with the hand 2, since the contact force starts to increase from a substantially constant state, the occurrence of contact by the robot 1 is prompted to the operator.

[0081] Furthermore, the prompt control unit 511 determines the contact direction of the robot 1 and operates the actuator corresponding to the direction of the contact force of the first vibration actuator 82 and the second vibration actuator 83. Specifically, the prompt control unit 511 operates the first vibration actuator 82 according to the contact force in the direction of the central axis A of the finger 22, and operates the second vibration actuator 83 according to the contact force in the direction orthogonal to the central axis A of the finger 22. As described above, the prompt control unit 511 compares each of the contact force in the direction of the central axis A of the finger 22 and the contact force in the direction orthogonal to the central axis A of the finger 22 with an upper limit value or a threshold value. Specifically, when the contact force in the direction of the central axis A of the finger 22 is greater than the noise level and is below the upper limit value, the prompt control unit 511 outputs the action signal of the first vibration actuator 82 to the tactile prompter 8. On the other hand, when the contact force in the direction of the central axis A of the finger 22 is greater than the upper limit value, the prompt control unit 511 does not output the action signal of the first vibration actuator 82. Furthermore, when the contact force of the finger 22 in the direction perpendicular to the central axis A is greater than the noise level and is below the upper limit, the prompt control unit 511 outputs the action signal of the second vibration actuator 83 to the tactile prompter 8. On the other hand, when the contact force of the finger 22 in the direction perpendicular to the central axis A is greater than the upper limit, the prompt control unit 511 does not output the action signal of the second vibration actuator 83. Furthermore, the prompt control unit 511 uses the first action signal and the second action signal differently for each of the first vibration actuator 82 and the second vibration actuator 83 according to the magnitude of the contact force.

[0082] In this way, when the prompt control unit 511 detects the contact of the robot 1 under a relatively small contact force, that is, a contact force below the upper limit value, the prompt control unit 511 operates the vibration actuator 81. On the other hand, when the contact force of the robot 1 is relatively large, that is, greater than the upper limit value, the prompt control unit 511 does not operate the vibration actuator 81. In other words, the prompt control unit 511 changes the magnitude of the vibration performed by the vibration actuator 81 in response to the magnitude of the contact force. In addition, the prompt control unit 511 uses the first vibration actuator 82 and the second vibration actuator 83 differently in response to the direction of the contact of the robot 1. In addition, when the contact force continues to be in a substantially constant state, the action of the vibration actuator 81 is determined by comparing the increase in the contact force with the upper limit value.

[0083] [Remote control system operation]

[0084] The remote control performed by the remote control system 100 will be described. Figure 6 1 is a flowchart showing the operation of the remote control system 100. Remote control is achieved by the control device 5 reading the remote control program 52a stored in the storage unit 52 into the memory 53 and developing it. During remote control, the image of the robot 1 captured by the camera device 91 is displayed on the display device 92. The user operates the operating device 4 while viewing the image of the robot 1 captured on the display device 92.

[0085] First, in step S101, when the operator operates the operating device 4, the operating force sensor 42 detects the operating force applied by the operator via the operating unit 41. The operating force detected by the operating force sensor 42 is input as a detection signal to the main control device 50 by the input processing unit 64. In the main control device 50, the operating force acquisition unit 54 inputs the operating force fm based on the detection signal to the adding unit 56.

[0086] When the contact force sensor 33 detects the contact force, the detected contact force is input as a sensor signal to the input processing unit 74. The sensor signal input to the input processing unit 74 is input to the main control device 50.

[0087] Next, in step S102, the main control device 50 operates the robot 1 in response to the operation via the operating device 4, and operates the operating device 4 in response to the contact force of the robot 1. Specifically, the adding unit 56 obtains the resultant force fm+fs from the input operating force fm and contact force fs, and inputs the resultant force fm+fs to the force / speed conversion unit 57. The force / speed conversion unit 57 uses the resultant force fm+fs to obtain the command speed xd' according to equation (2).

[0088] Regarding the robot 1, the first speed / position conversion unit 58 obtains the command position xds from the command speed xd'. The motion control unit 75 of the robot control device 7 operates the robot arm 11 according to the command position xds, and controls the position of the hand 2. In this way, the hand 2 moves in response to the operating force fm. Regarding the operating device 4, the second speed / position conversion unit 59 obtains the command position xdm from the command speed xd'. The motion control unit 65 of the operating control device 6 operates the support mechanism 43 according to the command position xdm, and controls the position of the operating part 41. In this way, the operator senses the reaction force in response to the contact force fs. Step S102 is equivalent to executing force control, in which the robot is operated in response to the operating force applied from the operator to the operating device and the operating device is operated in response to the reaction force received by the robot from the outside.

[0089] When the control unit 51 completes the processing of step S102, the control for one cycle is terminated. The control unit 51 repeats steps S101 and S102 in a predetermined control cycle. In this way, the robot 1 continuously moves in the second station S2 in response to the operation of the operating device 4 by the operator in the first station S1. At that time, the operator can operate the operating device 4 while sensing the reaction force received by the hand 2 from the outside through the operating device 4.

[0090] For example, Figure 1 As shown, when performing a transfer operation of transferring the workpiece W from the starting location P1 to the predetermined target location P2, first, the operator operates the robot arm 11 in such a manner that the hand 2 moves toward the starting location P1 of the workpiece W. Then, the operator causes the hand 2 to hold the workpiece W at the starting location P1. Next, the operator operates the robot arm 11 in such a manner that the workpiece W held by the hand 2 moves toward the target location P2. Finally, the operator releases the grip of the workpiece W by the hand 2 at the target location P2. Such a transfer operation is achieved by repeating the steps S101 and S102.

[0091] The remote control system 100 performs tactile prompting in parallel with such force control. Specifically, after the operator operates the operating device 4 in step S101, the prompt control unit 511 performs the processing of step S104 in parallel with step S102. In step S104, the prompt control unit 511 determines whether a contact force has been generated. At this time, the prompt control unit 511 subtracts the contact force of the reference value from the contact force actually detected by the contact force sensor 33 for determination. The subtraction of the reference value is a process for eliminating the influence of the contact force that is continuously generated, and is the so-called zero-point correction of the contact force. Since the initial value of the reference value is zero, the prompt control unit 511 uses the contact force actually detected by the contact force sensor 33 as it is after the remote control just starts, and determines the generation of the contact force. In addition, the prompt control unit 511 evaluates the contact force in the direction of the central axis A of the finger 22 (hereinafter referred to as "axial direction contact force") and the contact force of the finger 22 in the direction orthogonal to the central axis A (hereinafter referred to as "orthogonal contact force") respectively. That is, the presentation control unit 511 uses the value obtained by subtracting each reference value from the axial contact force and the orthogonal contact force to determine whether the axial contact force and the orthogonal contact force have occurred. The following determination and processing are also performed for each of the axial contact force and the orthogonal contact force.

[0092] When the contact force is greater than the noise level, the prompt control unit 511 determines that the contact force has been generated and enters step S105. When the contact force is below the noise level, the prompt control unit 511 determines that no contact force has been generated and ends the processing related to the tactile prompt in this cycle.

[0093] In step S105, the prompt control unit 511 determines whether the contact force is below the upper limit value. When the contact force is below the upper limit value, the prompt control unit 511 determines whether the contact force is below the threshold value in step S106. When the contact force is below the threshold value, the prompt control unit 511 outputs the first action signal to the tactile prompter 8 in step S107, and when the contact force is greater than the threshold value, the prompt control unit 511 outputs the second action signal to the tactile prompter 8 in step S108. Here, when the axial contact force meets the condition, the prompt control unit 511 outputs the first action signal or the second action signal to the first vibration actuator 82 of the tactile prompter 8. When the orthogonal contact force meets the condition, the prompt control unit 511 outputs the first action signal or the second action signal to the second vibration actuator 83 of the tactile prompter 8. Steps S107 and S108 are equivalent to prompting the operator of the occurrence of contact via the tactile prompter when the robot contacts the object.

[0094] On the other hand, in step S105, when the contact force is greater than the upper limit value, the prompt control unit 511 determines in step S109 whether the contact force is substantially constant during the prescribed period. For example, the prompt control unit 511 determines whether the change in the moving average value of the contact force during the prescribed period is within the prescribed determination range. When the change in the moving average value of the contact force is within the determination range, the prompt control unit 511 determines that the contact force is substantially constant during the prescribed period, and updates the reference value with the moving average value of the contact force at this moment in step S110. Then, the prompt control unit 511 performs the processing of step S104 again. In the second step S104, since the reference value is changed, the prompt control unit 511 determines the generation of the contact force based on the contact force obtained by subtracting the reference value from the contact force actually detected by the contact force sensor 33. That is, the prompt control unit 511 determines the generation of the contact force based on the increase in the contact force from the reference value. When the increase in the contact force from the reference value is below the noise level, the prompt control unit 511 determines that the contact force is not generated.

[0095] On the other hand, when the amount of increase in the contact force from the reference value is greater than the noise level, the prompt control unit 511 determines that the contact force has been generated. Then, the prompt control unit 511 performs the determination of steps S105 and S106 based on the amount of increase in the contact force from the reference value. However, when the prompt control unit 511 changes the reference value in step S110, the reference value is changed using the moving average value of the contact force detected by the contact force sensor 33, rather than the moving average value of the amount of increase in the contact force from the reference value.

[0096] In this way, the remote control system 100 performs force control and prompt control independently of each other. For example, when performing the transfer operation, first, the operator operates the operating device 4 to move the hand 2 to the starting position P1 of the workpiece W. At the starting position P1 of the workpiece W, the position of the hand 2 is adjusted so that the workpiece W is arranged between the two fingers 22.

[0097] At this time, it is possible that the finger 22 contacts the workpiece W or the surface on which the workpiece W is placed (hereinafter referred to as the "loading surface". When the finger 22 contacts the workpiece W, etc., the contact force sensor 33 detects the contact force. Since the reference value is zero at this time, the contact force detected by the contact force sensor 33 is used as is for the determination of step S104.

[0098] For example, when the finger 22 contacts the loading surface with a small contact force, and the contact force sensor 33 detects an axial contact force greater than the noise level and below the threshold, the prompt control unit 511 outputs a first action signal to the first vibration actuator 82 of the tactile prompter 8 (step S107). The first vibration actuator 82 generates a small vibration corresponding to the first action signal. When the operator learns that the finger 22 contacts the loading surface, he does not press the finger 22 excessively against the loading surface, and adjusts the position of the hand 2 to a position where the workpiece W can be held. At this time, when the pressure of the finger 22 against the loading surface becomes stronger, the contact force may be greater than the threshold and below the upper limit. At this time, the prompt control unit 511 outputs a second action signal to the first vibration actuator 82 of the tactile prompter 8 (step S108). The first vibration actuator 82 generates a larger vibration corresponding to the second action signal. By changing the size of the vibration, the operator is informed that the contact force of the finger 22 on the loading surface has increased. The operator adjusts the position of the hand 2 while paying attention to not increasing the contact force.

[0099] When the hand 2 completes the movement of the workpiece W to the starting position P1, the operator operates the operating device 4 to close the fingers 22 of the hand 2 so that the hand 2 holds the workpiece W. In such a holding process, almost no contact force is generated.

[0100] When the hand 2 ends holding the workpiece W, the operator operates the operating device 4 to move the hand 2 and the workpiece W to the target location P2. Since the weight of the workpiece W acts on the hand 2 when the workpiece W is transferred, the contact force sensor 33 detects the contact force through the posture of the hand 2, etc. The contact force caused by the weight of the workpiece W is compared with the threshold value and the upper limit value, and the tactile prompter 8 can be operated as needed. When the contact force caused by the weight of the workpiece W is greater than the upper limit value, the tactile prompt by the tactile prompter 8 is not performed.

[0101] When the contact force due to the weight of the workpiece W is greater than the upper limit and the contact force due to the weight of the workpiece W continues at a substantially constant value, the reference value of the contact force is changed (step S110). After the reference value is changed, in step S105 or S106, the increase in the contact force from the reference value is compared with the threshold value or the upper limit.

[0102] In this example, the workpiece W is moved from the side to the target location P2. At this time, other workpieces W are sometimes placed at the target location P2, and the workpiece W held by the hand 2 may be pushed in and inserted between multiple workpieces W. When the finger 22 or the workpiece W contacts the loading surface of the workpiece W, that is, the surface on which the workpiece W is placed or other workpieces W, the contact force detected by the contact force sensor 33 changes. At this time, when the increase in the contact force from the baseline value is greater than the noise level and is below the upper limit value, the prompt control unit 511 outputs a first action signal or a second action signal to the tactile prompter 8 (step S107 or S108). In the tactile prompter 8, the vibration actuator corresponding to the direction of the contact force vibrates. While the operator grasps the contact status of the hand 2 or the workpiece W, he adjusts the position of the workpiece W to a position where it can be inserted between multiple workpieces W.

[0103] When the workpiece W is in a position where it can be inserted, the operator operates the operating device 4 to push the workpiece W between multiple workpieces W. The hand 2 pushes the workpiece W in the direction of the center axis A of the finger 22. At this time, friction is generated on the workpiece W between multiple workpieces W or the loading surface of the workpiece W. The friction force during pushing can be detected by the contact force sensor 33 as an axial contact force. The contact force during pushing tends to be large and exceeds the upper limit value. At that time, no tactile prompt based on the contact force during pushing is performed. On the other hand, even if the contact force is large, force control is performed. The control unit 51 activates the operating device 4 in response to the contact force during pushing, and prompts the operator with the reaction force. While the operator feels the contact force, i.e., the friction force, generated on the workpiece W, he pushes the workpiece W to the target location P2.

[0104] When the workpiece W reaches the target location P2, the operator releases the grip of the workpiece W by the hand 2. When the grip of the workpiece W is released, the transfer operation is completed.

[0105] In this way, the control unit 51 performs force control and tactile prompting in parallel. That is, the control unit 51 operates the robot 1 in response to the operation of the operator's operating device 4, and at the same time operates the operating device 4 in response to the contact force detected by the contact force sensor 33 to prompt the operator with the reaction force. At that time, when the contact force is small, the control unit 51 notifies the operator of the occurrence of contact of the robot 1 by operating the tactile prompter 8.

[0106] Force control can be performed even within the range of the contact force that is the object of tactile prompt. Therefore, the occurrence of contact by the robot 1 can also be notified to the operator through the reaction force prompt via the operating device 4. However, in force control, the action of the robot 1 such as applying force to the workpiece W is assumed. The contact of the robot 1 as an operation such as intentionally pressing the workpiece W is larger than the accidental contact of the robot 1 with other objects. The control system of force control is designed to obtain initial responsiveness or stability for larger values ​​and a wider range of contact forces. Therefore, in force control, it is likely that the accidental contact of the robot 1 with other objects cannot be properly prompted to the operator as a reaction force. In addition, even if the reaction force of the operation is a little large, it is only that the resistance during the operation becomes slightly larger, and it is difficult for the operator to know the change.

[0107] In contrast, the control unit 51 performs tactile prompts in addition to prompts for the reaction force of force control. In this way, even with a relatively small contact force, the operator can be accurately notified of the occurrence of contact by the robot 1. Furthermore, the control unit 51 performs tactile prompts independently of force control. In other words, tactile prompts are performed without affecting force control. The range, responsiveness, and stability of the contact force that is the object of force control are not affected by the tactile prompts. Conversely, the tactile prompts are also not affected by force control. Therefore, the control system for the tactile prompts can be designed with a focus on smaller contact forces that are the object. In other words, the tactile prompts can appropriately provide tactile prompts to the operator regarding smaller contact forces that are the object.

[0108] Furthermore, since the tactile prompt indicates the contact of the robot 1 through vibration, it is easier for the operator to perceive it than the reaction force of the operation. Furthermore, the magnitude of the vibration of the tactile prompter 8 is not proportional to the magnitude of the contact force of the robot 1, but is set in stages relative to the magnitude of the contact force. When the contact force becomes smaller, the magnitude of the vibration does not decrease proportionally. Even a smaller contact force is prompted to the operator as a vibration of a certain magnitude. Therefore, the contact of the robot 1 under a smaller contact force can also be accurately conveyed to the operator.

[0109] Furthermore, the tactile prompt can also convey the magnitude of the contact force to the operator by increasing the magnitude of the vibration in stages in response to the magnitude of the contact force.

[0110] In addition, the direction of the contact force can be communicated to the operator by changing the vibration mode of the tactile indicator 8 in response to the direction of the contact force. In this example, as the vibration mode, the vibrating portion of the tactile indicator 8 is changed in response to the direction of the contact force.

[0111] As such, the remote control system 100 involved in the first aspect of the present invention includes an operating device 4, a robot 1, a tactile prompter 8 and a control device 5, wherein the operating device 4 is operated by an operator, the robot 1 moves in response to the operation to the operating device 4, the tactile prompter 8 prompts the prompter of the robot 1's contact with the object, and the control device 5 performs force control and prompt control. In the force control, the robot 1 moves in response to the operating force applied from the operator to the operating device 4 and the operating device 4 moves in response to the reaction force received by the robot 1 from the outside. In the prompt control, when the robot 1 contacts the object, the contact is prompted to the operator via the tactile prompter 8.

[0112] According to this structure, force control is performed in which the robot 1 moves via the operating device 4, and the operating device 4 moves in response to the reaction force received by the robot 1. In addition, the generation of contact of the robot 1 to another object is notified to the operator via the tactile prompter 8. Since the generation of contact of the robot 1 is notified to the operator via the tactile prompter 8 in addition to the reaction force prompt to the operating device 4, the operator can accurately know the generation of contact of the robot 1.

[0113] Furthermore, regarding the second aspect of the present invention, in the remote control system 100 according to the first aspect, the control device 5 executes the force control and the prompt control independently of each other.

[0114] According to this configuration, the hint control can be implemented separately from the force control, that is, the hint control can be implemented without affecting the force control. As a result, both the force control and the hint control can be appropriately executed.

[0115] Furthermore, with regard to the third aspect of the present invention, in the remote control system 100 involved in the first aspect or the second aspect, the robot 1 has a contact force sensor 33, and the contact force sensor 33 detects the contact force acting on the robot 1 from the outside, and the control device 5 uses the contact force detected by the contact force sensor 33 for force control, and at the same time determines the occurrence of contact of the robot 1 according to the contact force detected by the contact force sensor 33 in the prompt control.

[0116] According to this configuration, the contact force detected by the contact force sensor 33 of the robot 1 is used for both force control and prompt control. By sharing the contact force sensor 33, the number of parts can be reduced.

[0117] Regarding the fourth aspect of the present invention, in the remote control system 100 involved in the third aspect, the control device 5 performs prompt control when the contact force detected by the contact force sensor 33 is below a specified upper limit value, and stops the prompt control when the contact force detected by the contact force sensor 33 exceeds the upper limit value.

[0118] According to this structure, the prompt control is executed when the contact force is small, and is not executed when the contact force is large. Small contact forces are difficult to convey to the operator by the reaction force prompt performed by force control. In other words, the contact under the small contact force that is difficult to convey to the operator by the reaction force prompt can be properly conveyed to the operator.

[0119] Furthermore, regarding the fifth aspect of the present invention, in the remote control system 100 according to the fourth aspect, the control device 5 performs the force control within a range where the contact force detected by the contact force sensor 33 exceeds an upper limit value.

[0120] According to this structure, force control can be performed when a large contact force is generated. That is, the range of contact force as the object of force control is expanded toward the side with large contact force compared with the range of contact force as the object of prompt control. When the contact force is large, since the reaction force prompted by force control also becomes large, it is easier for the operator to know that contact has occurred. At this time, since the prompt control is stopped, it is possible to prevent the prompt control from affecting the force control. That is, the operator can appropriately perceive the reaction force via the operating device 4.

[0121] Regarding the sixth aspect of the present invention, in the remote control system 100 involved in the fourth aspect or the fifth aspect, the robot 1 has a hand 2 for holding the workpiece W, and the control device 5 uses the contact force caused by the grip of the workpiece W as a reference value when the hand 2 grips the workpiece W, and performs prompt control when the increase in the contact force detected by the contact force sensor 33 from the reference value is below the upper limit value, and stops the prompt control when the increase in the contact force detected by the contact force sensor 33 from the reference value exceeds the upper limit value.

[0122] According to this structure, even when the contact force of the robot 1 is generated in the state where the hand 2 holds the workpiece W, the generation of the contact can be appropriately communicated to the operator. In detail, when the hand 2 holds the workpiece W, the contact force caused by the holding of the workpiece W continuously acts on the robot 1. The contact force caused by the holding of the workpiece W is used as a reference value, and the prompt control is performed according to the contact force of the increase amount from the reference value. In this way, the generation of the contact of the robot 1 can be communicated to the operator based on the state where the hand 2 holds the workpiece W as a reference.

[0123] Furthermore, regarding the seventh aspect of the present invention, in the remote control system 100 according to any one of the first to sixth aspects, the tactile prompter 8 prompts the robot 1 to contact the object by giving stimulation to the operator's tactile sense.

[0124] According to this configuration, the operator can more easily know that the contact of the robot 1 has occurred than when the contact of the robot 1 is presented by the reaction force via the operating device 4 .

[0125] Regarding the eighth aspect of the present invention, in the remote control system 100 involved in the seventh aspect, the tactile prompter 8 has a vibration actuator 81 (vibration source), and the vibration actuator 81 (vibration source) generates vibration, and the control device 5 causes the tactile prompter 8 to vibrate when the robot 1 contacts an object during the prompt control.

[0126] According to this structure, the operator is informed of the occurrence of contact with the robot 1 by the vibration of the tactile indicator 8. The operator can more easily sense the vibration than the reaction force of the operation of the operating device 4. In other words, the operator can more easily know the occurrence of contact with the robot 1. Moreover, even when the reaction force is prompted to the operating device 4 by force control, the operator can more easily know the occurrence of contact with the robot 1 by the vibration of the tactile indicator 8.

[0127] The ninth aspect of the present invention involves a remote control method for controlling a robot 1 via an operating device 4, including the steps of executing force control and notifying an operator of the occurrence of contact via a tactile prompter 8 when the robot 1 contacts an object. In the force control, the robot 1 is moved in response to an operating force applied from the operator to the operating device 4, and the operating device 4 is moved in response to a reaction force received by the robot 1 from the outside.

[0128] The remote control program involved in the tenth aspect of the present invention is a remote control program for causing the control unit 51 (computer) to realize the function of controlling the remote control system 100, the remote control system 100 including an operating device 4 and a robot 1, the operating device 4 being operated by an operator, and the robot 1 acting in response to the operation on the operating device 4. The remote control program is used to cause the control unit 51 to realize the function of executing force control in which the robot 1 acts in response to the operating force applied from the operator to the operating device 4 and the operating device 4 acts in response to the reaction force received by the robot 1 from the outside, and the function of notifying the operator of the occurrence of the contact via the tactile prompter 8 when the robot 1 contacts an object.

[0129] According to the structure of the ninth or tenth aspect, force control is performed in which the robot 1 is moved via the operating device 4 and the operating device 4 is moved in response to the reaction force received by the robot 1. In addition, the generation of contact of the robot 1 to another object is notified to the operator via the tactile prompter 8. Since the generation of contact of the robot 1 is notified to the operator via the tactile prompter 8 in addition to the reaction force notification to the operating device 4, the operator can accurately know the generation of contact of the robot 1.

[0130] (Other Embodiments)

[0131] As described above, the embodiments are described as examples of the technology invented in this application. However, the technology of the present invention is not limited thereto, and can also be applied to embodiments that have been appropriately changed, replaced, added, omitted, etc. Furthermore, the various constituent elements described in the embodiments can also be combined as new embodiments. Furthermore, the constituent elements recorded in the drawings and detailed descriptions include not only the constituent elements necessary to solve the problem, but also constituent elements that are not necessary to solve the problem in order to exemplify the technology. Therefore, it should not be immediately assumed that those non-essential constituent elements are necessary just because they are recorded in the drawings and detailed descriptions.

[0132] The structure of the remote control system 100 is just an example and is not limited thereto. For example, the operation performed by the robot 1 is not limited to the transfer operation. The operation performed by the robot 1 may also be a processing operation. Furthermore, the end effector of the robot arm 11 is not limited to the hand 2. The end effector may be changed in response to the operation performed by the robot 1.

[0133] Furthermore, the robot 1 is not limited to an industrial robot. For example, the robot 1 may be a medical robot. Furthermore, the robot 1 may be a mobile manipulator or a humanoid robot.

[0134] The contact force sensor 33 for detecting the contact force acting on the robot 1 from the outside is not limited to a force sensor. For example, the contact force sensor may be an encoder 31, a current sensor for detecting the current of the servo motor 14 of the robot arm 11, or a torque sensor for detecting the torque of the servo motor 14. The contact force acting on the robot 1 from the outside can be obtained based on the deviation between the current rotation position and the target rotation position of the servo motor 14, the deviation between the current value and the target value, or the deviation between the current value and the target value of the torque.

[0135] The tactile prompter 8 is not limited to the structure described above. The tactile prompter 8 can be worn on the user in any manner as long as it can provide stimulation to the user's sense of touch. For example, the tactile prompter 8 can also be formed as one piece with the gripping portion 41a. In other words, the vibration actuator 81 can also be built into the gripping portion 41a. It should be noted that since the operating device 4 is not limited to the structure described above, the structure of the tactile prompter 8 can also be changed in response to the structure of the operating device 4.

[0136] Alternatively, the tactile prompter 8 may not be integrated with the operating device 4. For example, the tactile prompter 8 may not be worn by the operator. Specifically, the tactile prompter 8 may be a wristband with a built-in vibration actuator 81 and worn on the wrist of the operator.

[0137] Furthermore, the vibration source of the tactile prompter 8 is not limited to the voice coil motor, and the vibration source may be an eccentric rotating mass type or a piezoelectric type.

[0138] The number of the vibration actuators 81 of the tactile prompter 8 is not limited to two. The number of the vibration actuators 81 may be one or more than three. The type of the contact of the robot 1 may be notified to the user by changing the combination of the plurality of vibration actuators in response to various contacts of the robot 1. For example, the type of the contact of the robot 1 may be notified to the user in a discriminable manner by using the technology of phantom tactile sensation.

[0139] The vibration of each vibration actuator 81 is not limited to the first vibration and the second vibration. The vibration of each vibration actuator 81 may be only one type or three or more types.

[0140] The above block diagram is an example, and multiple blocks may be implemented as one block, one block may be divided into multiple blocks, or part of the functions may be transferred to other blocks.

[0141] The technology of the present invention may be a non-transitory computer-readable recording medium recording the remote control program 52a. Furthermore, the remote control program 52a may be a program that can be distributed via a transmission medium such as the Internet.

[0142] The flowchart is just an example. The steps in the flowchart may be appropriately changed, replaced, added, omitted, etc. Furthermore, the order of the steps in the flowchart may be changed, or serial processing may be performed in parallel.

[0143] The functions implemented by the components described in this specification may also be implemented in a circuit or processing circuitry that includes a general-purpose processor, a special-purpose processor, an integrated circuit, an ASIC (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), a conventional circuit, and / or a combination thereof that is programmed to implement the described functions. The processor includes transistors and other circuits and is considered a circuit or processing circuit. The processor may also be a programmable processor that executes a program stored in a memory.

[0144] In this specification, a circuit, unit or device is hardware programmed or executed to implement the described functions. The hardware may also be various hardware disclosed in this specification or various hardware that is well known as programmed or executed hardware to implement the described functions.

[0145] When the hardware is a processor of a type regarded as a circuit, the circuit, device or unit is a combination of hardware and software used to constitute the hardware and / or processor.

Claims

1. A remote control system, characterized in that: The remote control system includes an operating device, a robot, a tactile prompter and a control device. The operating device is operated by an operator, the robot moves in response to the operation of the operating device, the tactile prompter prompts the operator of the robot's contact with an object, and the control device performs force control and prompt control. In the force control, the robot moves in response to the operating force applied from the operator to the operating device and moves in response to the reaction force received by the robot from the outside. In the prompt control, when the robot contacts the object, the contact is prompted to the operator via the tactile prompter.

2. The remote control system according to claim 1, characterized in that: The control device performs the force control and the prompt control independently of each other.

3. The remote control system according to claim 1 or 2, characterized in that: The robot has a contact force sensor, which detects a contact force acting on the robot from the outside. The control device uses the contact force detected by the contact force sensor for the force control, and determines the occurrence of contact by the robot according to the contact force detected by the contact force sensor in the prompt control.

4. The remote control system according to claim 3, characterized in that: The control device executes the presentation control when the contact force detected by the contact force sensor is equal to or less than a predetermined upper limit value, and stops the presentation control when the contact force detected by the contact force sensor exceeds the upper limit value.

5. The remote control system according to claim 4, characterized in that: The control device performs the force control in a range in which the contact force detected by the contact force sensor exceeds the upper limit value.

6. The remote control system according to claim 4, characterized in that: The robot has a hand that holds a workpiece, When the hand holds the workpiece, the control device uses the contact force caused by holding the workpiece as a reference value, executes the prompt control when the increase in the contact force detected by the contact force sensor from the reference value is below the upper limit value, and stops the prompt control when the increase in the contact force detected by the contact force sensor from the reference value exceeds the upper limit value.

7. The remote control system according to claim 1, characterized in that: The tactile prompter provides stimulation to the operator's tactile sense to prompt the robot to make contact with the object.

8. The remote control system according to claim 7, characterized in that: The tactile prompter has a vibration source that generates vibration. The control device causes the tactile prompter to vibrate when the robot contacts an object during the prompt control.

9. A remote control method for controlling a robot via an operating device, characterized in that: The remote control method includes the steps of performing force control, in which the robot is moved in response to an operating force applied from the operator to the operating device and the operating device is moved in response to a reaction force received by the robot from the outside, and notifying an operator of the occurrence of contact via a tactile prompter when the robot contacts an object.

10. A remote control program for enabling a computer to realize a function of controlling a remote control system, wherein the remote control system comprises an operating device and a robot, wherein the operating device is operated by an operator, and the robot performs an action in response to an operation on the operating device, wherein: The remote control program is used to enable the computer to implement the functions of executing force control and notifying the operator of the occurrence of contact via a tactile prompter when the robot contacts an object. In the force control, the robot is moved in response to the operating force applied from the operator to the operating device and the operating device is moved in response to the reaction force received by the robot from the outside.

Citation Information

Patent Citations

  • Robot control system

    JP2020131411A