A teaching device that sets teaching points using a teaching tool or the operator's hands

The teaching device employs a three-dimensional sensor and processing unit to efficiently set teaching points for robot devices, addressing the time-consuming and spatial challenges of conventional methods.

JP7614326B2Active Publication Date: 2025-01-15FANUC LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2023505554
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-03-11
Filing Date
2022-03-07
Publication Date
2025-01-15
Estimated Expiration
2042-03-07

AI Technical Summary

Technical Problem

The conventional method of setting teaching points for robot devices is time-consuming, especially when many points are required, and it is difficult to confirm the position and orientation of the work tool in confined or narrow spaces, such as processing chambers.

Method used

A teaching device that uses a three-dimensional sensor to capture images of a teaching tool or the operator's hand, processing device to detect features, and a processing unit to generate commands for adjusting the robot's position and orientation based on an auxiliary coordinate system, allowing for efficient setting of teaching points.

Benefits of technology

Enables rapid setting of teaching points, even in challenging environments, reducing the time required for programming robot devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007614326000001
    Figure 0007614326000001
  • Figure 0007614326000002
    Figure 0007614326000002
  • Figure 0007614326000003
    Figure 0007614326000003
Patent Text Reader

Abstract

A robot control device is provided with a camera which images a teaching tool which includes a characteristic area, and a characteristic position detection unit which detects the position of the characteristic area. The robot control device includes a movement instruction generating unit which, when an operator has moved the teaching tool, changes the position and orientation of the robot such that the camera follows the characteristic area. The robot control device includes a calculation unit which, on the basis of the position of the characteristic area, calculates the position and orientation of an auxiliary coordinate system set for the teaching tool. The robot control device includes a setting unit which, on the basis of the position and orientation of the auxiliary coordinate system, sets the position of the teaching point and the orientation of the robot at the teaching point.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a teaching device that sets a teaching point using a teaching tool or an operator's hand. [Background technology]

[0002] The robot device includes a robot, a work tool attached to the robot, and a control device that controls the robot. The control device drives the robot and the work tool based on a work program. An operator can teach teaching points in advance to determine the position and posture of the robot. The work program includes information on the positions of the teaching points and the posture of the robot at the teaching points.

[0003] In the conventional technology, an operator operates a teaching pendant to change the position and orientation of the robot so that the work tool is in a desired position and orientation, and when the position and orientation of the robot are in the desired position and orientation, a teaching point can be set.

[0004] There is also a known method of performing a teaching operation using a teaching tool for indicating the position and orientation of a work tool. In this method, the teaching tool is imaged by a stereo camera fixed at a predetermined position. The position and orientation of the teaching tool are detected based on the image captured by the stereo camera. Then, the position and orientation of the robot are set based on the position and orientation of the teaching tool (for example, JP 2014-136275 A and JP 2011-104759 A). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2014-136275 A [Patent Document 2] JP 2011-104759 A Summary of the Invention [Problem to be solved by the invention]

[0006] When an operator sets teaching points, the operator must operate a teaching operation panel to change the position and posture of the robot for each teaching point, which poses a problem of long work time required for setting teaching points.

[0007] For example, when teaching points are set in a robot device that transports a workpiece, the position and posture of the robot must be adjusted manually. Since many teaching points must be set, there is a problem that the work time is long. In particular, when the path along which the workpiece is moved includes curves, many teaching points must be set in order to move the workpiece along the desired path. Even in the case of a robot device that performs a task other than transporting a workpiece, there are cases where many teaching points must be set in order to generate a task program, which results in a problem that the work time is long.

[0008] In addition, there are cases where the work tool enters a space enclosed by a housing or a narrow area to perform work. In such cases, it may be difficult for the worker to see the work tool when setting teaching points for the robot. As a result, it may be difficult to confirm the position and posture of the work tool.

[0009] For example, a machine tool has a housing that forms a machining chamber to prevent cutting fluid from splashing. In some cases, a workpiece is placed inside the machining chamber by a robot. When setting teaching points for such a robot device, there is a problem that it is difficult for an operator to confirm the position and posture of the work tool that has entered inside the housing. This causes a problem that it takes a long time to set the teaching points. [Means for solving the problem]

[0010] One aspect of the present disclosure is a teaching device that sets a teaching point of a robot device including a robot and a work tool. The teaching device includes a three-dimensional sensor that captures an image of a teaching tool or a worker's hand to indicate the position of the teaching point and the posture of the robot at the teaching point, and a processing device that processes a signal from the three-dimensional sensor. The processing device includes a characteristic part detection unit that detects the position of a characteristic part in the teaching tool or the worker's hand based on the output of the three-dimensional sensor. The processing device includes a movement command generation unit that generates a command to change the position and posture of the robot so as to maintain the position and posture of the three-dimensional sensor relative to the characteristic part when the worker moves the teaching tool or hand. The processing device includes a calculation unit that calculates the position and posture of an auxiliary coordinate system that is preset for the teaching tool or the worker's hand based on the position of the characteristic part detected by the characteristic part detection unit in a state in which the worker places the teaching tool or hand so as to correspond to the position and posture of the robot when the robot device performs a task. The processing device includes a setting unit that sets the position of the teaching point and the posture of the robot at the teaching point based on the position and posture of the auxiliary coordinate system calculated by the calculation unit. Effect of the Invention

[0011] According to an aspect of the present disclosure, a teaching device capable of performing teaching work in a short period of time can be provided. [Brief description of the drawings]

[0012] [Figure 1] FIG. 2 is a perspective view showing when the first robot device in the embodiment starts to transport a workpiece. [Diagram 2] FIG. 2 is a block diagram of a first robot device in the embodiment. [Diagram 3] FIG. 13 is a perspective view of the first robot device when it has finished transferring the workpiece. [Figure 4] FIG. 2 is a perspective view illustrating a moving path of the robot when transporting a workpiece. [Diagram 5] FIG. 2 is a perspective view of a first teaching tool in the embodiment. [Figure 6]FIG. 13 is a perspective view of a teaching tool and a camera when an auxiliary coordinate system is set. [Figure 7] 1 is a perspective view of a teaching tool, a camera, and a workpiece when a teaching point is set in a path mode in an embodiment. FIG. [Figure 8] 11 is a flowchart of an operation for setting one teaching point. [Figure 9] 1 is a perspective view of a teaching tool, a camera, and a workpiece when a teaching point is set in a point mode in an embodiment. FIG. [Figure 10] 11 is a perspective view of a teaching tool and a camera for explaining a first command operation of the teaching tool. FIG. [Figure 11] 13 is a perspective view of the teaching tool and a camera for explaining a second command operation of the teaching tool. FIG. [Figure 12] FIG. 4 is a perspective view of a second teaching tool in the embodiment. [Figure 13] FIG. [Figure 14] FIG. 2 is a perspective view of a second robot device in the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] A teaching device in an embodiment will be described with reference to Fig. 1 to Fig. 14. In this embodiment, a robot device including a robot that transports a workpiece from a start position to a target position will be described as an example.

[0014] FIG. 1 is a perspective view of a first robot device in this embodiment. FIG. 2 is a block diagram of the robot device in this embodiment. FIG. 1 is a perspective view when starting to transport a workpiece 81. With reference to FIGS. 1 and 2, the robot device 8 includes a hand 2 as a work tool, and a robot 1 that moves the hand 2. The robot device 8 includes a conveyor 84 that transports the workpiece 81. The first robot device 8 transports the rectangular parallelepiped workpiece 81 from a shelf 80 to the conveyor 84 as indicated by an arrow 91.

[0015] Fig. 3 is another perspective view of the first robot device in this embodiment. Fig. 3 is a perspective view when the transfer of the workpiece 81 is completed. When the transfer of the workpiece by the robot 1 is completed, the conveyor 84 moves the workpiece 81 to a predetermined position as indicated by the arrow 92.

[0016] 1 to 3, a robot 1 according to the present embodiment is a multi-joint robot including a plurality of joints. The robot 1 includes a base 14 and a swivel base 13 supported by the base 14. The swivel base 13 rotates relative to the base 14. The robot 1 includes an upper arm 11 and a lower arm 12. The lower arm 12 is supported by the swivel base 13 via a joint. The upper arm 11 is supported by the lower arm 12 via a joint. The robot 1 includes a wrist 15 connected to an end of the upper arm 11. The wrist 15 is supported by the upper arm 11 via a joint. The wrist 15 includes a flange 16 formed to rotate.

[0017] The hand 2 is formed to grip a workpiece 81. The hand 2 in this embodiment has two claws 2a that move in directions opposite to each other. The hand 2 is fixed to a flange 16 of a wrist 15. The work tool is not limited to a hand, and any device can be used depending on the work performed by the robot device. For example, when applying adhesive, a work tool such as a dispenser can be used as the work tool.

[0018] The robot 1 includes a robot driving device that drives components of the robot 1 such as the upper arm 11. The robot driving device of this embodiment includes a plurality of robot driving motors 22 for driving the upper arm 11, the lower arm 12, the rotating base 13, and the wrist 15. The hand 2 includes a hand driving device for driving the hand 2. The hand driving device of this embodiment includes a hand driving motor 24 for opening and closing the claw portion 2a.

[0019] The robot device 8 includes a robot control device 4 that controls the robot 1 and the hand 2. The robot control device 4 includes an arithmetic processing device (computer) having a CPU (Central Processing Unit) as a processor. The arithmetic processing device has a RAM (Random Access Memory), a ROM (Read Only Memory), etc., connected to the CPU via a bus.

[0020] The robot control device 4 includes a teaching operation panel 3 as an operation panel with which an operator manually operates the robot device 8. The teaching operation panel 3 includes an input section 3a for inputting information related to the robot 1 and the hand 2. The input section 3a is composed of components such as a keyboard and a dial. The teaching operation panel 3 includes a display section 3b for displaying information related to the control of the robot device 8. The display section 3b is composed of a display panel such as a liquid crystal display panel. The display section 3b may include a touch panel type display panel. In this case, the display section 3b has the function of the input section 3a.

[0021] The robot control device 4 drives the robot 1 and the hand 2 according to the operation program 40. The operation program 40 in this embodiment includes a work program 41 for performing a predetermined task such as transporting a workpiece. When the robot device 8 performs an actual task, the robot control device 4 changes the position and posture of the robot 1 based on the teaching points defined in the work program 41. The robot control device 4 includes a storage unit 42 that stores information related to the control of the robot device 8. The storage unit 42 can be configured with a non-transitory storage medium capable of storing information. For example, the storage unit 42 can be configured with a storage medium such as a volatile memory, a non-volatile memory, a magnetic storage medium, or an optical storage medium. The operation program 40 is stored in the storage unit 42. The positions of the teaching points for driving the robot 1 and the posture of the robot 1 at the teaching points are defined in the work program 41.

[0022] The robot control device 4 includes an operation control unit 43 that sends operation commands for the robot 1 and the hand 2. The operation control unit 43 corresponds to a processor that operates according to an operation program 40. The processor functions as the operation control unit 43 by reading the operation program 40 and implementing the control defined in the operation program 40. The processor also functions as the operation control unit 43 by driving the robot 1 and the hand 2 based on commands from the processing unit 51.

[0023] The operation control unit 43 sends an operation command for driving the robot 1 to the robot driving unit 45. The robot driving unit 45 includes an electric circuit for driving the robot driving motor 22. The robot driving unit 45 supplies electricity to the robot driving motor 22 based on the operation command. The operation control unit 43 also sends an operation command for driving the hand 2 based on the work program 41 to the hand driving unit 44. The hand driving unit 44 supplies electricity to the hand driving motor 24 based on the operation command.

[0024] The robot 1 includes a state detector for detecting the position and posture of the robot 1. The state detector in this embodiment includes a position detector 23 attached to the robot drive motor 22. The position and posture of the robot 1 are detected based on the outputs of the multiple position detectors 23.

[0025] A world coordinate system 71 is set in the robot device 8 of this embodiment. In the first robot device 8, the origin of the world coordinate system 71 is located on the base unit 14 of the robot 1. The world coordinate system 71 is also referred to as the reference coordinate system of the robot device 8. The world coordinate system 71 is a coordinate system in which the position of the origin is fixed, and further, the orientation of the coordinate axes is fixed. The world coordinate system 71 has, as its coordinate axes, an X-axis, a Y-axis, and a Z-axis that are orthogonal to each other. In addition, the W-axis is set as the coordinate axis around the X-axis. The P-axis is set as the coordinate axis around the Y-axis. The R-axis is set as the coordinate axis around the Z-axis.

[0026] In this embodiment, a tool coordinate system is set with an origin set at an arbitrary position of the work tool. The origin of the tool coordinate system 72 in this embodiment is set at the tool tip point. In setting the tool tip point in this embodiment, the center point in the height direction is set at the tips of the two claws 2a. Then, the midpoint of the line connecting the center points of the two claws 2a is set as the tool tip point. The tool coordinate system 72 has X-axis, Y-axis, and Z-axis as coordinate axes that are mutually orthogonal. The tool coordinate system 72 also has W-axis around X-axis, P-axis around Y-axis, and R-axis around Z-axis.

[0027] When the position and posture of the robot 1 change, the position and orientation of the origin of the tool coordinate system 72 change. For example, the position of the robot 1 corresponds to the position of the tool tip point (the position of the origin of the tool coordinate system 72). Moreover, the posture of the robot 1 corresponds to the orientation of the tool coordinate system 72 with respect to the world coordinate system 71.

[0028] The robot device 8 of this embodiment includes a teaching device that sets teaching points for the robot device 8. In this embodiment, the robot control device 4 functions as the teaching device. The teaching device includes a camera 27 as a three-dimensional sensor that captures an image of a teaching tool or a worker's hand. The camera 27 of this embodiment is a stereo camera that can detect the three-dimensional position of an object based on images captured by two two-dimensional cameras.

[0029] The parallax between the position of the object between the image captured by one two-dimensional camera and the image captured by the other two-dimensional camera is calculated. Based on this parallax, the distance from the stereo camera to the object at a measurement point set on the surface of the object is calculated. Furthermore, the three-dimensional position of the measurement point can be calculated based on the position and orientation of the camera 27.

[0030] The three-dimensional sensor is not limited to a stereo camera, and any sensor capable of detecting a characteristic part of an object (a teaching tool or a worker's hand) that specifies the position and posture of a work tool can be used. For example, a TOF (Time of Flight) camera that captures distance images by the time-of-flight method can be used as the three-dimensional sensor.

[0031] The camera 27 in this embodiment is supported by the robot 1. The camera 27 is fixed to the hand 2 via a support member 28. The position and orientation of the camera 27 change together with the hand 2. The camera 27 can acquire position information of measurement points on the surface of an object within a predetermined imaging range. For example, the camera 27 can capture a distance image of the imaging range based on the position information of the three-dimensional measurement points.

[0032] The teaching device of this embodiment includes a processing device that processes signals from the camera 27. The robot control device 4 includes a processing unit 51 that processes the output of the camera 27 and sets teaching points. In this embodiment, the processing unit 51 of the robot control device 4 functions as the processing device. The processing unit 51 also issues a command to the camera 27 to capture an image. The operation program 40 of this embodiment includes a setting program 46 that performs control for setting teaching points. The processing device is driven based on the setting program 46. The setting program 46 is created in advance and stored in the memory unit 42.

[0033] The processing unit 51 includes a characteristic part detection unit 52 that detects the position of a characteristic part on the teaching tool or the hand of the operator based on the output of the camera 27. The processing unit 51 includes a coordinate system setting unit 53 that sets an auxiliary coordinate system on the teaching tool or the hand of the operator. The processing unit 51 includes a movement command generation unit 54 that generates a command to change the position and posture of the robot 1 so as to maintain the position and posture of the camera 27 relative to the characteristic part.

[0034] An auxiliary coordinate system is set in advance for the teaching tool or the hand of the operator. The processing unit 51 includes a calculation unit 55 that calculates the position and orientation of the auxiliary coordinate system based on the position of the characteristic part detected by the characteristic part detection unit 52. The processing unit 51 includes a setting unit 56 as a teaching point setting unit that sets a teaching point so as to include information on the position of the teaching point and the orientation of the robot at the teaching point, based on the position and orientation of the auxiliary coordinate system calculated by the calculation unit 55.

[0035] Each unit of the processing unit 51, the characteristic part detection unit 52, the coordinate system setting unit 53, the movement command generation unit 54, the calculation unit 55, and the setting unit 56 corresponds to a processor that operates according to the setting program 46. The processor reads the setting program 46 and performs the control defined in the setting program 46, thereby functioning as each unit.

[0036] FIG. 4 is a perspective view illustrating the movement path of the robot in this embodiment. The position of the robot 1 moves along the movement path 98. That is, the tool tip point of the robot 1 moves along the movement path 98. As the position of the robot 1 moves, the posture of the robot 1 also changes. In this embodiment, the position and posture of the robot 1 change so that the hand 2 can grasp the workpiece 81 placed on the shelf 80. The hand 2 grasps the workpiece 81. Next, the robot 1 performs an operation to pull out the workpiece 81 from the shelf 80 while maintaining the posture of the hand 2. Next, the robot 1 performs an operation to place the workpiece 81 on the conveyor 84 while changing the position and posture of the hand 2.

[0037] The movement path 98 is determined based on a plurality of teaching points. In the example shown in Fig. 4, a start teaching point TPS at which the transfer of the workpiece 81 starts and an end teaching point TPE at which the transfer of the workpiece 81 ends are shown. A plurality of teaching points TP are set between the start teaching point TPS and the end teaching point TPE. In the teaching device of this embodiment, such teaching points of the robot 1 are set.

[0038] 5 shows a perspective view of a first teaching tool in this embodiment. In this embodiment, an operator specifies the position and posture of a hand 2 using a teaching tool 31. The position and posture of the hand 2 correspond to the position and posture of a robot 1. In this embodiment, the position of the robot 1 is the position of the tool tip point. That is, an operator specifies the position of the tool tip point and the posture of the robot 1 using the teaching tool 31.

[0039] The first teaching tool 31 has an elongated shape. The teaching tool 31 has a gripping portion 32 for an operator to hold, and a support portion 33 extending from the gripping portion 32. The teaching tool 31 has a designating portion 34 having a shape indicating the position and posture of the hand 2. The processing portion 51 of the robot control device 4 detects the position and posture of the designating portion 34 based on the output of the camera 27. Then, the processing portion 51 sets the position of the teaching point and the posture of the robot 1 at the teaching point based on the position and posture of the designating portion 34. The designating portion 34 is disposed at the tip of the support portion 33.

[0040] The designation unit 34 has a three-dimensional shape that can detect the position and orientation of the designation unit 34 based on the output of the camera 27. The designation unit 34 of the first teaching tool 31 has rod-shaped parts 34a, 34b, and 34c that extend in directions perpendicular to each other. A cone-shaped characteristic part 34d is formed at the tip of the rod-shaped part 34a. The end face of the tip of the rod-shaped part 34b constitutes the characteristic part 34e. A spherical characteristic part 34f is formed at the tip of the rod-shaped part 34c. In this way, the characteristic parts 34d, 34e, and 34f, which are different in shape from each other, are formed at the tips of the rod-shaped parts 34a, 34b, and 34c. In addition, the reference part where the rod-shaped parts 34a, 34b, and 34c intersect with each other constitutes the characteristic part 34g.

[0041] Fig. 6 shows a perspective view of the first teaching tool and the camera when an auxiliary coordinate system is set for the teaching tool. With reference to Figs. 2 and 6, the processing unit 51 in this embodiment has a characteristic portion detection unit 52 that detects the positions of the characteristic portions 34d to 34g of the teaching tool 31. The processing unit 51 includes a coordinate system setting unit 53 that sets an auxiliary coordinate system 73 for the teaching tool 31.

[0042] The worker manually changes the position and posture of the robot 1 using the teaching operation panel 3 so that the designated portion 34 of the teaching tool 31 can be imaged. The worker places the teaching tool 31 so that the designated portion 34 of the teaching tool 31 is located within the imaging range 27a of the camera 27. The worker changes the position and posture of the teaching tool 31 so that each of the characteristic portions 34d to 34g can be imaged. The camera 27 images the designated portion 34.

[0043] Next, the characteristic portion detection unit 52 detects the positions of the characteristic portions 34d to 34g of the teaching tool 31. In this embodiment, distance images captured from various angles and distances of the designation portion 34 of the teaching tool 31 are stored in advance in the storage unit 42. These images are called reference images.

[0044] The characteristic part detection unit 52 selects a reference image that is most suitable for an image actually captured by the camera 27 from a plurality of reference images. The characteristic part detection unit 52 detects the characteristic parts 34d-34g by comparing the image actually captured by the camera 27 with the reference image by pattern matching. Next, the characteristic part detection unit 52 specifies the positions of the characteristic parts 34d-34g in the actually captured image. The characteristic part detection unit 52 acquires position information of the three-dimensional points of the respective characteristic parts 34d-34g. The positions of the characteristic parts 34d-34g can be detected, for example, in a camera coordinate system that has a predetermined point on the camera 27 as its origin. The camera coordinate system moves together with the camera 27.

[0045] The camera 27 is fixed to the hand 2. The relative position and orientation of the camera coordinate system with respect to the tool coordinate system 72 are constant. The relative position and orientation of the camera coordinate system with respect to the tool coordinate system 72 can be measured in advance. Based on the position and orientation of the robot 1, the position expressed in the camera coordinate system can be converted into a position expressed in the world coordinate system 71. The characteristic part detection unit 52 can convert the position of the characteristic part detected in the camera coordinate system into the position of the characteristic part expressed in the world coordinate system 71.

[0046] The reference image may be created in advance by an operator using CAD (Computer Aided Design) data or the like. For example, the operator may generate reference images of the designated part in various positions and postures based on three-dimensional design data. Alternatively, a two-dimensional reference image may be generated in advance. Then, the characteristic part detection unit 52 may identify the position of the characteristic part in the three-dimensional image by performing pattern matching based on a two-dimensional image acquired by one camera included in the stereo camera.

[0047] Next, the coordinate system setting unit 53 sets the auxiliary coordinate system 73 for the teaching tool 31. The method of setting the auxiliary coordinate system 73 can be determined in advance. In this embodiment, the coordinate system setting unit 53 sets the characteristic portion 34g as the origin of the auxiliary coordinate system 73. Furthermore, the coordinate system setting unit 53 sets the axis from the origin of the auxiliary coordinate system 73 toward the optical center of the camera 27 as the Z axis. The coordinate system setting unit 53 sets the axis that extends vertically upward as viewed from the camera 27 among the axes perpendicular to the Z axis as the X axis. Furthermore, the coordinate system setting unit 53 sets the direction perpendicular to the X axis and the Z axis as the Y axis.

[0048] In this way, the coordinate system setting unit 53 sets the direction from the origin of the auxiliary coordinate system 73 defined for the teaching tool 31 toward the camera 27 as one coordinate axis of the auxiliary coordinate system. The one coordinate axis may be the X-axis or Y-axis. The robot control device 4 can automatically set the auxiliary coordinate system 73 by having the operator capture an image of the designation part 34 of the teaching tool 31 with the camera 27.

[0049] The method of setting the auxiliary coordinate system 73 is not limited to this, and any method can be adopted. For example, the Z-axis may be set so as to overlap the rod-shaped portion 34a. The X-axis may be set so as to overlap the rod-shaped portion 34b, and the Y-axis may be set so as to overlap the rod-shaped portion 34c. Alternatively, the operator may manually set the auxiliary coordinate system while looking at an image captured by the camera 27. The display unit 3b of the teaching pendant 3 can display a distance image captured by the camera 27. The operator can set the auxiliary coordinate system 73 for the teaching tool 31 by operating the input unit 3a.

[0050] In this embodiment, the origin of the auxiliary coordinate system is set to the teaching tool, but this is not limited to the embodiment. The origin of the auxiliary coordinate system may be away from the teaching tool. Also, the operator can position the robot 1 at the position of the start teaching point TPS, and position the teaching tool 31 so as to correspond to the position and posture of the robot 1 at the start teaching point TPS. After this, the operator may set the auxiliary coordinate system.

[0051] Next, the coordinate system setting unit 53 calculates the relative position and orientation of the auxiliary coordinate system 73 with respect to the positions of the characteristic portions 34d to 34g. The storage unit 42 stores the relative position and orientation of the auxiliary coordinate system 73 with respect to the positions of the characteristic portions 34d to 34g. When the positions of the characteristic portions 34d to 34g are detected, the position and orientation of the auxiliary coordinate system 73 can be calculated.

[0052] 7 shows a perspective view of the camera, workpiece, and teaching tool when a teaching point is set by the teaching tool of this embodiment. The robot control device 4 of this embodiment is configured to be able to implement a path mode in which teaching points are set continuously as the operator moves the teaching tool 31, and a point mode in which the operator stops the teaching tool 31 and sets teaching points. First, the path mode will be described.

[0053] 4 and 7, the worker changes the position and posture of the robot 1 to grip the workpiece 81 placed on the shelf 80 with the hand 2. That is, the worker positions the robot 1 at the position of the start teaching point TPS to which the workpiece 81 is to be transported. The worker positions the teaching tool 31 so as to correspond to the position and posture of the robot 1 at the start teaching point TPS. The worker positions the teaching tool 31 at a position where the camera 27 can capture an image of the designated portion 34. In this example, the worker positions the teaching tool 31 on the upper surface of the workpiece 81. The worker also positions the teaching tool 31 so that the direction of the Z axis of the tool coordinate system 72 is substantially parallel to the extending direction of the rod-shaped portion 34a including the characteristic portion 34d.

[0054] The processing unit 51 acquires an image captured by the camera 27. The characteristic part detection unit 52 detects the positions of the characteristic parts 34d, 34e, and 34f of the designation unit 34. The calculation unit 55 calculates the position and orientation of the auxiliary coordinate system 73 based on the positions of the characteristic parts 34d, 34e, and 34f. Next, the processing unit 51 calculates the relative position and relative orientation of the tool coordinate system 72 with respect to the auxiliary coordinate system 73. The storage unit 42 stores this initial relative position and relative orientation. Note that the operator can set the relative position and relative orientation of the tool coordinate system 72 with respect to the auxiliary coordinate system 73 when the hand 2 grips the workpiece 81 by any method. For example, the operator may input the relative position and relative orientation by operating the input unit 3a of the teaching pendant 3.

[0055] Fig. 8 shows a flow chart of control for setting one teaching point. With reference to Figs. 2, 4 and 8, when setting a teaching point, the robot control device 4 operates based on the setting program 46. In step 111, the operator moves the teaching tool 31 along the movement path 98. In this embodiment, the position and posture of the robot 1 are changed by performing a tracking control, which will be described later, so that the camera 27 moves in response to the movement of the teaching tool 31.

[0056] In step 112, the camera 27 captures an image of the designation portion 34 of the teaching tool 31. In step 113, the characteristic portion detection unit 52 detects the positions of the characteristic portions 34d, 34e, and 34f of the designation portion 34 based on the image captured by the camera 27.

[0057] The relative position and orientation of the auxiliary coordinate system 73 with respect to the positions of the characteristic portions 34d to 34g are calculated by the coordinate system setting unit 53. In step 114, the calculation unit 55 calculates the position and orientation of the auxiliary coordinate system 73 based on the relative position and relative orientation.

[0058] The relative position and orientation of the tool coordinate system 72 with respect to the auxiliary coordinate system 73 are measured in advance. In step 115, the setting unit 56 calculates the position and orientation of the tool coordinate system 72 (the position of the teaching point and the orientation of the robot at the teaching point) based on this relative position and relative orientation. In this way, the setting unit 56 sets the teaching point so as to include information on the position of the teaching point and the orientation of the robot at the teaching point, based on the position and orientation of the auxiliary coordinate system 73 detected by the calculation unit 55.

[0059] In step 116, the memory unit 42 stores the information on the teaching points. In this manner, the teaching points can be set by capturing an image of the teaching tool 31 placed by the operator with the camera 27.

[0060] Incidentally, the robot device 8 of this embodiment performs a tracking control in which, when the operator moves the teaching tool 31, the position and orientation of the robot 1 are changed so that the camera 27 can capture an image of the designated portion 34. In the tracking control, the position and orientation of the robot 1 are changed so as to maintain the relative position and relative orientation of the camera 27 with respect to the characteristic portions 34d, 34e, and 34f. In this embodiment, since the camera 27 is fixed to the hand 2, the position and orientation of the robot 1 are changed so as to maintain the relative position and relative orientation of the tool coordinate system 72 with respect to the auxiliary coordinate system 73.

[0061] 7, the operator moves the teaching tool 31 along a desired movement path as indicated by an arrow 93. In the tracking control, the camera 27 captures images at predetermined short time intervals. For example, images may be captured at each control cycle of the robot 1. The characteristic part detection unit 52 detects the positions of the characteristic parts 34d, 34e, and 34f. The calculation unit 55 detects the position and orientation of the auxiliary coordinate system 73 based on the positions of the characteristic parts 34d, 34e, and 34f.

[0062] The movement command generating unit 54 acquires from the storage unit 42 the relative position and relative orientation of the tool coordinate system 72 with respect to the auxiliary coordinate system 73 when the teaching tool 31 is placed at a position corresponding to the start teaching point TPS. The movement command generating unit 54 calculates the position and orientation of the robot 1 based on this relative position and relative orientation and the position and orientation of the auxiliary coordinate system 73. The movement command generating unit 54 sends a movement command for the robot 1 to the movement control unit 43 so that the robot 1 is positioned and oriented as described above.

[0063] In this way, when the operator moves the teaching tool 31, the movement command generating unit 54 changes the position and attitude of the robot 1 so that the position and attitude of the camera 27 follow the characteristic parts 34d, 34e, and 34f. In the tracking control, various controls can be implemented. For example, the position and attitude of the robot can be changed so that the relative position and relative attitude of the tool coordinate system or the camera coordinate system with respect to the characteristic parts are maintained. In the path mode in which teaching points are set continuously, the tracking control can be implemented during the period in which the teaching points are set.

[0064] 4 and 7, when performing the path mode, the operator operates the input unit 3a of the teaching pendant 3 to switch to the path mode. The operator manually sets a start teaching point TPS. As shown by an arrow 93, the operator moves the teaching tool 31 from a position corresponding to the start teaching point TPS along a movement path 98. By the tracking control, the position and posture of the robot 1 are automatically changed so that the designated portion 34 of the teaching tool 31 can be imaged by the camera 27.

[0065] The processing unit 51 sets the teaching point TP at predetermined intervals along with the movement of the teaching tool 31. The processing unit 51 sets the teaching point TP by the control shown in FIG. 8. The processing unit 51 can set the teaching point at predetermined time intervals or at predetermined movement distances of the teaching tool 31. The characteristic part detection unit 52 detects the positions of the characteristic parts 34d, 34e, and 34f at each interval. The calculation unit 55 calculates the position and orientation of the auxiliary coordinate system 73 based on the positions of the characteristic parts 34d, 34e, and 34f detected at each interval. The setting unit 56 sets the position of the teaching point TP and the orientation of the robot 1 at the teaching point TP so as to correspond to this interval.

[0066] When the teaching tool 31 has moved to a position corresponding to the end teaching point TPE, the operator operates the input unit 3a of the teaching pendant 3, whereby the processing unit 51 sets the end teaching point TPE and ends the path mode. In this manner, a plurality of teaching points TP can be automatically set while the operator is moving the teaching tool 31.

[0067] In the path mode, the operator does not need to operate the teaching operation panel each time a teaching point is set, and multiple teaching points can be set automatically. Also, many teaching points can be set at small intervals. The path mode is suitable for a robot device that performs work on a path in which the tool tip point moves in a curved manner, such as the movement path of this embodiment.

[0068] Next, the point mode, which is a mode for setting teaching points one by one, will be described. In the point mode, the operator operates the teaching pendant 3 each time a teaching point is set. As in the above-mentioned path mode, the relative position and relative orientation of the tool coordinate system 72 with respect to the auxiliary coordinate system 73 when the teaching tool 31 is placed at a position corresponding to a predetermined position such as a start teaching point TPS are obtained in advance.

[0069] The worker switches the robot control device 4 to the point mode by operating the teaching operation panel 3. Next, the work of steps 111 to 116 in FIG. 8 is performed to set a teaching point. In step 111, by performing tracking control, when the worker moves the teaching tool 31, the position and posture of the robot 1 automatically change so that the designation unit 34 can be imaged by the camera 27. The worker operates the teaching operation panel 3, and the processing unit 51 performs the control of steps 112 to 116. By repeating such placement of the teaching tool 31 by the worker and setting of teaching points by the robot control device 4, a plurality of teaching points are set.

[0070] FIG. 9 shows a perspective view of the workpiece, camera, and teaching tool when setting a teaching point that is an approach point. Before starting an actual operation, the robot device 8 places the tool tip point at a teaching point TPA near the start teaching point TPS. In the actual operation, the robot device 8 performs control to move the hand 2 from the teaching point TPA closer to the start teaching point TPS. At the teaching point TPA, the hand 2 is in an open state. When the position of the robot 1 is placed at the start teaching point TPS, the hand 2 performs control to close. Such a teaching point TPA near the start teaching point TPS is called an approach point.

[0071] The teaching of the teaching point TPA can be performed in the point mode. In addition, tracking control can be performed. When the operator moves the teaching tool 31, the movement command generating unit 54 changes the position and posture of the robot 1 so that the camera 27 follows the movement of the teaching tool 31. By performing tracking control, the operator does not need to adjust the position and posture of the robot 1 every time a teaching point is set, and can easily set the teaching point.

[0072] After setting the start teaching point TPS, the operator moves the teaching tool 31 to a position away from the workpiece 81, as indicated by an arrow 94. By using tracking control, the hand 2 to which the camera 27 is fixed moves in response to the movement of the teaching tool 31. When the teaching tool 31 is placed at a desired position, the operator operates the teaching pendant 3, which enables the processing unit 51 to set the teaching point TPA.

[0073] Furthermore, when the actual work is completed, the robot device 8 places the tip point of the hand 2 at a position away from the workpiece 81. The robot control device 4 places the position of the robot 1 at a teaching point retreated from the end teaching point TPE. After this, the robot control device 4 changes the position and posture of the robot 1 to perform the next operation. This teaching point is called an escape point. The teaching point that becomes the escape point can also be set in the point mode in the same way as the approach point.

[0074] In the point mode, the operator can stop the teaching tool 31 when setting one teaching point. The operator can finely adjust the position and posture of the teaching tool 31. For this reason, in the point mode, the position and posture of the robot at the teaching point can be finely adjusted. Also, in cases such as when the position of the robot moves linearly, the movement path is simplified. When the movement path is simple, it is sufficient to set a small number of teaching points. In this case, the operator can set the teaching points in a short time by setting the teaching points in the point mode.

[0075] In the robot control device 4 in this embodiment, the teaching point can be set by switching between the point mode and the path mode. Furthermore, when the teaching point is set, the conditions for driving the work tool can be set. For example, in a hand whose claw portion is driven by a motor, the worker can set conditions such as the magnitude of the force with which the hand grips the workpiece. When the worker operates the teaching operation panel 3 to set the point mode or path mode, the worker can input the conditions for driving the work tool. The memory unit 42 can store the conditions for driving the work tool together with the information of the set teaching point. The robot control device 4 can generate the work program 41 based on the information of the teaching point and the conditions for driving the work tool.

[0076] When the robot device 8 performs an actual work, the operation control unit 43 can control the position and posture of the robot by various methods of moving the tool tip point. For example, the operation control unit 43 can perform a first movement control that controls the position and posture of the robot 1 so that the tool tip point passes through the teaching points and moves linearly between the teaching points. The operation control unit 43 can also perform a second movement control that controls the position and posture of the robot 1 so that the tool tip point passes through the teaching points and moves curvedly between the teaching points. The operation control unit 43 can also perform a third movement control that controls the position and posture of the robot so that the tool tip point passes through the teaching points or the vicinity of the teaching points and moves curvedly. In the third movement control, the tool tip point does not need to pass through the teaching points, and the work tool moves on a smooth movement path.

[0077] When setting a teaching point, the worker can specify any one of the first to third movement controls. For example, the worker can specify the type of movement control by operating the teaching operation panel 3. The storage unit can store the type of movement control together with the information of the set teaching point. The robot control device 4 can generate a work program 41 based on the information of the teaching point and the type of movement control.

[0078] The point mode can be used when discrete teaching points are set. In the point mode, it is preferable to generate a command statement of a work program that changes the position and posture of the robot in the first movement control. On the other hand, the path mode can be used when the work tool performs work continuously while changing the position and posture of the robot. In the path mode, it is preferable to generate a command statement of a work program that changes the position and posture of the robot in the second movement control or the third movement control.

[0079] In the above-described embodiment, the operator operates the input unit 3a of the teaching pendant 3 to open or close the hand 2. Alternatively, the operator operates the input unit 3a of the teaching pendant 3 to switch between the point mode and the path mode. In the robot control device 4 in this embodiment, such commands can be issued by the operation of the teaching tool 31. That is, instead of operating the input unit 3a of the teaching pendant 3, input to the teaching pendant 3a can be made by the operation of the teaching tool 31.

[0080] Fig. 10 is a perspective view of the teaching tool and the camera when a command is given to the processing unit by the operation of the teaching tool. With reference to Figs. 2 and 10, processing unit 51 includes an operation detection unit 57 that detects a predetermined command operation of teaching tool 31 based on the output of camera 27. Operation detection unit 57 corresponds to a processor that operates according to setting program 46. The processor reads setting program 46 and performs control defined in setting program 46, thereby functioning as operation detection unit 57.

[0081] The motion detection unit 57 acquires the position of at least one of the characteristic parts 34d to 34g from the characteristic part detection unit 52 at predetermined time intervals. The motion detection unit 57 detects the movement of the characteristic parts 34d to 34g. The motion detection unit 57 detects a predetermined motion of the teaching tool 31. In this embodiment, the motion of the teaching tool 31 for instructing the robot control device 4 is called a command motion. In the example shown in FIG. 10, the operator performs a command motion to move the teaching tool 31 back and forth slightly in any direction, as indicated by an arrow 95. In this example, the operator moves the teaching tool 31 in the direction in which the rod-shaped part 34c on which the characteristic part 34f is arranged extends.

[0082] The motion detection unit 57 detects a command motion based on the position of the characteristic part 34d detected by the characteristic part detection unit 52. For example, the motion detection unit 57 detects that the characteristic part 34d moves in one direction and in a direction opposite to the one direction within a predetermined time. When such a motion is detected, the motion detection unit 57 determines that the motion is a predetermined command motion and implements control corresponding to the command motion. The control corresponding to such a command motion is predetermined.

[0083] For example, the motion detection unit 57 determines that the command motion is a command to close the hand 2. The storage unit 42 stores the command for the motion to close the hand 2 together with information on the current teaching points. The robot control device 4 can generate a task program 41 including the command to close the hand 2 together with information on the teaching points.

[0084] Alternatively, when setting a teaching point in the point mode, instead of an operator operating the teaching pendant, the motion detection unit 57 can determine that the command motion is a command to store a teaching point. The calculation unit 55 and the setting unit 56 acquire the position and attitude of the teaching tool 31 before performing the reciprocating motion indicated by the arrow 95. The calculation unit 55 and the setting unit 56 set the teaching point based on the position and attitude.

[0085] Alternatively, in the path mode, the operator can perform the command operation after placing the teaching tool 31 so as to correspond to the start teaching point TPS. The operation detection unit 57 can determine that the command is to set the start teaching point TPS in the path mode. Then, the operator moves the teaching tool 31 from a position corresponding to the start teaching point TPS to a position corresponding to the end teaching point TPE. The calculation unit 55 and the setting unit 56 automatically set a plurality of teaching points based on the position and posture at which the teaching tool 31 is placed. In teaching the end teaching point TPE, the command operation is performed after the teaching tool 31 reaches the end teaching point TPE. The calculation unit 55 and the setting unit 56 can set the end teaching point TPE based on the position and posture of the teaching tool 31 immediately before performing the command operation.

[0086] 11 shows a perspective view of the teaching tool and the camera for explaining another command operation of the teaching tool. As another command operation, the designating unit 34 of the teaching tool 31 can be suddenly brought closer to the camera 27 as shown by an arrow 96. For example, the operation detection unit 57 can determine that the command operation is performed when the characteristic portion 34d approaches the camera 27 within a predetermined distance range within a predetermined time. Alternatively, the operation detection unit 57 determines that the command operation is performed when the characteristic portion 34d moves toward the camera 27 by a distance greater than a predetermined distance judgment value within a predetermined time.

[0087] 11, the motion detector 57 can determine that the motion is a predetermined control command. For example, the motion detector 57 can switch between a point mode and a path mode. That is, the operator can switch between the path mode and the point mode by performing an operation of suddenly moving the designator 34 toward the camera 27 as shown by the arrow 96.

[0088] In this manner, in the robot control device 4 of the present embodiment, a command can be issued to the robot control device 4 by a predetermined command operation of the teaching tool. The worker can issue a command to the robot control device 4 without operating the teaching pendant 3. This allows the teaching work to be performed quickly.

[0089] The command action is not limited to the above-mentioned form, and any action can be adopted. For example, the operator can command the designated part to be placed outside the imaging range of the camera for a short time and then to be returned to the inside of the imaging range. Alternatively, the command action can be to move the teaching tool so that one characteristic part moves in a circular shape.

[0090] 12 shows a perspective view of the second teaching tool in this embodiment. The teaching tool is not limited to the above-mentioned form, and may have any shape that allows the position and orientation of the designated part of the teaching tool to be detected from an image captured by a camera. The second teaching tool 37 has a gripping part 32 that is held by a person, and a support part 33 that extends in a rod shape from the gripping part 32. A designating part 38 is disposed at the end of the support part 33.

[0091] The designating portion 38 of the second teaching tool 37 has characteristic portions 38d, 38e, and 38f. The characteristic portions 38d and 38e are formed in annular shapes. The characteristic portion 38f is formed so as to protrude from the side surface.

[0092] In the second teaching tool 37, similarly to the first teaching tool 31, the characteristic part detection unit 52 detects the positions of the characteristic parts 38d to 38f based on the three-dimensional information acquired by the camera 27. The coordinate system setting unit 53 sets an auxiliary coordinate system 73 for the teaching tool 37. The origin of the auxiliary coordinate system 73 can be located, for example, at the characteristic part 38f. The coordinate system setting unit 53 can calculate the relative position and relative orientation of the auxiliary coordinate system 73 with respect to the characteristic parts 38d, 38e, and 38f. Next, the worker places the teaching tool 37 at a desired position and orientation with respect to the work tool and captures an image with the camera 27. The processing unit 51 calculates the relative position and relative orientation of the work tool with respect to the auxiliary coordinate system 73 (the relative position and relative orientation of the tool coordinate system 72) based on the image of the camera 27. For other tasks, the teaching points can be set by performing the same tasks as those of the first teaching tool 31.

[0093] Fig. 13 shows a perspective view of the hand of a worker in this embodiment. In the above-described embodiment, the position and orientation of the work tool with respect to the workpiece are specified by using the first teaching tool 31 or the second teaching tool 37, but this is not limited to the embodiment. The worker may use the hand 39 to specify the position and orientation of the work tool.

[0094] In the example shown in FIG. 13, the shape of the hand 39 is generated so that the thumb, index finger, and middle finger are oriented in directions that are approximately perpendicular to each other. The tip of the thumb is set to characteristic portion 39d. The tip of the index finger is set to characteristic portion 39f. The tip of the middle finger is set to characteristic portion 39e. The shape of the worker's hand 39 is not limited to this form, and the position and orientation of the work tool can be specified in any shape that allows the characteristic portions to be detected. The worker can specify the position and orientation of the work tool while maintaining the shape of the hand 39.

[0095] Similarly to the teaching tools 31 and 37, the auxiliary coordinate system 73 can be set for the worker's hand 39. For example, the coordinate system setting unit 53 can automatically set the auxiliary coordinate system 73 based on a distance image of the worker's hand 39 captured by the camera 27. In this example, the origin of the auxiliary coordinate system 73 is set to the characteristic part 39f at the tip of the index finger.

[0096] The control for setting other teaching points is similar to the control for setting teaching points using a teaching tool. With the teaching device of this embodiment, the operator can perform the teaching work of the robot device even if he or she uses his or her hands instead of the teaching tool.

[0097] 14 shows a perspective view of a second robot device in this embodiment. The second robot device 9 includes a robot 5 and a machine tool 7. In the robot device 9 of this embodiment, the robot 5 replaces a workpiece 82 to be machined by the machine tool 7. The robot device 9 includes the robot 5 and a hand 6. The hand 6 includes a suction pad 6a that grips the workpiece 82 by suction. A camera 27, which is a stereo camera, is fixed to the hand 6.

[0098] The robot device 9 includes a conveyor 85 that transports the workpieces 82. The conveyor 85 transports a plurality of workpieces 82 as shown by an arrow 97. The conveyor 85 transports the workpieces 82 to a position where the hand 6 can grasp the workpieces 82.

[0099] The machine tool 7 of this embodiment is of a numerically controlled type. The machine tool 7 can automatically machine the workpiece 82 based on a machining program created in advance. The machine tool 7 includes a door 76 arranged on a side of a frame 75. The door 76 opens and closes. In a machining chamber surrounded by the frame 75, a spindle head on which a tool is attached and a table 77 supporting the workpiece 82 are arranged. A fixing member 78 on which the workpiece 82 is placed is fixed to the table 77. The workpiece 82 is placed in a recess 78a of the fixing member 78. During machining of the workpiece 82, at least one of the spindle head and the table 77 moves, and the relative position of the tool with respect to the workpiece 82 changes. The workpiece 82 is machined into a desired shape.

[0100] The robot 5 places the workpiece 82 before machining on the fixed member 78 and removes the machined workpiece 82 from the fixed member 78. During the period when the workpiece 82 is being replaced, the door 76 is in an open state. The workpiece 82 transported by the conveyor 85 is placed on the fixed member 78 inside the machining chamber by the robot 5, as shown by the arrow 99. At this time, the robot 5 inserts the upper arm 11 and the lower arm 12 into the machining chamber through the opening. When performing a teaching operation, the worker must check the position and posture of the hand 6 from outside the machining chamber. For this reason, it may be difficult to see the position and posture of the hand 6.

[0101] However, in the teaching device of this embodiment, the operator can easily specify the position and posture of the robot 5 because the operator can set the teaching points using a teaching tool or by hand. In particular, by using a teaching tool, the operator can specify the position and posture of the robot while standing outside the machining chamber. This allows the teaching work to be completed in a short time.

[0102] In this embodiment, a robot device that transports a workpiece and a robot device that processes a workpiece are described as examples, but the present invention is not limited to this embodiment. The control of this embodiment can be applied to a robot device that performs any work. For example, the control of this embodiment can be applied to a robot device equipped with a work tool that applies adhesive, or a robot device equipped with a laser head that performs laser processing.

[0103] In the above embodiment, the position where the work is to be performed is specified using a teaching tool or the worker's hand. As a method of specifying the position where the work is to be performed, a sticker with letters or symbols written thereon can be attached to the work as a two-dimensional marker. Then, the position of the two-dimensional marker can be detected by a camera to set the position of the teaching point. The robot moves the camera so as to capture an image of the surroundings. Then, the teaching device searches for the marker from the image of the camera. When the two-dimensional marker is found, the position of the two-dimensional marker can be set as the position of the teaching point.

[0104] The above-mentioned embodiments can be combined as appropriate. In each of the above-mentioned drawings, the same or equivalent parts are given the same reference numerals. Note that the above-mentioned embodiments are examples and do not limit the invention. In addition, the embodiments include modifications of the embodiments shown in the claims. [Explanation of symbols]

[0105] 1,5 Robot 2,6 Hands 4 Robot control device 8,9 Robotic Devices 27 Camera 31,37 Teaching tools 32 Gripping part 34,38 Specified part 34a,34b,34c Rod-shaped part 34d, 34e, 34f, 34g Characteristic areas 38d, 38e, 38f Characteristic parts 39 Hands 39d, 39e, 39f Characteristic parts 42 Storage section 51 Processing section 52 Characteristic part detection unit 53 Coordinate system setting section 54 Movement command generation section 55 Calculation section 56 Setting section 57 Motion detection unit 73 Auxiliary Coordinate Systems 81,82 Work 98 Travel Path TP, TPA teaching points TPS start teaching point TPE End Teaching Point

Claims

1. A teaching device for setting teaching points of a robot device including a robot and a work tool, comprising: a three-dimensional sensor for capturing an image of a teaching tool or an operator's hand to indicate the position of a teaching point and the posture of the robot at the teaching point; a processing device for processing a signal from the three-dimensional sensor, the processing device includes a characteristic part detection unit that detects a position of a characteristic part on a teaching tool or a hand of an operator based on an output of the three-dimensional sensor; a movement command generating unit that generates a command to change the position and orientation of the robot so as to maintain the position and orientation of the three-dimensional sensor relative to a characteristic portion when an operator moves a teaching tool or a hand; a calculation unit that calculates a position and orientation of a preset auxiliary coordinate system for a teaching tool or the hand of an operator based on a position of the characteristic part detected by the characteristic part detection unit, in a state in which the operator places a teaching tool or his / her hand so as to correspond to a position and orientation of the robot when the robot device performs a task; a setting unit that sets the position of a teaching point and the attitude of the robot at the teaching point based on the position and attitude of the auxiliary coordinate system calculated by the calculation unit.

2. Equipped with teaching tools, the teaching tool has a gripping portion for being held by an operator and a designating portion having a characteristic portion; The teaching device according to claim 1 , wherein the designation unit has a three-dimensional shape capable of detecting a position and orientation of the designation unit based on an output from the three-dimensional sensor.

3. a coordinate system setting unit that sets an auxiliary coordinate system for a teaching tool or a hand of an operator based on the position of the characteristic portion detected by the characteristic portion detection unit; 3. The teaching device according to claim 1, wherein the coordinate system setting unit sets a direction from an origin of the auxiliary coordinate system, which is determined on a teaching tool or a worker's hand, toward the three-dimensional camera as one coordinate axis of the auxiliary coordinate system.

4. the processing device includes an operation detection unit that detects a predetermined command operation of a teaching tool based on an output of the three-dimensional sensor, The teaching device according to claim 1 , wherein the motion detection unit is configured to, when detecting a command motion, carry out control corresponding to the command motion.

5. the characteristic portion detection unit detects the position of the characteristic portion at predetermined intervals in accordance with the movement of the teaching tool or the hand of the operator; the calculation unit calculates a position and an orientation of the auxiliary coordinate system based on the positions of the characteristic portions detected for each of the intervals; The teaching device according to claim 1 , wherein the setting unit sets a position of the teaching point and a posture of the robot at the teaching point so as to correspond to the interval.

Citation Information

Patent Citations

  • Real time follow-up type optical manipulator orbit teaching system

    JP1993023983A

  • Noncontact point teaching device

    JP1995129231A

  • Robot position instructing tool, and robot position instructing method

    JP1996001563A

  • Teaching auxiliary tool for robot control system, teaching method using the teaching auxiliary tool, and robot control system performing teaching by the teaching method

    JP2011104759A

  • Method of controlling action of robot, and robot system

    JP2011110620A