Processing device, robot control system and program

JPWO2024143530A5Active Publication Date: 2024-11-26KYOCERA CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2023580885
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-12-28
Filing Date
2023-12-28
Publication Date
2024-11-26
Estimated Expiration
2043-12-28

AI Technical Summary

Technical Problem

Existing robot technologies face challenges in efficiently holding objects using suction, particularly when the normal direction of the suction surface interferes with obstacles or the robot's structure, leading to reduced suction success rates.

Method used

The robot system employs an elastic suction section that contacts the object from a direction different from its normal surface, adjusting the approach direction based on a reference direction and an adjustment angle to optimize suction success, using a control unit to set the approach direction considering the robot's capabilities and potential interference.

Benefits of technology

This approach enhances the suction success rate by allowing the robot to effectively hold objects despite structural limitations and obstacles, improving the reliability of object handling operations.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The processing device is a processing device that controls a robot having an elastic suction part capable of suction-holding an object to be held. The processing device includes a control unit that controls the robot. The control unit can control the suction part to come into contact with the object to be held from a direction different from the normal direction of the suction surface of the object to be held, thereby causing the suction part to suction the object to be held.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a technology for a robot to suck and hold an object to be held. [Background technology]

[0002] Patent Document 1 describes a technique related to a robot that holds an object to be held. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2002-331480 A Summary of the Invention

[0004] A processing device, a robot control system, a program, and a terminal device are disclosed. In one embodiment, the processing device is a processing device that controls a robot having an elastic suction part capable of suction-holding an object to be held. The processing device includes a control unit that controls the robot. The control unit can control the suction part to come into contact with the object to be held from a direction different from the normal direction of the suction surface of the object to be held, thereby causing the suction part to suction the object to be held.

[0005] In one embodiment, a robot control system includes the above-mentioned processing device and a robot connected to the processing device.

[0006] In one embodiment, the program is a program for causing a computer device to function as the processing device described above.

[0007] In one embodiment, the processing device is a processing device that controls a robot having an adsorption unit that movably adsorbs and holds the object to be held. The processing device includes a control unit that controls the robot. The control unit controls the robot so that the adsorption unit contacts the adsorption surface of the object to be held in a state in which a first end side of the adsorption unit is contracted more than a second end side opposite the first end side with respect to the adsorption surface of the object to be held.

[0008] In one embodiment, the terminal device includes a display unit and a control unit, the control unit obtains an approach direction of the robot capable of suction-holding the holding object from a direction different from a normal direction of a suction target surface of the holding object, and causes the display unit to display the approach direction in a recognizable manner. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram illustrating an example of a processing apparatus. [Diagram 2] FIG. 1 is a schematic diagram showing an example of a robot and its surroundings. [Diagram 3] 11 is a schematic diagram showing an example of a state in which the robot approaches from a set approach direction. FIG. [Figure 4] 10 is a flowchart showing an example of an operation of a control unit. [Diagram 5] FIG. 2 is a schematic diagram showing an example of a reference direction and a normal direction. [Figure 6] 10 is a schematic diagram for explaining an example of a method for setting a reference direction. FIG. [Figure 7] 11 is a schematic diagram showing an example of a direction based on an adjustment angle (first relaxation direction). FIG. [Figure 8] 11 is a schematic diagram showing an example of a state in which the robot approaches from a direction based on an adjustment angle. FIG. [Figure 9] 1 is a schematic diagram showing an example of a state in which a robot is suctioning an object; [Figure 10] 10 is a flowchart showing an example of an operation of a control unit. [Figure 11] FIG. 13 is a schematic diagram showing an example of a state in which a robot approaches from a normal direction. [Figure 12] 10 is a flowchart showing an example of an operation of a control unit. [Figure 13] 10 is a flowchart showing an example of an operation of a control unit. [Figure 14] FIG. 11 is a schematic diagram showing an example of a direction (second relaxation direction) based on an upper limit value. [Figure 15] FIG. 11 is a schematic diagram showing an example of a state in which the robot approaches from a direction based on an upper limit value. [Figure 16] 10 is a flowchart showing an example of an operation of a control unit. [Figure 17] 10 is a flowchart showing an example of an operation of a control unit. [Figure 18] 11 is a schematic diagram showing an example of a direction based on an adjustment angle (first relaxation direction) and a direction based on an upper limit value (second relaxation direction). FIG. [Figure 19] FIG. 4 is a schematic diagram illustrating an example of table information. [Figure 20] FIG. 1 is a schematic diagram illustrating an example of a configuration of a robot control system. [Figure 21] FIG. 11 is a schematic diagram showing a display example of a terminal device. [Figure 22] FIG. 11 is a schematic diagram showing a display example of a terminal device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Fig. 1 is a schematic diagram showing an example of the configuration of a processing device 1. The processing device 1 is capable of setting an approach direction in which a robot 10, which suction-holds a holding target 50, approaches the holding target 50. Fig. 2 is a schematic diagram showing an example of the robot 10 and its surroundings.

[0011] The robot 10 performs a task of moving, for example, a holding target 50 (also simply referred to as the target 50) from a source area to a destination area. The robot 10 approaches the holding target 50 in the source area from an approach direction set by the processing device 1, and adsorbs and holds the holding target 50. Then, the robot 10 moves the held target 50 from the source area to the destination area. For example, the robot 10 moves the held target 50 from the source area to the destination area by changing the posture of the robot 10. The target 50 is also referred to as, for example, a workpiece.

[0012] The source area and the destination area are, for example, containers. A plurality of objects 50 exist in a container 17 (also referred to as source container 17) as the source area. In the source container 17, the plurality of objects 50 are, for example, piled up in bulk. The robot 10, for example, suctions and holds the objects 50 in the source container 17 one by one, and moves them to a container 18 (also referred to as destination container 18) as the destination area. The source container 17 and the destination container 18 are, for example, placed on a work table 15 and a work table 16, respectively. The work table 15 can also be referred to as a work start table 15, and the work table 16 can also be referred to as a work target table 16. It can also be said that the robot 10 moves the object 50 on the work start table 15 to the work target table 16.

[0013] The robot 10 includes, for example, an arm 11 and an end effector 12 connected to the arm 11. The arm 11 includes a plurality of joints. The position of the arm 11, in other words, the posture of the arm 11, is determined by the amount of rotation of the plurality of joints.

[0014] The end effector 12 is capable of suction-holding an object 50. The end effector 12 includes, for example, a long and thin suction nozzle 120 and a suction unit 121 attached to the tip of the suction nozzle 120. The end effector 12 can also be said to be a suction-holding unit that suction-holds the object 50.

[0015] The suction portion 121 is made of an elastic material such as synthetic rubber, and is also called a suction pad. The suction portion 121 is hollow and has a suction opening 121a. When the end effector 12 suctions and holds the target object 50, the opening edge of the suction opening 121a in the suction portion 121 comes into contact with the target object 50, and the suction opening 121a is blocked by the target object 50. Then, the robot 10 reduces the pressure inside the suction portion 121 through the suction nozzle 120, so that the opening edge of the suction portion 121 comes into close contact with the target object 50. As a result, the target object 50 is suctioned to the suction portion 121. When the suction portion 121 suctions the target object 50, the suction portion 121 elastically deforms due to the reduced pressure inside the suction portion 121. The suction portion 121 may be flat or bellows-shaped. The suction portion 121 is also called a vacuum pad.

[0016] The robot 10 approaches the object 50 in the source container 17 from the approach direction (set approach direction) set by the processing device 1 by moving the arm 11, and adsorbs and holds the object 50 with the end effector 12. That is, the robot 10 approaches the object 50 by moving the end effector 12 in the set approach direction by changing the posture of the arm 11, and then adsorbs and holds the object 50 with the end effector 12. Then, the robot 10 moves the object 50 to the destination container 18 by moving the arm 11 with the end effector 12 holding the object 50. For example, the robot 10 moves the object 50 to the destination container 18 by changing the posture of the arm 11. Then, when the end effector 12 releases the object 50 (that is, when it releases the adsorption to the object 50), the object 50 is placed in the destination container 18. The robot 10 repeats this operation. Note that the operation performed by the robot 10 is not limited to this.

[0017] The robot 10 includes, for example, a camera 13. The camera 13 is, for example, a three-dimensional camera. As shown in Fig. 2, the camera 13 is attached to, for example, the end effector 12. Therefore, the shooting range of the camera 13 changes according to the posture of the end effector 12. Since the posture of the end effector 12 changes according to the posture of the arm 11, the shooting range of the camera 13 changes according to the posture of the arm 11.

[0018] When the end effector 12 holds the object 50 in the container 17, the camera 13 photographs the container 17 from the opening 17a side of the container 17 (in other words, from above the container 17). In this case, the photographing range of the camera 13 includes multiple objects 50 in the container 17. On the other hand, when the end effector 12 releases the object 50 and places the object 50 in the container 18, the camera 13 photographs the container 18 from the opening 18a side of the container 18 (in other words, from above the container 18).

[0019] The camera 13 captures an image of the capture range and generates, for example, a two-dimensional color image and a distance image. When the end effector 12 holds an object 50 in a container 17, the color image captures the container 17 and the multiple objects 50 in the container 17. The camera 13 generates a camera image including a color image and a distance image. The distance image may be acquired, for example, by a stereo method, a ToF (Time of Flight) method, or another method.

[0020] The processing device 1 is, for example, a type of computer device. The processing device 1 can, for example, not only set the approach direction in which the suction unit 121 contacts the target object 50, but also control the robot 10. The processing device 1 also functions as a robot control device that controls the robot 10. The processing device 1 can, for example, control the robot 10 so that the robot 10 approaches the target object 50 from the set approach direction. Note that a robot control device that controls the robot 10 may be provided separately from the processing device 1. In this case, the processing device 1 notifies the robot control device of the set approach direction. The robot control device controls the robot 10 so that the robot 10 approaches the target object 50 from the notified set approach direction.

[0021] 1, the processing device 1 includes, for example, a control unit 2, a storage unit 3, an interface 4, and an input unit 5. The processing device 1 can also be referred to as, for example, a processing circuit.

[0022] The interface 4 is capable of communicating with the robot 10. The control unit 2 is capable of controlling the robot 10 through the interface 4. The control unit 2 is capable of acquiring camera images generated by the camera 13 from the robot 10 through the interface 4. The interface 4 may be, for example, an interface circuit, a communication unit, or a communication circuit. The interface 4 may perform wired communication with the robot 10, or may perform wireless communication. Note that, when a robot control device that controls the robot 10 is provided separately from the processing device 1, the processing device 1 does not need to include the interface 4. Hereinafter, simply referring to a camera image means a camera image generated by the camera 13.

[0023] The control unit 2 can generally manage the operation of the processing device 1 by controlling the other components of the processing device 1. The control unit 2 can also be referred to as, for example, a control circuit. The control unit 2 includes at least one processor to provide control and processing power for performing various functions, as described in more detail below.

[0024] According to various embodiments, the at least one processor may be implemented as a single integrated circuit (IC) or as multiple communicatively connected integrated circuit ICs and / or discrete circuits. The at least one processor may be implemented according to various known techniques.

[0025] In one embodiment, a processor includes one or more circuits or units configured to perform one or more data computation procedures or processes, for example by executing instructions stored in associated memory. In other embodiments, a processor may be firmware (e.g., discrete logic components) configured to perform one or more data computation procedures or processes.

[0026] According to various embodiments, the processor may include one or more processors, controllers, microprocessors, microcontrollers, application specific integrated circuits (ASICs), digital signal processors, programmable logic devices, field programmable gate arrays, or any combination of these devices or configurations, or other known devices and configurations, to perform the functions described below.

[0027] The control unit 2 may include, for example, a CPU (Central Processing Unit) as a processor. The storage unit 3 may include a non-transitory recording medium readable by the CPU of the control unit 2, such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The storage unit 3 stores, for example, a program 30 for controlling the processing device 1. Various functions of the control unit 2 are realized, for example, by the CPU of the control unit 2 executing the program 30 in the storage unit 3.

[0028] The configuration of the control unit 2 is not limited to the above example. For example, the control unit 2 may include multiple CPUs. The control unit 2 may also include at least one DSP (Digital Signal Processor). All or some of the functions of the control unit 2 may be realized by a hardware circuit that does not require software to realize the function. The storage unit 3 may also include a computer-readable non-transitory recording medium other than ROM and RAM. The storage unit 3 may also include, for example, a small hard disk drive and an SSD (Solid State Drive).

[0029] The input unit 5 can receive various inputs from the user. The input unit 5 may include, for example, a mouse and a keyboard. The input unit 5 may also include a touch sensor that receives a touch operation by the user. The processing device 1 may include a display unit such as a liquid crystal display. In this case, the display unit and the touch sensor may constitute a touch panel display having a display function and a touch detection function. The input unit 5 may also include a microphone that receives a voice input by the user. The control unit 2 recognizes the content of the user input received by the input unit 5 based on the output signal from the input unit 5.

[0030] The control unit 2 is capable of executing an approach direction setting process for setting an approach direction. The control unit 2 includes, for example, a determination unit 20 and a setting unit 21. The determination unit 20 and the setting unit 21 are functional blocks formed in the control unit 2, for example, by the CPU of the control unit 2 executing a program 30 in the storage unit 3. Note that all or some of the functions of the determination unit 20 may be realized by a hardware circuit that does not require software to realize the function. The same applies to the setting unit 21.

[0031] The identification unit 20 identifies the normal direction of the surface to be attracted of the target object 50. The setting unit 21 sets the approach direction based on the normal direction identified by the identification unit 20 and a reference direction of the approach of the robot 10 to the target object 50. An example of the operation of the identification unit 20 and the setting unit 21 will be described later in detail.

[0032] <An example of how a robot approaches an object> Fig. 3 is a schematic diagram showing an example of how the robot 10 approaches an object 50 in a container 17. In Fig. 3, a cross-sectional structure of the container 17 is shown so that the state inside the container 17 can be seen. The same applies to each of the subsequent figures showing the container 17.

[0033] When the robot 10 holds the object 50 in the container 17, first, the robot 10 moves the arm 11 so that the suction portion 121 of the end effector 12 comes close to the object 50. Then, the robot 10 approaches the object 50 from a set approach direction 100 set by the processing device 1, and holds the object 50 by suction with the end effector 12.

[0034] When approaching the target object 50 , the robot 10 moves the end effector 12 closer to the target object 50 so that the moving direction of the end effector 12 coincides with the longitudinal direction of the suction nozzle 120 , for example.

[0035] Here, a plane including the suction opening 121a of the suction portion 121 is referred to as the suction opening plane. The longitudinal direction of the suction nozzle 120 is, for example, perpendicular to the suction opening plane. In this case, when the robot 10 approaches the target object 50, for example, the end effector 12 approaches the target object 50 so that the movement direction of the end effector 12 is perpendicular to the suction opening plane, and the end effector 12 comes into contact with the target object surface.

[0036] When the robot 10 approaches the target object 50 from the set approach direction 100, the end effector 12 moves in the approach direction 100 to bring the end effector 12 closer to and into contact with the target object 50. At this time, as shown in Fig. 3, for example, while pointing the suction opening 121a of the suction unit 121 toward the target object 50, the robot 10 moves the end effector 12 in the approach direction 100 so that the longitudinal direction of the suction nozzle 120 coincides with the approach direction 100 to bring the end effector 12 closer to and into contact with the target object 50. When the robot 10 approaches the target object 50 and the suction unit 121 comes into close contact with the target object 50, the pressure inside the suction unit 121 is reduced to suction the target object 50 with the suction unit 121. In this example, since the longitudinal direction of the suction nozzle 120 is perpendicular to the suction opening surface, the robot 10 can be said to approach the object 50 by moving the end effector 12 closer to the object 50 so that the suction opening surface is perpendicular to the approach direction 100 and comes into contact with the object 50.

[0037] <An example of approach direction setting processing> 4 is a flowchart showing an example of approach direction setting processing executed by the control unit 2. Before executing the approach direction setting processing, the control unit 2 determines an object 50 to be approached (also referred to as an approach object 50) from among the multiple objects 50 in the container 17. The control unit 2 determines the approach object 50 based on, for example, a camera image. When the control unit 2 determines the approach object 50, the end effector 12 is positioned above the container 17, and the camera 13 captures an image of the container 17 and the multiple objects 50 in the container 17.

[0038] In this example, a certain area on the surface of the target object 50 is the surface to be attracted to which the robot 10 attracts and holds the target object 50. For example, an area on the surface of the target object 50 to which the suction unit 121 is easily attracted is the surface to be attracted. Alternatively, an area on the surface of the target object 50 to which the suction unit 121 is less likely to damage the target object 50 is the surface to be attracted. When the robot 10 attracts the target object 50, the robot 10 approaches the surface to be attracted of the target object 50 and attracts the surface to be attracted. The surface to be attracted may be a flat surface or a curved surface. Also, each of a part of a plurality of surfaces constituting the surface of the target object 50 may be the surface to be attracted.

[0039] The control unit 2, for example, based on a camera image, identifies the object 50 having the largest visible area on the surface of the object to be attracted among the multiple objects 50 in the container 17. Then, the control unit 2 sets the identified object 50 as the approach object 50. The visible area on the surface of the object to be attracted is the area that can be seen when the surface of the object to be attracted is viewed from above the container 17. The visible area on the surface of the object to be attracted can also be said to be the area of ​​the surface of the object to be attracted that is captured by the camera 13. Note that the method of determining the approach object 50 is not limited to this.

[0040] When the control unit 2 determines the approach object 50, it executes an approach direction setting process shown in Fig. 4 for the determined approach object 50. When the approach direction is set in the approach direction setting process, the control unit 2 controls the robot 10 so that the robot 10 is at a position (approach start position) from which the robot 10 starts an approach to the approach object 50 from the set approach direction. The approach start position is set to a position where the robot 10 does not interfere with the container 17. Then, the control unit 2 controls the robot 10 so that the robot 10, at the approach start position, approaches the approach object 50 from the set approach direction and adsorbs the approach object 50.

[0041] In the approach direction setting process, first, in step s1, the identification unit 20 of the control unit 2 identifies the position and orientation of the attraction target surface (also referred to as the approach target surface) of the approach object 50 based on the camera image. This can also be said to be recognition of the approach object 50. The orientation of the attraction target surface can also be said to be the orientation of the attraction target surface. The identification unit 20 generates point cloud data representing the approach target surface based on, for example, a distance image included in the camera image. Then, the control unit 2 identifies the position and orientation of the approach target surface based on the generated point cloud data.

[0042] After step s1, the identification unit 20 identifies the normal direction of the approach target surface based on the identified position and orientation of the approach target surface. For example, the identification unit 20 identifies the normal direction of the approach target surface that passes through a representative point of the approach target surface. The representative point may be, for example, the center of the approach target surface.

[0043] Fig. 5 is a schematic diagram showing an example of a normal direction 110 of an approach target surface 50a (also referred to as an adsorption target surface 50a) of an approach target 50, identified by the identification unit 20. When the approach target surface 50a is a flat surface as in the example of Fig. 5, a normal direction 110 that is perpendicular to the approach target surface 50a and passes through a representative point 50aa of the approach target surface 50a is identified. On the other hand, when the approach target surface 50a is a curved surface, a normal direction 110 that is perpendicular to a tangent plane that touches the curved surface at the representative point 50aa and passes through the representative point 50aa is identified.

[0044] After step s2, the setting unit 21 sets the approach direction 100 based on the normal direction 110 identified in step s2 and a reference direction 112 of the approach of the robot 10 to the approach target 50.

[0045] FIG. 6 is a schematic diagram for explaining an example of a method for setting the reference direction 112. The reference direction 112 is set, for example, as a direction in which the robot 10 can easily approach the approach target 50. In this example, the target 50 is placed in a container 17 with an open top. Therefore, as shown in FIG. 6, when the robot 10 approaches the target 50 from directly above the container 17, it can easily approach each target 50 in the container 17. In other words, when the robot 10 approaches the target 50 from directly above the container 17, it can evenly approach a plurality of targets 50 in the container 17. When the robot 10 approaches the container 17 from directly above the container 17, it can also be said that the suction unit 121 can easily reach each location in the container 17.

[0046] Therefore, the reference direction 112 is set based on the direction of the opening 17a of the container 17, for example. For example, the reference direction 112 may be set in a direction perpendicular to a plane 17aa (also called the opening plane 17aa) including the opening 17a of the container 17, as shown in FIG. 5. For example, the reference direction 112 may be set in a direction perpendicular to the opening plane 17aa and passing through a representative point 50aa of the approach target surface 50a. In this example, since the height direction of the wall 170 of the container 17 is perpendicular to the opening plane 17aa, it can be said that the reference direction 112 is set along the height direction of the wall 170. Note that the reference direction 112 may be slightly inclined with respect to the direction perpendicular to the opening plane 17aa. In this case, the inclination angle of the reference direction 112 with respect to the direction perpendicular to the opening plane 17aa may be, for example, greater than 0 degrees and equal to or less than 10 degrees. Furthermore, the reference direction 112 may be a direction in which the degree of freedom of each joint of the robot 10 is the highest when the robot 10 approaches the container 17, for example, based on the positional relationship between the robot 10 and the container 17. Furthermore, the reference direction 112 may be expressed, for example, by a line segment connecting a position where the inside of the container 17 can be best viewed from the robot 10 and a representative point of the approach target 50. In this case, the position where the inside of the container 17 can be best viewed from the robot 10 is located above the center of the opening plane 17aa, for example. In the above example, the reference direction 112 is set as a direction that is easy to approach, but the direction perpendicular to the opening plane of the container 17 may simply be set as the reference direction 112. Furthermore, the reference direction 112 may be changed for each approach target 50.

[0047] The reference direction 112 may be set by a user such as a robot user or a robot setter. The method of determining the reference direction 112 may be set by the user, for example. The user inputs reference direction information indicating the reference direction 112 to the processing device 1, for example, via the input unit 5. The reference direction information input to the processing device 1 is stored in the storage unit 3. The setting unit 21 sets the approach direction 100 based on the reference direction 112 indicating the reference direction information in the storage unit 3.

[0048] When the approach direction 100 is set after step s2, first, in step s3, the setting unit 21 obtains a direction 113 based on the adjustment angle α (also referred to as a first relaxation direction 113) that is moved toward the reference direction 112 side by the adjustment angle α from the normal direction 110 as shown in FIG. 7. In this embodiment, the first relaxation direction 113 is closer to the reference direction 112 by the adjustment angle α from the normal direction 110. The reference direction 112 can be used as a reference for the adjustment direction when setting the approach direction 100. The adjustment angle α is set based on, for example, the success rate of adsorption of the adsorption unit 121 to the adsorption target surface 50a (also referred to as the adsorption success rate), as described later. The adjustment angle α may be set to, for example, at least 5 degrees or more, at least 10 degrees or more, at least 15 degrees or more, or at least 20 degrees or more.

[0049] When the setting unit 21 determines the direction 113 based on the adjustment angle α (in other words, the first relaxed direction 113), for example, a specific plane including the normal direction 110 and the reference direction 112 is considered. Then, the setting unit 21 sets the direction obtained by rotating the normal direction 110 toward the reference direction 112 by the adjustment angle α on the specific plane with one end of the normal direction 110 on the representative point 50aa side as a rotation fulcrum as the first relaxed direction 113. Here, the angle of the normal direction 110 with respect to the reference direction 112, that is, the angle between the reference direction 112 and the normal direction 110, is set as the normal angle β. The first relaxed direction 113 is a direction whose angle with the normal direction 110 is α and whose angle with the reference direction 112 is (β-α).

[0050] After step s3, in step s4, the setting unit 21 determines whether or not the robot 10 can actually approach the approach target surface 50a from the first reduction direction 113. In other words, the setting unit 21 determines whether or not the robot 10 can approach the approach target surface 50a from the approach start position along the first reduction direction 113 and actually reach the approach target surface 50a.

[0051] Here, when the robot 10 attempts to approach from a certain direction, the robot 10 may interfere with the container 17. In this case, the robot 10 cannot actually approach the approach target surface 50a from the certain direction. In addition, since the robot 10 has a singular point, the robot 10 is not structurally capable of freely setting the position of the suction portion 121 of the end effector 12. Therefore, the robot 10 may not actually be able to approach the approach target surface 50a from a certain direction.

[0052] The setting unit 21 specifies the position and posture of the container 17 based on, for example, a camera image, and determines whether the robot 10 will interfere with the container 17 when the robot 10 approaches the approach target surface 50a from the first reduction direction 113 based on the result of the specification. The control unit 2 also specifies each position of the suction unit 121 to be set in order for the robot 10 to approach the approach target surface 50a from the first reduction direction 113, and determines whether the position of the suction unit 121 can actually be set at each specified position using an inverse kinematic equation. Then, when the setting unit 21 determines that the position of the suction unit 121 can actually be set at each specified position and determines that the robot 10 will not interfere with the container 17, it determines that the robot 10 can actually approach the approach target surface 50a from the first reduction direction 113.

[0053] When the setting unit 21 determines in step s4 that the robot 10 can approach the approach target surface 50a from the first reduced direction 113, in step s5, it sets the first reduced direction 113 to the approach direction 100. Thereby, the approach direction 100 for the approach target 50 is set, and the approach direction setting process ends.

[0054] When the approach direction 100 is set in the approach direction setting process, the control unit 2 controls the robot 10 so that the robot 10 approaches the approach target surface 50a from the set approach direction 100 and adsorbs the approach target surface 50a. Fig. 8 is a schematic diagram showing an example of a state in which the robot 10 approaches the approach target surface 50a from a first easing direction 113 set in the approach direction 100.

[0055] As in the example of Fig. 8, when the robot 10 approaches the approach target surface 50a from the first relaxation direction 113 and the suction unit 121 suctions the target object 50, as shown in Fig. 9, the first end 121x side of the suction unit 121 contacts the suction target surface 50a of the target object 50 in a state in which it is more contracted than the second end 121y side opposite the first end 121x side. In the example of Fig. 9, when the suction unit 121 approaches the target object 50, the upper side (which can be said to be the left side in Fig. 9) of the suction unit 121 comes into close contact with the target object 50 in a state in which it is more contracted than the lower side (which can be said to be the right side in Fig. 9). In the case where the outer shape of the suction part 121 is, for example, a truncated cone, the suction part 121 can be said to be in close contact with the target object 50 in a state where the first portion 121x on the side of the truncated cone on the side where the approach direction 100 is inclined with respect to the normal direction 110 is contracted more than the second portion 121y on the opposite side to the first portion 121x. In addition, the suction part 121 approaches the target object 50 in a state where the suction opening surface 121a does not directly face the suction target surface 50a of the target object 50. In other words, the suction part 121 approaches the target object 50 while the suction opening surface 121a faces the suction target surface 50a at an angle. In addition, after the suction part 121 suctions the target object 50, the shape of the suction part 121 may differ from that when it was in close contact with the target object 50 due to the gravity of the target object 50. In other words, the shape of the suction part 121 may differ before and after the suction part 121 lifts the target object 50.

[0056] The control unit 2 controls the robot 10 so that, when the robot 10 picks up the target object 50, the robot 10 moves the target object 50 to the destination container 18 and places the target object 50 in the destination container 18. When the robot 10 places the target object 50 in the destination container 18, the control unit 2 controls the robot 10 so that the end effector 12 is located above the source container 17. Thereafter, the control unit 2 determines the next approach target object 50 and executes the approach method setting process for the determined next approach target object 50. Thereafter, the control unit 2 operates in the same manner. When the control unit 2 determines the approach target object 50 based on the camera image, for example, as shown in FIG. 6, it controls the posture of the arm 11 so that the suction opening surface of the suction unit 121 is parallel to the opening plane 17aa of the container 17.

[0057] On the other hand, in step s4, when it is determined that the robot 10 cannot actually approach the approach target surface 50a from the first mitigation direction 113 due to interference between the robot 10 and the container 17 or due to a singularity of the robot 10, the approach direction 100 for the approach target 50 is not set and the approach direction setting process ends.

[0058] When the approach setting process ends without setting the approach direction 100, the control unit 2 determines the next approach object 50. Then, the control unit 2 executes the approach method setting process for the determined next approach object 50. Thereafter, the control unit 2 operates in the same manner.

[0059] In addition, when the first mitigation direction 113 is obtained, when the normal direction 110 is rotated toward the reference direction 112 by the adjustment angle α on the specific plane with one end of the normal direction 110 on the representative point 50aa side as a fulcrum of rotation, the rotated normal direction 110 may exceed the reference direction 112. In this case, the setting unit 21 may determine in step s4 whether or not the robot 10 can approach the approach target surface 50a from the reference direction 112. Then, when the setting unit 21 determines that the robot 10 can approach the approach target surface 50a from the reference direction 112, the setting unit 21 may set the reference direction 112 to the approach direction 100 in step s5.

[0060] Thus, in the present disclosure, a direction different from the normal direction 110 is set as the approach direction 100. Specifically, for example, the approach direction 100 is set based on the normal direction 110 and the reference direction 112. Here, from the viewpoint of the success rate of suction, it is desirable for the robot 10 to approach the approach target surface 50a from the normal direction 110. On the other hand, as described above, there is a possibility that the robot 10 cannot actually approach the approach target surface 50a from the normal direction 110 due to the reason that the robot 10 interferes with the container 17, etc. In addition, even if the robot 10 approaches the approach target surface 50a from a direction deviated from the normal direction 110, there is a possibility that the suction part 121 can suction the approach target surface 50a due to the elasticity of the suction part 121 (in other words, due to flexibility). As in this example, the approach direction 100 is set based on the normal direction 110 and the reference direction 112 of the approach of the robot 10 to the approach target 50, thereby improving the possibility that the robot 10 can actually approach the target 50 from the set approach direction 100 while increasing the pickup success rate. For example, as in the example of Fig. 4, a direction 113 based on the adjustment angle α, which is closer to the reference direction 112 of the approach of the robot 10 to the approach target 50 by the adjustment angle α from the normal direction 110, is set as the approach direction 100, thereby improving the possibility that the robot 10 can actually approach the target 50 from the set approach direction 100 while increasing the pickup success rate. Therefore, the robot 10 can easily pick up and hold the target 50.

[0061] The adjustment angle α is set based on, for example, a suction success rate when the robot 10 approaches the approach target surface 50a from the first relaxation direction 113 and suctions the approach target surface 50a (also referred to as a suction success rate in the first relaxation direction). If the suction success rate when the robot 10 approaches the approach target surface 50a from the normal direction 110 and suctions the approach target surface 50a is called a suction success rate in the normal direction, the adjustment angle α is set to, for example, a value such that the suction success rate in the first relaxation direction is a predetermined % or more of the suction success rate in the normal direction. The predetermined % is less than 100%, and may be set to, for example, 70%, or may be set to another value. The adjustment angle α may be input by, for example, a user through the input unit 5.

[0062] The suction success rate in the first relaxation direction and the suction success rate in the normal direction for setting the adjustment angle α may be calculated by actually operating the robot 10 (i.e., the actual robot 10 may be used for calculation), or may be calculated using a robot physics simulator. In the latter case, information that affects the suction success rate in the first relaxation direction may be input to the robot physics simulator. For example, suction unit information on the suction unit 121 and object information on the target object 50 may be input to the robot physics simulator. The suction unit information input to the robot physics simulator may include, for example, at least one of the diameter of the suction opening 121a of the suction unit 121, the length of the suction unit 121, and the material of the suction unit 121. In addition, the object information input to the robot physics simulator may include at least one of the mass of the target object 50, information specifying the surface treatment (such as anodizing, bead treatment, or cutting treatment) of the target object 50, and position information of the suction target surface 50a of the target object 50.

[0063] <Another example of approach direction setting processing> FIG. 10 is a flow chart showing another example of the approach direction setting process. In the example of FIG. 10, the above-mentioned steps s1 and s2 are executed. Next, in step s11, the setting unit 21 judges whether or not the robot 10 can actually approach the approach target surface 50a from the normal direction 110, in the same manner as in step s4. If the judgment in step s11 is YES, in step s12, the setting unit 21 sets the normal direction 110 to the approach direction 100. As a result, the approach direction 100 for the approach target 50 is set, and the approach setting process ends. When the normal direction 110 is set to the approach direction 100, the control unit 2 controls the robot 10 so that the robot 10 approaches the approach target surface 50a from the normal direction 110 and picks up the approach target surface 50a. FIG. 11 is a schematic diagram showing an example of the robot 10 approaching the approach target surface 50a from the normal direction 110. When the robot 10 picks up the target 50, the control unit 2 operates in the same manner as described above.

[0064] On the other hand, if it is determined in step s11 that the robot 10 cannot actually approach the approach target surface 50a from the normal direction 110 due to interference between the robot 10 and the container 17, etc., the above-mentioned steps s3 and s4 are executed. If the determination in step s4 is Yes, the above-mentioned step s5 is executed and the first mitigation direction 113 is set to the approach direction 100. As a result, the approach direction 100 for the approach target 50 is set and the approach direction setting process is terminated. When the approach direction 100 is set and the approach direction setting process is terminated, the control unit 2 controls the robot 10 so that the robot 10 approaches the approach target surface 50a from the set approach direction 100 and adsorbs the approach target surface 50a, as described above. Thereafter, the control unit 2 operates in the same manner.

[0065] If the determination in step s4 is NO, the approach direction 100 for the approach object 50 is not set and the approach setting process ends. If the approach direction 100 is not set and the approach setting process ends, the control unit 2 determines the next approach object 50. Then, the control unit 2 executes the approach method setting process for the determined next approach object 50. Thereafter, the control unit 2 operates in the same manner.

[0066] 10, the setting unit 21 determines whether or not the robot 10 can approach the approach target surface 50a from the normal direction 110. When the setting unit 21 determines that the robot 10 can approach the approach target surface 50a from the normal direction 110, the setting unit 21 sets the normal direction 110 as the approach direction 100. This can improve the success rate of suction.

[0067] In contrast, as in the example of Figure 4, when it is not determined whether the robot 10 can approach the approach target surface 50a from the normal direction 110 and the first mitigation direction 113 is set to the approach direction 100, the time required for the approach direction setting process can be shortened.

[0068] After determining the direction in which the robot 10 approaches the approach target surface 50a, the setting unit 21 may further determine whether or not the approach posture from the determined direction does not exceed the limit posture of the robot 10. Specifically, when the setting unit 21 determines that the approach is possible from the normal direction 110 of the approach target surface 50a, the setting unit 21 may determine whether or not the angle of the approach posture from the normal direction 110 (i.e., normal angle β) does not exceed an upper limit value L (also referred to as posture upper limit value L) based on postures that the robot can take, which will be described later. When the angle of the approach posture from the normal direction 110 does not exceed the posture upper limit value L, the setting unit 21 may set the normal direction 110 as the approach direction. On the other hand, when the angle of the approach posture from the normal direction 110 exceeds the posture upper limit value L, the setting unit 21 may determine whether or not the robot 10 can approach from a direction based on the posture upper limit value L, which will be described later. Furthermore, when the robot 10 cannot approach from a direction based on the posture upper limit value L, the setting unit 21 may determine whether or not the robot 10 can approach from a first mitigation direction 113. Furthermore, if the angle of the approach posture from the normal direction 110 exceeds the posture upper limit value L, the setting unit 21 may determine whether or not the robot 10 can approach from the first relaxed direction 113. Furthermore, if the robot 10 cannot approach from the first relaxed direction 113, it may determine whether or not the robot 10 can approach from a direction based on the posture upper limit value L. After that, the setting unit 21 may set the direction that the robot 10 can approach to the approach direction 100.

[0069] Furthermore, when the setting unit 21 determines that the approach target surface 50a is approachable from the first reduced direction 113, the setting unit 21 may determine whether or not the angle of the approach posture from the first reduced direction 113 (i.e., the angle between the reference direction 112 and the first reduced direction 113) exceeds the posture upper limit value L. When the angle of the approach posture from the first reduced direction 113 does not exceed the posture upper limit value L, the setting unit 21 may set the first reduced direction 113 as the approach direction. On the other hand, when the angle of the approach posture from the first reduced direction 113 exceeds the posture upper limit value L, the setting unit 21 may determine whether or not the robot 10 is approachable from a direction based on the posture upper limit value L. Thereafter, the setting unit 21 may set the direction in which the robot 10 is approachable to the approach direction 100.

[0070] Fig. 12 is a flowchart showing another example of the approach direction setting process. In the example of Fig. 12, the setting unit 21 can execute a first setting process and a second setting process that set the approach direction 100 by using different methods. In the first setting process, the normal direction 110 is set to the approach direction 100. In the second setting process, the first mitigation direction 113 is set to the approach direction 100. The setting unit 21 determines whether to execute the first setting process or the second setting process depending on the normal angle β (see Fig. 7).

[0071] In the approach direction setting process of FIG. 13, the above-mentioned steps s1 and s2 are first executed. Next, in step s21, the setting unit 21 obtains a normal angle β as the angle of the normal direction 110 with respect to the reference direction 112. Next, in step s22, the setting unit 21 judges whether the normal angle β is equal to or greater than a threshold value. If the result of the judgment in step s22 is YES, that is, if the normal angle β is relatively large, the setting unit 21 executes a first setting process in step s23. In the first setting process, for example, steps s11 and s12 in FIG. 10 are executed. If the result of the judgment in step s11 is YES and step s12 is executed, the approach setting process in which the normal direction 110 is set to the approach direction 100 is terminated. On the other hand, if the result of the judgment in step s11 is No, the approach setting process is terminated without setting the approach direction 100.

[0072] If the determination in step s22 is NO, that is, if the normal angle β is relatively small, the setting unit 21 executes a second setting process in step s24. In the second setting process, for example, steps s3, s4, and s5 in Fig. 4 are executed. If the determination in step s4 is YES and step s5 is executed, the first mitigation direction 113 is set to the approach direction 100 and the approach direction setting process ends. On the other hand, if the determination in step s4 is NO, the approach direction 100 is not set and the approach setting process ends.

[0073] As described above, when the robot 10 picks up the target object 50, the camera 13 photographs the target object 50 from above the container 17. For this reason, when the actual normal angle β of the approach target object 50 is large (in other words, when the approach target surface 50a is significantly inclined with respect to the reference direction 112), the accuracy with which the identification unit 20 identifies the position and posture of the approach target surface 50a based on the distance image included in the camera image (also referred to as the identification accuracy of the approach target surface 50a) may decrease. For example, when the distance image is acquired by the stereo method, when the actual normal angle β of the approach target object 50 is large, it becomes difficult for the approach target surface 50a to be captured by the stereo camera. This may decrease the identification accuracy of the approach target surface 50a. Also, when the distance image is acquired by the ToF method, when the actual normal angle β of the approach target object 50 is large, it becomes difficult for the light receiving sensor to receive the reflected light from the approach target surface 50a. This may decrease the identification accuracy of the approach target surface 50a. When the accuracy of identifying the approach target surface 50a decreases, the accuracy of identifying the normal direction 110 by the identifying unit 20 decreases. When the accuracy of identifying the normal direction 110 decreases, the first mitigation direction 113 set by the setting unit 21 may be away from the actual normal direction 110 by an angle greater than the adjustment angle α. In other words, the set first mitigation direction 113 may be significantly inclined with respect to the actual normal direction 110. In this case, even if the robot 10 approaches the approach target surface 50a from the first mitigation direction 113 set by the setting unit 21, it may fail to adsorb to the approach target surface 50a.

[0074] 12, in the case where the setting unit 21 determines whether to execute the first setting process or the second setting process depending on the obtained normal angle β, when the obtained normal angle β is relatively large, the setting unit 21 can set the specified normal direction 110 as the approach direction 100, rather than the first mitigation direction 113. As a result, even if the actual normal angle β is large and the specification accuracy of the normal direction 110 is low, the set approach direction 100 is less likely to deviate from the actual normal direction 110, and the robot 10 can more easily adsorb the approach target 50.

[0075] The threshold value to be compared with the normal angle β in step s22 can be set appropriately by the user based on, for example, the results of investigating how the accuracy of the normal direction 110 identified based on the distance image changes depending on the magnitude of the actual normal angle β. The threshold value is notified to the processing device 1 via, for example, the input unit 5.

[0076] In the first setting process, if step s11 is determined to be NO, steps s3, s4, and s5 may be executed as in Fig. 9. In this case, when it is determined that the robot 10 cannot approach the approach target surface 50a from the normal direction 110 due to, for example, interference between the robot 10 and the container 17, the first mitigation direction 113 may be set to the approach direction 100, thereby improving the possibility that the robot 10 can adsorb the approach target surface 50a.

[0077] Fig. 13 is a flowchart showing another example of the approach direction setting process. In the example of Fig. 13, the above-mentioned steps s1, s2, and s21 are executed. Next, in step s31, the setting unit 21 determines whether the normal angle β is equal to or smaller than an upper limit L based on the posture that the robot 10 can take (also referred to as a posture upper limit L).

[0078] The orientation upper limit value L is set based on the orientation that the robot 10 can take. In this example, since the orientation of the robot 10 is determined by the orientation of the arm 11, the orientation upper limit value L can be said to be a value based on the orientation that the arm 11 can take, for example. The orientation upper limit value L is a value that allows the robot 10 to generally take an orientation that allows the robot 10 to approach the suction target surface 50a from the normal direction 110 of the suction target surface 50a without interfering with a specific obstacle, regardless of the direction in which the suction target surface 50a faces, when the suction target surface 50a of the object 50 in the container 17 can be seen from above the container 17 and the normal angle β of the suction target surface 50a is equal to or less than the orientation upper limit value L. The state in which the suction target surface 50a of the object 50 in the container 17 can be seen from above the container 17 can also be said to be a state in which the suction target surface 50a of the object 50 in the container 17 can be photographed by the camera 13 above the container 17. The camera 13 above the container 17 can also be said to be the camera 13 that photographs the container 17. When the suction target surface 50a of the object 50 in the container 17 is captured by the camera 13 that photographs the container 17 and the normal angle β of the suction target surface 50a is equal to or smaller than the upper orientation limit value L, the robot 10 is highly likely to be able to approach the suction target surface 50a from the normal direction 110 of the suction target surface 50a without interfering with a specific obstacle, regardless of the direction in which the suction target surface 50a faces.

[0079] Here, the specific obstacle means an obstacle other than the container 17 that impedes the movement of the robot 10 and has a fixed position and shape during the operation of the robot 10. The specific obstacle includes, for example, a safety fence that surrounds the periphery of the robot 10. The specific obstacle does not include the container 17.

[0080] The orientation upper limit L is set based on the results of adsorbing the target object 50 at various positions and orientations in the container 17 to the robot 10 using the actual robot 10 or on a robot physics simulator.

[0081] If it is determined in step s31 that the normal angle β is equal to or less than the posture upper limit value L, then the above-mentioned step s11 is executed. If it is determined in step s11 that the robot 10 can approach the approach target surface 50a from the normal direction 110, then the above-mentioned step s12 is executed. As a result, the normal direction 110 is set to the approach direction 100, and the approach setting process ends. On the other hand, if it is determined in step s11 that the robot 10 cannot approach from the normal direction 110, then the approach direction 100 is not set, and the approach setting process ends.

[0082] When it is determined in step s31 that the normal angle β is greater than the orientation upper limit, step s32 is executed. In step s32, the setting unit 21 obtains a direction 114 based on the orientation upper limit L (also referred to as a second relaxed direction 114) that is closer to the divided normal direction 110 of the orientation upper limit L from the reference direction 112 as shown in FIG. 14. When obtaining the direction 114 based on the orientation upper limit L, the setting unit 21 considers, for example, a specific plane including the normal direction 110 and the reference direction 112. Then, the setting unit 21 sets the direction obtained by rotating the reference direction 112 by the orientation upper limit L on the specific plane toward the normal direction 110, with one end of the reference direction 112 on the representative point 50aa side as the fulcrum of rotation, as the direction 114 based on the orientation upper limit L. A direction 114 based on the orientation upper limit value L (in other words, a second relaxed direction 114) is a direction that forms an angle L with the reference direction 112 and an angle (β−L) with the normal direction 110.

[0083] After step s32, in step s33, the setting unit 21 judges whether or not the robot 10 can actually approach the approach target surface 50a from the second relaxation direction 114 in the same manner as in step s4 described above. If it is judged YES in step s33, in step s34, the setting unit 21 sets the second relaxation direction 114 to the approach direction 100. As a result, the approach direction 100 for the approach target 50 is set, and the approach setting process ends. When the control unit 2 sets the second relaxation direction 114 to the approach direction 100, the control unit 2 controls the robot 10 so that the robot 10 approaches the approach target surface 50a from the second relaxation direction 114 and picks up the approach target surface 50a. FIG. 15 is a schematic diagram showing an example of the robot 10 approaching the approach target surface 50a from the second relaxation direction 114. When the robot 10 picks up the target 50, the control unit 2 operates in the same manner as described above.

[0084] On the other hand, if the determination in step s33 is NO, the approach direction 100 is not set for the approach object 50 and the approach setting process ends. After that, the control unit 2 determines the next approach object 50. Then, the control unit 2 executes the approach method setting process for the determined next approach object 50. Thereafter, the control unit 2 operates in the same manner.

[0085] 13, when the normal angle β of the approach target object 50 is larger than the orientation upper limit value L based on the orientation that the robot 10 can take, the second relaxed direction 114, which is closer to the normal direction 110 from the reference direction 112 by the orientation upper limit value L, is set as the approach direction 100. In this case, the second relaxed direction 114 set as the approach direction 100 is closer to the reference direction 112 of the approach of the robot 10 to the target object 50 than the normal direction 110, as shown in FIGS. 14 and 15. As a result, when the normal direction 110 of the approach target surface 50a is inclined more than the reference direction 112 and therefore the robot 10 is highly likely not to be able to approach from the normal direction 110, the robot 10 approaches the approach target surface 50a from the second relaxed direction 114, which is closer to the reference direction 112, thereby making it easier for the robot 10 to adsorb the approach target surface 50a.

[0086] In the example of Fig. 13, if step s11 is determined to be NO, steps s3, s4, and s5 may be executed as shown in Fig. 16. In this case, when the robot 10 cannot approach the approach target surface 50a from the normal direction 110, a first mitigation direction 113 that is closer to the reference direction 112 from the normal direction 110 by the adjustment angle α may be set as the approach direction 100. This makes it easier for the robot 10 to adsorb the approach target surface 50a.

[0087] 13, if it is determined in step s33 that the robot 10 cannot approach the approach target surface 50a from the second easing direction 114, steps s3, s4, and s5 may be executed as shown in Fig. 17. In this case, when the robot 10 cannot approach the approach target surface 50a from the second easing direction 114, a first easing direction 113 that is closer to the reference direction 112 from the normal direction 110 by the adjustment angle α may be set as the approach direction 100.

[0088] 18 is a schematic diagram showing an example of the first relaxed direction 113 and the second relaxed direction 114 when the normal direction 110 is larger than the orientation upper limit value L. The orientation upper limit value L is set to a value larger than the adjustment angle α. For example, the orientation upper limit value L is set to 35 degrees, and the adjustment angle α is set to 20 degrees. In this case, when the normal angle β is 40 degrees, the angle between the first relaxed direction 113 and the reference direction 112 is 20 degrees, which is smaller than the orientation upper limit value L (i.e., the angle between the second relaxed direction 114 and the reference direction 112). Also, when the normal angle β is 50 degrees, the angle between the first relaxed direction 113 and the reference direction 112 is 30 degrees, which is smaller than the orientation upper limit value L. 18, when the angle that the first reduction direction 113 makes with the reference direction 112 is smaller than the posture upper limit value L, the first reduction direction 113 is closer to the reference direction 112 for the robot 10 to approach the target object 50 than the second reduction direction 114. When the robot 10 cannot approach from the second reduction direction 114, the first reduction direction 113, which is closer to the reference direction 112 than the second reduction direction 114, is set as the approach direction 100, making it easier for the robot 10 to adsorb the approach target surface 50a.

[0089] If the normal angle β is large enough that the angle between the first mitigation direction 113 and the reference direction 112 is equal to or larger than the orientation upper limit value L, the approach direction setting process may end without executing steps s3, s4, and s5 if step s33 returns NO. Alternatively, if the normal angle β is large enough that the angle between the first mitigation direction 113 and the reference direction 112 is equal to or larger than the orientation upper limit value L, the approach direction setting process may end without executing steps s32 and onward.

[0090] In the first setting process in the example of FIG. 12, the process after step s31 in the flowchart of FIG. 13 (that is, steps s31, s32, s33, s34, s11, and s12) may be executed. In this case, the threshold value to be compared with the normal angle β in step s22 of FIG. 12 is set to a value smaller than the orientation upper limit value L. For example, the threshold value is set to 30 degrees, and the orientation upper limit value L is set to 35 degrees. In the first setting process, when the process after step s31 in the flowchart of FIG. 13 is executed, if it is determined as NO in step s11, steps s3, s4, and s5 may be executed as shown in FIG. 16. In addition, in the first setting process, when the process after step s31 in the flowchart of FIG. 13 is executed, if it is determined as NO in step s33, steps s3, s4, and s5 may be executed as shown in FIG. 17.

[0091] As described above, when the actual normal angle β of the approach object 50 is large, the accuracy of identifying the approach object surface 50a may decrease. When the accuracy of identifying the approach object surface 50a decreases, the accuracy of identifying the normal direction 110 by the identifying unit 20 decreases. When the accuracy of identifying the normal direction 110 decreases, the first relaxation direction 113 set by the setting unit 21 may be away from the actual normal direction 110 by an angle greater than the adjustment angle α. In other words, the set first relaxation direction 113 may be significantly inclined with respect to the actual normal direction 110. As a result, when the robot 10 approaches the approach object 50 from the first relaxation direction 113, it may fail to adsorb the approach object 50.

[0092] Therefore, the setting unit 21 may change the adjustment angle α according to the obtained normal angle β. Specifically, the setting unit 21 may reduce the adjustment angle α as the obtained normal angle β increases. This reduces the possibility that the first mitigation direction 113 will deviate significantly from the actual normal direction 110. Therefore, the robot 10 is less likely to fail to adsorb the approach target 50. For example, when the normal angle β is greater than 30 degrees, the setting unit 21 may set the adjustment angle α to 15 degrees, and when the normal angle β is 30 degrees or less, the setting unit 21 may set the adjustment angle α to 20 degrees. Note that the setting unit 21 may change the adjustment angle α in three or more stages according to the normal angle β.

[0093] Furthermore, when the depth of the container 17 is large (i.e., when the wall 170 is high) and the adjustment angle α is small, if the normal angle β is large, even if the robot 10 attempts to approach the approach object 50 from the first mitigation direction 113, it may interfere with the high wall 170 of the container 17 and be unable to approach the approach object 50.

[0094] Therefore, in a case where the accuracy of identifying the approach target surface 50a does not decrease significantly even when the actual normal angle β of the approach target 50 is large, and the container 17 is deep, the setting unit 21 may increase the adjustment angle α as the calculated normal angle β increases. This makes it easier for the robot 10 to approach the approach target 50 from the first mitigation direction 113, even when the normal angle β is large. For example, the setting unit 21 may set the adjustment angle α to 25 degrees when the normal angle β is larger than 30 degrees, and set the adjustment angle α to 20 degrees when the normal angle β is 30 degrees or less.

[0095] Furthermore, the setting unit 21 may set the adjustment angle α based on suction unit information related to the suction unit 121 and object information related to the object 50. In this case, the setting unit 21 may set the adjustment angle α based on table information 500 indicating the correspondence between the suction unit information, the object information, and the adjustment angle α. By referring to the table information 500, the setting unit 21 can specify what value of the adjustment angle α to set in what case of the suction unit information and the object information.

[0096] 19 is a schematic diagram showing an example of table information 500. The suction portion information included in the table information 500 includes, for example, the diameter (also simply referred to as the opening diameter) of the suction opening 121a of the suction portion 121, the length of the suction portion 121, and the material of the suction portion 121. The target object information included in the table information 500 includes the mass of the target object 50 and information specifying the surface treatment of the target object 50 (anodizing, beading, cutting, etc.). The table information 500 shown in FIG. 19 shows that, for example, when the opening diameter of the suction portion 121 is a1, the length of the suction portion 121 is b1, the material of the suction portion 121 is silicone rubber, the mass of the target object 50 is d1, and the surface treatment of the target object 50 is anodizing, the value of the adjustment angle α is set to α1. Furthermore, table information 500 indicates that the value of adjustment angle α is set to α2 when, for example, the opening diameter of adsorption portion 121 is a2, the length of adsorption portion 121 is b2, the material of adsorption portion 121 is polyurethane rubber, the mass of object 50 is d2, and the surface treatment of object 50 is a cutting treatment. Furthermore, table information 500 indicates that the value of adjustment angle α is set to α3 when, for example, the opening diameter of adsorption portion 121 is a3, the length of adsorption portion 121 is b3, the material of adsorption portion 121 is fluororubber, the mass of object 50 is d3, and the surface treatment of object 50 is a bead treatment.

[0097] The storage unit 3 stores suction unit information related to the suction unit 121 currently included in the robot 10, and object information related to the current object 50. The setting unit 21 acquires the value of the adjustment angle α corresponding to the contents of the suction unit information and the object information in the storage unit 3 from the table information 500. Then, the setting unit 21 uses the value acquired from the table information 500 as the value of the adjustment angle α.

[0098] The table information 500 may be generated based on the suction success rate in the first relaxation direction and the suction success rate in the normal direction calculated using an actual robot 10, or may be generated based on the suction success rate in the first relaxation direction and the suction success rate in the normal direction calculated using a robot physics calculation simulator. For example, α1 may be set to a value such that the suction success rate in the first relaxation direction is equal to or greater than a predetermined percentage of the suction success rate in the normal direction when the opening diameter of the suction part 121 is a1, the length of the suction part 121 is b1, the material of the suction part 121 is silicone rubber, the mass of the target object 50 is d1, and the surface treatment of the target object 50 is anodized. The table information 500 is input to the processing device 1 through, for example, the input unit 5. The table information 500 input to the processing device 1 is stored in the storage unit 3.

[0099] Note that, in a case where the adjustment angle α is made smaller as the obtained normal angle β is larger, the setting unit 21 may, for example, determine the maximum value of the adjustment angle α using the table information 500, and set another value of the adjustment angle α based on the maximum value determined using the table information 500. In a case where the adjustment angle α is made larger as the obtained normal angle β is larger, the setting unit 21 may, for example, determine the minimum value of the adjustment angle α using the table information 500, and set another value of the adjustment angle α based on the minimum value determined using the table information 500.

[0100] The above-mentioned reference direction 112 may be specified in the robot coordinate system or in the camera coordinate system. The robot coordinate system is a three-dimensional orthogonal coordinate system set in the robot 10. When controlling the robot 10, the control unit 2 manages the position of the robot 10 in the robot coordinate system. On the other hand, the camera coordinate system is a three-dimensional orthogonal coordinate system set in the camera 13. The position of each pixel value of the color image and the range image generated by the camera 13 is expressed in the camera coordinate system.

[0101] For example, consider the case where the reference direction 112 is specified in the robot coordinate system, that is, the reference direction 112 is set in the robot coordinate system. In this case, if the orientation of the opening 17a of the container 17 (in other words, the orientation of the opening plane 17aa) changes, the reference direction 112 in the robot coordinate system changes. Therefore, it is necessary to re-specify the reference direction 112 in accordance with the change in the orientation of the opening 17a.

[0102] In contrast, consider the case where the reference direction 112 is specified in the camera coordinate system, that is, the case where the reference direction 112 is set in the camera coordinate system. Since the camera 13 is fixed to the end effector 12, even if the orientation of the opening 17a of the container 17 changes, the posture of the camera 13 with respect to the orientation of the opening 17a when the camera 13 photographs the object 50 in the container 17 from above the container 17 can be kept constant. Therefore, when the reference direction 112 is specified in the camera coordinate system, it is not necessary to re-specify the reference direction 112 according to the change in the orientation of the opening 17a. Furthermore, even if the robot 10 sucks and holds the object 50 in turn from a plurality of containers 17 whose openings 17a have different orientations, it is not necessary to specify the reference direction 112 for each container 17, and it is possible to specify a common reference direction 112 for the plurality of containers 17. Therefore, when the reference direction 112 is specified in the camera coordinate system, it is possible to reduce the burden on the user.

[0103] In the above-described approach direction setting process, the approach direction 100 in the camera coordinate system may be set. In this case, the reference direction 112 may be set to any one of the x-axis, y-axis, and z-axis of the camera coordinate system. This reduces the amount of calculation required to obtain the first relaxation direction 113 and the second relaxation direction 114 set based on the reference direction 112. In the case where the z-axis of the camera coordinate system when the camera 13 photographs the object 50 in the container 17 from above the container 17 is perpendicular to the opening plane 17aa, the reference direction 112 may be set to the z-axis of the camera coordinate system. In the approach direction setting process, when the approach direction 100 in the camera coordinate system is set, the control unit 2 converts the approach direction 100 set in the camera coordinate system into the approach direction 100 in the robot coordinate system and then controls the robot 10.

[0104] In the approach direction setting process, the approach direction 100 in the robot coordinate system may be set. In this case, when the reference direction 112 is specified in the camera coordinate system, the control unit 2 sets the approach direction 100 after converting the reference direction 112 in the camera coordinate system into the reference direction 112 in the robot coordinate system.

[0105] In the above example, the camera 13 is a three-dimensional camera, but it may be a two-dimensional camera that generates a color image. In this case, the identification unit 20 identifies the position and posture of the approach target object 50 based on the color image. Then, the identification unit 20 identifies the position and posture of the approach target surface 50a based on the identified position and posture of the approach target object 50 and attraction target surface information indicating the position and range of the attraction target surface on the surface of the target object 50. The attraction target surface information is stored in the storage unit 3 in advance.

[0106] In the above example, the adjustment angle α is smaller than the normal angle β, but the normal angle β may be smaller than the adjustment angle α. In this case, the suction portion 121 may have the approach direction 100 set on the opposite side of the normal direction 110 across the reference direction 112.

[0107] In the above example, the case where the approach direction 100 is adjusted toward the reference direction 112 is described, but the present disclosure is not limited thereto. For example, when the target object 50 is near the wall of the container 17, when the approach direction 100 is set toward the reference direction 112, it may interfere with the wall of the container 17. In this case, for example, the approach direction 100 may be set in a direction away from the reference direction 112. In this case, for example, after it is determined that there is interference with the first approach direction rotated and moved toward the reference direction 112 by the adjustment angle α, it may be determined whether there is interference with the second approach direction rotated and moved by the adjustment angle α in a direction away from the reference direction 112. Also, for example, when the normal angle β is smaller than a predetermined value, it may be determined that there is interference with the second approach direction without determining that there is interference with the first approach direction. In these cases, the adjustment angle α for the second approach direction may be set smaller than the adjustment angle α for the first approach direction.

[0108] In the above example, the approach direction 100 is set based on the reference direction 112, but the reference direction 112 does not have to be set. In this case, for example, a maximum value of the adjustment angle α is set, and the adjustment angle α is set so as to gradually approach the maximum value of the adjustment angle α with the maximum value of the adjustment angle α as a limit value. Then, interference of the approach direction 100 at the stepwise set adjustment angle α is judged, and if it is judged that there is no interference, the adjustment angle α is set as the approach direction 100. In this case, the adjustment angle α may be changed, for example, so that the height of a certain point in the normal direction 110 is increased, or, for example, so that the object 50 and the wall surface of the container 17 recognized based on the camera image are moved away.

[0109] In the above example, the adjustment angle α is changed so that the height of a certain point in the normal direction 110 increases, but the present disclosure is not limited to this. For example, when a plane including the opening plane 17aa of the container 17 is taken as a plane passing through the x-axis and y-axis, the adjustment angle α may be changed so that the x-axis value and the y-axis value change.

[0110] <Robot control system> The processing device 1 according to the present embodiment may be a part of a robot control system 60 and may be communicatively connected to the robot 10 so as to be able to control the robot 10. FIG. 20 is a schematic diagram showing an example of the configuration of the robot control system 60. As shown in FIG. 20, the robot control system 60 includes, for example, the above-mentioned processing device 1 and the robot 10 connected to the processing device 1. Furthermore, the robot control system 60 according to the present embodiment includes a terminal device 70 connected to the processing device 1. Specifically, the interface 4 (also referred to as the first interface 4) of the processing device 1 and a second interface 71 of the terminal device 70 are communicatively connected to each other, whereby the processing device 1 and the terminal device 70 are connected to each other. Note that the second interface 71 may have a configuration similar to that of the first interface 4, for example.

[0111] The terminal device 70 may have a second control unit 72 and a display unit 73. The second control unit 72 may acquire necessary information from the control unit 2 (also referred to as the first control unit 2) of the processing device 1 via the first interface 4 and the second interface 71, and display the information on the display unit 73. For example, the second control unit 72 may display on the display unit 73 the approach direction of the suction unit 121 to the target object 50 so that the approach direction is visible. Specifically, the second control unit 72 may display on the display unit 73 information indicating the target object 50 and the approach direction of the suction unit 121 to the suction target surface 50a of the target object 50. The information indicating the approach direction may be, for example, a line segment or an arrow connected to the representative point 50aa of the attraction target surface 50a, an animation in which the attraction part 121 approaches the attraction target surface 50a according to the approach direction, an image in which the positional relationship between the attraction part 121 located on the approach trajectory and the attraction target surface 50a can be recognized from a bird's-eye view, or an image in which the attraction target surface 50a is viewed from the approach direction. As a result, for example, the user can confirm how the robot 10 approaches the target object 50 before starting work.

[0112] 21 and 22 are schematic diagrams showing examples of display on the display unit 73. FIG. 21 shows an example of an animation of the suction unit 121 approaching the target object 50 as viewed from the side by the display unit 73. FIG. 22 shows an example of an animation of the suction unit 121 approaching the target object 50 as viewed from above by the display unit 73. In FIG. 21, information indicating the approach direction of the suction unit 121 is displayed by an arrow 730. In FIG. 22, the positional relationship between the suction unit 121 located on the approach trajectory and the suction target surface 50a is displayed in a bird's-eye view.

[0113] The first control unit 2 can also obtain information necessary for controlling the robot 10 from the second control unit 72. The second control unit 72 of the terminal device 70 may have a configuration equivalent to that of the first control unit 2 of the processing device 1. The display unit 73 of the terminal device 70 may be, for example, a touch panel display or a liquid crystal display.

[0114] As the information indicating the approach direction, a plurality of pieces of information may be displayed simultaneously, or a plurality of pieces of information different from each other may be displayed at different times. When a plurality of pieces of information are displayed simultaneously, for example, an arrow indicating the approach direction and an animation of the suction part 121 approaching the suction target surface 50a along the arrow may be displayed simultaneously. When a plurality of pieces of information different from each other are displayed at different times, for example, after the approach trajectory of the suction part 121 along the approach direction is displayed, the image may be switched to an image of the suction target surface 50a viewed from the approach direction, and how the suction part 121 contacts the suction target surface 50a may be displayed.

[0115] The terminal device 70 may further include an input unit 74. In this case, when the display unit 73 displays information indicating the object 50 and the approach direction, for example, the user may select at least one of the multiple objects 50 arranged in the container 17 via the input unit 74, and the display unit 73 may display information indicating the approach direction for each selected object 50. As a result, the user can confirm whether the robot 10 can approach any object 50. The input unit 74 of the terminal device 70 may have a configuration equivalent to that of the input unit 5 of the processing device 1. In addition, when the robot control system 60 includes the input unit 74 of the terminal device 70, the input unit 74 may function as the input unit 5 of the processing device 1.

[0116] The information indicating the approach direction displayed on the display unit 73 may be operable by the user via the input unit 74. In this case, the terminal device 70 may receive a user operation in which, for example, the user selects information indicating the approach direction displayed linearly via the input unit 74 and moves the information on the display unit 73. The first control unit 2 may determine whether the robot 10 can hold the object 50 when the robot 10 attempts to hold the object 50 along the changed approach direction based on the changed approach direction changed by the user operation. In this case, the second control unit 72 may receive from the first control unit 2 a determination result of the holdability based on the changed approach direction and cause the display unit 73 to display the determination result of the holdability based on the changed approach direction. The determination result may be displayed, for example, as a binary value indicating whether the object can be held or not, or may be displayed as a numerical value as a hold success probability. In addition, for example, as a determination result, a valid approach direction may be highlighted to indicate that the object 50 can be held in the approach direction, or an ineffective approach direction may be darkened to indicate that the object 50 cannot be held in the approach direction.

[0117] The second control unit 72 may also display information indicating the normal direction of the attraction target surface 50a of the target object 50 on the display unit 73. The information indicating the normal direction may be, for example, a line segment or an arrow connected to the representative point 50aa of the attraction target surface 50a, an animation in which the attraction unit 121 approaches the attraction target surface 50a in the normal direction, an image in which the positional relationship between the attraction unit 121 located on the normal line and the attraction target surface 50a can be recognized from a bird's-eye view, or an image in which the attraction target surface 50a is viewed from the normal direction. As a result, for example, the user can confirm how the robot 10 approaches the target object.

[0118] Furthermore, when the display unit 73 displays information indicating the object 50 and the normal direction, for example, the user may be able to select at least one of the multiple objects 50 placed in the container 17 via the input unit 74, and information indicating the normal direction may be displayed for each selected object 50. As a result, the user can check whether the robot 10 can approach any object 50 from the normal direction.

[0119] Furthermore, the second control unit 72 may cause the display unit 73 to display information indicating the approach direction and information indicating the normal direction in a comparable manner. As a result, the user can easily determine how much the approach direction is inclined with respect to the normal direction. The second control unit 72 may cause the display unit 73 to display information indicating the approach reference direction 112 of the object 50. The second control unit 72 may cause the display unit 73 to display the adjustment angle α. The second control unit 72 may cause the display unit 73 to display the normal angle β.

[0120] As described above, the processing device and the robot control system have been described in detail, but the above description is merely illustrative in all respects, and this disclosure is not limited thereto. Furthermore, the above-described various examples can be combined and applied as long as they are not mutually inconsistent. It is understood that countless examples not illustrated can be envisioned without departing from the scope of this disclosure.

[0121] This disclosure includes the following:

[0122] In one embodiment, (1) the processing device is a processing device that controls a robot having an elastic suction portion capable of suction-holding a holding object, and includes a control unit that controls the robot, and the control unit is capable of controlling the suction portion to contact the holding object from a direction different from the normal direction of the suction surface of the holding object, thereby causing the suction portion to suction the holding object.

[0123] (2) In the processing device of (1) above, the control unit has an identification unit that identifies a normal direction of the suction surface of the object to be held, and a setting unit that sets an approach direction in which the suction unit contacts the object to be held, based on the normal direction identified by the identification unit and a reference direction of the robot's approach to the object to be held.

[0124] (3) In the processing device of (2) above, the setting unit sets a direction moved from the normal direction toward the reference direction by an amount of the adjustment angle and based on the adjustment angle as the approach direction.

[0125] (4) In the processing device of (3) above, the setting unit determines whether the robot can approach the surface to be attracted from the normal direction, and when it is determined that the robot can approach the surface to be attracted from the normal direction, sets the normal direction to the approach direction, and when it is determined that the robot cannot approach the surface to be attracted from the normal direction, sets the direction based on the adjustment angle as the approach direction.

[0126] (5) In the processing device of (3) above, the setting unit sets the direction based on the adjustment angle as the approach direction without determining whether or not the robot can approach the surface to be attracted from the normal direction.

[0127] (6) In the processing apparatus according to any one of (2) to (5) above, the setting unit sets the approach direction based on a limit posture of the robot.

[0128] (7) In the processing device of (3) above, the setting unit is capable of executing a first setting process and a second setting process for setting the approach direction by different methods, in which the setting unit sets the normal direction to the approach direction in the first setting process, and in which the setting unit sets the direction based on the adjustment angle to the approach direction in the second setting process, and the setting unit determines whether to execute the first setting process or the second setting process depending on a normal angle as the angle of the normal direction with respect to the reference direction.

[0129] (8) In the processing device of (7) above, in the first setting process, the setting unit determines whether or not the robot can approach the surface to be attracted from the normal direction, and when it is determined that the robot can approach the surface to be attracted from the normal direction, sets the normal direction to the approach direction, and when it is determined that the robot cannot approach the surface to be attracted from the normal direction, sets the direction based on the adjustment angle as the approach direction.

[0130] (9) In the processing device of (7) above, in the first setting process, the setting unit determines whether the normal angle is equal to or less than an upper limit value based on a posture that the robot can take, and if the normal angle is equal to or less than the upper limit value, sets the normal direction to the approach direction, and if the normal angle is greater than the upper limit value, sets the direction based on the upper limit value that is closer to the normal direction from the reference direction by the upper limit value to the approach direction.

[0131] (10) In the processing device of (9) above, when the normal angle is equal to or less than the upper limit value in the first setting process, the setting unit determines whether or not the robot can approach the surface to be attracted from the normal direction, and when it is determined that the robot can approach the surface to be attracted from the normal direction, sets the normal direction to the approach direction, and when it is determined that the robot cannot approach the surface to be attracted from the normal direction, sets the direction based on the upper limit value as the approach direction.

[0132] (11) In the processing device of (9) or (10) above, when the normal angle is greater than the upper limit value in the first setting process, the setting unit determines whether or not the robot can approach the surface to be attracted from the direction based on the upper limit value, and when it is determined that the robot can approach the surface to be attracted from the direction based on the upper limit value, sets the direction based on the upper limit value as the approach direction, and when it is determined that the robot cannot approach the surface to be attracted from the direction based on the upper limit value, sets the direction based on the adjustment angle as the approach direction.

[0133] (12) In the processing device of (2) above, the setting unit determines whether the normal angle, which is the angle of the normal direction with respect to the reference direction, is equal to or less than an upper limit value based on a posture that the robot can take, and if the normal angle is equal to or less than the upper limit value, sets the normal direction to the approach direction. If the normal angle is greater than the upper limit value, sets a direction based on the upper limit value that is closer to the normal direction from the reference direction by the upper limit value to the approach direction.

[0134] (13) In the processing device of (12) above, when the normal angle is equal to or less than the upper limit value, the setting unit determines whether or not the robot can approach the surface to be attracted from the normal direction, and when it is determined that the robot can approach the surface to be attracted from the normal direction, sets the normal direction as the approach direction, and when it is determined that the robot cannot approach the surface to be attracted from the normal direction, sets the approach direction to a direction based on the adjustment angle, which is moved from the normal direction toward the reference direction by the adjustment angle.

[0135] (14) In the processing device of (12) or (13) above, when the normal angle is greater than the upper limit value, the setting unit determines whether or not the robot can approach the surface to be attracted from the direction based on the upper limit value, and when it determines that the robot can approach the surface to be attracted from the direction based on the upper limit value, sets the direction based on the upper limit value as the approach direction, and when it determines that the robot cannot approach the surface to be attracted from the direction based on the upper limit value, sets the direction based on the adjustment angle, which is moved from the normal direction toward the reference direction by the adjustment angle, as the approach direction.

[0136] (15) In the processing device according to any one of (3) to (11), (13) and (14) above, the setting unit changes the adjustment angle in accordance with the normal angle.

[0137] (16) In any one of the processing devices described above in (3) to (11) and (13) to (15), the setting unit sets the adjustment angle based on suction unit information regarding an suction unit that adsorbs the held object and that is possessed by the robot, and object information regarding the held object.

[0138] (17) A robot control system includes any one of the processing devices described above in (1) to (16) and a robot connected to the processing device.

[0139] (18) The program is a program for causing a computer device to function as any one of the processing devices described above in (1) to (16).

[0140] (19) The processing device is a processing device that controls a robot having an adsorption part that adsorbs and holds a holdable object in a movably manner, and includes a control part that controls the robot, and the control part controls the robot so that the adsorption part contacts the adsorption surface of the holdable object with a first end side of the adsorption part contracted relative to the adsorption surface of the holdable object more than a second end side opposite the first end side.

[0141] (20) The terminal device includes a display unit and a control unit that acquires an approach direction of a robot capable of suction-holding an object to be held from a direction different from the normal direction of a surface of the object to be held, and displays the approach direction on the display unit so that the approach direction is recognizable. [Explanation of symbols]

[0142] 1 Processing equipment 10. Robot 2 Control section (first control section) 20 Specific section 21 Setting section 30 Programs 50 Holding Objects 50a Adsorption target surface 60 Robot Control System 70 Terminal Equipment 72 Second Control Section 73 Display section 110 Normal Direction 121 Adsorption part 112 Reference direction 130 1st relaxation direction 140 Second relaxation direction L Upper limit α Adjustment angle β normal angle

Claims

1. A processing device for controlling a robot having an elastic suction part capable of suction-holding a holding object, A control unit for controlling the robot is provided. The control unit is capable of controlling the suction unit to contact the holding object from a direction different from the normal direction of the suction surface of the holding object, thereby causing the suction unit to suction the holding object.

2. 2. The processing device according to claim 1, The control unit is An identification unit that identifies a normal direction of a surface to be attracted of the object to be held; a setting unit that sets an approach direction in which the suction unit contacts the object to be held, based on the normal direction identified by the identification unit and a reference direction of an approach of the robot to the object to be held; A processing device comprising:

3. 3. The processing device according to claim 2, The setting unit sets a direction moved from the normal direction toward the reference direction by an amount of the adjustment angle and based on the adjustment angle as the approach direction.

4. 4. The processing device according to claim 3, The setting unit is determining whether the robot can approach the target surface from the normal direction; when it is determined that the robot can approach the target surface from the normal direction, the normal direction is set as the approach direction; a processing device that, when it is determined that the robot cannot approach the surface to be attracted from the normal direction, sets the direction based on the adjustment angle as the approach direction.

5. 4. The processing device according to claim 3, The setting unit sets the direction based on the adjustment angle as the approach direction without determining whether the robot can approach the attraction target surface from the normal direction.

6. The processing apparatus according to any one of claims 2 to 5, The setting unit sets the approach direction based on a limit posture of the robot.

7. 4. The processing device according to claim 3, The setting unit is capable of executing a first setting process and a second setting process for setting the approach direction by different methods, The setting unit sets the normal direction to the approach direction in the first setting process, The setting unit sets the direction based on the adjustment angle to the approach direction in the second setting process, The processing device, wherein the setting unit determines whether to execute the first setting process or the second setting process depending on a normal angle as an angle of the normal direction with respect to the reference direction.

8. 8. The processing device according to claim 7, In the first setting process, the setting unit determining whether the robot can approach the target surface from the normal direction; when it is determined that the robot can approach the target surface from the normal direction, the normal direction is set as the approach direction; a processing device that, when it is determined that the robot cannot approach the surface to be attracted from the normal direction, sets the direction based on the adjustment angle as the approach direction.

9. 8. The processing device according to claim 7, In the first setting process, the setting unit determining whether the normal angle is equal to or smaller than an upper limit based on a posture that the robot can take; If the normal angle is equal to or smaller than the upper limit, the normal direction is set to the approach direction; When the normal angle is greater than the upper limit value, a direction based on the upper limit value that is closer to the normal direction from the reference direction by the upper limit value is set as the approach direction.

10. 10. The processing device according to claim 9, In the first setting process, the setting unit If the normal angle is equal to or smaller than the upper limit, it is determined whether or not the robot can approach the target surface from the normal direction; when it is determined that the robot can approach the target surface from the normal direction, the normal direction is set as the approach direction; a processing device that, when it is determined that the robot cannot approach the surface to be attracted from the normal direction, sets the direction based on the upper limit value as the approach direction.

11. The processing device according to claim 9 or 10, In the first setting process, the setting unit If the normal angle is greater than the upper limit, it is determined whether or not the robot can approach the target surface from the direction based on the upper limit; when it is determined that the robot can approach the attraction target surface from the direction based on the upper limit value, the direction based on the upper limit value is set as the approach direction; a processing device that, when it is determined that the robot cannot approach the surface to be attracted from the direction based on the upper limit value, sets the direction based on the adjustment angle as the approach direction.

12. 3. The processing device according to claim 2, The setting unit is determining whether or not a normal angle as an angle of the normal direction with respect to the reference direction is equal to or smaller than an upper limit value based on a posture that the robot can take; If the normal angle is equal to or smaller than the upper limit, the normal direction is set to the approach direction; When the normal angle is greater than the upper limit value, a direction based on the upper limit value that is closer to the normal direction from the reference direction by the upper limit value is set as the approach direction.

13. 13. The processing device of claim 12, The setting unit is If the normal angle is equal to or smaller than the upper limit, it is determined whether or not the robot can approach the target surface from the normal direction; when it is determined that the robot can approach the target surface from the normal direction, the normal direction is set as the approach direction; a processing device that, when it is determined that the robot cannot approach the surface to be attracted from the normal direction, sets the approach direction to a direction based on the adjustment angle, which is moved from the normal direction toward the reference direction by the adjustment angle.

14. 14. The processing device according to claim 12 or 13, The setting unit is If the normal angle is greater than the upper limit, it is determined whether or not the robot can approach the target surface from the direction based on the upper limit; when it is determined that the robot can approach the attraction target surface from the direction based on the upper limit value, the direction based on the upper limit value is set as the approach direction; a processing device that, when it is determined that the robot cannot approach the surface to be attracted from the direction based on the upper limit value, sets the approach direction to a direction based on the adjustment angle, which is moved from the normal direction toward the reference direction by the adjustment angle.

15. A processing apparatus according to any one of claims 3 to 5, claims 7 to 10 and claims 13, The setting unit changes the adjustment angle in accordance with the normal angle.

16. A processing apparatus according to any one of claims 3 to 5, claims 7 to 10 and claims 13, The setting unit sets the adjustment angle based on suction unit information related to a suction unit of the robot that suctions the object to be held and object information related to the object to be held.

17. A processing device according to any one of claims 1 to 5, claims 7 to 10, claims 12 and 13; A robot connected to the processing device; A robot control system comprising:

18. A program for causing a computer device to function as the processing device according to any one of claims 1 to 5, claims 7 to 10, claims 12 and 13.

19. A processing device for controlling a robot having a suction unit that movably suctions and holds a holding object, A control unit for controlling the robot is provided. The control unit controls the robot so that the suction portion contacts the suction surface of the object to be held with a first end side of the suction portion contracted relative to the suction surface of the object to be held more than a second end side opposite the first end side.

20. A display unit; a control unit that acquires an approach direction of the robot capable of suction-holding the holding object from a direction different from a normal direction of a surface of the holding object to be suctioned, and displays the approach direction on the display unit in a recognizable manner; A terminal device comprising: