ROBOT SYSTEM, PROCESSING METHOD, AND PROGRAM
Patent Information
- Application Number
- JP2024510905
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-09-26
- Publication Date
- 2024-12-04
- Estimated Expiration
- 2042-03-30
AI Technical Summary
Existing robot systems face challenges in minimizing damage when objects fall during movement to their destination, as they lack effective height constraints and route calculation methods to prevent such incidents.
A robot system with a setting means for constraining the height of object lifting and a calculation means for determining optimal routes based on these constraints, using a reference plane to ensure safe movement and reduce the risk of damage.
The system effectively reduces the possibility of damage by setting height constraints and calculating routes that prevent objects from falling or minimize impact during movement.
Abstract
Description
ROBOT SYSTEM, PROCESSING METHOD, AND RECORDING MEDIUM
[0001] The present disclosure relates to a robot system, a processing method, and a recording medium.
[0002] Robots are used in various fields, such as logistics. Some robots operate autonomously. Patent Document 1 discloses, as a related technology, a picking device that safely places an object while taking clearance into consideration. Patent Document 2 discloses, as a related technology, a technology related to an article picking device that determines an approach path for grasping an object.
[0003] JP 2019-181573 A JP 2010-012567 A
[0004] With the technologies described in Patent Documents 1 and 2, it is difficult to avoid damage to an object if the object falls while the robot is moving it to a destination. Therefore, one of the objects of the present disclosure is to provide a robot system or the like that can reduce the possibility of damage to an object even if the object falls while the robot is moving it to a destination.
[0005] One of the objectives of each aspect of the present disclosure is to provide a robot system, a processing method, and a recording medium that can solve the above-mentioned problems.
[0006] In order to achieve the above object, according to one aspect of the present disclosure, the robot system includes a setting means for setting a constraint on the height to which each object can be lifted from a reference surface, and a calculation means for calculating a path for moving the object to a destination based on the constraint set by the setting means.
[0007] In order to achieve the above object, according to another aspect of the present disclosure, a processing method sets a constraint on the range of height to which an object can be lifted relative to a reference plane, and calculates a path for moving the object to a destination based on the set constraint.
[0008] In order to achieve the above object, according to another aspect of the present disclosure, a recording medium stores a program that causes a computer to execute the following steps: setting a constraint on the range of height to which an object can be lifted relative to a reference plane; and calculating a path for moving the object to a destination based on the set constraint.
[0009] According to each aspect of the present disclosure, even if an object falls while the robot is moving the object to its destination, the possibility of damage can be reduced.
[0010] 1 is a diagram illustrating an example of a configuration of a robot system according to a first embodiment of the present disclosure. FIG. 2 is a diagram illustrating an example of a configuration of a control device according to a first embodiment of the present disclosure. FIG. 3 is a diagram illustrating an example of a GUI for accepting input of a constraint according to a first embodiment of the present disclosure. FIG. 4 is a diagram illustrating an example of a GUI for accepting input of a constraint according to a first embodiment of the present disclosure. FIG. 5 is a diagram illustrating an example of a GUI for accepting input of a constraint according to a first embodiment of the present disclosure. FIG. 6 is a diagram illustrating an example of a GUI for accepting input of a constraint according to a first embodiment of the present disclosure. FIG. 7 is a diagram illustrating an example of a GUI for accepting input of a constraint according to a first embodiment of the present disclosure. FIG. 8 is a diagram illustrating an example of a GUI for accepting input of a constraint according to a first embodiment of the present disclosure. FIG. 9 is a diagram illustrating an example of a GUI for accepting input of a constraint according to a first embodiment of the present disclosure. FIG. 10 is a diagram illustrating an example of a GUI for accepting input of a constraint according to a first embodiment of the present disclosure. FIG. 1 is a schematic block diagram illustrating the configuration of a computer according to at least one embodiment.
[0011] The following describes the embodiments in detail with reference to the drawings. First Embodiment A robot system 1 according to a first embodiment of the present disclosure is a system for moving an object M placed at one position to another position. The system restricts the path of the object M by setting a lifting height for the object M, thereby reducing the possibility of the object M being damaged even if it falls. The reference height for the object M is determined by points on a reference plane. Examples of the reference plane include the surface of an obstacle that can be seen from above in the height direction in an area where an obstacle exists within the area where the object M can move from the source to the destination, and the floor surface in an area where no obstacle exists. This floor surface is flush with the pedestal 402, which will be described later. The reference plane may also be a plane with a constant absolute value in the height direction (for example, the height direction is the z-axis direction, and if the floor surface is not flat, a plane that includes the lowest point in the height direction and is parallel to a plane including the x-axis and y-axis). The robot system 1 is a system that is installed in, for example, a warehouse in a logistics center. Hereinafter, when simply referring to "the height to which the object M is lifted," the reference height is assumed to be the reference plane. Obstacles are all objects other than the object M that the robot 40 moves to its destination and that exist within the imaging range of the imaging device 50, which will be described later. Therefore, the cardboard box C containing the object M, which will be described later, and a container (for example, a tray T), which will be described later, are also considered obstacles.
[0012] (Configuration of Robot System) Fig. 1 is a diagram illustrating an example of the configuration of a robot system 1 according to a first embodiment of the present disclosure. As shown in Fig. 1, the robot system 1 includes a control device 2, a robot 40, and a photographing device 50. Note that Fig. 1 illustrates an obstacle O as an obstacle other than cardboard boxes C and containers (e.g., trays T). Fig. 1 also illustrates a floor F.
[0013] 2 is a diagram illustrating an example of the configuration of the control device 2 according to the first embodiment of the present disclosure. As shown in FIG. 2, the control device 2 includes an input unit 201, a generation unit 202, a control unit 203, and a management unit 204.
[0014] The input unit 201 inputs task goals and constraints to the generation unit 202. Examples of task goals include information indicating the type of object M, the number of objects M to be moved, the origin of the object M, and the destination of the object M. Examples of constraints include a no-entry area when moving the object M, and an area in which the robot 40 cannot move. The constraints on the no-entry area when moving the object M and the area in which the robot 40 cannot move include a constraint on the height to which the object M must be lifted while moving the object M from the origin to the destination, in other words, a constraint on the height from a reference plane of a robot arm 401 (described later) that grasps the object M. The input unit 201 may receive an input from the user as a task goal, such as "move three parts A from tray A to tray B," and specify that the type of object M to be moved is part A, the quantity of objects M to be moved is three, the source of the object M is tray A, and the destination of the object M is tray B, and input the specified information to the generation unit 202. The input unit 201 may also receive a constraint from the user as a constraint on the height to which the object M is lifted while moving the object M from the source to the destination (i.e., a constraint on the height from the reference plane to the robot arm 401 that grasps the object M), and input the specified information to the generation unit 202. The constraint on the height to which the object M is lifted may be different at different points on the reference plane.
[0015] FIG. 3 is a first diagram illustrating an example of a GUI that accepts input of constraints in the first embodiment of the present disclosure. FIG. 4 is a second diagram illustrating an example of a GUI that accepts input of constraints in the first embodiment of the present disclosure. The input unit 201 is, for example, a display device having a touch panel function. In this case, the input unit 201 accepts, for example, a constraint on the height at which the object M is to be lifted, via a GUI (Graphical User Interface) such as those shown in FIGS. 3 and 4 . Examples of the reference plane include the surface of an obstacle that can be seen from the height direction in an area where the object M can move between the source and destination, and the floor surface in an area where no obstacles exist. The reference plane may also be a plane with a constant absolute height in the height direction. The example shown in FIG. 3 is an example of a GUI that allows setting upper and lower limits for the height at which the object M is to be lifted. The upper and lower limits are set within a range determined to prevent damage to the object M even if it falls. The lower limit is set within a range that does not contact the reference surface. The example shown in Fig. 4 is an example of a GUI that sets the height to which the object M is lifted as a fixed value. Note that in the GUI shown in Fig. 3, the input unit 201 may set a fixed value by having the user input the same value for the upper limit and the lower limit.
[0016] FIG. 5 is a diagram illustrating a first example of the movement of the object M when a constraint is set in the first embodiment of the present disclosure. FIG. 5 illustrates an example of the movement of the object M when, in the area where the object M can move from the start point to the destination point, the surface of the obstacle visible from the height direction in the area where the obstacle exists and the floor surface in the area where the obstacle does not exist are set as reference planes, and upper and lower limits for the height at which the object M can be lifted are set as constraints. In this example, the difference between the floor surface and the upper and lower limits for the height at which the object M can be lifted, which are set as the reference plane, is the same as the difference between the upper and lower limits for the height at which the object M can be lifted, which are set as the reference plane, the surface of the obstacle (in this case, the tray T). In this case, the object M is controlled by the control device 2 to move between the upper and lower limits for the height set using the floor surface as the reference plane. The object M is then lifted by the height of the tray T and controlled by the control device 2 to move between the upper and lower limits for the height set using the surface of the obstacle as the reference plane.
[0017] FIG. 6 is a diagram illustrating a second example of the movement of the object M when a constraint is set in the first embodiment of the present disclosure. FIG. 6 illustrates an example of the movement of the object M when, in the area where the object M can move from the start point to the destination point, the surface of the obstacle that can be seen from the height direction in the area where the obstacle exists and the floor surface in the area where the obstacle does not exist are set as reference planes, and the height to which the object M is lifted is set as a fixed value as a constraint. In this example, the object M is controlled by the control device 2 to move at a constant height with the floor surface as the reference plane. The object M is lifted to maintain a constant height with the surface of the obstacle O as the reference plane and controlled by the control device 2 to pass through the obstacle O. After passing through the obstacle O, the object M is again controlled by the control device 2 to move at a constant height with the floor surface as the reference plane. The object M is then lifted by the height of the tray T and controlled by the control device 2 to move at a constant height with the surface of the obstacle as the reference plane.
[0018] 7 is a diagram illustrating a third example of the movement of the object M when a constraint is set in the first embodiment of the present disclosure. FIG. 7 illustrates an example of the movement of the object M when a plane with a constant absolute value in the height direction (for example, the height direction is the z-axis direction, and if the floor surface is not flat, a plane that includes the lowest point in the height direction and is parallel to a plane including the x-axis and y-axis) is used as the reference plane, and the height at which the object M is lifted is set as a fixed value as a constraint. In this example, the object M is controlled by the control device 2 to move at a constant height relative to the floor surface as the reference plane. Note that when the fluctuation in the vertical height of the object M is small or minimal, the possibility of the robot 40 dropping the object M can be reduced.
[0019] Fig. 8 is a diagram illustrating an example of the configuration of the generation unit 202 according to the first embodiment of the present disclosure. As shown in Fig. 8, the generation unit 202 includes a first processing unit 202a, a second processing unit 202b, a third processing unit 202c, a fourth processing unit 202d, and a fifth processing unit 202e.
[0020] The first processing unit 202a recognizes the robot 40. For example, the first processing unit 202a recognizes a robot model using CAD (Computer Aided Design) data. This CAD data includes information indicating the shape of the robot 40 and information indicating the range of motion, such as the reach range of the robot arm 401. The shape includes dimensions. The CAD data is, for example, drawing data designed using CAD.
[0021] The first processing unit 202a also recognizes the environment around the robot 40. For example, the first processing unit 202a acquires images captured by the camera device 50. The images captured by the camera device 50 include information captured by the camera and depth information. This depth information corresponds to colored point cloud data, which will be described later. The first processing unit 202a recognizes the position and shape of obstacles from the acquired images. Here, obstacles refer to all objects present within the camera range of the camera device 50, other than the target object M that the robot 40 is to move to its destination. As will be described later, the camera device 50 is capable of acquiring three-dimensional information of objects within the camera range. Therefore, the first processing unit 202a can recognize the environment around the robot 40, including the position and shape of obstacles. Note that the first processing unit 202a is not limited to recognizing the environment around the robot 40 from images captured by the camera device 50. For example, the first processing unit 202a may recognize the environment around the robot 40 using a three-dimensional occupancy map (Octomap), CAD data, AR (Augmented Reality) markers, etc. This CAD data includes information indicating the shape of obstacles. The shape includes dimensions.
[0022] The first processing unit 202a also recognizes the release position at the destination of the object M. For example, when the destination is a container (e.g., a tray T), the first processing unit 202a recognizes the release position by machine learning using model-based matching. Model-based matching is a technique for determining the position and orientation of an object by using image data obtained from a camera or the like and shape and structural data of the object (in this case, a container) whose position and orientation are to be acquired, and matching the shape and structural data with the object extracted from the image. Note that the first processing unit 202a is not limited to a device that recognizes the release position by machine learning using model-based matching. For example, the first processing unit 202a may also recognize the release position using an AR marker.
[0023] The second processing unit 202b also recognizes a pedestal 402 (described later) of the robot 40. For example, the second processing unit 202b recognizes the pedestal 402 by acquiring CAD data. This CAD data includes information indicating the shape of the pedestal 402. The shape includes dimensions. This allows the second processing unit 202b to recognize the Z coordinate of the top surface of the pedestal 402 in that coordinate system as the height of the pedestal 402. Note that if no CAD data for the pedestal 402 exists, the second processing unit 202b may extract information about the work surface of the pedestal 402 using a plane equation, and recognize the average value of the Z coordinate of the point cloud in that coordinate system as the height of the pedestal 402.
[0024] The third processing unit 202c determines whether or not it is necessary to preserve the object M. For example, based on a flag indicating whether or not to preserve the object M, the third processing unit 202c preserves the object M when the flag is set. Furthermore, the third processing unit 202c does not preserve the object M when the flag is not set.
[0025] Furthermore, the third processing unit 202c recognizes the state (i.e., position and posture) of the object M. For example, the third processing unit 202c recognizes the position of the object M by performing machine learning using model-based matching. Furthermore, the third processing unit 202c recognizes the posture of the object M by using a technique for generating a bounding box, such as an AABB (Axis Aligned Bounding Box) or an OBB (Oriented Bounding Box), for the object M whose position has been identified. Note that the third processing unit 202c may classify the object M using clustering, which is a machine learning technique, for the image captured by the image capture device 50, and identify the state of the object M by using a technique for generating a bounding box.
[0026] Furthermore, the third processing unit 202c acquires the height of the object M. For example, the third processing unit 202c recognizes the object M by acquiring CAD data. This CAD data includes information indicating the shape of the object M. The shape includes dimensions. This allows the third processing unit 202c to recognize the Z coordinate of the object M in that coordinate system as the height of the object M. Note that the third processing unit 202c may recognize the height of the object M by subtracting the Z coordinate of the base 402 from the Z coordinate of the top surface of the object M.
[0027] The fourth processing unit 202d sets a range of heights to which the object M is lifted. For example, the fourth processing unit 202d receives setting information on the lifting height for each object M input from the input unit 201 via the GUI. The fourth processing unit 202d may also receive the setting information on the lifting height for each object M from a pre-prepared configuration file that includes information on the range of heights to which the object M is lifted. The fourth processing unit 202d then stores the received setting information on the lifting height for each object M. As a result, the setting information on the lifting height for each object M is set.
[0028] It should be noted that some objects M are unlikely to be damaged even if dropped. For such objects M, there is no need to set a range of heights for lifting the object M. Therefore, status information (e.g., "1") indicating that a range of heights for lifting the object M has been set, and status information (e.g., "0") indicating that a range of heights for lifting the object M has not been set may be set.
[0029] The fifth processing unit 202e generates an initial plan sequence that indicates the flow of operation of the robot 40, based on the task goals determined by the processing of the first processing unit 202a, the second processing unit 202b, and the third processing unit 202c, and the constraints, including the constraint on the range of height for lifting the object M, determined by the processing of the fourth processing unit 202d. For example, the fifth processing unit 202e acquires the task goals from the first processing unit 202a, the second processing unit 202b, and the third processing unit 202c. The fifth processing unit 202e also acquires the range of height for lifting the object M from the fourth processing unit 202d. The fifth processing unit 202e adds the acquired constraint on the range of height for lifting the object M to the constraints input from the input unit 201. Then, based on the acquired task goal and constraints, the fifth processing unit 202e generates information indicating each state of the robot 40 at each time step from the state at the source of the object M to the state at the destination of the object M (such as the type of object M, the position and posture of the robot 40, the grip strength of the object M, and the actions of the robot 40 (including, for example, a reach action to approach the object M, a pick action to pick the object M, an arm movement action to properly move the picked object to the destination, and a release action to place the object)) which is necessary for the control unit 203 to generate a control signal for controlling the robot 40. In other words, the information indicating each state of the robot 40 at each time step from the state at the source of the object M to the state at the destination of the object M which is necessary for the control unit 203 to generate a control signal for controlling the robot 40 is a sequence. The fifth processing unit 202e outputs the generated sequence to the control unit 203 and the management unit 204. The fifth processing unit 202e may be realized using artificial intelligence (AI) technology including temporal logic, reinforcement learning, optimization technology, and the like.
[0030] 9 is a diagram illustrating an example of a sequence TBL1 of an initial plan generated by the generator 202 according to the first embodiment of the present disclosure. For example, the sequence TBL1 of the initial plan generated by the generator 202 is a sequence indicating each state of the robot 40 for n time steps from the origin to the destination of the object M, as shown in FIG.
[0031] The control unit 203 generates a control signal for controlling the robot 40 based on a sequence input from the outside (i.e., the generation unit 202). Note that the control unit 203 may generate a control signal that optimizes an evaluation function when generating the control signal. Examples of the evaluation function include a function that represents the amount of energy consumed by the robot 40 when moving the object M, and a function that represents the distance along the path along which the object M is moved. The control unit 203 outputs the generated control signal to the robot 40 and the management unit 204.
[0032] 10 is a diagram illustrating an example of the control signal Cnt of the initial plan generated by the control unit 203 according to the first embodiment of the present disclosure. For example, the control signal Cnt of the initial plan generated by the control unit 203 is, for example, each control signal for n time steps from the movement origin to the movement destination of the object M, as shown in FIG.
[0033] The robot 40 includes a robot arm 401 and a base 402. The robot arm 401 is connected to the base 402. The robot arm 401 grasps the object M and moves the object M from a starting point to a destination point in response to a control signal output by the control unit 203.
[0034] The image capturing device 50 captures an image of the state of the object M. The image capturing device 50 is, for example, a depth camera, and is capable of identifying the state (i.e., the position and posture) of the object M. The image captured by the image capturing device 50 is represented, for example, by colored point cloud data, and includes three-dimensional information of the captured object. The image capturing device 50 outputs the captured image to the generation unit 202.
[0035] The management unit 204 estimates the current states of the robot 40 and the object M based on the sequence output by the generation unit 202 and the control signal output by the control unit 203. The current states of the robot 40 and the object M estimated by the management unit 204 are ideal states that the robot 40 and the object M should be in at the present time.
[0036] 11 is a diagram illustrating an example of a processing flow of the robot system 1 according to the first embodiment of the present disclosure. Next, processing performed by the robot system 1 will be described with reference to FIG.
[0037] The first processing unit 202a recognizes the environment around the robot 40 (step S1). For example, the first processing unit 202a acquires an image captured by the imaging device 50. The first processing unit 202a recognizes the position and shape of an obstacle from the acquired image. The first processing unit 202a also recognizes a release position at the destination of the object M. For example, when the destination is a container (e.g., a tray T), the first processing unit 202a recognizes the release position by machine learning using model-based matching.
[0038] The second processing unit 202b recognizes the base 402 of the robot 40 (step S2). For example, the second processing unit 202b obtains the height of the base 402 by acquiring CAD data.
[0039] The third processing unit 202c determines whether or not it is necessary to preserve the object M (step S2). For example, based on a flag indicating whether or not to preserve the object M, the third processing unit 202c preserves the object M if the flag is set. Furthermore, the third processing unit 202c does not preserve the object M if the flag is not set.
[0040] When the third processing unit 202c determines that the object M needs to be preserved (a pick object is set in FIG. 11 ) (YES in step S3), it recognizes the state (i.e., the position and orientation) of the object M (step S4). For example, the third processing unit 202c recognizes the position and orientation of the object M by using model-based matching, machine learning, or a technique for generating a bounding box such as AABB or OBB.
[0041] The third processing unit 202c acquires the height of the object M (step S5). For example, the third processing unit 202c recognizes the object M by acquiring CAD data.
[0042] The fourth processing unit 202d sets a range of heights to which the object M is lifted (step S6). For example, the fourth processing unit 202d receives setting information on the lifting height for each object M input from the input unit 201 via the GUI.
[0043] The fifth processing unit 202e generates an initial plan sequence that indicates the flow of operation of the robot 40 based on the work goal determined by processing by the first processing unit 202a, the second processing unit 202b, and the third processing unit 202c, and constraints including a constraint on the range of height to which the object M can be lifted determined by processing by the fourth processing unit 202d.
[0044] For example, the fifth processing unit 202e acquires task targets from the first processing unit 202a, the second processing unit 202b, and the third processing unit 202c. The fifth processing unit 202e also acquires a range of heights for lifting the object M from the fourth processing unit 202d (step S7). The fifth processing unit 202e adds the acquired constraint on the range of heights for lifting the object M to the constraints input from the input unit 201. Then, based on the acquired task goal and constraints, the fifth processing unit 202e generates (calculates) information indicating each state of the robot 40 at each time step from the state at the origin of the object M to the state at the destination of the object M, which is necessary for the control unit 203 to generate a control signal for controlling the robot 40 (such as the type of object M, the position and posture of the robot 40, the grip strength of the object M, and the actions of the robot 40 (including, for example, a reach action to approach the object M, a pick action to pick the object M, an arm movement action to properly move the picked object to the destination, and a release action to place the object)) (step S8). In other words, the information indicating each state of the robot 40 at each time step from the state at the origin of the object M to the state at the destination of the object M, which is necessary for the control unit 203 to generate a control signal for controlling the robot 40, is a sequence. The fifth processing unit 202e outputs the generated sequence to the control unit 203 and the management unit 204 (step S9).
[0045] Furthermore, if the third processing unit 202c determines that there is no need to preserve the object M (no pick object is set in Figure 11) (NO in step S3), the robot system 1 calculates a path under conditions that do not include a restriction on the range of height to which the object M can be lifted, moves the object M to its destination along that path, and returns to the processing of step S1.
[0046] (Advantages) The robot system 1 according to the first embodiment of the present disclosure has been described above. In the robot system 1, the fourth processing unit 202d (an example of a setting unit) sets a constraint on the range of height to which the object M can be lifted relative to a reference plane. The fifth processing unit 202e (an example of a calculation unit) calculates a path for moving the object M to a destination based on the constraint set by the fourth processing unit 202d.
[0047] By doing so, the robot system 1 can reduce the possibility of damage to the object even if the object falls while the robot is moving it to its destination.
[0048] Second Embodiment Next, a robot system 1 according to a second embodiment of the present disclosure will be described. The robot system 1 according to the second embodiment calculates a path for moving the target object M to a destination using a constraint that further limits the movement range of the target object M according to a user, in addition to the constraints in the robot system 1 according to the first embodiment.
[0049] FIG. 12 is a diagram illustrating an example of a GUI that accepts input of constraints in the second embodiment of the present disclosure. For example, as shown in part (a) of FIG. 12 , with the target object M, the release location as the destination, the obstacle O, the cardboard box C, and the tray T displayed on the GUI, the user inputs constraints by, for example, specifying with a finger the movable range from the target object M to the destination on the input unit 201. The input unit 201 accepts the input constraints. In this case, the fourth processing unit 202d acquires the constraints from the input unit 201 and adds them to the constraints already set. The fifth processing unit 202e performs the same calculation as the fifth processing unit 202e in the first embodiment for the movable range indicated by the added constraints.
[0050] 12(b), it is assumed that the user inputs a constraint to the input unit 201 by specifying with a finger one possible route from the object M to the destination. The input unit 201 accepts this input constraint. In this case, the fourth processing unit 202d acquires this constraint from the input unit 201 and adds it to the constraints already set. The fifth processing unit 202e performs the same calculation as the fifth processing unit 202e according to the first embodiment on the route indicated by the added constraint. If the fifth processing unit 202e is unable to calculate a route that satisfies the constraint, it may notify the user that there is no route that satisfies the constraint.
[0051] Note that, when the fifth processing unit 202e acquires the height constraint from the fourth processing unit 202d, the fifth processing unit 202e takes the height constraint into consideration and, if an obstacle is determined to be high (for example, obstacle O), sets the obstacle O as a no-entry area for the object M. Then, the fifth processing unit 202e may instruct the input unit 201 to display the no-entry area on the GUI.
[0052] (Advantages) The robot system 1 according to the second embodiment of the present disclosure has been described above. In the robot system 1, the fourth processing unit 202d acquires this constraint from the input unit 201 and adds this constraint to the constraints that have already been set. The fifth processing unit 202e performs the same calculation as the fifth processing unit 202e according to the first embodiment for the movable range indicated by the added constraint.
[0053] By doing so, the robot system 1 can make the object M pass through a path that the user thinks is less likely to cause the object M to fall.
[0054] <Modification of Second Embodiment> Next, a robot system 1 according to a modification of the second embodiment of the present disclosure will be described. In the robot system 1 according to the second embodiment, a user may specify a movable range from the object M to the destination using a feature such as a guide tape. FIG. 13 is a diagram illustrating an example of specifying a constraint using a feature in the modification of the second embodiment of the present disclosure. For example, the imaging device 50 captures an image of the feature as shown in FIG. 13. The input unit 201 accepts an image of the captured feature. The input unit 201 may then identify the range specified by the feature in the image as a constraint on the movable range from the object M to the destination. The fourth processing unit 202d may acquire this constraint from the input unit 201 and add it to the already set constraints. The fifth processing unit 202e may perform the same calculation as the fifth processing unit 202e according to the first embodiment for the movable range indicated by the added constraint. This allows the robot system 1 to cause the object M to pass through a path that the user considers to be less likely to cause the object M to fall.
[0055] Third Embodiment Next, a robot system 1 according to a third embodiment of the present disclosure will be described. The robot system 1 according to the third embodiment includes a cushion or other buffer material B that reduces impact even when the object M falls into an area where the movement of the object M in the height direction is predicted to be greater than or equal to a threshold value. FIG. 14 is a diagram illustrating an example of the placement of the buffer material B according to the third embodiment of the present disclosure. For example, the fifth processing unit 202e may instruct the control unit 203 to place the buffer material B along the entire calculated path. Furthermore, for example, when the fifth processing unit 202e acquires a height constraint from the fourth processing unit 202d, the fifth processing unit 202e may instruct the control unit 203 to place the buffer material B around the obstacle O if the fifth processing unit 202e determines that the height of an obstacle (e.g., obstacle O) is high, taking the height constraint into consideration. The buffer material B may also be placed by the user. Also, in the third embodiment, for example, the user may set the movement range of the object M via the input unit 201, as described with reference to FIG. 12 . Furthermore, in the area where the buffer material B is arranged in this manner, the height restriction may be relaxed (specifically, the upper limit of the height may be increased).
[0056] Advantages The robot system 1 according to the third embodiment of the present disclosure has been described above. The robot system 1 includes a buffer material B such as a cushion that reduces impact even when the object M falls into an area where the movement of the object M in the height direction is predicted to be greater than or equal to a threshold value.
[0057] By doing so, the robot system 1 can reduce the possibility of damage to the target object M if it falls, compared to a robot system 1 that does not have the buffer material B.
[0058] <Modification of Third Embodiment> Next, a robot system 1 according to a modification of the third embodiment of the present disclosure will be described. The robot system 1 according to the modification of the third embodiment may include a new obstacle O that reduces the movement of the object M in the height direction in an area where the movement of the object M in the height direction is predicted to be greater than a threshold value. By doing so, the robot system 1 can reduce the possibility of damage to the object M if it falls, compared to a robot system 1 that does not include the new obstacle O.
[0059] Next, processing of a robot system 1 with a minimum configuration according to an embodiment of the present disclosure will be described. FIG. 15 is a diagram illustrating a robot system 1 with a minimum configuration according to an embodiment of the present disclosure. The robot system 1 with a minimum configuration according to an embodiment of the present disclosure includes a fourth processing unit 202d (an example of a setting unit) and a fifth processing unit 202e (an example of a calculation unit). The fourth processing unit 202d sets a constraint on the range of heights to which the object M is lifted relative to a reference plane. The fourth processing unit 202d can be realized, for example, using the functions of the fourth processing unit 202d illustrated in FIG. 8. The fifth processing unit 202e calculates a path for moving the object M to a destination based on the constraints set by the fourth processing unit 202d. The fifth processing unit 202e can be realized, for example, using the functions of the fifth processing unit 202e illustrated in FIG. 8.
[0060] Next, a description will be given of processing by the robot system 1 having a minimum configuration according to an embodiment of the present disclosure. Fig. 16 is a diagram showing an example of a processing flow of the robot system 1 having a minimum configuration according to an embodiment of the present disclosure. Here, the processing by the robot system 1 having a minimum configuration will be described with reference to Fig. 16.
[0061] The fourth processing unit 202d sets a restriction on the range of height to which the object M is lifted relative to the reference plane (step S101). The fifth processing unit 202e calculates a path for moving the object M to the destination based on the restriction set by the fourth processing unit 202d (step S102).
[0062] The above describes a robot system 1 with a minimum configuration according to an embodiment of the present disclosure. This robot system 1 can reduce the possibility of damage to an object even if the object falls while the robot is moving it to its destination.
[0063] The order of the processes in the embodiments of the present disclosure may be changed as long as the processes are performed appropriately.
[0064] Although the embodiments of the present disclosure have been described, the robot system 1, the control device 2, the input unit 201, the generation unit 202, the control unit 203, the management unit 204, the robot 40, the image capture device 50, and other control devices may have a computer device inside. The above-described processing steps are stored in the form of a program on a computer-readable recording medium, and the above processing is performed by the computer reading and executing the program. Specific examples of computers are shown below.
[0065] FIG. 17 is a schematic block diagram showing the configuration of a computer according to at least one embodiment. As shown in FIG. 17 , the computer 5 includes a CPU 6, a main memory 7, a storage 8, and an interface 9. For example, the robot system 1, the control device 2, the input unit 201, the generation unit 202, the control unit 203, the management unit 204, the robot 40, the imaging device 50, and other control devices are implemented in the computer 5. The operation of each of the above-mentioned processing units is stored in the storage 8 in the form of a program. The CPU 6 reads the program from the storage 8, loads it into the main memory 7, and executes the above-mentioned processing in accordance with the program. The CPU 6 also allocates storage areas in the main memory 7 corresponding to each of the above-mentioned storage units in accordance with the program.
[0066] Examples of storage 8 include a hard disk drive (HDD), a solid state drive (SSD), a magnetic disk, a magneto-optical disk, a compact disc read-only memory (CD-ROM), a digital versatile disc read-only memory (DVD-ROM), and a semiconductor memory. Storage 8 may be an internal medium directly connected to the bus of computer 5, or an external medium connected to computer 5 via interface 9 or a communication line. Furthermore, if the program is distributed to computer 5 via a communication line, computer 5 that receives the program may load the program into main memory 7 and execute the above-described processing. In at least one embodiment, storage 8 is a non-transitory tangible storage medium.
[0067] The program may also implement some of the functions described above. Furthermore, the program may be a file that can implement the functions described above in combination with a program already stored in the computer device, a so-called differential file (differential program).
[0068] Although several embodiments of the present disclosure have been described, these embodiments are merely examples and do not limit the scope of the disclosure. Various additions, omissions, substitutions, and modifications may be made to these embodiments without departing from the spirit of the disclosure.
[0069] Note that part or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.
[0070] (Supplementary Note 1) A robot system comprising: a setting means for setting a constraint on a range of heights for lifting an object relative to a reference plane; and a calculation means for calculating a path for moving the object to a destination based on the constraint set by the setting means.
[0071] (Supplementary Note 2) The robot system described in Supplementary Note 1, wherein the reference surface is a surface of an obstacle visible from the height direction in an area where the obstacle exists, and a floor surface in an area where the obstacle does not exist, in an area where the object can move between the start point and the destination point.
[0072] (Supplementary Note 3) The robot system according to Supplementary Note 1, wherein the reference plane is a plane in which the height as an absolute value in the height direction is constant in an area in which the object can move between a start point and a destination point.
[0073] (Supplementary Note 4) The robot system according to any one of Supplementary Note 1 to Supplementary Note 3, further comprising: a receiving unit that receives the height constraint via a GUI (Graphical User Interface), wherein the setting unit sets the height constraint received by the receiving unit.
[0074] (Supplementary Note 5) The robot system according to any one of Supplementary Notes 1 to 4, wherein the setting means sets different constraints on the height at different points on the reference plane.
[0075] (Supplementary Note 6) The robot system according to any one of Supplementary Note 1 to Supplementary Note 5, further comprising a buffer material in an area where the movement of the object in the height direction is predicted to be greater than or equal to a threshold value.
[0076] (Supplementary Note 7) The robot system according to any one of Supplementary Note 1 to Supplementary Note 6, further comprising a new obstacle in an area where the movement of the object in the height direction is predicted to be greater than or equal to a threshold value.
[0077] (Supplementary Note 8) The robot system according to any one of Supplementary Note 1 to Supplementary Note 7, wherein the setting means sets, via a GUI, a range of a path along which the object designated by the user is to be moved to a destination as a new constraint.
[0078] (Supplementary Note 9) The robot system according to any one of Supplementary Notes 1 to 7, wherein the setting means uses a feature to set a range of a path along which the object designated by the user is moved to a destination as a new constraint.
[0079] (Supplementary Note 10) A processing method comprising: setting a restriction on a range of heights for lifting an object relative to a reference plane; and calculating a path for moving the object to a destination based on the restriction.
[0080] (Supplementary Note 11) A recording medium storing a program that causes a computer to execute the following steps: setting a constraint on a range of heights for lifting an object relative to a reference plane; and calculating a path for moving the object to a destination based on the set constraint.
[0081] According to each aspect of the present disclosure, even if an object falls while the robot is moving the object to its destination, the possibility of damage can be reduced.
[0082] REFERENCE SIGNS LIST 1 robot system 2 control device 5 computer 6 CPU 7 main memory 8 storage 9 interface 40 robot 50 imaging device 201 input unit 202 generation unit 202a first processing unit 202b second processing unit 202c third processing unit 202d fourth processing unit 202e fifth processing unit 203 control unit 204 management unit B cushioning material C cardboard F floor M object O obstacle T tray
Claims
1. A setting means for setting a restriction on a range of heights for lifting an object relative to a reference plane; a calculation means for calculating a path for moving the object to a destination based on the constraint set by the setting means; A robot system comprising:
2. The reference surface is In an area where the object can move between a start point and a destination point, the surface of the obstacle that can be confirmed from the height direction in an area where the obstacle exists, and the floor surface in an area where the obstacle does not exist. The robot system of claim 1 .
3. The reference surface is In the area in which the object can move between the origin and destination, the altitude as an absolute value in the height direction is a constant plane. The robot system of claim 1 .
4. a receiving means for receiving the height constraint via a GUI (Graphical User Interface); Equipped with The setting means is setting a constraint on the height accepted by the accepting means; The robot system according to any one of claims 1 to 3.
5. The setting means is setting different constraints on the height at different points on the reference plane; The robot system according to any one of claims 1 to 4.
6. providing a buffer material in an area where the movement of the object in the height direction is predicted to be greater than or equal to a threshold value; The robot system according to any one of claims 1 to 5.
7. providing a new obstacle in an area where the movement of the object in the height direction is predicted to be greater than or equal to a threshold value; The robot system according to any one of claims 1 to 6.
8. The setting means is setting, via a GUI, a range of a route along which the object designated by the user is to be moved to a destination as a new constraint; The robot system according to any one of claims 1 to 7.
9. Set a constraint on the range of heights to which the object can be lifted relative to a reference plane; calculating a path for moving the object to a destination based on the set constraints; Processing methods.
10. Setting a constraint on a range of heights for lifting an object relative to a reference plane; calculating a path for moving the object to a destination based on the set constraints; A program that causes a computer to execute the following.
