SYSTEM, METHOD, AND USER INTERFACE FOR USING CLEARANCE DETERMINATION IN ROBOT MOTION PLANNING AND CONTROL - Patent application

The system addresses the challenge of accurately determining and visualizing robot clearance by using a roadmap-based approach with adjustable parameters, enhancing collision avoidance and reducing energy consumption in robot motion planning.

JP7591317B2Active Publication Date: 2024-11-28REALTIME ROBOTICS INC
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
JP2023532462
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-12-02
Filing Date
2021-12-01
Publication Date
2024-11-28
Estimated Expiration
2041-12-01

AI Technical Summary

Technical Problem

Existing robot motion planning systems struggle to accurately determine and visualize clearance or margin between robot parts and objects in the operating environment, leading to potential collisions, especially with dynamic objects, and often require costly and energy-intensive simulations.

Method used

A system and method for determining and visually representing clearance between robot parts and objects using a roadmap with adjustable parameters, allowing for intuitive adjustment of motion plans through user interfaces or autonomous modifications based on computed clearances.

Benefits of technology

Enhances collision avoidance by providing precise clearance visualization and enabling efficient, low-cost, and energy-efficient motion planning adjustments, reducing the likelihood of collisions and improving operational safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007591317000001
    Figure 0007591317000001
  • Figure 0007591317000002
    Figure 0007591317000002
  • Figure 0007591317000003
    Figure 0007591317000003
Patent Text Reader

Abstract

The systems, methods, and user interfaces use clearance or margin determinations in motion planning and motion control of a robot in an operating environment, where the clearance or margin determination represents an amount of clearance or margin between at least a portion of the robot and one or more objects in the operating environment. The clearance may be displayed in a representation of the motion, such as a roadmap or a representation of multiple paths in a representation of a three-dimensional environment in which the robot operates. The roadmap may be adjusted, for example, based on user input or autonomously, based at least in part on the determined clearance.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates generally to robots, and more particularly to systems, methods, and user interfaces used in robot motion planning and control, such as systems, methods, and user interfaces that employ clearance or margin determination in the motion planning and motion control of a robot in an operational environment, where the clearance or margin determination represents an amount of clearance or margin between at least a portion of the robot and one or more objects in the operational environment. [Background technology]

[0002] 2. Description of Related Art Robots are becoming ubiquitous in a variety of applications and environments.

[0003] Typically, a processor-based system performs motion planning and / or control of a robot. A processor-based system may include, for example, a processor communicatively coupled to one or more sensors (e.g., a camera, a contact sensor, a force sensor, an encoder). The processor-based system may determine and / or execute a motion plan for causing the robot to perform a sequence of tasks. Motion planning is a fundamental problem in robot control and robotics. A motion plan specifies a path that a robot can follow from a start state to a goal state, typically completing a task without colliding with any objects (e.g., static obstacles, dynamic obstacles including humans) in the operating environment or with a reduced likelihood of colliding with any objects in the operating environment. Challenges in motion planning include the ability to perform motion planning at very high speeds even as characteristics of the environment change. For example, characteristics such as the position or orientation of one or more objects (or objects) in the environment may change over time. Challenges further include performing motion planning using relatively low-cost equipment, with relatively low energy consumption, and with a limited amount of storage (e.g., memory circuitry on the processor chip circuitry).

[0004] Motion planning is typically performed using a data structure called a roadmap, often interchangeably called a motion plan graph. The roadmap comprises a number of nodes and a number of edges, each edge connecting the nodes of a respective pair of nodes. The nodes, often interchangeably called vertices, hubs, waypoints, or viapoints, correspond to poses or configurations of the robot. An edge between two nodes of a pair of nodes corresponds to a movement or transition from one pose of the robot represented by one of the pair of nodes to another pose of the robot represented by the other of the pair of nodes. DISCLOSURE OF THEINVENTION [Problem to be solved by the invention]

[0005] One of the goals in robot motion planning is to avoid, or at least reduce the likelihood of, collisions with objects in the robot's operating environment. These objects may include, for example, static objects that have a known position prior to runtime operation of the robot. These objects may additionally or alternatively include dynamic objects (e.g., another robot, a human), whose position or location may change during runtime operation of the robot.

[0006] In addition to avoiding collisions, it may be particularly advantageous to understand and consider the amount of clearance or margin between the robot or portions thereof and objects in the operating environment. In some instances, certain clearances may be more relevant than others. In some instances, different amounts of clearance may be desired for different parts of the robot or for different operations. For example, a larger clearance may be desired for the welding gun end of a robot's arm tool than is desired for the robot's elbow.

[0007] To ensure that sufficient clearance exists, engineers often scale up the size of part or all of the robot. Thus, if the scaled up robot moves without colliding, there is increased confidence that the clearance is sufficient. Nevertheless, even this approach can fail for at least two reasons. First, the operation ( motion). Static objects (e.g., static obstacles) simply do not allow the desired clearance during movement. Second, the real world may differ enough from the model used by the simulator that the clearances are no longer sufficient. Thus, while a motion plan may have sufficient clearances in a simulated work cell, these clearances are not sufficient when applied to a real-world work cell. Thus, while a user or operator may attempt to visually assess the clearances, such is particularly difficult to perform with any reasonable accuracy. [Means for solving the problem]

[0008] The approach described herein allows an engineer to simulate or execute a motion plan and, instead of simply "eyeballing" the clearance, advantageously see a specific visual indication of the size and location of the clearance for one or more parts of the robot during or along one or more movements of the robot or part thereof. Providing a specific visual indication of the clearance allows the engineer to quickly and intuitively focus on exactly where to adjust the motion plan, for example, by adjusting values ​​of various parameters to slow down movements around tight clearances, by using more conservative path smoothing, or by adding or removing nodes or edges in the roadmap and / or by adjusting nodes or edges in the roadmap.

[0009] It is therefore particularly advantageous to computationally determine the clearance of one or more parts of the robot relative to one or more objects in the operating environment and present for review a visual representation of the determined clearance. For example, a visual representation of the determined amount of clearance for one, two, more, or even all parts of the robot or robot appendages may be visually presented in a representation of motion of the robot. The representation of motion may take the form of, for example, a representation of a three-dimensional (3D) space in which the robot operates, such as one or more paths of movement of the robot. The representation of motion may take the form of, for example, a roadmap or graph representation showing nodes representing poses and edges corresponding to transitions between poses or movements of the robot. The amount of clearance may be determined with respect to one or more objects, including another robot operating in the operating environment. In some implementations, a representation of the determined amount of clearance may be presented for one, two, or even more robots operating in the operating environment.

[0010] The determined amount of clearance for one or more parts of the robot may be presented as a value, such as a numerical value (e.g., millimeters, centimeters, inches). The determined amount of clearance for one or more parts of the robot may be presented as a color (e.g., red, orange, yellow, green, blue), such as a color corresponding to the amount of clearance or even a deviation from a specified nominal clearance amount. The determined amount of clearance for one or more parts of the robot may be presented, for example, as a heat map with a transition of colors and / or shades (e.g., dark red, light red, light green, dark green) corresponding to the amount of clearance or even a deviation from a specified nominal clearance amount. The determined amount of clearance for one or more parts of the robot may be presented as a cue or visual effect, such as a line weight or other visual effect (e.g., marquee, blinking).

[0011] A visually presented indication of the determined amount of clearance may, for example, be spatially associated with a corresponding action or movement, e.g., an indication of the determined amount of clearance may be spatially associated with a path or portion thereof in a 3D representation of the space, or an edge or portion thereof in a roadmap or graph representation. A visually presented indication of the determined amount of clearance may, for example, be spatially associated with a robot or portion thereof, e.g., in a simulation of a robot or portion thereof moving in a representation of a 3D space, e.g., by applying a color around the robot or portion thereof, the color corresponding to the computationally determined amount of clearance.

[0012] The visually presented indication of the determined amount of clearance can represent, for example, a minimum clearance experienced by the entire robot when performing a movement. The visually presented indication of the determined amount of clearance can represent, for example, a minimum clearance experienced by each portion of the robot (e.g., a robot appendage; a link, a joint, an end of an arm tool, or a tool center point (TCP) of a robot appendage) when performing a movement. For example, the visually presented indication of the determined amount of clearance can represent an amount of clearance experienced by the end of an arm tool, an end effector or tool center point, a particular link, or a particular joint during a specified movement.

[0013] Each motion may have a respective single measure of clearance determined, which represents the minimum clearance experienced over the entire range of motion, or each motion may have multiple measures of clearance, each measure of clearance representing the minimum clearance experienced at a respective point along the range of motion.

[0014] Traditionally, motion planning involves removing edges from a roadmap where the motion corresponding to the edge conflicts with the current environment (e.g., collision or significant likelihood of collision), and then solving a shortest path search from the current node to a destination node or one of several possible destination nodes. The shortest path search can incorporate a cost metric (or cost distance / cost metric) where each edge has a cost. The cost metric reflects one or more parameters of interest (e.g., latency, energy cost). In at least one implementation of the techniques described herein, the cost metric can be extended (e.g., via a cost function) to incorporate determined clearance information. This can advantageously enable the generation of a roadmap representing the determined clearance and / or clearance-aware motion planning.

[0015] In at least one implementation, a user interface is provided that allows adjustment of the roadmap, for example, based at least in part on the determined clearances. For example, the nodes and edges of the roadmap in the form of a visually presented graph may take the form of user-selectable icons that may be removed, moved, added, or their associated parameters adjusted via user input. Additionally or alternatively, a menu or palate of user-selectable icons may allow the nodes and edges of the roadmap to be modified (e.g., removed, moved, copied, or duplicated, and / or parameter values ​​adjusted), or new nodes or edges may be added to the roadmap. Thus, the robotic movements may be adjusted based on the received input. Additionally or alternatively, the robotic movements may be adjusted automatically and autonomously (i.e., without user or operator input or intervention) based on one or more determined clearances.

[0016] The described approaches may be used in motion planning that is performed during simulated operation of the robot during pre-runtime (or pre-runtime, pre-runtime) or configuration time, and / or during run-time (or runtime) operation of the robot. [Brief description of the drawings]

[0017] In the drawings, identical reference numbers indicate similar elements or acts. The sizes and relative positions of elements in the drawings are not necessarily drawn to scale. For example, the shapes and angles of various elements are not drawn to scale, and some of these elements have been appropriately enlarged and positioned at times to improve drawing readability. Furthermore, the particular shapes of the elements as drawn are not intended to convey any information regarding the actual shape of the particular elements, but have been selected solely for ease of recognition in the drawings. [Figure 1] FIG. 1 is a schematic diagram of a processor-based system for performing motion planning for one or more robots, with multiple robots operating in an operating environment to perform tasks. [Diagram 2] FIG. 2 is a functional block diagram of the processor-based system of FIG. 1 communicatively coupled to control a first robot of a plurality of robots. [Diagram 3] FIG. 3 is an example roadmap for a robot operating in an operating environment or work cell, according to one example embodiment. [Figure 4] FIG. 4 is an exemplary representation of movement in a three-dimensional environment in which a robot operates, including multiple paths that parts of the robot may follow. [Diagram 5]FIG. 5 is a flow chart illustrating a method of operation in the processor-based system of FIGS. 1 and 2 , in accordance with at least one example embodiment, to determine clearance of two or more portions of a robot and present a representation of the robot movement as a path in a three-dimensional spatial representation or as edges in a roadmap, along with a visual indication of the determined clearance of two or more portions of the robot in the presentation of the representation of the robot movement. [Figure 6] FIG. 6 is a flow diagram illustrating a method of operation in the processor-based system of FIGS. 1 and 2 for determining a clearance for at least one of two or more robots operating in an operating environment and presenting a representation of movement of at least one of the robots in a three-dimensional spatial representation along with a visual indication of the determined clearance in the three-dimensional spatial representation. [Figure 7] FIG. 7 is a flow diagram illustrating a method of operations in the processor-based system of FIGS. 1 and 2 for determining clearances for one or more portions of a robot and setting or adjusting a cost metric associated with each edge of a roadmap based at least in part on the determined clearances according to at least one illustrated implementation. [Figure 8] FIG. 8 is a flow diagram illustrating a method of operation in the processor-based systems of FIGS. 1 and 2 for setting or adjusting a cost metric associated with each edge according to at least one illustrated implementation that can be executed as part of the method shown in FIG. [Figure 9] FIG. 9 is a flow diagram illustrating a method of operation in the processor-based systems of FIGS. 1 and 2 for setting or adjusting a cost metric associated with each edge according to at least one illustrated implementation that can be executed as part of the method shown in FIG. [Figure 10]FIG. 10 is a flow diagram illustrating a method of operation in the processor-based system of FIGS. 1 and 2 for determining clearance of a portion of a robot, providing a visual indication of the determined clearance, receiving input, and adjusting movement of the robot based at least in part on the received input. [Figure 11] FIG. 11 is a flow diagram illustrating a method of operation in the processor-based system of FIGS. 1 and 2 to provide a user interface that enables adjustment of at least a portion of a roadmap to coordinate the movement or motion of one or more robots, according to at least one illustrated implementation. [Figure 12] FIG. 12 is a flow diagram illustrating a method of operation in the processor-based system of FIGS. 1 and 2 to provide a graphical user interface that enables coordination of movement or motion of one or more robots according to at least one illustrated implementation. [Figure 13] FIG. 13 is a flow diagram illustrating a method of operation in the processor-based system of FIGS. 1 and 2 that provides a visual display of the determined clearance as one or more numerical values ​​associated with each edge or path, according to at least one illustrated implementation. [Figure 14] FIG. 14 is a flow diagram illustrating a method of operation in the processor-based system of FIGS. 1 and 2 to provide a visual indication of the determined clearance as one or more colors associated with each edge or path, according to at least one illustrated implementation. [Figure 15] FIG. 15 is a flow diagram illustrating a method of operation in the processor-based systems of FIGS. 1 and 2 to provide a visual display of determined clearances as one or more heat maps associated with respective edges or paths in accordance with at least one illustrated implementation. [Figure 16]FIG. 16 is an image of a displayed user interface showing a presentation of a representation of a movement of a robot or part thereof together with an indication of a determined clearance according to at least one illustrated implementation, where the representation of the movement is in the form of a roadmap and the indication of the determined clearance is in the form of a single numerical value representing the minimum clearance experienced by one or more parts of the robot in a movement corresponding to a transition represented by an edge of the roadmap. [Figure 17] FIG. 17 is an image of a displayed user interface showing a representation of movement of a robot or portion thereof together with an indication of determined clearances according to at least one illustrated implementation, where the representation of the movement is in the form of a roadmap and the indication of determined clearances is in the form of a plurality of numerical values ​​representing respective clearances experienced by respective portions of the robot in movements corresponding to transitions represented by edges of the roadmap. [Figure 18] FIG. 18 is an image of a displayed user interface showing a display of a representation of a movement of a robot or portion thereof together with an indication of a determined clearance according to at least one illustrated implementation, where the representation of the movement is in the form of a roadmap and the indication of the determined clearance is in the form of a single color representing the minimum clearance experienced by one or more portions of the robot when performing a movement corresponding to a transition represented by an edge of the roadmap. [Figure 19] FIG. 19 is an image of a displayed user interface showing a display of a representation of movement of a robot or portion thereof along with a representation of a determined clearance according to at least one illustrated implementation, where the representation of movement is in the form of a roadmap and the representation of the determined clearance is in the form of multiple colors of a heatmap representing respective clearances experienced by respective portions of the robot when performing movements corresponding to transitions represented by edges in the roadmap. [Figure 20]FIG. 20 is an image of a displayed user interface showing a representation of movement of a robot or portion thereof together with an indication of a determined clearance in at least one illustrated implementation, where the representation of the movement is in the form of one or more paths in a representation of a three-dimensional operating environment, and the indication of the determined clearance is in the form of a single numerical value representing the minimum clearance experienced by the robot when performing the movement represented by the path in the representation of the three-dimensional operating environment. [Figure 21] FIG. 21 is an image of a displayed user interface showing a representation of movement of a robot or portion thereof together with an indication of determined clearances in at least one illustrated implementation, where the representation of movement is in the form of one or more paths in a representation of a three-dimensional operating environment, and the indication of determined clearances is in the form of a plurality of numerical values ​​representing respective clearances experienced by the robot when performing the movement movements represented by the paths in the representation of the three-dimensional operating environment. [Figure 22] FIG. 22 is an image of a displayed user interface showing a representation of movement of a robot or portion thereof along with an indication of a determined clearance in at least one illustrated implementation, where the representation of the movement is in the form of one or more paths in a representation of a three-dimensional operating environment, and the indication of the determined clearance is in the form of a single color representing the minimum clearance experienced by the robot when performing the movement represented by the paths in the representation of the three-dimensional operating environment. [Figure 23] FIG. 23 is an image of a displayed user interface showing a representation of movement of a robot or part thereof together with an indication of determined clearances in at least one illustrated implementation, where the representation of movement is in the form of one or more paths in a representation of a three-dimensional operating environment, and where the indication of determined clearances is in the form of multiple colors in a heat map representing respective clearances experienced by the robot when performing the movements represented by the paths in the representation of the three-dimensional operating environment. [Figure 24]FIG. 24 is an image of a displayed user interface showing a representation of movement of two or more parts of the robot along with a representation of a determined clearance according to at least one illustrated implementation, where the representation of the movement is in the form of two or more paths in a representation of a three-dimensional operating environment, and the representation of the determined clearance is in the form of a single numerical value representing the minimum clearance experienced by each of the two or more parts of the robot when performing the movement represented by the paths in the representation of the three-dimensional operating environment. [Diagram 25] FIG. 25 is an image of a displayed user interface showing a representation of movement of two or more parts of a robot along with a representation of determined clearances according to at least one illustrated implementation, where the representation of the movements is in the form of two or more paths in a representation of a three-dimensional operating environment, and the representation of the determined clearances is in the form of a plurality of numerical values ​​representing respective clearances experienced by each of the two or more parts of the robot when performing the movements represented by the paths in the representation of the three-dimensional operating environment. [Figure 26] FIG. 26 is an image of a displayed user interface showing a representation of movement of two or more parts of the robot along with a representation of a determined clearance according to at least one illustrated implementation, where the representation of the movement is in the form of two or more paths in a representation of a three-dimensional operating environment, and the representation of the determined clearance is in the form of a single color representing the minimum clearance experienced by each of the two or more parts of the robot when performing the movement represented by the paths in the representation of the three-dimensional operating environment. [Figure 27] FIG. 27 is an image of a displayed user interface showing a representation of movement of two or more parts of the robot along with a representation of determined clearances according to at least one illustrated implementation, where the representation of movement is in the form of two or more paths in a representation of a three-dimensional operating environment and the representation of determined clearances is in the form of multiple colors of a heat map representing the respective clearances experienced by each of the two or more parts of the robot when performing the movements represented by the paths in the representation of the three-dimensional operating environment. [Figure 28]FIG. 28 is an image of a displayed user interface showing a presentation of a representation of the movement of two or more portions of a robot along with an indication of the determined clearance, according to at least one illustrated implementation. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] The details of the disclosure are described below to provide an understanding of various embodiments. However, those skilled in the art will readily appreciate that the present invention may be practiced without one or more of these specific details, or with other methods, components, or materials. In other instances, well-known structures related to processor-based systems, computer systems, actuators, actuator systems, and / or communication networks or channels have not been shown or described in detail to avoid unnecessarily obscuring the description of the embodiments. In other instances, well-known motion planning methods and techniques and / or computer vision methods and techniques for generating sensory data and volumetric representations of one or more objects, etc., have not been described in detail to avoid unnecessarily obscuring the description of the embodiments.

[0019] Unless the context otherwise requires, throughout the following specification and claims, the term "comprise" and variations thereof, such as "comprises" and "comprising," are to be interpreted in their open and inclusive sense of "including, but not limited to."

[0020] Throughout this specification, a reference to "one embodiment" or "one embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment is included in at least one embodiment or at least one embodiment. Thus, the appearances of the phrases "one implementation" or "one implementation" or "in one embodiment" or "in one embodiment" in various places throughout this specification do not necessarily all refer to the same implementation or embodiment. Furthermore, particular features, structures, or characteristics may be combined in any suitable manner in one or more implementations or embodiments.

[0021] As used in this specification and the appended claims, the singular includes the plural unless the content clearly dictates otherwise. Additionally, the term "or" is generally used in its sense to include "and / or" unless the content clearly dictates otherwise.

[0022] As used herein and in the appended claims, the term "module" or "module" refers to a "program" or "logic" means circuitry (e.g., a processor, e.g., microprocessor, microcontroller, central processing unit (CPU), CPU core, application specific integrated circuit (ASIC), field programmable gate array (FPGA)) that executes logic (e.g., a set of instructions or algorithms) defined in hardware, software, and / or firmware in the absence of a preceding circuit.

[0023] As used in this specification and the appended claims, the term "program module" or "program module" means executable logic in the form of a set of instructions or an algorithm stored on a non-transitory medium.

[0024] As used herein and in the appended claims, the term "robot" or "robots" refers to both a robot or parts of a robot and / or robots. Although generally discussed with respect to robots, the various structures, activities, and / or operations may be applicable to an operating environment with one, two, or more robots operating therein.

[0025] As used herein and in the appended claims, the term "operating environment" or "environment" is used to refer to the volume, space, or work cell in which one, two, or more robots operate. The operating environment may include various objects, such as obstacles (i.e., items that the robot must avoid) and / or workpieces (i.e., items that the robot must interact with or act on).

[0026] As used in this specification and the appended claims, the term "path" means a collection or locus of points in two or three dimensional space, and the term "trajectory" means a path including the time to reach a particular one of those points, and optionally including velocity and / or acceleration.

[0027] As used herein and in the appended claims, the term "three-dimensional spatial representation" or "3D spatial representation" means a representation of a three-dimensional or 3D operating environment in which one or more robots operate, whether represented visually in a two-dimensional or three-dimensional image presentation or display, or whether represented logically in a data structure stored on a non-transitory processor-readable medium.

[0028] As used herein and in the appended claims, the term "roadmap" is used interchangeably with the term "motion planning graph" to refer to a graph representation including a plurality of nodes and a plurality of edges, each edge connecting a respective node of the nodes, the nodes representing a respective state, configuration or pose of the robot, and the edges representing respective legal or valid transitions between respective pairs of states, configurations or poses of the robot represented by the respective pair of nodes of the nodes connected by the respective edges. The states, configurations or poses may represent, for example, a set of joint positions, orientations, poses or coordinates for each of the joints of the respective robot 102. Thus, each node may represent a pose of the robot 102 or a portion of the robot 102 as completely defined by the poses of the joints that comprise the robot 102.

[0029] As used herein and in the appended claims, the term "task" is used to refer to a robot task in which the robot transitions from Pose A to Pose B, preferably without colliding with obstacles in its environment. A task may possibly include grasping or ungrasping an item, moving or dropping an item, rotating an item, picking up or placing an item. The transition from Pose A to Pose B may optionally include transitions between one or more intermediate poses.

[0030] As used in this specification and the appended claims, the terms "color" and "color" refer to humanly perceptibly distinguishable colors (e.g., red, orange, green, blue) as well as humanly perceptibly distinguishable shades, whether the differences in shades or shades are due to differences in hue, value, saturation, and / or color temperature.

[0031] As used in this specification and the appended claims, when used in the context of whether a collision will occur or result, the terms "determine," "determining," and "determined" mean that an evaluation or prediction is made as to whether a given pose or movement between two poses through several intermediate poses will result in a collision between a part of the robot and some object (e.g., another part of the robot, a part of another robot, a permanent obstacle, a transient obstacle).

[0032] As used in this specification and the appended claims, the terms "determine," "determining," and "determined," when used in the context of clearance or margin, mean that a computational assessment or prediction is made via a processor of the amount of distance or space that exists or will exist between the robot, or a portion thereof, and one or more objects in the operating environment when performing a motion or movement of the robot, or a portion thereof, such as a motion or movement along a path or motion or movement represented by an edge in a roadmap.

[0033] As used herein and in the appended claims, the term "sensor" includes a sensor or transducer that detects a physical characteristic of the operating environment, as well as any transducer or other energy source associated with such a detecting sensor or transducer, such as transducers that emit energy that is reflected, refracted or otherwise returned, such as light emitting diodes, other light sources, lasers and laser diodes, speakers, haptic engines, ultrasonic energy sources, and the like.

[0034] As used in this specification and the appended claims, references to the operation or movement (or motion) or action of a robot include the operation or movement (or motion) or action of the entire robot and / or the operation or movement (or motion) or action of a portion of the robot (e.g., a robotic appendage, end of an arm tool, end effector).

[0035] At least some implementations are described with respect to operations (e.g., motion planning, clearance determination) from the perspective of a given robot (e.g., a first robot), e.g., motion planning for the first robot in the presence of one or more other robots in the operating environment. References to "other robots" in such descriptions mean any other robots in the environment other than the particular robot on which the particular instance of the operation being described is being performed. It should be noted that similar operations may be performed simultaneously on two or more different robots, and that from the perspective of the motion planning and clearance determination operations for a first one of the robots, a second one of the robots is considered to be the other robot. Meanwhile, from the perspective of the motion planning and clearance determination operations for the second robot, the first robot is considered to constitute the other robot.

[0036] The title and abstract are for convenience only and do not represent the scope of the invention or imply embodiments.

[0037] FIG. 1 illustrates a processor-based system 100 for performing motion planning with one or more robots 102 a, 102 b (collectively designated 102) operating in an operating environment 104 (also referred to as a workcell) to perform tasks, according to one illustrated embodiment.

[0038] The robot 102 may take any of a wide variety of forms. Typically, the robot 102 takes the form of or has one or more robotic appendages 105 (only one is referred to in FIG. 1). The robotic appendages 105 may include one or more links 105a, one or more joints 105b, one or more linkages with an end effector or end of an arm tool 105c typically located at a tool center point 105d, and optionally one or more cables. The processor-based system 100 may use other forms of robots 102, for example, autonomous vehicles with or without movable appendages.

[0039] The operating environment 104 typically represents a three-dimensional space in which the robots 102a, 102b may operate and move, although in certain limited implementations the operating environment 104 may represent a two-dimensional space or area.

[0040] The operating environment 104 may include one or more objects in the form of obstacles, such as machines (e.g., conveyors 106), posts, pillars, walls, ceilings, floors, tables, humans, and / or animals. It should be noted that the robot 102b or parts thereof may constitute obstacles when considered from the perspective of another robot 102a (i.e., during motion planning of the robot 102a) in situations where parts of the robots 102a, 102b may overlap in space and time or may otherwise collide if their movements are not controlled to avoid collisions. The operating environment 104 may further include one or more objects in the form of work items or workpieces 108 that the robot 102 manipulates as part of a task to perform work, such as one or more parcels, packaging, fasteners, tools, items, or other objects.

[0041] The processor-based system 100 may include one or more motion planners 110. In at least some implementations, a single motion planner 110 may be used to perform motion planning for two, more, or all of the robots 102. In other implementations, a respective motion planner 110 is used to perform motion planning for each of the robots 102a, 102b.

[0042] The motion planner 110 is optionally communicatively coupled to control one or more of the robots 102, for example, by providing the robots 102 with respective motion plans 115 (one shown) for execution by the robots 102. The motion planner 110 is also communicatively coupled to receive various types of input. For example, the motion planner 110 may receive a robot geometric model 112 (also known as a kinematic model). Also, for example, the motion planner 110 may receive tasks 114. The motion planner 110 may optionally receive other roadmaps 117, which are roadmaps 117 for other robots 102 operating within the operating environment 104 with respect to the given robot 102 for which a particular instance of motion planning or clearance determination is being performed. For example, with respect to the motion planning or clearance determination of the first robot 102a, the second robot 102b is considered to be the other robot. When performing motion planning or clearance determination for the second robot 102b, the first robot 102a is considered as another robot.

[0043] The motion planner 110 generates or generates a roadmap 116 based at least in part on the inputs received.

[0044] The robot geometric models (GEOMODELS) 112 define the geometry of a given robot 102, for example, in terms of joints, degrees of freedom, dimensions (e.g., linkage lengths), and / or the robot's 102 respective "configuration space" or "C-space." Conversion of the robot geometric models 112 into a roadmap (i.e., motion plan graph) 116 may occur prior to run-time or task execution, for example, performed by a processor-based server system (not shown) and provided to the motion planner 110. Alternatively, the roadmap 116 may be generated by the processor-based system 100, for example, using the robot geometric models 112, using any of a variety of techniques.

[0045] The tasks 114 may, for example, specify tasks to be performed with respect to an end pose, end configuration or end state, and / or intermediate poses, intermediate configurations or states of each robot 102. The poses, configurations or states may, for example, be defined in terms of joint positions and joint angles / rotations (e.g., joint poses, joint coordinates) of each robot 102.

[0046] The motion planner 110 is optionally communicatively coupled to receive input in the form of an environmental model 120, for example, provided by a sensing system 124. The environmental model 120 represents static and / or dynamic objects in the work cell or operating environment 104 that are known a priori and / or are not known a priori. The environmental model 120 may take the form of, for example, a point cloud, an occupancy grid, a box (e.g., a bounding box) or other geometric object, or a stream of voxels (i.e., a "voxel" is equivalent to a 3D pixel or volumetric pixel) that represent obstacles present in the operating environment 104. The environmental model 120 may be generated by the sensing system 124 from raw data sensed via one or more sensors 122a, 122b (e.g., two-dimensional or three-dimensional cameras, time-of-flight cameras, laser scanners, LIDAR, LED-based photoelectric sensors, laser-based sensors, passive infrared (PIR) motion sensors, ultrasonic sensors, sonar sensors).

[0047] The sensing system 124 may include one or more processors capable of executing one or more machine-readable instructions that cause the sensing system 124 to generate respective discretizations of a representation of the operating environment 104 in which the robot 102 operates to perform tasks of various different scenarios. The sensing system 124 may be separate and remote from, but communicatively coupled to, the processor-based system 100. Alternatively, the sensing system 124 may form part of the processor-based system 100.

[0048] The motion planner 110 is optionally communicatively coupled to receive input in the form of static object data (not shown). The static object data is representative (e.g., size, shape, location, occupancy) of static objects within the operating environment 104 and may be known, for example, a priori. The static objects may include, for example, one or more fixed structures within the operating environment 104, such as columns, pillars, walls, ceilings, floors, conveyors 106, etc.

[0049] The motion planner 110 is operable to dynamically generate a motion plan 115 to cause the robot 102 to perform a task in the operating environment 104 while taking into account objects (e.g., the conveyor 106) in the operating environment 104, including other robots 102. As an example, the motion planner 110 takes into account collision assessments and determined clearances between the robot 102 or parts thereof and objects (e.g., the conveyor 106) in the operating environment 104, including other robots 102. The motion planner 110 may optionally take into account static object data and / or a priori representations of static objects represented by the environment model 120 when generating the motion plan 115. Optionally, during motion planning of a given robot (e.g., the first robot 120a), the motion planner 110 may take into account the operating conditions of the other robots 102 (e.g., the second robot 102b) at a given time, e.g., whether another robot 102 (e.g., the second robot 102b) has completed a given operation or task, and may enable recalculation of the motion planning of the given robot (e.g., the first robot 102a) based on an operation or task of one of the other robots (e.g., the second robot 102b) being completed, thus making available and selecting a path or trajectory that was previously ruled out. Optionally, the motion planner 110 may take into account the operating conditions of the robots 102, e.g., occurrence or detection of a fault condition, occurrence or detection of an interruption condition, and / or occurrence or detection of a request to expedite or delay or skip a motion planning request.

[0050] The processor-based system 100 may include one or more clearance determination and display modules 126, e.g., a respective clearance determination and display module 126 for each of the robots 102a, 102b, respectively. In at least some implementations, a single clearance determination and display module 126 may be used to determine the clearance of two, more than, or all of the robots 102. As described herein, the clearance determination and display module evaluates the motion of the robot 102, or a portion thereof, relative to one or more objects in the operating environment 104 to determine the amount of clearance or margin between the robot 102, or a portion thereof, and an object during the motion or movement of the robot or portion thereof. Such may be evaluated in addition to, or even as part of, performing collision assessment. The clearance determination and display module 126 may, for example, simulate movements specified in the roadmap 116 and evaluate distances between one or more parts of the robot 102 (e.g., links, joints, end of an arm tool, tool center point) and one or more objects in the operating environment 104 (including other robots 102 over the range of movement).

[0051] The processor-based system 100 may include one or more presentation systems 128. Alternatively, the presentation system 128 may be separate and distinct from, but communicatively coupled to, the processor-based system 100. The presentation system 128 includes one or more displays 128a, also referred to as display screens. The presentation system 128 may include one or more user interface components or devices, such as one or more of a keyboard 128b, a keypad, a computer mouse 128c, a trackball, a stylus, or other user input components or devices. The display 128a may take the form of, for example, a touch screen display to operate as a user input / output (I / O) component or device. In at least some implementations, the presentation system 128 may optionally take the form of a computer system 128d (e.g., a personal computer system, a high performance workstation, e.g., a CAD workstation), e.g., having its own processor, memory, and / or storage devices. Alternatively, the operations may include presentation via a web-based interface, for example in a Software as a Service (SaaS) implementation, with processing being performed remotely from the display 128a.

[0052] The processor-based system 100 may include one or more correction and / or adjustment modules 130, e.g., a respective correction and / or adjustment module 130 for each of the robots 102a, 102b. In at least some implementations, a single correction and / or adjustment module 130 may be employed for two, more, or all of the robots 102. As described herein, the correction and / or adjustment module 130 may make corrections or adjustments to the roadmap based at least in part on the determined clearance and / or based at least in part on inputs that are based at least in part on the determined clearance. In some examples, the corrections or adjustments may be made directly or autonomously (i.e., without user or operator input or intervention of another user or operator). For example, the modification and / or adjustment module 130 may automatically and autonomously set or adjust a cost metric for each of one or more edges of the roadmap 116 based on the determined clearance, for example, if the determined clearance does not meet a condition (e.g., less than a specified or nominal clearance). In some examples, the modification or adjustment may be made indirectly based on user or operator intervention (e.g., user or operator input, user or operator selection) with respect to the determined clearance, which itself may be based at least in part on user or operator consideration of the indicators of the determined clearance. For example, the modification and / or adjustment module 130 may add nodes, add edges, delete nodes, delete edges, duplicate or copy nodes, duplicate or copy edges, move nodes, move edges, set or change values ​​of various parameters based on user or operator input or intervention based on user evaluation of the displayed indicators of the determined clearance.

[0053] Various communication paths are indicated by arrows in FIG. 1. The communication paths may take the form of, for example, one or more wired communication paths (e.g., electrical conductors, signal buses, or optical fibers) and / or one or more wireless communication paths (e.g., via RF or microwave radio and antennas, infrared transceivers). Each of the motion planners 110 may optionally be communicatively coupled to one another, either directly or indirectly, to provide other roadmaps 117 to the motion planner 110 for robots (e.g., robot 102b) other than the robot for which a motion is planned (e.g., robot 102a). For example, the motion planners 110 may be communicatively coupled to one another via a network infrastructure, for example, a non-proprietary network infrastructure (e.g., an Ethernet network infrastructure).

[0054] Figure 2 illustrates in more detail a processor-based system 100 for performing motion planning on the first robot 102a of Figure 1. The processor-based system 100 includes a motion planner 110 that generates a motion plan 115 that controls the movement of the first robot 102a, and may optionally effect adjustments to a roadmap 116 (Figure 1), for example, via setting a cost metric. The processor-based system 100 also includes a clearance determination and display module 126 (labeled "clearance module" in Figure 2) that determines the amount of clearance or margin between the robot 102 or a portion thereof and an object during movement or movement of the robot or a portion thereof, and causes a visual display of the determined clearance to be presented.

[0055] The processor-based system 100 may include another motion planner for generating a motion plan and optionally causing adjustments to a roadmap for another robot (not shown in FIG. 2), and may include another clearance determination and display module 126 for determining clearances for the other robot and presenting a visual indication of the determined clearance.

[0056] The processor-based system 100 may, for example, be communicatively coupled via at least one communication channel (e.g., transmitter, receiver, transceiver, radio, router, Ethernet) to receive the roadmap or motion planning graph from one or more sources of the roadmap or motion planning graph. The source of the roadmap or motion planning graph may be separate and distinct from the motion planner 110, for example, a server computer that may be operated or controlled by the respective manufacturer of the robot 102 or by some other entity. The roadmap or motion planning graph may be determined, set up, or defined prior to runtime, for example, during pre-runtime or configuration time (i.e., defined prior to execution of a task). This advantageously allows some of the most computationally intensive work to be performed prior to runtime, when responsiveness is not a particular concern. The roadmap or motion planning graph may, for example, be adjusted or updated based at least in part on the determined clearance, as described herein.

[0057] As described above, each robot 102 may include a robot appendage 105 (FIG. 1) including, for example, links 105a, joints 105b, end effectors, or end of arm tools 105c. The robot 102 may also include one or more actuators 205 (three shown, only one called out in FIG. 2) coupled and operable to move the linkage in response to control or drive signals. The actuators 205 may take the form of one or more of an electric motor, a stepper motor, a solenoid, a pneumatic actuator, or a hydraulic actuator. A pneumatic actuator may include, for example, one or more pistons, cylinders, valves, a reservoir of gas, and / or a pressure source (e.g., compressor, blower). A hydraulic actuator may include, for example, one or more pistons, cylinders, valves, a reservoir of fluid (e.g., low compressibility hydraulic fluid), and / or a pressure source (e.g., compressor, pump).

[0058] Each robot 102 may include one or more motion controllers (e.g., motor controllers) 220 (only one shown in FIG. 2 ) that receive control signals, for example in the form of a motion plan 115, and provide drive signals for driving the actuators 205.

[0059] There may be a processor-based system 100 for each robot 102a, 102b (FIG. 1), or one processor-based system 100 may perform motion planning for more than one robot 102a, 102b. One processor-based system 100 is described in detail with respect to FIG. 2 for illustrative purposes. Those skilled in the art will recognize that the description may apply to similar or even identical additional instances of the processor-based system 100.

[0060] The processor-based system 100 may include one or more processors 222 and one or more associated non-transitory computer-readable or processor-readable storage media, such as a system memory 224a, a drive 224b, and / or memory or registers (not shown) of the processor 222. The non-transitory computer-readable or processor-readable storage media are communicatively coupled to the processor 222 via one or more communication channels, such as a system bus 227. The system bus 227 may employ any known bus structure or architecture, including a memory bus with a memory controller, a peripheral bus, and / or a local bus. One or more of such components may also, or instead, communicate with each other via one or more other communication channels, such as one or more parallel cables, serial cables, or high-speed wireless network channels, such as Universal Serial Bus ("USB") 3.0, Peripheral Component Interconnect Express (PCIe), or via Thunderbolt.

[0061] The processor-based system 100 may also be communicatively coupled to one or more remote computer systems, such as a server computer, a desktop computer, a laptop computer, an ultra-portable computer, a tablet computer, a smartphone, a wearable computer, and / or a sensor (not shown in FIG. 2). The remote computing systems (e.g., server computers) may be used to program, configure, control, or otherwise interface with the processor-based system 100 and various components of the processor-based system 100 with data (e.g., other roadmap 117, task specification 114). Such connections may be over one or more communication channels, such as one or more wide area networks (WANs), such as Ethernet, or the Internet, using the Internet Protocol.

[0062] As mentioned above, the processor-based system 100 may include one or more processors 222, (i.e., circuitry), non-transitory storage media (e.g., system memory 224a, drive 224b), and a system bus 227 coupling various system components. The processor 222 may be any logical processing unit, such as one or more microcontrollers, central processing units (CPUs), digital signal processors (DSPs), graphic processing units (GPUs), field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), programmable logic controllers (PLCs), and the like. The system memory 224a may include read only memory ("ROM") 226, random access memory ("RAM") 228, flash memory 230, and EEPROM (not shown). A basic input / output system ("BIOS") 232 may be stored by the ROM 226 and contains the basic routines that help transfer information between elements within the processor-based system 100, such as during start-up.

[0063] The drives 224b may be, for example, a hard disk drive (HDD) for reading and writing from a magnetic disk, a solid state drive (SSD, e.g., flash memory) for reading and writing from a solid state memory, and / or an optical disk drive (ODD) for reading and writing from a removable optical disk. The processor-based system 100 may also include any combination of such drives in various different embodiments. The drives 224b may communicate with the processor 222 via a system bus 227. The drive(s) 224b may include an interface or controller (not shown) coupled between such drives 224b and the system bus 227. The drives 224b and associated computer-readable media provide non-volatile storage of computer or processor-readable and / or executable instructions, data structures, program modules, and other data for the processor-based system 100. Those skilled in the art will appreciate that other types of computer-readable media capable of storing data accessible by a computer may be used, such as a WORM drive, a RAID drive, a magnetic cassette, a digital video disk ("DVD"), a Bernoulli cartridge, RAM, ROM, smart cards, etc.

[0064] Executable instructions and data may be stored in system memory 224a, such as an operating system 236, one or more application programs 238, and program data 242. The application program 238 instructs the processor(s) 222 to generate a discretized representation of the operating environment 104 ( FIG. 1 ) in which the robot 102 is to operate, including objects in the operating environment 104 (e.g., obstacles and / or target objects or workpieces) in which the planned motion of other robots 102 may be represented as obstacles, generate a motion plan that includes invoking or otherwise obtaining the results of a collision assessment to determine clearance between the robot 102 or portions thereof and objects in the operating environment 104 (e.g., obstacles, e.g., conveyor 106), and to determine the clearance between the robot 102 or portions thereof and objects in the operating environment 104 (e.g., obstacles, e.g., conveyor 106). presenting a representation of the movement (e.g., a roadmap, a representation of a path in three-dimensional space) along with a visual indication of the clearance (e.g., numerical values, colors, heatmaps, visual cues or effects) determined; modifying and / or adjusting the roadmap 116 ( FIG. 1 ), including, for example, setting cost values ​​for edges, evaluating available paths within the roadmap; and, optionally, storing the determined roadmaps and / or providing a motion plan 115 for execution by the robot 102. Motion planning (e.g., collision detection or evaluation), updating cost values ​​of edges in the roadmap based on collision detection, and / or based on clearance determination or evaluation may be performed as described herein and in references incorporated herein by reference. Collision detection or evaluation may be performed using various structures and techniques described elsewhere herein. Clearance determination or evaluation may be performed using various structures and techniques described elsewhere herein. The application programs 238 may further include one or more machine-readable and machine-executable instructions that cause the processor 222 to perform other operations, for example, optionally process sensory data (captured via the sensors).The application programs 238 may further include one or more machine-executable instructions that cause the processor 222 to perform various other methods described herein and in the references incorporated herein by reference.

[0065] Although shown in FIG. 2 as being stored in system memory 224a, the operating system 236, application programs 238, and / or program data 242 may be stored in other non-transitory computer-readable or processor-readable media, such as drive 224b.

[0066] The motion planner 110 of the processor-based system 100 may include dedicated motion planner hardware (e.g., FPGA) or may be implemented in whole or in part via the processor 222 and processor-executable instructions, logic or algorithms stored in the system memory 224a and / or drive 224b.

[0067] The motion planner 110 may include or implement an optional motion converter 250 , a collision detector 252 , and a path analyzer 256 .

[0068] The modification and / or adjustment module 130 may include a roadmap adjuster 259 and a cost setter 254 .

[0069] The motion converter 250 converts motions of other ones of the robots 102 into representations of obstacles, which advantageously allow the motions of the other robots (e.g., robot 102b) to be taken into account when evaluating collisions and clearances of a given robot (e.g., robot 102a). The motion converter 250 receives a motion plan or other representation of motion, for example from another motion planner 110. The motion converter 250 then determines an area or volume that corresponds to the motion. For example, the motion converter 250 may convert the motion to a corresponding swept volume, i.e., a volume swept by the corresponding robot or part thereof as it moves or transitions between poses represented by the motion plan. Advantageously, the motion planner 110 need only queue the obstacles (e.g., swept volumes) and may not need to determine, track, or indicate the time of the corresponding motion or swept volume. Although the motion converter 250 of a given robot 102 has been described as converting the motion of another robot into an obstacle, in some implementations the other robot 102b (FIG. 1) may provide the given robot 102 with an obstacle representation (e.g., a swept volume) of a particular motion.

[0070] The collision detector 252 performs collision detection or analysis to determine whether a transition or movement of a given robot 102 or a portion thereof results in a collision with an obstacle. As described above, the movements of other robots 102 may be advantageously represented as obstacles. Thus, the collision detector 252 may determine whether the movement of one robot (e.g., robot 102a) results in a collision with another robot (e.g., robot 102b) moving through the work cell or operating environment 104 (FIG. 1).

[0071] In some implementations, the collision detector 252 implements software-based collision detection or evaluation, for example, performing bounding box-bounding box collision evaluation or evaluation based on a hierarchy of geometric (e.g., spherical) representations of volumes swept by the robot 102 or by portions of the robot during robot movement. In some implementations, the collision detector 252 implements hardware-based collision detection or evaluation, for example, employing a set of dedicated hardware logic circuits to represent obstacles and streaming a representation of the movement through the dedicated hardware logic circuits. In hardware-based collision detection or evaluation, the collision detector 252 can use one or more configurable arrays of circuits, for example one or more FPGAs 258, and can optionally generate Boolean collision evaluations.

[0072] The roadmap adjuster 259 adjusts or modifies the roadmap 116 ( FIG. 1 ) directly (e.g., autonomously) or indirectly (e.g., based on user or operator input based on a visual display) based on the determined clearance or margin determined by the processor 222. For example, the roadmap adjuster 259 may add one or more nodes to the roadmap 116, remove one or more nodes from the roadmap 116, and / or move one or more nodes in the roadmap 116. Additionally or alternatively, the roadmap adjuster 259 may, for example, add one or more edges to the roadmap 116, remove one or more edges from the roadmap 116, and / or move one or more edges in the roadmap 116. Additionally or alternatively, the roadmap adjuster 259 may, for example, set or otherwise adjust values ​​of one or more parameters associated with the roadmap 116 or associated with one or more nodes or edges of the roadmap 116. For example, roadmap adjuster 259 may adjust or otherwise set a travel speed associated with one or more edges and / or adjust the value of a path smoothing parameter.

[0073] The cost setter 254 may set or adjust a cost metric for edges in the roadmap 116 ( FIG. 1 ) based at least in part on the collision detection or evaluation by the motion planner 110, and optionally, at least in part on the determined clearance determined by the clearance determination module 264. For example, the cost setter 254 may set a relatively high value for the cost metric for edges that represent transitions between poses, states or movements that result in or are likely to result in a collision, and / or result in insufficient clearance (e.g., less than a specified or nominal clearance) being maintained between the robot or a portion thereof and one or more objects in the operating environment 104 ( FIG. 1 ). Also, for example, the cost setter 254 may set a relatively low value for the cost metric of edges representing transitions between poses or states or actions that are not likely to result in a collision and / or that are not likely to maintain insufficient clearance (e.g., less than a specified or nominal clearance) between the robot or a part thereof and one or more objects in the operating environment 104. Setting the cost may include setting or adjusting a value of the cost metric that is logically associated with the corresponding edge via some data structure (e.g., a field, a pointer, a table, a vector). The cost metric may be determined based on a cost function, for example, using one or more parameters, for example, a collision assessment parameter, a clearance assessment parameter, a latency parameter, and / or an energy consumption parameter. The parameters may have respective weightings in the cost function. For example, the collision assessment may be weighted more heavily than the clearance assessment. Also, for example, the clearance assessment parameter may be weighted more heavily than the latency parameter and / or the energy consumption parameter. The cost metric may be, for example, on a scale of 0 to 10, 0 to 100, 0 to 1,000, or 0 to 10,000.

[0074] The path analyzer 256 may determine a path (e.g., optimal or optimized) using the roadmap with a cost metric. For example, the path analyzer 256 may configure a minimum-cost path optimizer that determines a lowest-cost or relatively low-cost path between two states, configurations, or poses, where the states, configurations, or poses are represented by respective nodes in the roadmap. The path analyzer 256 may use or execute any of a variety of path-finding algorithms, such as a least-cost path-finding algorithm, taking into account cost values ​​logically associated with each edge that represent the likelihood of collision and / or the likelihood of not maintaining a specified clearance, and optionally other parameters.

[0075] Various algorithms and structures for determining a minimum cost path may be used, including those implementing the Bellman-Ford algorithm, but others may be used, including (but not limited to) any such process in which a minimum cost path is determined as a path between two nodes in the roadmap 116 where the sum of the cost metric or weights of its constituent edges is minimized. This process improves the technique of motion planning for the robot 102 by using the roadmap 116 representing collision assessment as well as clearance determination or evaluation of the robot's movements, increasing efficiency and response time for finding the "best" path to perform a task without collisions while maintaining a specified or nominal clearance.

[0076] The motion planner 110 may optionally include a pruner 260. The pruner 260 may receive information representing the completion of a motion by another robot, referred to as a motion completion message, or may set a flag to indicate completion. In response, the pruner 260 may remove the obstacle, or a portion of the obstacle representing the currently completed motion. This may enable the generation of a new motion plan for a given robot (e.g., robot 102a), which may be more efficient, or may allow the given robot to participate in the execution of a task previously prevented by the motion of another robot (e.g., robot 102b). This approach advantageously allows the motion converter 250 to ignore the timing of the motion when generating the obstacle representation of the motion, while still achieving better throughput than using other techniques. The motion planner 110 may further cause the collision detector 252 to perform new collision detection or evaluation and clearance determination or evaluation given the obstacle modification to generate an updated roadmap 116 with modified edge weights or costs associated with the edges, and cause the cost setter 254 and the path analyzer 256 to update the cost metrics and determine a new or modified motion plan accordingly.

[0077] Motion planner 110 may optionally include an environment converter (not shown) that converts output from optional sensors (e.g., digital cameras, not shown) (e.g., digitized representations of the environment) into representations of obstacles. Thus, motion planner 110 may perform motion planning that takes into account transient objects, e.g., people, animals, etc., in operating environment 104 (FIG. 1).

[0078] The clearance determination and display module 126 evaluates the motion of the robot 102 or a portion thereof relative to one or more objects in the operating environment 104 to determine the amount of clearance or margin between the robot 102 or a portion thereof and the objects during the motion or movement of the robot or portion thereof. To do so, the clearance determination and display module 126 may use a run motion module (or execute movement module) 262 that simulates or actually executes a movement specified by the roadmap 116 or a portion thereof (e.g., an edge) of one or more robots (e.g., robot 102a, FIG. 1). The clearance determination and display module 126 may include a clearance determination module 264 that determines the clearance or margin of one or more portions of the robot 102 (e.g., robot 102a) with respect to objects in the operating environment 104, including other robots (e.g., robot 102b, FIG. 1), when the movement is simulated or actually executed.

[0079] To determine clearance, various approaches may be used, such as using posed meshes or sphere trees, or using swept volumes. In some implementations, clearance detection is for offline use, including roadmap building, roadmap adjustment, and / or visualization. Clearance detection is typically used for static objects, since dynamic objects typically cannot be planned in advance. When clearance detection is used for offline use (e.g., roadmap building, roadmap adjustment, and / or visualization), the approach used does not need to be as fast as when used in online applications (e.g., controlling a robot in real time).

[0080] There are at least two approaches to perform clearance detection. One approach is to use meshes of polygons, either custom or with software based on publicly available software (e.g., Flexible Collision Library or FCL). Given a set of meshes (e.g., triangular meshes), the software determines the distance between the meshes. This approach is general in nature and not specific to robots. When using this approach, the system covers obstacles in the operating environment within (or with) the meshes. The system may further cover the sweep volume of each movement of the robot with a mesh. Under this approach, it may be easier to divide the robot's movement into several intermediate poses, where the number of intermediate poses is selected, for example, to satisfy a threshold of differences between joint angles in successive poses. The system then wraps each pose with a respective mesh. In another approach, the system uses a data structure similar in at least some respects to the data structure used for collision detection described in various of the applicant's own patent applications. For example, the system may use a distance field (e.g., a Euclidean distance field) to represent obstacles present in the operating environment, and a sphere tree to represent the pose of the robot. It is relatively easy for the system to calculate the distance from the sphere tree to anything in the distance field.

[0081] The clearance determination and display module 126 also includes a path or edge association clearance module 266 that logically associates the determined clearances with respective paths or edges, for example in a data structure stored in memory or some other processor-readable medium. In some implementations, the clearance determination module 264 or the path or edge association clearance module 266 can be directly communicatively coupled to the cost setter 254, such that the cost setter 254 can automatically and autonomously (i.e., without user or operator input or other user, operator or human intervention) set or adjust cost metrics associated with edges based on the determined clearances.

[0082] The clearance determination and display module 126 causes the representation of the movement or action to be presented, for example, in the form of a three-dimensional representation showing the movement or action of the robot or part thereof as a path in the three-dimensional space of the operating environment, or in the form of a roadmap showing the action as edges representing transitions between configurations or poses of the robot in the robot's C-space. The clearance determination and display module 126 further causes the representation of the movement or action to be presented with a visual indication of the determined clearance, for example, as a numerical value, a color, a heat map, and / or a cue or visual effect. For example, the clearance determination and display module 126 can include a display file generation module 268 that generates a display file that includes the representation of the action and a visual indication of the determined clearance when displayed. The display file generation module 268 can generate a display file for the representation of the action separately from a display file for an indication of the determined clearance. Alternatively, the display file generation module 268 can generate a display file that combines both the representation of the action and an indication of the determined clearance.

[0083] Optionally, the clearance determination and display module 126 includes a receiving input module 270 that receives input from one or more input devices (e.g., a touch screen display 128a, a keyboard 128b, a computer mouse 128c). Based on the received input, the receiving input module 270 may provide instructions, commands, and / or data to the roadmap adjuster 259 and / or the cost setter 254.

[0084] The processor 222 and / or the motion planner 110 may be or include any logical processing unit, such as one or more central processing units (CPUs), digital signal processors (DSPs), graphics processing units (GPUs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), programmable logic controllers (PLCs), etc. Non-limiting examples of commercially available computer systems include, but are not limited to, the Celeron, Core, Core 2, Itanium, and Xeon families of microprocessors offered by Intel Corporation, USA; the K8, K10, Bulldozer, and Bobcat series microprocessors offered by Advanced Micro Devices, Inc., USA; the A5, A6, and A7 series microprocessors offered by Apple Computer, Inc., USA; the Snapdragon series microprocessors offered by Qualcomm Inc., USA; and the SPARC series microprocessors offered by Oracle Corporation, USA. Construction & Operation The various structures, techniques, and algorithms illustrated in FIG. 2 may embody or use the structures, techniques, and algorithms described in U.S. Patent No. 63 / 105,542, filed on October 26, 2020, entitled "Motion Planning for Autonomous Vehicles and Reconfigurable Motion Plan Processor," filed on June 9, 2017, "Specialized Robotic Motion Planning Hardware and Methods of Use Thereof," filed on January 5, 2016, "Apparatus, Methods, and Articles for Facilitating Motion Planning for Autonomous Vehicles in Environments Having Dynamic Objects," filed on January 12, 2018, and / or as appropriately modified as described herein.

[0085] Although not required, many of the implementations are described in the general context of computer-executable instructions, such as program application modules, objects, or macros, stored on a computer- or processor-readable medium and executed by one or more computers or processors that may perform obstacle representation, collision assessment, clearance determination, and other motion planning operations.

[0086] The motion planning operations may include, but are not limited to, generating or converting one, more, or all of the representations of the robot geometric model 112 ( FIG. 1 ), the tasks 114 ( FIG. 1 ), the roadmap 116, and the volumes (e.g., swept volumes) occupied by the robot in various states or poses and / or while moving between states or poses into a digital format, such as, for example, a point cloud, a Euclidean distance field, a data structure format (e.g., hierarchical format, non-hierarchical format), and / or a curve (e.g., polynomial or spline representation). The motion planning operations may optionally include, but are not limited to, generating or converting one or more representations of the static object data and / or representations of static or persistent obstacles represented by the environment model 120 ( FIG. 1 ) into a digital format, such as, for example, a point cloud, a Euclidean distance field, a data structure format (e.g., hierarchical format, non-hierarchical format), and / or a curve (e.g., polynomial or spline representation).

[0087] Motion planning operations may include, but are not limited to, determining or detecting or predicting collisions for various states or poses of the robot, or movements of the robot between states or poses, using various collision assessment techniques or algorithms (e.g., software-based, hardware-based). Motion planning operations may include, but are not limited to, determining or detecting clearances between the robot, or portions thereof, and one or more objects in an operating environment experienced by the robot, or portions thereof, when performing operations, presenting the determined clearances, and generating or modifying a roadmap based at least in part on the determined clearances.

[0088] In some implementations, the motion planning operations may include, but are not limited to, determining one or more motion plans, storing the determined motion plans, and / or providing the motion plans to control movement of the robot.

[0089] In one implementation, collision detection or evaluation is performed in response to a function call or similar process. Collision detector 252 may be implemented via one or more field programmable gate arrays (FPGAs) 258 and / or one or more application specific integrated circuits (ASICs) to perform collision detection while achieving low latency, relatively low power consumption, and increased amounts of information that can be processed.

[0090] In various implementations, such operations may be performed entirely in hardware circuitry or as software stored in memory storage, such as system memory 224a, by one or more hardware processors 222, such as one or more microprocessors, digital signal processors (DSPs), field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), graphics processing unit (GPU) processors, programmed logic controllers (PLCs), electrically programmable read only memories (EEPROMs), or as a combination of hardware circuitry and software stored in memory storage.

[0091] Various aspects of perception, roadmap building, collision detection, and pathfinding that may be used in whole or in part are also described in International Patent Application No. WO 2016 / 122840, filed January 5, 2016, and entitled "Motion Plans for Autonomous Vehicles and Reconfigurable Motion Plan Processor," U.S. Patent Application No. 62 / 616,783, filed January 12, 2018, and entitled "Apparatus, Methods, and Articles for Facilitating Motion Planning for Autonomous Vehicles in Dynamic Environments," U.S. Patent Application No. 62 / 856,548, filed June 3, 2019, and entitled "Apparatus, Methods, and Articles for Facilitating Motion Planning in Environments with Dynamic Obstacles," and / or U.S. Patent Application No. 63 / 10542, filed October 26, 2020, suitably modified to operate as described herein. Those skilled in the art will appreciate that the illustrated implementation, as well as other implementations, may be practiced with other system architectures and arrangements, including those of robots, handheld devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, personal computers ("PCs"), networked PCs, minicomputers, mainframe computers, and the like, and / or other computing system architectures and arrangements. An implementation or embodiment or portions thereof (e.g., configuration and execution) may be practiced in a distributed computing environment where tasks or modules are performed by remote processing devices linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices or media. However, where and how certain types of information are stored is important to help improve the motion plan.

[0092] For example, various motion planning solutions "bake in" the roadmap 116 (i.e., the motion planning graph) into a processor (e.g., FPGA 258), and each edge in the roadmap 116 corresponds to a non-reconfigurable Boolean circuit in the processor. Designs in which the roadmap 116 is "baked" into the processor pose the problem of having limited processor circuitry for storing multiple or large roadmaps, and are generally not reconfigurable for use with different robots.

[0093] One solution provides a reconfigurable design that places the roadmap 116 information in a memory storage device. This approach stores the information in memory instead of being burned into the circuit. Another approach uses templated reconfigurable circuits instead of memory.

[0094] As mentioned above, some of the information (e.g., the robot geometric model 112) may be captured, received, input, or provided during configuration time prior to runtime. The received information may be processed during configuration time, including performing collision detection for each edge of the roadmap, to generate processed information (e.g., the volume of space swept by the robot in performing operations represented as edges in the roadmap) for later use at runtime to speed up operations or reduce computational complexity during runtime.

[0095] During runtime, collision detection can be performed on the entire operating environment 104 (FIG. 1), including determining, for any pose or movement between poses, whether any part of the robot 102 will collide or is predicted to collide with another part of the robot 102 itself, other robots 102 or parts thereof, permanent or static obstacles in the operating environment 104, or transient obstacles in the operating environment 104 having an unknown trajectory (e.g., a human or humans).

[0096] FIG. 3 shows an example roadmap 300 for one of the robots 102a (FIG. 1) when the goal of the robot 102a is to perform a task while avoiding collisions with objects, which may include other robots (e.g., robot 102b) operating in the operating environment 104 (FIG. 1).

[0097] The roadmap 300 includes a number of nodes 308a-i (represented in the figure as open circles) connected by edges 310a-h (represented in the figure as straight lines between pairs of nodes). Each node implicitly or explicitly represents time and variables that characterize a state of the robot 102 in the configuration space of the robot 102. The configuration space, often referred to as C-space, is the space of states or configurations or poses of the robot 102a represented in the roadmap 300. For example, each node can represent a state, configuration, or pose of the robot 102a, which may include, but is not limited to, a position, an orientation, or a combination of a position and an orientation. The state, configuration, or pose may be represented, for example, by a set of joint positions and joint angles / rotations (e.g., joint poses, joint coordinates) of the joints of the robot 102a.

[0098] The edges in the roadmap 300 represent valid or allowed transitions between these states, configurations, or poses of the robot 102a. The edges of the roadmap 300 do not represent actual movements in Cartesian coordinates, but rather transitions between states, configurations, or poses in C-space. Each edge of the roadmap 300 represents a transition of the robot 102a between a respective pair of nodes. For example, edge 310a represents a transition of the robot 102a between two nodes. In particular, edge 310a represents a transition between a state of the robot 102a in a particular configuration associated with node 308b and a state of the robot 102a in a particular configuration associated with node 308c. Although the nodes are shown at various distances from each other, this is for illustrative purposes only and does not relate to any physical distance. However, there is no limit to the number of nodes or edges in the roadmap 300, and the more nodes and edges used in the roadmap 300, the more paths there are to select a minimum-cost path from, so the motion planner 110 (FIGS. 1 and 2) may be able to more accurately and precisely determine an optimal path according to one or more states, configurations, or poses of the robot 102a for performing a task.

[0099] Each edge is assigned or associated with a cost metric, and the assignment may be updated, for example, at run-time or during execution. The cost metric is illustrated in FIG. 3 as a single-digit value inserted into each edge. Although illustrated as a single-digit value, the cost metric may take a variety of forms, including single or multiple digit integers, real numbers, etc. The cost metric may represent a number of different parameters. For example, the cost metric may represent a collision assessment for the motion represented by the corresponding edge. Also, for example, the cost metric may represent a respective clearance determination. For example, the cost metric may represent an assessment of the likelihood or probability of a motion that causes a portion of the robot to come within one or more specified or nominal clearance distances of objects in the operating environment. The cost metric (e.g., weight) assigned to an edge may be increased for edges that correspond to transitions that result in a relatively small clearance and / or that result in a clearance below some specified or nominal clearance for one or more parts of the robot. As noted elsewhere, different parts of the robot may be associated with different respective specified or nominal clearances. For example, it may be desirable to maintain a welding head clearance greater than the robot's joint clearance.

[0100] Examples of collision assessment are described in International Patent Application No. PCT / US2017 / 036880, filed June 9, 2017, entitled "Motion Planning for Autonomous Vehicles and Reconfigurable Motion Plan Processor," U.S. Patent Application No. 62 / 722,067, filed August 23, 2018, entitled "Collision Detection Useful in Motion Planning for Robots," and International Patent Application No. WO 2016 / 122840, filed January 5, 2016, entitled "Specialized Robot Motion Planning Hardware and Methods of Making and Using Same."

[0101] For nodes in the roadmap 300 where a direct transition between nodes has a relatively high probability of causing a collision with an obstacle and / or a relatively high probability of experiencing a small clearance or clearance less than the specified or nominal clearance, the cost metric or weight assigned to the edges of the roadmap 300 transitioning between those nodes may be assigned a relatively high cost metric (e.g., 8, 9, or 10 out of 10). Conversely, for nodes in the roadmap 300 where a direct transition between nodes has a relatively low probability of causing a collision with an obstacle and / or a relatively low probability of experiencing a small clearance or clearance less than the specified or nominal clearance, the cost metric or weight assigned to the edges of the roadmap 300 transitioning between those nodes may be assigned a relatively low cost metric (e.g., 0, 1, or 2 out of 10). For nodes in roadmap 300 where a direct transition between the nodes has a medium probability of causing a collision with an obstacle and / or a medium probability of experiencing small clearance or clearance less than the specified or nominal clearance, the cost metric or weight assigned to the edges of roadmap 300 transitioning between those nodes may be assigned a relatively neutral cost metric that is neither high cost nor low cost (e.g., 4, 5, or 6 out of 10).

[0102] As explained above, the cost may reflect not only the probability of collision and / or the probability of experiencing a low clearance situation, but also other factors or parameters (e.g., latency, energy consumption). In this example, the current state, configuration, or pose of the robot 102 in the roadmap 300 is at node 308a, and the path is shown as path 312 in the roadmap 300 (the bold path including a segment extending from node 308a through node 308i) that is the result of the least-cost analysis.

[0103] Although depicted as a path in the roadmap 300 having many sharp turns, such turns do not represent corresponding physical turns in the route, but rather represent logical transitions between states, configurations, or poses of the robot 102. For example, each edge of the identified path 312 may represent a state change to the physical configuration of the robot 102, but does not necessarily represent a change in orientation of the robot 102 corresponding to the angles of the path 312 shown in FIG.

[0104] FIG. 4 shows a representation of movement in a three-dimensional environment 400 in which the robot 102 operates.

[0105] The robot 102 may include a base 403 and a robot appendage 405. The robot appendage 405 includes a number of links 405a, 405b, 405c (three shown), a number of joints 405d, 405e that rotationally couple each pair of the links 405a, 405b, 405c, and an end effector or end of an arm tool 405f located at a distal end of the robot appendage 405. The robot 102 includes one or more actuators, such as electric motors 205 (FIG. 2).

[0106] The representation of the three-dimensional environment 400 shows several paths (four shown) 406a, 406b, 406d, 406d (four shown) that represent the movements or trajectories of respective parts of the robot 102 (e.g., links 405a, 405b, 405c, end of arm tool 405f) as it performs transitions between configurations or poses.

[0107] 5 illustrates a method 500 of operation in the processor-based system 100 of FIGs. 1 and 2 for determining clearance for one or more portions of a robot and presenting a representation of the movement of one or more portions of the robot as a roadmap along with a visual indication of the determined clearance for the one or more portions of the robot, according to at least one illustrated implementation. Method 500 may be performed, for example, by one or more processors 222 (FIG. 2) of the processor-based system 100 (FIG. 1).

[0108] Method 500 begins at 502. For example, method 500 may begin in response to powering up the processor-based system 100, the robotic control system, and / or the robot 102, or in response to a call or invocation from a calling routine. Method 500 may execute intermittently or even continuously, for example, during operation of the robot 102.

[0109] At 504, a component of the processor-based system 100, such as the clearance determination and display module 126 or the clearance determination module 264 (FIG. 2), determines an amount of clearance between one or more portions of the robot and one or more objects in the operating environment. For example, for each movement of the robot and for each of one, two, or more portions of the robot, the clearance determination and display module 126 or the clearance determination module 264 (FIG. 2) computationally determines a respective amount of clearance between the portion of the robot and one or more objects in the operating environment that the robot or portion experiences as it moves along a path or trajectory of the robot or portion. The determined clearance may be represented, for example, as a distance in Cartesian coordinates or as a vector value.

[0110] At 506, a component of the processor-based system 100, such as the clearance determination and display module 126 or the display file generation module 268 (FIG. 2), causes a representation of one or more movements of the robot to be presented. For example, the clearance determination and display module 126 can cause a roadmap to be presented having a plurality of nodes and a plurality of edges, each edge connecting the nodes of a respective pair of nodes. For example, the display file generation module 268 (FIG. 2) can generate and provide one or more display files to the presentation system 128. The nodes represent respective configurations of the robot, and the edges represent respective transitions between respective pairs of configurations of the robot represented by the nodes of the pair of nodes connected by respective edges. The transitions correspond to movements of the robot or a portion thereof.

[0111] At 508, a component of the processor-based system 100, such as the clearance determination and display module 126 or the display file generation module 268 (FIG. 2), causes one or more visual indications of the determined clearance to be presented in a presentation of the robot's movement, such as in a presentation of a roadmap. For example, the clearance determination and display module 126 can cause a visual indication to be presented for at least one or more portions of the robot of a respective clearance amount between the portion of the robot and one or more objects in the environment. For example, the display file generation module 268 (FIG. 2) can generate and provide one or more display files to the presentation system 128. The indication of the determined clearance can take various forms, such as numerical values, colors, heat maps, and / or visual cues or visual effects. The indication of the determined clearance can be spatially associated with a representation of the respective motion, such as with a respective edge that represents a transition corresponding to the motion. In an implementation, the display file generation module 268 can generate separate image files for the roadmap and the visual indication of the determined clearance. The separate image files may be displayed, for example, on separate layers of a visual presentation. In other implementations, the display file generation module 268 may generate an integrated image file that includes both the roadmap and a visual indication of the determined clearance in a single image file.

[0112] Optionally, at 510, a component of the processor-based system 100, such as the clearance determination and display module 126 or the receiving input module 270 (FIG. 2), receives input. The input can take a variety of forms, such as instructions or commands to add nodes and / or edges to the roadmap, remove nodes and / or edges from the roadmap, move nodes and / or edges in the roadmap, and / or set, change, or adjust the value of one or more parameters (e.g., travel speed, path smoothing parameters, cost metrics for edges). The clearance determination and display module 126 may receive input from one or more user input / output devices (e.g., touch screen display 128a).

[0113] Optionally, at 512, a component of the processor-based system 100, such as the roadmap adjuster 259, adjusts the robot's roadmap based at least in part on the determined clearance. Such may occur autonomously, for example, in response to the occurrence of a particular defined condition. Such may occur, for example, in response to a received user or operator input, which itself may be based at least in part on the determined clearance. The roadmap adjuster 259 may adjust one or more components of a data structure in which the roadmap 116 (FIGS. 1 and 2) is represented in memory or other processor-readable storage device.

[0114] Optionally, at 514, components of the processor-based system 100 provide a motion plan 115 (FIGS. 1 and 2) for execution by the robot. For example, the motion planner 110 may provide the motion plan to the robot or a robot controller for execution by the robot.

[0115] Method 500 ends, e.g., at 516, until called again. In some implementations, method 500 may operate continuously, or even periodically, e.g., while the robot or a portion thereof is powered.

[0116] 6 illustrates a method 600 of operation in the processor-based system 100 of FIGs. 1 and 2 for determining clearances for at least two or more portions of a robotic appendage operating in an operating environment and presenting a representation of the movement of the two or more portions along with a visual indication of the determined clearances for the two or more portions of the robotic appendage as a path, or as a roadmap, in a representation of a three-dimensional space in which the robotic appendage operates. Method 600 may be performed, for example, by one or more processors 222 (FIG. 2) of the processor-based system 100 (FIG. 1).

[0117] Method 600 begins at 602. For example, method 600 may begin in response to powering up the processor-based system 100, the robotic control system and / or the robot 102, or in response to a call or invocation from a calling routine. Method 600 may execute, for example, intermittently, or even continuously, during operation of one or more robots 102.

[0118] At 604, a component of the processor-based system 100, such as the clearance determination and display module 126 or the clearance determination module 264 (FIG. 2), determines an amount of clearance between two or more portions of the robotic appendage and one or more objects in the operating environment. For example, for each movement of the robotic appendage, and for each of the at least two or more portions of the robotic appendage, the clearance determination and display module 126 or the clearance determination module 264 (FIG. 2) computationally determines a respective amount of clearance between the portion of the robotic appendage and one or more objects in the operating environment experienced by the robotic appendage or portions thereof as it traverses along a path or trajectory of the two or more portions of the robotic appendage. The determined clearance may be represented, for example, as a distance in Cartesian coordinates or as a vector value.

[0119] At 606, a component of the processor-based system 100, such as the clearance determination and display module 126 or the display file generation module 268 (FIG. 2), causes a representation of one or more movements of the robotic appendage or two or more portions thereof to be presented. For example, the clearance determination and display module 126 can cause one or more paths in a representation of a three-dimensional space along which the robotic appendage operates to be presented. Alternatively, the clearance determination and display module 126 can cause a roadmap to be presented having a number of nodes and a number of edges, each edge connecting the nodes of a respective pair of nodes. For example, the display file generation module 268 (FIG. 2) can generate and provide one or more display files to the presentation system 128. In the presentation of one or more paths in a representation of a three-dimensional space, the paths represent the movements or trajectories of the robotic appendage or portions thereof. In the presentation of the roadmap, the nodes represent respective configurations of the robot, and the edges represent respective transitions between respective pairs of configurations of the robot represented by the nodes of the pairs of nodes connected by respective edges. These transitions correspond to movements of the robot appendage or parts thereof.

[0120] At 608, a component of the processor-based system 100, such as the clearance determination and display module 126 or the display file generation module 268 (FIG. 2), causes one or more visual indications of the determined clearance to be presented in a representation of the movement of the robotic appendage or a portion thereof. For example, the clearance determination and display module 126 can cause the visual indication to be presented in a representation of a roadmap. Also, for example, the clearance determination and display module 126 can cause the visual indication to be presented in a representation of a representation of a three-dimensional space in which the robotic appendage operates. The clearance determination and display module 126 can, for example, cause at least two or more portions of the robotic appendage to present visual indications of respective clearance amounts between the portions of the robotic appendage and one or more objects in the environment. The indication of the determined clearance can take various forms, such as, for example, numerical values, colors, heat maps, and / or visual cues or effects. The indication of the determined clearance may be spatially associated with the respective representations of the movements, such as, for example, with respective edges that represent transitions corresponding to the movements of the portions of the robotic appendage. The clearance determination and display module 126 or the display file generation module 268 (FIG. 2) may generate image files and provide the image files for presentation. In implementations, the clearance determination and display module 126 or the display file generation module 268 (FIG. 2) may generate separate image files for the roadmap and the visual indication of the determined clearance. The separate image files may be displayed, for example, on separate layers of the visual presentation. In other implementations, the clearance determination and display module 126 or the display file generation module 268 (FIG. 2) may generate a combined image file that includes both the roadmap and the visual indication of the determined clearance.

[0121] Optionally, at 610, a component of the processor-based system 100, such as the clearance determination and display module 126 or the receiving input module 270 (FIG. 2), receives input. The input can take a variety of forms, such as instructions or commands to add nodes and / or edges to the roadmap, remove nodes and / or edges from the roadmap, move nodes and / or edges in the roadmap, and / or set, change, or adjust the value of one or more parameters (e.g., travel speed, path smoothing parameters, cost metrics of edges). The clearance determination and display module 126 or the receiving input module 270 (FIG. 2) may receive input from one or more user input / output devices (e.g., touch screen display 128a).

[0122] Optionally, at 612, a component of the processor-based system 100, such as the roadmap adjuster 259, adjusts the roadmap 116 of the robotic appendage based at least in part on the determined clearance. Such may occur autonomously, for example, in response to the occurrence of a particular defined condition. Such may occur, for example, in response to a received user or operator input, which may itself be based at least in part on the determined clearance. The roadmap adjuster 259 may adjust one or more components of a data structure in which the roadmap 116 is represented in memory or other processor-readable storage device.

[0123] Optionally, at 614, components of the processor-based system 100 provide a motion plan 115 (FIGS. 1 and 2) for execution by the robotic appendage. For example, the motion planner 110 may provide the motion plan to the robotic appendage or to a robot controller for execution by the robotic appendage.

[0124] Method 600 then ends at 616, e.g., until called again. In some implementations, method 600 may operate continuously, or even periodically, e.g., while the robotic appendage or a portion thereof is powered.

[0125] 7 illustrates a method 700 of operation in the processor-based system 100 of FIGS. 1 and 2 according to at least one example implementation to determine clearance of one or more portions of at least one of two or more robotic appendages operating in an operating environment and present a representation of at least one movement of the robotic appendage or portions thereof along with a visual representation of the determined clearance of one or more portions of at least one of the robotic appendages. For example, the operating environment can include a first robot, and the first robot is or includes a first robotic appendage. The operating environment can also include a second robot, and the second robot is or includes a second robotic appendage. Method 700 can be performed, for example, by one or more processors 222 (FIG. 2) of the processor-based system 100 (FIG. 1).

[0126] Method 700 begins at 702. For example, method 700 may begin in response to powering up the processor-based system 100, the robotic control system, and / or the robot 102, or in response to a call or invocation from a calling routine. Method 700 may execute, for example, intermittently, or even continuously, during operation of one or more robotic appendages 105.

[0127] At 704, a component of the processor-based system 100, such as the clearance determination and display module 126 or the clearance determination module 264 (FIG. 2), determines an amount of clearance between one or more portions of the first robotic appendage and one or more objects in the operating environment. For example, for each movement of the first robotic appendage, and for each of at least one or more portions of the first robotic appendage, the clearance determination and display module 126 clearance determination module 264 (FIG. 2) determines a respective amount of clearance between the portion of the first robotic appendage and one or more objects in the operating environment 104 (FIG. 1) that the first robotic appendage or portion thereof experiences as the first robotic appendage or portion thereof traverses along a path or trajectory of the first robotic appendage or portion thereof. In particular, the objects may include the second robotic appendage.

[0128] At 706, a component of the processor-based system 100, such as the clearance determination and display module 126 or the display file generation module 268 (FIG. 2), may cause a representation of one or more movements of the first robotic appendage or a portion thereof, and optionally, the second robotic appendage or a portion thereof, to be presented. For example, the clearance determination and display module 126 may cause one or more paths in a representation of a three-dimensional space in which the first robotic appendage and the second robotic appendage operate. The paths represent the movements or trajectories of the first robotic appendage or a portion thereof, and optionally, the second robotic appendage or a portion thereof. Alternatively, the clearance determination and display module 126 may cause a roadmap to be presented having a plurality of nodes and a plurality of edges, each edge connecting the nodes of a respective pair of nodes, which may be particularly suitable when representing the movements of only one of the first robotic appendage or the second robotic appendage. For example, the display file generation module 268 (FIG. 2) may generate and provide one or more display files to the presentation system 128.

[0129] Optionally, at 708, a component of the processor-based system 100, such as the clearance determination and display module 126 or the clearance determination module 264 (FIG. 2), determines an amount of clearance between a portion of the second robotic appendage and one or more objects in the operating environment. For example, for each movement of the second robotic appendage, and for each of at least one or more portions of the second robotic appendage, the clearance determination and display module 126 or the clearance determination module 264 (FIG. 2) determines a respective amount of clearance between the portion of the second robotic appendage and one or more objects in the operating environment that is experienced as the second robotic appendage or portion thereof traverses along a path or trajectory of the second robotic appendage or portion thereof. In particular, the objects may include the first robotic appendage.

[0130] At 710, a component of the processor-based system 100, such as the clearance determination and display module 126 or the display file generation module 268, causes one or more visual indications of the determined clearance to be presented in the representation of the movement of at least the first robotic appendage. For example, the clearance determination and display module 126 can cause the presentation of the visual display in the representation of the path in the representation of the three-dimensional space along which the first robotic appendage and the second robotic appendage operate. For example, the clearance determination and display module 126 can cause a visual indication to be presented, for at least one or more of the portions of the first robotic appendage, of a respective amount of clearance between one or more portions of the first robotic appendage and one or more objects in the environment. For example, the clearance determination and display module 126 can optionally cause a visual indication to be presented, for at least one or more of the portions of the second robotic appendage, of a respective amount of clearance between one or more portions of the second robotic appendage and one or more objects in the environment. The representation of the determined clearance may be spatially associated with the respective representation of the motion, e.g., with the respective edges representing the transitions corresponding to the motion of the portion of the robotic appendage. The clearance determination and display module 126 or the display file generation module 268 ( FIG. 2 ) may generate the image files and transfer the image files for presentation. In an implementation, the clearance determination and display module 126 or the display file generation module 268 may generate separate image files for the roadmap and the visual representation of the determined clearance. The separate image files may be displayed, for example, on separate layers of the visual presentation. In other implementations, the clearance determination and display module 126 or the display file generation module(s) 268 may generate a combined image file that includes both the roadmap and the visual indication of the determined clearance in a single display file.

[0131] Optionally, at 714, a component of the processor-based system 100, such as the clearance determination and display module 126 or the receiving input module 270 (FIG. 2), receives input. The input can take a variety of forms, such as instructions or commands to add nodes and / or edges to the roadmap, remove nodes and / or edges from the roadmap, move nodes and / or edges in the roadmap, and / or set, change, or adjust the value of one or more parameters (e.g., travel speed, path smoothing parameters, cost metrics for edges). The clearance determination and display module 126 or the receiving input module 270 (FIG. 2) may receive input from one or more user input / output devices (e.g., touch screen display 128a).

[0132] Optionally, at 716, a component of the processor-based system 100, such as the roadmap adjuster 259, adjusts the roadmap 116 of one of the first robotic appendage or the second robotic appendage based at least in part on the determined clearance. Such may occur autonomously, for example, in response to the occurrence of a particular defined condition. Such may occur, for example, in response to a received user or operator input, which itself may be based at least in part on the determined clearance. The roadmap adjuster 259 may adjust one or more components of a data structure in which the roadmap 116 is represented in memory or other processor-readable storage device.

[0133] Optionally, at 718, components of the processor-based system 100 provide the motion plan 115 (FIGS. 1 and 2) for execution by the robotic appendage. For example, the motion planner 110 may provide the motion plan 115 to a first robotic appendage or a robot controller for execution by a first robotic appendage.

[0134] Method 700 then ends, e.g., at 720, until called again. In some implementations, method 700 may operate continuously or even periodically, e.g., while at least the first robotic appendage or a portion thereof is powered.

[0135] 8 illustrates a method 800 of operation in the processor-based system 100 of FIGs. 1 and 2 for determining clearance of one or more portions of a robot operating in an operating environment and setting or adjusting a cost metric associated with each edge of a roadmap for the robot according to at least one illustrated implementation. Method 800 may be performed, for example, by one or more processors 222 (FIG. 2) of the processor-based system 100 (FIG. 1).

[0136] Method 800 begins at 802. For example, method 800 may begin in response to powering up the processor-based system 100, the robotic control system and / or the robot 102, or in response to a call or invocation from a calling routine. Method 800 may execute, for example, intermittently or even continuously during operation of one or more robots 102.

[0137] At 804, a component of the processor-based system 100, such as the clearance determination and display module 126 or the clearance determination module 264 (FIG. 2), determines an amount of clearance between one or more portions of the robot and one or more objects in the operating environment. For example, for each movement of the robot, and for each of at least one or more portions of the robot, the clearance determination and display module 126 or the clearance determination module 264 (FIG. 2) determines a respective amount of clearance between the one or more portions of the robot and one or more objects in the operating environment that the robot or portion of the robot experiences as it traverses along a path or trajectory of the robot or portion of the robot. In particular, the objects may include a second robot operating in the operating environment.

[0138] Optionally, at 806, a component of the processor-based system 100, such as the clearance determination and display module 126 or the receiving input module 270 (FIG. 2), receives input. The input can take a variety of forms, such as instructions or commands to add nodes and / or edges to the roadmap, remove nodes and / or edges from the roadmap, move nodes and / or edges in the roadmap, copy or duplicate nodes or edges in the roadmap, and / or set, change, or adjust the value of one or more parameters (e.g., travel speed, path smoothing parameters, cost metrics of edges). The clearance determination and display module 126 or the receiving input module 270 (FIG. 2) can receive input from one or more user input / output devices (e.g., touch screen display 128a).

[0139] At 808, a component of the processor-based system 100, such as the cost setter 254, sets a cost metric logically associated with each edge in the roadmap 116 based at least in part on the determined amount of each clearance for the motion corresponding to the edge. The cost metric may be logically associated with the edge in a data structure logically representing the roadmap 116 stored in a memory or some other processor-readable medium, for example. The cost setter 254 may set a cost metric for each of one or more edges of the roadmap. For example, the cost setter 254 may set a cost metric for edges associated with a relatively small or tight clearance to a relatively high value, and the cost setter 254 may set a cost metric for edges associated with a relatively large or loose clearance to a relatively low value. This may favor the selection of edges or transitions with relatively large clearances over those with relatively small clearances during motion planning (e.g., during minimum or lowest cost analysis). Additionally or alternatively, the cost setter 254 may, for example, set a cost metric for edges associated with movement of one part of the robot to a relatively high value, while the cost setter 254 sets a cost metric for edges associated with movement of other parts of the robot to a relatively low value. This may favor the selection of edges or transitions that have relatively large clearances for a given part of the robot (e.g., a welding head) when the clearances for other parts of the robot (e.g., an elbow) are less stringent. In particular, the cost metric may be set based on a cost function. The cost function may represent one, two, or more cost parameters, such as any one or combination of: i) collision risk or probability, ii) collision severity, iii) desired amount of clearance, iv) waiting time, v) energy consumption, and / or vi) estimated amount of clearance.

[0140] At 810, a component of the processor-based system 100, such as the path analyzer 256, performs motion planning using the roadmap 116, at least in part, with a cost metric that represents or reflects the determined clearance. The path analyzer 256 may use, for example, any of a wide variety of least-cost algorithms.

[0141] At 812, components of the processor-based system 100 provide a motion plan 115 (FIGS. 1 and 2) for execution by the robot. For example, the motion planner 110 may provide the motion plan to the robot or a robot controller for execution by the robot.

[0142] Method 800 then ends, e.g., until called again, at 814. In some implementations, method 800 may operate continuously, or even periodically, e.g., while the robot or a portion thereof is powered.

[0143] 9 illustrates a method 900 of operation in the processor-based system 100 of FIGs. 1 and 2 for setting or adjusting a cost metric associated with each edge according to at least one illustrated implementation. Method 900 may be performed, for example, by one or more processors 222 (FIG. 2) of the processor-based system 100 (FIG. 1), for example, as part of the execution of method 800 (e.g., operation 808 of FIG. 8).

[0144] At 902, a component of the processor-based system 100, such as the cost setter 254, sets a cost metric logically associated with each edge based at least in part on a minimum clearance experienced by the robot or portion thereof when following the transition represented by the respective edge. The cost metric may be logically associated with the edge, for example, in a data structure logically representing the roadmap stored in memory or some other processor-readable medium.

[0145] Figure 10 illustrates a method 1000 of operation in the processor-based system 100 of Figures 1 and 2 for setting or adjusting a cost metric associated with each edge according to at least one illustrated implementation. Method 1000 may be performed, for example, by one or more processors 222 (Figure 2) of processor-based system 100 (Figure 1), for example, as part of the execution of method 800 (e.g., operation 808 of Figure 8).

[0146] At 1002, a component of the processor-based system 100, such as the cost setter 254, sets a cost metric logically associated with each edge based at least in part on a single numeric value that represents the smallest minimum distance among all of the determined minimum distances for all of the robot appendage links, joints, arm tool ends, and optionally cables for the movement represented by the respective edge. The cost metric may, for example, be logically associated with the edge in a data structure that logically represents the roadmap stored in memory or some other processor-readable medium.

[0147] FIG. 11 illustrates a method 1100 of operation in the processor-based system 100 of FIGS. 1 and 2 according to at least one illustrated implementation, determining clearance for one or more portions of the robot, presenting a representation of movement of one or more portions of the robot along with a visual indication of the determined clearance, receiving input, and adjusting at least a portion of a roadmap to adjust movement of the robot based at least in part on the received input.

[0148] Method 1100 begins at 1102. For example, method 1100 may begin in response to powering up the processor-based system 100, the robotic control system, and / or the robot 102, or in response to a call or invocation from a calling routine. Method 1100 may execute intermittently or even continuously, for example, during operation of the robot 102.

[0149] At 1104, a component of the processor-based system 100, such as the clearance determination and display module 126 or the clearance determination module 264 (FIG. 2), determines an amount of clearance between one or more portions of the robot and one or more objects in the operating environment. For example, for each movement of the robot and for each of one, two, or more portions of the robot, the clearance determination and display module 126 or the clearance determination module 264 (FIG. 2) determines a respective amount of clearance between the portion of the robot and one or more objects in the operating environment 104 (FIG. 1) that the robot or portion experiences as it moves along a path or trajectory of the robot or portion. In particular, the objects may include a second robot operating in the operating environment.

[0150] Optionally, at 1106, a component of the processor-based system 100, such as the clearance determination and display module 126 or the display file generation module 268 (FIG. 2), causes a representation of one or more movements of the robot to be presented along with one or more visual indications of the determined clearance in the representation of the movement of one or more parts of the robot. For example, the clearance determination and display module 126 can cause a representation of a path in a representation of a three-dimensional space in which the robot operates. Also, for example, the clearance determination and display module 126 can cause a roadmap for the robot to be presented, with edges representing transitions corresponding to movements or movements. The indication of the determined clearance can take various forms, such as numerical values, colors, heat maps, and / or visual cues or visual effects. The indication of the determined clearance may be spatially associated with the respective representation of the movements, such as spatially associated with the respective paths representing the movements, or spatially associated with the respective edges representing transitions corresponding to the movements. The clearance determination and display module 126 or the display file generation module 268 (FIG. 2) may generate image files and transfer the image files for presentation. In implementations, the clearance determination and display module 126 or the display file generation module 268 (FIG. 2) may generate separate image files for the roadmap and the visual indication of the determined clearance. The separate image files may be displayed, for example, on separate layers of the visual presentation. In other implementations, the clearance determination and display module 126 or the display file generation module 268 (FIG. 2) may generate a combined image file that includes both the roadmap and the visual indication of the determined clearance.

[0151] At 1108, a component of the processor-based system 100, such as the clearance determination and display module 126 or the receiving input module 270 (FIG. 2), receives input. The input can take a variety of forms, such as instructions or commands to add nodes and / or edges to the roadmap, remove nodes and / or edges from the roadmap, move nodes and / or edges within the roadmap, copy or duplicate nodes and / or edges from the roadmap, and / or set, change, or adjust the value of one or more parameters (e.g., travel speed, path smoothing parameters). The clearance determination and display module 126 or the receiving input module 270 may receive input from one or more user input / output devices (e.g., touch screen display 128a).

[0152] At 1110, a component of the processor-based system 100 adjusts at least a portion of the roadmap based at least in part on the received input. For example, a component of the processor-based system 100 may adjust the speed of one or more movements. In some implementations, the roadmap adjuster 259 adjusts the robot's roadmap based at least in part on the determined clearance. Such may occur autonomously, for example, in response to the occurrence of a particular defined condition. Such may occur, for example, in response to a received user or operator input that may itself be based at least in part on the determined clearance. The roadmap adjuster 259 may adjust one or more components of a data structure in which the roadmap is represented in memory or other processor-readable storage.

[0153] The method 1100 then ends, e.g., at 1112, until called again. In some implementations, the method 1000 may operate continuously, or even periodically, e.g., while the robot or a portion thereof is powered.

[0154] Figure 12 illustrates a method 1200 of operation in the processor-based system 100 of Figures 1 and 2 to provide a user interface that enables coordination of movement or motion of one or more robots according to at least one illustrated implementation. Method 1100 may be performed, for example, by one or more processors 222 (Figure 2) of processor-based system 100 (Figure 1) as part of the execution of, for example, any of methods 500 (Figure 5), 600 (Figure 6), 700 (Figure 7), 800 (Figure 8), and 1100 (Figure 11).

[0155] At 1202, components of the processor-based system 100 cause a user interface to be presented that enables adjustment of one or more robot movements or operations, including, for example, adjustment of a roadmap. The user interface may include one or more of a toolbar, a pull-down menu, a pop-up menu, a palette, a scroll bar, a radio button, a fillable field, a dialog box, a prompt, a user-selectable icon, and / or other user interface elements. The user interface may, for example, enable a user to set values ​​for one or more parameters, such as to control one or more of a speed of movement associated with one or more edges, a value of a path smoothing parameter, and / or a cost metric assigned to one or more edges in the roadmap. The user interface may, for example, enable a user to adjust one or more nodes and / or edges in the roadmap, add one or more nodes and / or edges to the roadmap, remove one or more nodes and / or edges from the roadmap, copy or duplicate one or more nodes and / or edges from the roadmap, and / or move one or more nodes or edges in the roadmap. The user interface may allow for the designation of a node or edge for modification, adjustment, or deletion, for example, through the use of a unique identifier that uniquely identifies the node or edge, or through selection of the node or edge via a user input / output device. The user interface may allow for the setting or specification of values ​​for one or more parameters for a node or edge, or roadmap, for example, through pull-down menus, pop-up menus, dialog boxes, or fillable fields associated with the node, edge, or roadmap.

[0156] Figure 13 illustrates a method 1300 of operation in the processor-based system 100 of Figures 1 and 2 to provide a graphical user interface that enables coordination of movement or motion of one or more robots according to at least one illustrated implementation. Method 1300 may be performed, for example, by one or more processors 222 (Figure 2) of processor-based system 100 (Figure 1) as part of the execution of, for example, any of methods 500 (Figure 5), 600 (Figure 6), 700 (Figure 7), 800 (Figure 8), and 1100 (Figure 11).

[0157] At 1302, a component of the processor-based system 100 causes a graphical user interface to be presented in which nodes and / or edges in a displayed roadmap are user selectable icons. The graphical user interface may include one or more of a toolbar, a pull-down menu, a pop-up menu, a palette, a scroll bar, a radio button, a fillable field, a dialog box, a prompt, a user selectable icon, and / or other user interface elements. In particular, the graphical user interface may include several user selectable elements that are components of the roadmap, such as user selectable nodes and / or user selectable edges. Selection of a node or edge may, for example, select a node or edge for modification, adjustment, copying or duplicating, or deletion. Selection of a node or edge may, for example, allow a drag-and-drop operation to be performed on the selected node or edge. Selection of a node or edge may, for example, cause a pop-up menu or dialog box to be presented, for example, allowing for setting values ​​for one or more parameters associated with the node, edge, or roadmap. In some implementations, selection of an edge or path or a portion thereof may cause an indication of the determined clearance to be presented as a pop-up value or color or visual effect.

[0158] Figure 14 illustrates a method 1400 of operation in the processor-based system 100 of Figures 1 and 2 to provide a visual display of determined clearance as a numerical value associated with each edge or path according to at least one illustrated implementation. Method 1400 may be performed, for example, by one or more processors 222 (Figure 2) of processor-based system 100 (Figure 1) as part of the execution of any of methods 500 (Figure 5), 600 (Figure 6), 700 (Figure 7) and 1100 (Figure 11).

[0159] At 1402, a component of the processor-based system 100, such as the clearance determination and display module 126 (FIG. 1) or the display file generation module 268 (FIG. 2), provides a visual representation of the minimum clearance experienced by the robot when moving between two configurations in the form of one or more numerical values ​​(e.g., integer, real number). The numerical values ​​may represent the amount of clearance and may be specified, for example, in a defined set of units (e.g., inches, millimeters, centimeters). The numerical values ​​may be spatially associated with the respective edge or path representing the transition between the two configurations where the minimum clearance was experienced (e.g., proximate to, with or without a lead line). For example, the numerical values ​​may be presented proximate to, adjacent to, or even on the respective edge or path, for example, at the start or end of the edge or path and / or at one or more intermediate points along the edge or path between the start and / or end of the edge or path. Thus, each edge or path may have a single numerical value representing the minimum clearance experienced during the movement corresponding to the edge or path, or each edge or path may have two or more numerical values ​​representing the minimum clearance experienced by different parts of the robot during different parts of the motion or movement corresponding to the edge or path.

[0160] 1 and 2 according to at least one illustrated implementation to provide a visual indication of determined clearance as a color associated with a respective edge or path. Method 1500 may be performed, for example, by one or more processors 222 (FIG. 2) of processor-based system 100 (FIG. 1) as part of the execution of any of methods 500 (FIG. 5), 600 (FIG. 6), 700 (FIG. 7), and 1100 (FIG. 11).

[0161] At 1502, a component of the processor-based system 100, such as the clearance determination and display module 126 (FIG. 1) or the display file generation module 268 (FIG. 2), provides a visual indication of the minimum clearance experienced by the robot when moving between two configurations as one or more colors. The color may represent the amount of clearance (e.g., less than 1.0 millimeter is red, more than 1.0 centimeter is green). The color may be spatially associated with each edge or path representing the transition between the two configurations where the minimum clearance was experienced. For example, each edge or path may be represented with a color corresponding to the determined clearance. Also, for example, each edge or path may be overlaid with a transparent color overlay, where a particular color corresponds to the determined clearance. Thus, each edge or path may have a single color representing the minimum clearance experienced during the movement corresponding to the edge or path. Alternatively, each edge or path may have two or more colors to represent the minimum clearance experienced by different parts of the robot during the movement corresponding to the edge or path, or the minimum clearance experienced at different parts of the corresponding motion or movement.

[0162] 1 and 2 according to at least one illustrated implementation to provide a visual display of determined clearances as a heat map associated with respective edges or paths. Method 1600 may be performed, for example, by one or more processors 222 (FIG. 2) of processor-based system 100 (FIG. 1) as part of the execution of any of methods 500 (FIG. 5), 600 (FIG. 6), 700 (FIG. 7), 800 (FIG. 8), and 1100 (FIG. 11).

[0163] At 1602, a component of the processor-based system 100, such as the clearance determination and display module 126 (FIG. 1) or the display file generation module 268 (FIG. 1), provides a visual representation of the minimum clearance experienced by the robotic appendage when moving between two configurations as a heat map. The heat map can include different colors, including shades of color, with the color or shade of color representing each determined clearance (e.g., dark red for less than 0.25 millimeters, light red for more than 0.25 millimeters and less than 0.5 millimeters, dark green for more than 0.5 millimeters and less than 1.0 millimeters, light green for more than 1.0 millimeters and less than 5.0 millimeters). The heat map can be spatially associated with each edge or path representing the transition between the two configurations where the minimum clearance was experienced. For example, each edge or path may be represented in the heat map corresponding to the determined clearance. Also, for example, each edge or path may be overlaid with a transparent heat map overlay, with a particular color or shade of the heat map corresponding to the determined clearance. Thus, each edge or path may have a respective heat map that represents the minimum clearance experienced during the movement corresponding to the edge or path.

[0164] Providing a heat map for each operation helps to draw the human user's or operator's attention to portions of the operation (e.g., represented by edges on a roadmap) that present potential problems. Thus, when previewing an edge, the user or operator knows which portions of the edge to look at and more quickly identifies potential problems. For example, if one centimeter of clearance is acceptable, but five millimeters of clearance is not, coloring those portions of the edge that do not have sufficient clearance (i.e., the specified or nominal clearance) differently than other portions of the edge makes the potential problem more readily apparent, since a difference of five millimeters is exceptionally difficult to visually detect, especially on a computer display screen. If the specified or nominal clearance is violated in the middle of the edge, it immediately tells the user or operator that this may be avoidable at an intermediate node or intermediate point. If only the end points of the edge violate the specified or nominal clearance, it may be considered acceptable and unavoidable.

[0165] FIG. 17 illustrates a displayed user interface 1700 showing a presentation of a representation of the movement of a robot or a portion thereof along with an indication of a determined clearance, according to at least one illustrated implementation.

[0166] The user interface 1700 may include a set of user selectable icons, e.g., a toolbar 1702 including several pull-down menus, e.g., a node pull-down menu 1702a, an edge pull-down menu 1702b, and a parameter setting pull-down menu 1702c. The node pull-down menu 1702a allows nodes of the roadmap to be added, deleted, moved, copied, or otherwise modified. The edge pull-down menu 1702b allows edges of the roadmap to be added, removed, moved, addressed, or otherwise modified. The parameter setting pull-down menu 1702c allows parameters of the roadmap to be added, deleted, moved, or otherwise modified.

[0167] In particular, the representation of the movement is in the form of a roadmap 1704 having several nodes 1706a, 1706b (only two are called out) and edges 1708a, 1708b (only two are called out), and the representation of the determined clearance is in the form of a single numerical value 1710 (only one is shown) representing the minimum clearance experienced by one or more parts of the robot when executing the movement corresponding to the transition represented by the edges 1708a, 1708b in the roadmap 1704.

[0168] FIG. 18 illustrates a displayed user interface 1800 showing a presentation of a representation of the movement of a robot or a portion thereof along with an indication of a determined clearance, according to at least one illustrated implementation.

[0169] User interface 1800 may include a set of user-selectable icons, e.g., a toolbar 1702 similar to or identical to those in FIG. 17, including several pull-down menus, e.g., node pull-down menu 1702a, edge pull-down menu 1702b, and parameter setting pull-down menu 1702c.

[0170] In particular, the representation of the movement is in the form of a roadmap 1804 having several nodes 1806a, 1806b (only two are called out (or labeled)) and edges 1808a, 1808b (only two are called out), and the indication of the determined clearance is in the form of a number of numerical values ​​1810a, 1810b, 1810n (seven shown, only three are called out) representing respective clearances experienced by parts of the robot when executing movements corresponding to the set of transitions represented by the edges in the roadmap 1804.

[0171] FIG. 19 illustrates a displayed user interface 1900 showing a presentation of a representation of the movement of a robot or a portion thereof along with an indication of a determined clearance, according to at least one illustrated implementation.

[0172] The user interface 1900 may include a set of user-selectable icons, e.g., a toolbar 1702, similar or identical to that of FIG. 17, including several pull-down menus, e.g., a node pull-down menu 1702a, an edge pull-down menu 1702b, and a parameter setting pull-down menu 1702c.

[0173] In particular, the representation of the movement is in the form of a roadmap 1904 having several nodes 1906a, 1906b (only two are callouts) and edges 1908a, 1908b (only two are callouts), and the representation of the determined clearance is in the form of single colors 1910a, 1910b, 1910c (color represented by cross-hatching, three are callouts) representing the minimum clearance experienced by one or more parts of the robot when executing the movement corresponding to the transition represented by the respective edges 1908a, 1908b in the roadmap 1904.

[0174] FIG. 20 illustrates a displayed user interface 2000 showing a presentation of a representation of a movement of a robot or a portion thereof along with an indication of a determined clearance, according to at least one illustrated implementation.

[0175] The user interface 2000 may include a set of user-selectable icons, e.g., a toolbar 1702, similar or identical to that of FIG. 17, including several pull-down menus, e.g., a node pull-down menu 1702a, an edge pull-down menu 1702b, and a parameter setting pull-down menu 1702c.

[0176] In particular, the representation of the movement is in the form of a roadmap 2004 having several nodes 2006a, 2006b (only two are callouts) and edges 2008a, 2008b (only two are callouts), and the indication of the determined clearance is in the form of multiple colors 2010a, 2010b, 2010c, 2010d, 2010e, 2010f (colors with color shades represented by cross-hatching, six are callouts) that make up one or more heat maps 2012 (three shown, one callout) representing respective clearances experienced by one or more parts of the robot when executing movements corresponding to the set of transitions represented by edges 2008a, 2008b in the roadmap 2004.

[0177] FIG. 21 illustrates a displayed user interface 2100 showing a presentation of a representation of a movement of a robot or a portion thereof along with an indication of a determined clearance, according to at least one illustrated implementation.

[0178] The user interface 2100 may include a set of user-selectable icons, such as a toolbar 2102 that includes several pull-down menus, such as a parameter setting pull-down menu 2102a.

[0179] In particular, the representation of the movement is in the form of one or more paths 2108 (one shown) in a representation of the three-dimensional operating environment 2104, and the indication of the determined clearance is in the form of a single numerical value 2110 representing the minimum clearance the robot will encounter when executing the movement represented by the path 2108 in the representation of the three-dimensional operating environment 2104. The single numerical value 2110 is presented in spatial association with the path 2108, for example, proximate or adjacent thereto, with or without a lead. The representation of the three-dimensional operating environment 2104 may include representations of one or more objects 2112a, 2112b (two shown) present in the operating environment.

[0180] FIG. 22 illustrates a displayed user interface 2200 showing a presentation of a representation of a movement of a robot or a portion thereof along with an indication of a determined clearance, according to at least one illustrated implementation.

[0181] The user interface 2200 may include a set of user selectable icons, eg, a toolbar 2102 that includes a number of pull-down menus, eg, parameter setting pull-down menus, eg, similar to or identical to those in FIG.

[0182] In particular, the representation of the movement is in the form of one or more paths 2208 (one shown) in the representation of the three-dimensional operating environment 2204, and the indication of the determined clearance is in the form of a plurality of numerical values ​​2210a, 2210b, 2210c, 2210d, 2210e (five shown) representing respective clearances experienced by the robot when executing the movement represented by the path 2208 in the representation of the three-dimensional operating environment 2204. The numerical values ​​2210a, 2210b, 2210c, 2210d, 2210e are presented in spatial association with respective portions of the path 2108, e.g., presented proximate or adjacent thereto, with or without leads. The representation of the three-dimensional operating environment 2204 may include representations of one or more objects 2112a, 2112b (two shown) present in the operating environment.

[0183] Also shown in FIG. 22 is a cursor 2214, which may be controlled by a user or operator via one or more input / output devices (e.g., touch screen display 128a) to select a user selectable icon (e.g., path 2208 or a portion thereof, parameter setting pull-down menu 2102a). Selecting the path 2208 may, for example, allow for the presentation of a pop-up menu or dialog box presenting information about the path and / or modification of values ​​of various parameters associated with the path 2208. Selecting a portion of the path 2208 may, for example, cause a clearance value corresponding to a portion of the motion corresponding to the selected portion of the path 2208 to be presented. Selection of the path 2208 may be performed by placing the cursor 2214 over the portion of the path 2208 and clicking once. Selection of a portion of the path 2208 may be performed by placing the cursor 2214 over the portion of the path 2208 and double clicking, allowing distinction from selection of the entire path 2208.

[0184] FIG. 23 is an image of a displayed user interface 2300 showing the presentation of a representation of the movement of a robot or a portion thereof along with an indication of a determined clearance, according to at least one illustrated implementation.

[0185] The user interface 2300 may include a set of user selectable icons, eg, a toolbar 2102 that includes a number of pull-down menus, eg, parameter setting pull-down menus, eg, similar to or identical to those in FIG.

[0186] In particular, the representation of the movement is in the form of one or more paths 2308a, 2308b (two shown) in the representation of the three dimensional operating environment 2304, and the indication of the determined clearance is in the form of a single color (e.g., a first color 2310a, a second color 2310b, a color indicated by cross-hatching) representing the minimum clearance the robot will encounter when executing the movement represented by each one of the paths 2308a, 2308b in the representation of the three dimensional operating environment. The representation of the three dimensional operating environment 2304 may include a representation of one or more objects 2112a, 2112b (two shown) present in the operating environment.

[0187] FIG. 24 illustrates a displayed user interface 2400 showing a presentation of a representation of a movement of a robot or a portion thereof along with an indication of a determined clearance, according to at least one illustrated implementation.

[0188] The user interface 2400 may include a set of user selectable icons, eg, a toolbar 2102 that includes a number of pull-down menus, eg, parameter setting pull-down menus, eg, similar to or identical to those in FIG.

[0189] In particular, the representation of the movement is in the form of one or more paths 2408 (one shown) in the representation of the three-dimensional operating environment 2404, and the indication of the determined clearance is in the form of a number of colors 2410a, 2410b, 2410c, 2410d (colors including shades of color represented by cross-hatching, four shown) that make up a heat map 2412 representing the respective clearances incurred by the robot when executing the movements represented by the paths 2408 in the representation of the three-dimensional operating environment 2404. The representation of the three-dimensional operating environment 2404 may include representations of one or more objects 2112a, 2112b (two shown) present in the operating environment.

[0190] FIG. 25 illustrates a displayed user interface 2500 showing a presentation of a representation of the movement of two or more parts of a robot along with an indication of the determined clearance, according to at least one illustrated implementation.

[0191] The user interface 2500 may include a set of user selectable icons, eg, a toolbar 2102 that includes a number of pull-down menus, eg, parameter setting pull-down menus, eg, similar to or identical to those in FIG.

[0192] In particular, the representation of the movements is in the form of two or more paths 2508a, 2508b, 2508c (three shown) of respective portions 2516a, 2516b, 2516c (three callouts) of the robot appendage 2516 in the representation of the three-dimensional operating environment 2504, and the indication of the determined clearance is in the form of single numerical values ​​2510a, 2510b, 2510b, 2510c (three shown, one for each path 2508a, 2508b, 2508c) representing the minimum clearance experienced by each of the two or more portions of the robot when performing the movements represented by the paths 2508a, 2508b, 2508c in the representation of the three-dimensional operating environment 2504. The values ​​2510a, 2510b, 2510c may be spatially associated with, and may be proximate or adjacent to, each of the paths 2508a, 2508b, 2508c, for example, with or without a lead. The representation of the three-dimensional operating environment 2504 may include a representation of one or more objects 2112a, 2112b (two shown) present in the operating environment.

[0193] FIG. 26 illustrates a displayed user interface 2600 showing a presentation of a representation of the movement of two or more parts of a robot along with an indication of the determined clearance, according to at least one illustrated implementation.

[0194] The user interface 2600 may include a set of user selectable icons, eg, a toolbar 2102 that includes a number of pull-down menus, eg, parameter setting pull-down menus, eg, similar to or identical to those in FIG.

[0195] In particular, the representation of the movements is in the form of two or more paths 2608a, 2608b, 2608c (three shown) of respective portions 2616a, 2616b, 2616c (three called out) of the robot appendage 2616 in a representation of the three-dimensional operating environment 2604. The representation of the determined clearance is in the form of a plurality of numerical values ​​2610a, 2610b, 2610c, 2610d (four for each path, one set of four for one of the paths 2608c for ease of illustration) for each of the paths 2608a, 2608b, 2608c, where the numerical values ​​2610a, 2610b, 2610c, 2610d represent respective clearances incurred by each of the two or more portions of the robot when performing the movements represented by the paths 2608a, 2608b, 2608c in the representation of the three-dimensional operating environment 2604. The values ​​2610a, 2610b, 2610c, 2610d may be spatially associated with each one of the paths 2608c, e.g., proximate or adjacent thereto, with or without a lead. The representation of the three-dimensional operating environment 2604 may include a representation of one or more objects 2112a, 2112b (two are shown) present in the operating environment.

[0196] FIG. 27 illustrates a displayed user interface 2700 showing a presentation of a representation of the movement of two or more parts of a robot along with an indication of the determined clearance, according to at least one illustrated implementation.

[0197] The user interface 2700 may include a set of user selectable icons, eg, a toolbar 2102 that includes a number of pull-down menus, eg, parameter setting pull-down menus, eg, similar to or identical to those in FIG.

[0198] In particular, the representation of the movements is in the form of two or more paths 2708a, 2708b (two shown) of respective portions 2716a, 2716c (two callouts) of the robot appendage 2716 in the representation of the three-dimensional operating environment 2704, and the indication of the determined clearance is in the form of a single color 2710a, 2710b for each path 2708a, 2708b, the single color representing the minimum clearance experienced by each of the two or more portions 2716a, 2716c of the robot 2716 when performing the movements represented by the paths 2708a, 2708b in the representation of the three-dimensional operating environment 2704. The representation of the three-dimensional operating environment 2704 may include representations of one or more objects 2112a, 2112b (two shown) present in the operating environment.

[0199] FIG. 28 illustrates a displayed user interface 2800 showing a presentation of a representation of the movement of two or more parts of a robot along with an indication of the determined clearance, according to at least one illustrated implementation.

[0200] The user interface 2800 may include a set of user selectable icons, eg, a toolbar 2102 including a number of pull-down menus, eg, parameter setting pull-down menus, eg, similar or identical to those in FIG.

[0201] In particular, the representation of the movement is in the form of two or more paths 2808a, 2808b (two shown) of respective portions 2816a, 2816c (two callouts) of the robot appendage 2816 in the representation of the three-dimensional operating environment 2804, and the indication of the determined clearance is in the form of a plurality of colors 2810a, 2810b, 2810c, 2810d (colors including color shading represented by cross-hatching, four callouts for one path 2808a) constituting one or more heat maps 2812 (two shown, one callout) representing the respective clearances received by each of the two or more portions 2816a, 2816c of the robot 2816 when performing the movements represented by the paths 2808a, 2808b in the representation of the three-dimensional operating environment 2804. The representation of the three-dimensional operating environment 2804 may include representations of one or more objects 2112a, 2112b (two shown) present in the operating environment.

[0202] In the above detailed description, various apparatus and / or method embodiments are described using block diagrams, schematic diagrams, and examples. Although these block diagrams, schematic diagrams, and examples include one or more functions and / or operations, it will be apparent to one of ordinary skill in the art that each function and / or operation in these block diagrams, flow diagrams, and examples, individually and / or collectively, may be implemented by various hardware, software, firmware, or virtually any combination thereof. In an embodiment, the subject matter may be implemented via Boolean circuits, application specific integrated circuits (ASICs), and / or FPGAs. However, it will be appreciated that the embodiments disclosed herein may be implemented, in whole or in part, in a variety of different implementations in standard integrated circuits, as one or more computer programs running on one or more computers (e.g., as one or more programs running on one or more computer systems), as one or more programs running on one or more processors (e.g., microprocessors), as firmware, or virtually any combination thereof, and that designing circuitry and / or code for the software and / or firmware is well within the skill of one of ordinary skill in the art in light of the present disclosure.

[0203] Those skilled in the art will recognize that many of the methods or algorithms described herein may employ additional acts, omit certain acts, and / or perform acts in an order other than as specified.

[0204] The various embodiments described above can be combined to provide further embodiments. All of the assigned U.S. patent applications, U.S. patent applications, and foreign patent applications described and / or cited herein, including International Patent Application No. PCT / US2017 / 036880, filed June 9, 2017, entitled "Motion Planning for Autonomous Vehicles and Reconfigurable Motion Plan Processor," International Patent Application No. WO 2016 / 12840, filed January 5, 2016, entitled "Specialized Robot Motion Planning Hardware and Methods of Making and Using Same," U.S. Patent Application No. 62 / 616,783, filed January 12, 2018, entitled "Apparatus, Methods, and Articles for Facilitating Motion Planning for Autonomous Vehicles in Environments with Dynamic Objects," U.S. Patent Application No. No. 62 / 856,548, filed February 6, 2018 (filed June 3, 2019), U.S. Patent Application No. 62 / 865,431, filed June 24, 2019, entitled “MOTION PLANNING FOR SHARING MULTIPLE ROBOTS”, International Patent Application No. PCT / US2020 / 039193, filed June 23, 2020, entitled “MOTION PLANNING FOR SHARING MULTIPLE ROBOTS”, U.S. Patent Application No. 63 / 105,542, filed October 26, 2020, entitled “SAFETY SYSTEMS AND METHODS FOR USE IN ROBOT OPERATION”, and / or U.S. Patent Application No. 63 / 120,412, filed December 2, 2020, entitled “SYSTEMS, METHODS, AND USER INTERFACES PLOYING CLEARANCE DETERMINATIONS IN ROBOT PLANNING AND ... "CONTROL", which is suitably modified as described herein and is hereby incorporated by reference in its entirety. These and other variations can be made to those embodiments in light of the above detailed description.

[0205] In general, in the following claims, the terms used should not be construed to limit the claims to the specific embodiments disclosed in the specification and the claims, but rather to include all possible embodiments, along with the full scope of equivalents to which such claims are entitled. Accordingly, the claims are not limited by this disclosure. The following is an invention described at the beginning of the present application. <Claim 1> 1. A method of motion planning comprising the steps of: determining, for at least one movement of the robot, for each of at least one or more portions of the robot, a respective amount of clearance between the portion of the robot and one or more objects in an operating environment; presenting a roadmap for the movement of the robot in the form of a graph having a number of nodes and a number of edges, each edge connecting a respective pair of nodes, the nodes representing respective configurations of the robot in a configuration space (C-space) of the robot, and the edges representing respective transitions between respective pairs of the configurations of the robot represented by the respective pairs of nodes connected by the respective edges; and causing a visual indication of the determined amount of clearance to be presented in the presentation of the roadmap for at least one or more of the portions of the robot. <Claim 2> 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein causing a visual indication of the determined amount of clearance to be presented in the presentation of the roadmap includes causing a visual indication of the determined amount of clearance for all of the links, the joints, and the end of an arm tool of the robot appendage to be presented in the presentation of the roadmap. <Claim 3> 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, at least one cable, and an end of an arm tool, and wherein causing a visual indication of the determined amount of clearance to be presented in the presentation of the roadmap includes causing a visual indication of the determined amount of clearance relative to an entirety of the robot appendage to be presented in the presentation of the roadmap. <Claim 4> A method according to any one of claims 1 to 3, wherein the step of presenting a visual indication of the determined amount of clearance in the presentation of the roadmap includes the step of providing a visual indication of a minimum clearance experienced by any part of the robot when moving between two configurations represented as respective pairs of nodes connected by respective edges. <Claim 5> The method of any one of claims 1 to 3, wherein the step of presenting a visual indication of the determined amount of clearance in the presentation of the roadmap includes providing a visual indication of a minimum clearance experienced by at least one portion of the robot when moving between two configurations as at least one numerical value spatially associated with a respective one of the edges representing the transition between the two configurations. <Claim 6> 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein causing the step of presenting a visual indication of the determined amount of clearance in the presentation of the roadmap includes providing a visual indication of a minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a single numerical value spatially associated with each one of the edges representing the transition between the two configurations, the single numerical value representing a minimum distance that is smallest among all of the determined minimum distances for all of the links, joints, and end of the arm tool of the robot appendage for the movement represented by each one of the edges. <Claim 7> 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein causing the step of presenting a visual indication of the determined amount of clearance in the presentation of the roadmap includes providing a visual indication of the minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a plurality of numerical values ​​spatially associated with the edges, the plurality of numerical values ​​representing the determined minimum distances for all of the links, joints, and end of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage assumes when transitioning between the configurations represented by the pairs of nodes connected by the edges. <Claim 8> The method of any one of claims 1-3 or 6-7, wherein the step of presenting a visual indication of the determined amount of clearance in the presentation of the roadmap includes providing a visual indication of a minimum clearance experienced by at least a portion of the robot when moving between two configurations as one or more colors spatially associated with a respective one of the edges representing the transition between the two configurations, each color representing an amount of clearance. <Claim 9> 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein causing the step of presenting a visual indication of the determined amount of clearance in the presentation of the roadmap includes providing a visual indication of a minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a single color spatially associated with a respective one of the edges representing the transition between the two configurations, the single color representing a minimum distance that is smallest among all of the determined minimum distances for all of the links, joints, and end of the arm tool of the robot appendage for the movement represented by the respective edge. <Claim 10> 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein causing the step of presenting a visual indication of the determined amount of clearance in the presentation of the roadmap includes providing a visual indication of a minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a plurality of colors spatially associated with respective ones of the edges representing the transition between the two configurations, the plurality of colors representing the determined minimum distance for all of the links, the joints, and the end of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage assumes when transitioning between the configurations represented by the pairs of nodes connected by the respective ones of the edges. <Claim 11> 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein causing the step of presenting a visual indication of the determined amount of clearance in the presentation of the roadmap includes providing a visual indication of the minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a heat map spatially associated with each one of the edges representing the transition between the two configurations, the heat map representing the determined minimum distance for all of the links, the joints, and the end of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage takes when transitioning between the configurations represented by the pairs of nodes connected by the respective ones of the edges. <Claim 12> A method according to any one of claims 1 to 3, 6 to 7, or 9 to 11, wherein determining a respective amount of clearance between the portion of the robot and one or more objects in the operating environment includes determining a respective amount of clearance between the portion of the robot and a portion of another robot operating within the operating environment. <Claim 13> 1. A system for use in motion planning, comprising: At least one processor; and at least one non-transitory processor-readable medium storing processor-executable instructions that, when executed by the at least one processor, cause the at least one processor to perform a method according to any one of claims 1 to 12. <Claim 14> 1. A system for use in motion planning, comprising: At least one processor; When executed by the at least one processor, the at least one processor determining, for at least one movement of the robot, for each of at least one or more portions of the robot, a respective amount of clearance between the portion of the robot and one or more objects in an operating environment; presenting a roadmap for the movement of the robot in the form of a graph having a number of nodes and a number of edges, each edge connecting a respective pair of nodes, the nodes representing respective configurations of the robot in a configuration space (C-space) of the robot, and the edges representing respective transitions between respective pairs of the configurations of the robot represented by the respective pairs of nodes connected by the respective edges; causing a visual indication of the determined amount of clearance in the representation of the roadmap for at least one or more of the portions of the robot; and at least one non-transitory processor-readable medium storing processor-executable instructions to cause the system to perform the above steps. <Claim 15> 15. The system of claim 14, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and the processor executable instructions cause the at least one processor to present a visual indication of the determined amount of clearance in the presentation of the roadmap for all of the links, joints, and end of the arm tool of the robot appendage. <Claim 16> 15. The system of claim 14, wherein the robot includes a robot appendage having at least two links, at least one joint, at least one cable, and an end of an arm tool, and the processor executable instructions cause the at least one processor to present a visual indication of the determined amount of clearance in the presentation of the roadmap for an entire robot appendage, to present a visual indication of the determined amount of clearance in the presentation of the roadmap. <Claim 17> 17. The system of any one of claims 14 to 16, wherein the processor executable instructions cause the at least one processor to present a visual representation of the determined amount of clearance in the presentation of the roadmap, the visual representation of a minimum clearance experienced by any part of the robot when moving between two configurations represented as respective pairs of nodes connected by respective edges. <Claim 18> 17. The system of claim 14, wherein the processor executable instructions cause the at least one processor to present a visual representation of the determined amount of clearance in the presentation of the roadmap, the at least one processor presenting a visual representation of a minimum clearance experienced by at least one portion of the robot when moving between two configurations as at least one numerical value spatially associated with a respective one of the edges representing the transition between the two configurations. <Claim 19> 15. The system of claim 14, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein, for causing the robot to present a visual representation of the determined amount of clearance in the presentation of the roadmap, the processor-executable instructions cause the at least one processor to present a visual representation of a minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a single numerical value spatially associated with a respective one of the edges representing the transition between the two configurations, the single numerical value representing a minimum distance smallest of all of the determined minimum distances for all of the links, joints, and end of the arm tool of the robot appendage for the movement represented by the respective one of the edges. <Claim 20> 15. The system of claim 14, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and for causing the robot to present a visual representation of the determined amount of clearance in the presentation of the roadmap, the processor-executable instructions cause the at least one processor to present a visual representation of the minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a plurality of numerical values ​​spatially associated with the edges, the plurality of numerical values ​​representing the determined minimum distances for all of the links, joints, and end of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage assumes when transitioning between the configurations represented by the pairs of nodes connected by the edges. <Claim 21> 21. The system of any one of claims 14-16 or 19-20, wherein the processor-executable instructions cause the at least one processor to present a visual representation of the determined amount of clearance in the presentation of the roadmap as one or more colors spatially associated with a respective one of the edges representing the transition between the two configurations, each color representing an amount of clearance. <Claim 22> 15. The system of claim 14, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein, for causing the robot to present a visual indication of the determined amount of clearance in the presentation of the roadmap, the processor-executable instructions cause the at least one processor to present a visual indication of a minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a single color spatially associated with a respective one of the edges representing the transition between the two configurations, the single color representing a minimum distance that is smallest among all of the determined minimum distances for all of the links, joints, and end of the arm tool of the robot appendage for the movement represented by the respective edge. <Claim 23> 15. The system of claim 14, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and for causing the robot to present a visual indication of the determined amount of clearance in the presentation of the roadmap, the processor-executable instructions cause the at least one processor to present a visual indication of the minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a plurality of colors spatially associated with respective ones of the edges representing the transition between the two configurations, the plurality of colors representing the determined minimum distance for all of the links, the joints, and the end of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage assumes when transitioning between the configurations represented by the nodes of the pairs of nodes connected by the respective ones of the edges. <Claim 24> 15. The system of claim 14, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and for causing the robot to present a visual representation of the determined amount of clearance in the presentation of the roadmap, the processor-executable instructions cause the at least one processor to present a visual representation of the minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a heat map spatially associated with a respective one of the edges representing the transition between the two configurations, the heat map representing the determined minimum distances for all of the links, joints, and end of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage takes when transitioning between the configurations represented by the pairs of nodes connected by the respective ones of the edges. <Claim 25> A system as described in any one of claims 14-16, 19-20, or 22-24, wherein to determine respective amounts of clearance between the portion of the robot and one or more objects in an operating environment, the at least one processor determines respective amounts of clearance between the portion of the robot and a portion of another robot operating within the operating environment. <Claim 26> 1. A method of motion planning for a robot operating in an operating environment, the robot having a robotic appendage comprising at least two links, at least one joint, and an end of arm tool, the operating environment including one or more objects, the method comprising: determining, for at least one movement of the robot, for each of the at least two links, at least one joint, and the end of the arm tool of the robot appendage, a respective amount of clearance between the two or more portions thereof and the one or more objects in the operating environment; presenting the at least one movement of the robot in at least one of a three-dimensional space (3D space) representation or a roadmap representation, the 3D space representation taking the form of one or more paths representing the movement of the robot in the operating environment, the roadmap representation taking the form of a graph having a number of nodes and a number of edges, each edge connecting a respective pair of nodes, the nodes representing respective configurations of the robot in a configuration space (C-space) of the robot, and the edges representing respective transitions between respective pairs of the configurations of the robot represented by the respective pairs of nodes connected by the respective edges; causing a visual indication of the determined amount of clearance for two or more portions of the robot appendage in the 3D spatial representation or roadmap representation to be presented, wherein the visual indication of the determined amount of clearance is spatially related to one or more paths of the robot appendage in the 3D spatial representation or spatially related to one or more of the edges representing respective ones of the transitions of the robot appendage. <Claim 27> 27. The method of claim 26, wherein causing a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation comprises causing a visual indication of the determined amount of clearance in the presentation of the 3D spatial representation or the roadmap representation for all of the links, joints, and arm tools of the robot appendage. <Claim 28> 27. The method of claim 26, wherein the robot further includes at least one cable, and causing a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation includes causing a visual indication of the determined amount of clearance in the presentation of the 3D spatial representation or the roadmap representation for the entire robot appendage. <Claim 29> A method according to any one of claims 26 to 28, wherein causing the presentation of the 3D spatial representation or the roadmap representation to present a visual indication of the determined amount of clearance for the two or more portions of the robot appendage comprises providing a visual indication of a minimum clearance experienced by any portion of the robot when moving along a respective path in the 3D spatial representation or when moving between two configurations represented as a pair of respective nodes connected by a respective edge in the roadmap representation. <Claim 30> 29. The method of any one of claims 26 to 28, wherein the step of causing a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation comprises the step of providing a visual indication of the minimum clearance experienced by at least two portions of the robot when moving along their respective paths or when moving between two configurations as at least one numerical value spatially associated with a respective one of the paths representing the movement in the 3D spatial representation or spatially associated with a respective one of the edges representing a transition between the two configurations in the roadmap representation. <Claim 31> 29. The method of claim 26, wherein causing a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation comprises providing a visual indication of the minimum clearance experienced by any portion of the robot appendage when moving along a respective path or when moving between two configurations as a single numerical value spatially associated with a respective one of the paths representing the movement in the 3D spatial representation or spatially associated with a respective one of the edges representing the transition between the two configurations in the roadmap representation, the single numerical value representing the smallest minimum distance among all of the determined minimum distances for all of the links, joints and ends of the arm tool of the robot appendage for the movement represented by the respective path or respective one of the edges. <Claim 32> 29. The method of claim 26, wherein causing the presentation of the 3D spatial representation or the roadmap representation to present a visual indication of the determined amount of clearance for the two or more portions of the robot appendage comprises providing a visual indication of the minimum clearance experienced by any portion of the robot appendage when moving along a respective path or when moving between two configurations as a plurality of numerical values ​​spatially associated with a respective one of the paths representing the movement in the 3D spatial representation or a respective one of the edges representing the transition between the two configurations in the roadmap representation, the plurality of numerical values ​​representing the determined minimum distances for all of the links, joints and ends of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage assumes when moving along a respective one of the paths or when transitioning between the configurations represented by the nodes of the pairs of nodes connected by the respective edges. <Claim 33> 29. The method of any one of claims 26 to 28, wherein the step of presenting a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation comprises providing a visual indication of a minimum clearance experienced by at least one portion of the robot when moving along a respective path in the 3D spatial representation or when moving between two configurations in the roadmap representation as one or more colors spatially associated with a respective one of the paths representing the movement in the 3D spatial representation or a respective one of the edges representing the transition between the two configurations in the roadmap representation, each color representing an amount of clearance. <Claim 34> 29. The method of any one of claims 26 to 28, wherein causing the visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation comprises providing a visual indication of a minimum clearance experienced by any portion of the robot appendage when moving along a respective one of the paths or when moving between two configurations as a single color spatially associated with a respective one of the paths representing the movement in the 3D spatial representation or as a single color spatially associated with a respective one of the edges representing the transition between the two configurations in the roadmap representation, the single color representing a minimum distance that is smallest among all of the determined minimum distances for all of the links, joints and ends of the arm tool of the robot appendage for the movement represented by the respective path or the respective edge. <Claim 35> 29. The method of claim 26, wherein causing the presentation of the 3D spatial representation or the roadmap representation to present a visual indication of the determined amount of clearance for the two or more portions of the robot appendage comprises providing a visual indication of the minimum clearance experienced by any portion of the robot appendage when moving along a respective path or between two configurations as a plurality of colors spatially associated with a respective one of the paths representing the movement in the 3D spatial representation or a respective one of the edges representing the transition between the two configurations in the roadmap representation, the plurality of colors representing the determined minimum distances for all of the links, joints and ends of the arm tool of the robot appendage in each of three or more poses of the robot appendage assumed when the robot appendage moves along a respective one of the paths or transitions between the configurations represented by the nodes of the pair of nodes connected by a respective one of the edges. <Claim 36> 29. The method of claim 26, wherein causing the visual indication of the determined amount of clearance for the two or more portions of the robot appendage to be presented in the presentation of the 3D spatial representation or the roadmap representation comprises providing a visual indication of the minimum clearance experienced by any portion of the robot appendage when moving along a respective path or between two configurations as a heat map spatially associated with a respective one of the paths representing the movement in the 3D spatial representation, or spatially associated with a respective one of the paths representing the movement, or spatially associated with a respective one of the edges representing the transition between the two configurations in the roadmap representation, the heat map representing the determined minimum distances for all of the links, joints and ends of the arm tool of the robot appendage in each of three or more poses of the robot appendage taken when moving along a respective one of the paths or when transitioning between the configurations represented by the nodes of the pairs of nodes connected by a respective one of the edges. <Claim 37> 29. The method of any one of claims 26 to 28, wherein determining respective amounts of clearance between two or more parts of the robot and one or more objects within an operating environment includes determining respective amounts of clearance between two or more parts of the robot and at least one part of another robot operating within the operating environment. <Claim 38> 1. A system for use in motion planning, comprising: At least one processor; and at least one non-transitory processor-readable medium storing processor-executable instructions that, when executed by the at least one processor, cause the at least one processor to perform a method according to any one of claims 26 to 37. <Claim 39> 1. A system for use in motion planning of a robot having a robot appendage comprising at least two links, at least one joint, and an end of arm tool, comprising: At least one processor; When executed by the at least one processor, the at least one processor determining, for at least one movement of the robot, for each of the at least two links, the at least one joint, and the end of the arm tool of the robot appendage, an amount of respective clearance between the two or more portions thereof and the one or more objects in the operating environment; presenting the at least one movement of the robot in at least one of a three-dimensional space (3D space) representation or a roadmap representation, the 3D space representation taking the form of one or more paths representing the movement of the robot in the operating environment, the roadmap representation taking the form of a graph having a number of nodes and a number of edges, each edge connecting a respective pair of nodes, the nodes representing respective configurations of the robot in a configuration space (C-space) of the robot, and the edges representing respective transitions between respective pairs of the configurations of the robot represented by the respective pairs of nodes connected by the respective edges; and at least one non-transitory processor-readable medium storing processor-executable instructions to cause a visual indication of the determined amount of clearance relative to the two or more portions of the robot appendage in the 3D spatial representation or roadmap representation, the visual indication of the determined amount of clearance being spatially associated with one or more paths of the robot appendage in the 3D spatial representation or spatially associated with one or more of the edges representing respective ones of the transitions of the robot appendage. <Claim 40> 40. The system of claim 39, wherein the processor executable instructions cause the at least one processor to present a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation for all of the links, joints, and ends of the arm tool of the robot appendage. <Claim 41> 40. The system of claim 39, wherein the robot further includes at least one cable, and the processor executable instructions cause the at least one processor to present a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation for an entire robot appendage in the presentation of the 3D spatial representation or the roadmap representation. <Claim 42> 42. The system of any one of claims 39 to 41, wherein the processor executable instructions cause the at least one processor to present, in the presentation of the 3D spatial representation or the roadmap representation, a visual indication of the determined amount of clearance for the two or more portions of the robot appendage, to present a visual indication of a minimum clearance experienced by any portion of the robot when moving along a respective path in the 3D spatial representation or moving between two configurations represented as a pair of respective nodes connected by a respective edge in the roadmap representation. <Claim 43> 42. The system of any one of claims 39 to 41, wherein the processor-executable instructions cause the at least one processor to present a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation, the processor-executable instructions cause the at least one processor to present a visual indication of the minimum clearance experienced by two or more portions of the robot as they move along respective paths or between two configurations as at least one numerical value spatially associated with a respective one of the paths representing the movement in the 3D spatial representation or a respective one of the edges representing the transition between the two configurations in the roadmap representation. <Claim 44> 42. The system of claim 39, wherein the processor-executable instructions cause the at least one processor to present a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation, the at least one processor to present a visual indication of the minimum clearance experienced by any portion of the robot appendage as it moves along a respective path or moves between two configurations as a single numerical value spatially associated with a respective one of the paths representing the movement in the 3D spatial representation or spatially associated with a respective one of the edges representing the transition between the two configurations in the roadmap representation, the single numerical value representing the smallest minimum distance among all of the determined minimum distances to all of the links, joints, and ends of the arm tool of the robot appendage for the movement represented by the respective path or respective one of the edges. <Claim 45> 42. The system of claim 39, wherein the processor-executable instructions cause the at least one processor to present a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation, the at least one processor presenting a visual indication of the minimum clearance experienced by any portion of the robot appendage as it moves along a respective path or moves between two configurations as a plurality of numerical values ​​spatially associated with a respective one of the paths representing the movement in the 3D spatial representation or a respective one of the edges representing the transition between the two configurations in the roadmap representation, the plurality of numerical values ​​representing the determined minimum distances for all of the links, joints, and end of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage assumes as it moves along a respective one of the paths or during a transition between the configurations represented by the nodes of the pairs of nodes connected by the respective edges. <Claim 46> 42. The system of any one of claims 39 to 41, wherein the processor-executable instructions cause the at least one processor to present a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation, the processor-executable instructions cause the at least one processor to present a visual indication of the minimum clearance experienced by at least one portion of the robot when moving along a respective path in the 3D spatial representation or moving between two configurations in the roadmap representation as one or more colors spatially associated with a respective one of the paths representing the movement in the 3D spatial representation or a respective one of the edges representing the transition between the two configurations in the roadmap representation, each color representing an amount of clearance. <Claim 47> 42. The system of claim 39, wherein the processor-executable instructions to cause the at least one processor to present a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation, cause the at least one processor to present a visual indication of a minimum clearance experienced by any portion of the robot appendage when moving along a respective one of the paths or moving between two configurations as a single color spatially associated with a respective one of the paths representing the movement in the 3D spatial representation or a respective one of the edges representing a transition between the two configurations in the roadmap representation, the single color representing a smallest minimum distance of all of the determined minimum distances for all of the links, joints, and ends of the arm tool of the robot appendage for the movement represented by the path or edge. <Claim 48> 42. The system of claim 39, wherein the processor-executable instructions cause the at least one processor to present a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation, the at least one processor presenting a visual indication of a minimum clearance experienced by any portion of the robot appendage when moving along a respective path or moving between two configurations as a plurality of colors spatially associated with a respective one of the paths representing the movement in the 3D spatial representation or a respective one of the edges representing the transition between the two configurations in the roadmap representation, the plurality of colors representing the determined minimum distances for all of the links, joints, and ends of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage assumes when moving along the respective one of the paths or transitioning between the configurations represented by the nodes of the pair of nodes connected by the respective one of the edges. <Claim 49> The processor executable instructions cause the at least one processor to present a visual indication of the determined amount of clearance for the two or more portions of the robot appendage when moving along a respective one of the paths or between two configurations in the 3D spatial representation, the visual indication being spatially associated with a respective one of the paths representing the movement in the 3D spatial representation, or a visual indication being spatially associated with a respective one of the paths representing the movement in the roadmap representation, to present a visual indication of the determined amount of clearance for the two or more portions of the robot appendage in the presentation of the 3D spatial representation or the roadmap representation. 42. The system of claim 39, wherein the representation is presented as a heat map spatially associated with a respective one of the edges representing the transition between the two configurations, the heat map representing the determined minimum distances for all of the links, joints and ends of the arm tool of the robot appendage in each of three or more poses of the robot appendage as the robot appendage moves along the respective one of the paths or transitions between the configurations represented by the nodes of the pair of nodes connected by the respective one of the edges. <Claim 50> 42. The system of any one of claims 39 to 41, wherein to determine respective amounts of clearance between two or more parts of the robot and one or more objects in an operating environment, the at least one processor determines respective amounts of clearance between two or more parts of the robot and at least one part of another robot operating within the operating environment. <Claim 51> 1. A method of motion planning for a first robot and a second robot operating in an operating environment, the first robot having a first robot appendage comprising at least two links, at least one joint, and an end of an arm tool, the second robot having a second robot appendage comprising at least two links, at least one joint, and an end of an arm tool; determining, for at least one movement of at least one of the first robotic appendage or the second robotic appendage, a respective amount of clearance between at least a portion of the first robotic appendage and at least one or more objects in the operating environment including the second robot; presenting a movement of the at least one of the first or second robotic appendages in a three-dimensional (3D) spatial representation; causing a visual representation of the determined amount of clearance for the first robot appendage of the first robot in the 3D spatial representation to be presented, wherein the visual representation of the determined amount of clearance for the first robot appendage is spatially associated with a respective path of the first robot appendage of the first robot in the 3D spatial representation and is visually distinguishable from any visual representation of the respective paths. <Claim 52> determining, for at least one movement of at least one of the first robotic appendage or the second robotic appendage, a respective amount of clearance between at least a portion of the second robotic appendage and at least one or more objects in the operating environment including the first robot; 52. The method of claim 51, further comprising the step of: causing a visual indication of the determined amount of clearance for the second robot appendage of the second robot in the 3D spatial representation to be presented, the visual indication of the determined amount of clearance for the second robot appendage being spatially related to a respective path of the second robot appendage of the first robot in the 3D spatial representation. <Claim 53> 53. The method of claim 52, wherein the step of causing a visual representation of the determined amount of clearance for the second robot appendage of the second robot in the 3D spatial representation occurs while the presentation of the visual representation of the determined amount of clearance for the first robot appendage of the first robot persists. <Claim 54> 54. The method of any one of claims 51 to 53, wherein causing a visual indication of the determined amount of clearance of the first robot appendage of the first robot to be presented in the presentation of the 3D spatial representation includes causing a visual indication of the determined amount of clearance of the first robot appendage of the first robot to be presented in the presentation of the 3D spatial representation for all of the links, joints and ends of the arm tool of the first robot appendage. <Claim 55> 52. The method of claim 51 , wherein the first robot appendage further includes at least one cable, and causing a visual indication of the determined amount of clearance of the first robot appendage of the first robot to be presented in the presentation of the 3D spatial representation includes causing a visual indication of the determined amount of clearance of the first robot appendage of the first robot to be presented in the presentation of the 3D spatial representation relative to the entirety of the first robot appendage. <Claim 56> 54. A method according to any one of claims 51 to 53, wherein causing a visual indication of the determined amount of clearance of the first robot appendage of the first robot in the presentation of the 3D spatial representation comprises providing a visual indication of a minimum clearance experienced by any part of the first robot appendage when moving along a path represented in the 3D spatial representation. <Claim 57> 54. The method of any one of claims 51 to 53, wherein causing a visual indication of the determined amount of clearance of the first robot appendage of the first robot in the presentation of the 3D spatial representation includes providing a visual indication of a minimum clearance experienced by at least a portion of the first robot appendage when moving along a path represented in the 3D spatial representation as at least one numerical value spatially related to the path in the 3D spatial representation. <Claim 58> 54. The method of any one of claims 51 to 53, wherein causing, in the presentation of the 3D spatial representation, to present a visual indication of the determined amount of clearance of the first robot appendage of the first robot comprises providing a visual indication of the minimum clearance experienced by any portion of the first robot appendage when moving along a path represented in the 3D spatial representation as a single numerical value spatially associated with the 3D spatial representation, the single numerical value representing the smallest minimum distance among all of the determined minimum distances to all of the links, joints and ends of the arm tool of the first robot appendage for the movement represented by the respective path. <Claim 59> 54. The method of any one of claims 51 to 53, wherein causing a visual indication of the determined amount of clearance of the first robot appendage of the first robot in the presentation of the 3D spatial representation comprises providing a visual indication of the minimum clearance experienced by any portion of the first robot appendage when moving along a path represented in the 3D spatial representation as a plurality of numerical values ​​spatially associated with the path in the 3D spatial representation, the plurality of numerical values ​​representing the determined minimum distances for all of the links, joints and end of the arm tool of the first robot appendage at each of three or more poses of the first robot appendage taken by the first robot appendage when moving along the path represented in the 3D spatial representation. <Claim 60> 54. The method of any one of claims 51 to 53, wherein presenting a visual indication of the determined amount of clearance of the first robot appendage of the first robot in the presentation of the 3D spatial representation includes providing a visual indication of the minimum clearance experienced by at least a portion of the first robot appendage when moving along a path represented in the 3D spatial representation as one or more colors spatially associated with the path represented in the 3D spatial representation, each color representing an amount of clearance. <Claim 61> 54. The method of any one of claims 51 to 53, wherein causing a visual indication of the determined amount of clearance of the first robot appendage of the first robot in the presentation of the 3D spatial representation comprises providing a visual indication of the minimum clearance experienced by any portion of the first robot appendage when moving along a path in the 3D spatial representation as a single color spatially associated with the path in the 3D spatial representation, the single color representing the smallest minimum distance among all of the determined minimum distances for all of the links, joints and ends of the arm tool of the first robot appendage for the movement represented by the path in the 3D spatial representation. <Claim 62> 54. The method of any one of claims 51 to 53, wherein the step of presenting a visual indication of the determined amount of clearance of the first robot appendage of the first robot in the presentation of the 3D spatial representation includes providing a visual indication of the minimum clearance experienced by any portion of the first robot appendage when moving along a path in the 3D spatial representation as a plurality of colors spatially associated with the path in the 3D spatial representation, the plurality of colors representing the determined minimum distances for all of the links, joints and end of the arm tool of the first robot appendage in each of three or more poses of the first robot appendage taken by the first robot appendage when moving along the path in the 3D spatial representation. <Claim 63> 54. The method of any one of claims 51 to 53, wherein causing a visual indication of the determined amount of clearance of the first robot appendage of the first robot in the presentation of the 3D spatial representation comprises providing a visual indication of the minimum clearance experienced by any portion of the first robot appendage when moving along a path represented in the 3D spatial representation as a heat map spatially associated with the path within the 3D spatial representation, the heat map representing the determined minimum distances for all of the links, joints and end of the arm tool of the first robot appendage in each of three or more poses of the first robot appendage taken by the first robot appendage when moving along the path represented in the 3D spatial representation. <Claim 64> 1. A system for use in motion planning for a first robot and a second robot operating in an operating environment, the first robot having a first robot appendage comprising at least two links, at least one joint, and an end of an arm tool, the second robot having a second robot appendage comprising at least two links, at least one joint, and an end of an arm tool, the system comprising: At least one processor; and at least one non-transitory processor-readable medium storing processor-executable instructions that, when executed by the at least one processor, cause the at least one processor to perform a method according to any one of claims 52 to 63. <Claim 65> 1. A system for use in motion planning for a first robot and a second robot operating in an operating environment, the first robot having a first robot appendage comprising at least two links, at least one joint, and an end of an arm tool, the second robot having a second robot appendage comprising at least two links, at least one joint, and an end of an arm tool, the system comprising: At least one processor; When executed by at least one processor, the method causes the at least one processor to: determining, for at least one movement of at least one of the first robotic appendage or the second robotic appendage, an amount of respective clearance between at least a portion of the first robotic appendage and at least one or more objects in the operating environment including the second robot; presenting a movement of the at least one of the first robotic appendage or the second robotic appendage in a three-dimensional (3D) spatial representation; and at least one non-transitory processor-readable medium storing processor-executable instructions to cause a visual representation of the determined amount of clearance for the first robot appendage of the first robot in the 3D spatial representation to be presented, the visual representation of the determined amount of clearance for the first robot appendage being spatially associated with a respective path of the first robot appendage of the first robot in the 3D spatial representation and visually distinguishable from any visual representation of the respective paths. <Claim 66> The processor-executable instructions, when executed by at least one processor, further cause the at least one processor to: determining, for at least one movement of at least one of the first robotic appendage or the second robotic appendage, a respective amount of clearance between at least a portion of the second robotic appendage and at least one or more objects in the operating environment including the first robot; 66. The system of claim 65, further comprising: a step of: presenting a visual indication of the determined amount of clearance for the second robot appendage of the second robot in a 3D spatial representation, the visual indication of the determined amount of clearance for the second robot appendage spatially related to a respective path of the second robot appendage of the first robot in the 3D spatial representation. <Claim 67> 67. The system of claim 66, wherein the processor executable instructions, when executed by the at least one processor, cause the at least one processor to present a visual representation of the determined amount of clearance of the second robot appendage of the second robot in the 3D spatial representation for as long as the presentation of the visual representation of the determined amount of clearance of the first robot appendage of the first robot persists. <Claim 68> 68. The system of any one of claims 65 to 67, wherein the processor executable instructions cause the at least one processor to present, in the presentation of the 3D spatial representation, a visual indication of the determined amount of clearance for the first robot appendage of the first robot for all of the links, joints and end of the arm tool of the first robot appendage. <Claim 69> 66. The system of claim 65, wherein the first robot appendage further includes at least one cable, and wherein the processor executable instructions cause the at least one processor to present, in the presentation of the 3D spatial representation, a visual indication of the amount of the determined clearance of the first robot appendage of the first robot relative to the entirety of the first robot appendage, in the presentation of the 3D spatial representation. <Claim 70> 68. The system of any one of claims 65 to 67, wherein the processor executable instructions cause the at least one processor to present, in the presentation of the 3D spatial representation, a visual indication of the determined amount of clearance for the first robot appendage of the first robot, a visual indication of a minimum clearance experienced by any portion of the first robot appendage when moving along a path represented in the 3D spatial representation. <Claim 71> 68. The system of any one of claims 65 to 67, wherein the processor executable instructions cause the at least one processor to present, in the presentation of the 3D spatial representation, a visual indication of the determined amount of clearance for the first robot appendage of the first robot, as at least one numerical value spatially associated with the path within the 3D spatial representation, a visual indication of a minimum clearance experienced by at least one portion of the first robot appendage when moving along a path represented within the 3D spatial representation. <Claim 72> 68. The system of any one of claims 65 to 67, wherein the processor-executable instructions cause the at least one processor to present, in the presentation of the 3D spatial representation, a visual indication of the determined amount of clearance for the first robot appendage of the first robot, as a single numerical value spatially associated with the path in the 3D spatial representation, the single numerical value representing the smallest minimum distance among all of the determined minimum distances for all of the links, joints, and end of the arm tool of the first robot appendage for the movement represented by the respective path. <Claim 73> 68. The system of claim 65, wherein in the presentation of the 3D spatial representation, the processor-executable instructions cause the at least one processor to present a visual representation of the determined amount of clearance of the first robot appendage of the first robot as a plurality of numerical values ​​spatially associated with the path within the 3D spatial representation, the plurality of numerical values ​​representing the determined minimum distances for all of the links, joints and end of the arm tool of the first robot appendage at each of three or more poses of the first robot appendage that the first robot appendage assumes as it moves along the path represented within the 3D spatial representation. <Claim 74> 68. The system of any one of claims 65 to 67, wherein the processor-executable instructions cause the at least one processor to present, in the presentation of the 3D spatial representation, a visual indication of the determined amount of clearance for the first robot appendage of the first robot as one or more colors spatially associated with the path represented in the 3D spatial representation, each color representing an amount of clearance. <Claim 75> 68. The system of any one of claims 65 to 67, wherein the processor-executable instructions to cause the at least one processor to present, in the presentation of the 3D spatial representation, a visual indication of the determined amount of clearance for the first robot appendage of the first robot as a visual indication of a minimum clearance experienced by any portion of the first robot appendage when moving along a path in the 3D spatial representation as a single color spatially associated with the path in the 3D spatial representation, the single color representing a minimum distance that is smallest among all of the determined minimum distances for all of the links, joints, and ends of the arm tool of the first robot appendage relative to the movement represented by the path in the 3D spatial representation. <Claim 76> 68. The system of claim 65, wherein the processor-executable instructions cause the at least one processor to present, in the presentation of the 3D spatial representation, a visual indication of the determined amount of clearance of the first robot appendage of the first robot as a visual indication of a minimum clearance experienced by any portion of the first robot appendage when moving along a path in the 3D spatial representation as a plurality of colors spatially associated with the path in the 3D spatial representation, the plurality of colors representing the determined minimum distances for all of the links, joints, and end of the arm tool of the first robot appendage in each of three or more poses of the first robot appendage assumed by the first robot appendage when moving along the path in the 3D spatial representation. <Claim 77> 68. The system of claim 65, wherein in the presentation of the 3D spatial representation, the processor-executable instructions for causing the at least one processor to present a visual indication of the determined amount of clearance of the first robot appendage of the first robot as a heat map spatially associated with the path within the 3D spatial representation, the heat map representing the determined minimum distances for all of the links, joints, and end of the arm tool of the first robot appendage in each of three or more poses of the first robot appendage taken by the first robot appendage as it moves along the path represented in the 3D spatial representation. <Claim 78> A method of motion planning using a roadmap including a plurality of nodes and edges, each edge connecting a respective pair of the nodes, the nodes representing respective configurations of a robot in a configuration space (C-space) of the robot, and the edges representing available transitions between the configurations represented by the nodes connected by the respective edges; determining, for at least one portion of the robot, a respective amount of clearance between the at least one portion of the robot and one or more objects in an operating environment, the respective amount of clearance representing an amount of clearance between the at least one portion of the robot and the one or more objects in the operating environment when the robot performs at least one movement in a simulation or physical operation; for at least one edge of the roadmap, the at least one edge representing a respective one of the at least one movements of the robot in a simulation or physical operation, setting a cost metric logically associated with the respective edge based at least in part on the determined respective amount of clearance between the portion of the robot and the one or more objects in the operating environment for the respective at least one movement; and performing motion planning using at least a portion of the roadmap. <Claim 79> 80. The method of claim 78, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein determining respective clearance amounts between the at least one portion of the robot and one or more objects in an operating environment includes determining respective clearance amounts between all of the links, joints, and end of the arm tool of the robot appendage and the one or more objects in the operating environment for each of the at least one movement. <Claim 80> 80. The method of claim 78, wherein the robot includes a robot appendage having at least two links, at least one joint, at least one cable, and an end of an arm tool, and wherein determining respective clearance amounts between the at least one portion of the robot and one or more objects in an operating environment includes determining respective clearance amounts between all of the links, the at least one joint, the at least one cable, and the end of the arm tool of the robot appendage and the one or more objects in the operating environment for each of the at least one movement. <Claim 81> 80. The method of claim 78, wherein setting a cost metric logically associated with each edge based at least in part on the determined respective amount of clearance between the portion of the robot and the one or more objects in the operating environment for the at least one movement comprises setting the cost metric logically associated with the respective edge based at least in part on a minimum clearance experienced by any portion of the robot when moving along a path represented by the respective edge. <Claim 82> 79. The method of claim 78, wherein the robot includes a robot appendage comprising at least two links, at least one joint, and an end of an arm tool, and wherein setting a cost metric logically associated with each edge for the at least one movement based at least in part on the determined respective amount of clearance between the portion of the robot and the one or more objects in the operating environment comprises setting the cost metric logically associated with each edge for the movement represented by the respective edge based at least in part on a single numeric value representing the smallest minimum distance among all of the determined minimum distances of all of the links, joints, and end of the arm tool of the robot appendage. <Claim 83> 80. The method of claim 78, wherein determining respective clearance amounts between the portion of the robot and one or more objects in an operating environment includes determining respective clearance amounts between the portion of the robot and a portion of another robot operating within the operating environment. <Claim 84> 1. A system for motion planning using a roadmap including a plurality of nodes and edges, each edge connecting a respective pair of the nodes, the nodes representing respective configurations of a robot in a configuration space (C-space) of the robot, the edges representing available transitions between the configurations represented by the nodes connected by the respective edges, the system comprising: At least one processor; and at least one non-transitory processor-readable medium storing processor-executable instructions that, when executed by the at least one processor, cause the at least one processor to perform a method according to any one of claims 78 to 83. <Claim 85> 1. A system for motion planning using a roadmap including a plurality of nodes and edges, each edge connecting a respective pair of the nodes, the nodes representing respective configurations of a robot in a configuration space (C-space) of the robot, the edges representing available transitions between the configurations represented by the nodes connected by the respective edges, the system comprising: At least one processor; When executed by the at least one processor, the at least one processor determining, for at least one portion of the robot, a respective amount of clearance between the at least one portion of the robot and one or more objects in an operating environment, the respective amount of clearance representing an amount of clearance between the at least one portion of the robot and the one or more objects in the operating environment when the robot performs at least one movement in a simulation or physical operation; for at least one edge of the roadmap, the at least one edge representing a respective one of the at least one movements of the robot in a simulation or physical operation, setting a cost metric logically associated with the respective edge based at least in part on the determined respective amount of clearance between the portion of the robot and the one or more objects in the operating environment for the respective at least one movement; performing motion planning using at least a portion of the roadmap; and at least one non-transitory processor-readable medium storing processor-executable instructions to cause the system to perform the motion planning. <Claim 86> 86. The system of claim 85, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and to determine respective amounts of clearance between the at least one portion of the robot and one or more objects in an operating environment, the processor-executable instructions cause the at least one processor to determine, for each of the at least one movement, respective amounts of clearance between the links, the joints, and the end of the arm tool of the robot appendage and the one or more objects in the operating environment. <Claim 87> 86. The system of claim 85, wherein the robot includes a robot appendage having at least two links, at least one joint, at least one cable, and an end of an arm tool, and wherein to determine respective amounts of clearance between the at least one portion of the robot and one or more objects in an operating environment, the processor executable instructions cause the at least one processor to determine, for each of the at least one movements, respective amounts of clearance between the links, the at least one joint, the at least one cable, and the end of the arm tool of the robot appendage and the one or more objects in the operating environment. <Claim 88> 86. The system of claim 85, wherein the processor executable instructions cause the at least one processor to set a cost metric logically associated with each edge based at least in part on the determined respective amount of clearance between the portion of the robot and the one or more objects in the operating environment for each of the at least one movement, the cost metric logically associated with each edge based at least in part on a minimum clearance experienced by any portion of the robot when moving along a path represented by the respective edge. <Claim 89> 86. The system of claim 85, wherein the robot includes a robot appendage comprising at least two links, at least one joint, and an end of an arm tool, and for setting a cost metric logically associated with each edge for the at least one movement based at least in part on the determined respective amount of clearance between the portion of the robot and the one or more objects in the operating environment, the processor executable instructions cause the at least one processor to set the cost metric logically associated with each edge based at least in part on a single numeric value representing the smallest minimum distance among all of the determined minimum distances for all of the links, joints, and end of the arm tool of the robot appendage for the movement represented by the respective edge. <Claim 90> 86. The system of claim 85, wherein the processor executable instructions cause the at least one processor to determine respective amounts of clearance between the portion of the robot and one or more objects within an operating environment, the processor determining respective amounts of clearance between the portion of the robot and a portion of another robot operating within the operating environment. <Claim 91> 1. A method of motion planning, the method comprising: determining, for at least one portion of a robot, a respective amount of clearance between the at least one portion of the robot and one or more objects in an operating environment, the respective amount of clearance representing an amount of clearance between the at least one portion of the robot and the one or more objects in the operating environment when the robot executes at least one movement according to a motion planning performed in a simulation or physical operation; presenting a visual representation of the at least one movement including a representation of the determined amount of clearance between the at least one portion of the robot and the one or more objects in the operating environment; receiving at least one input representing at least one adjustment to a movement of the robot; and adjusting a roadmap for the robot based at least in part on the received at least one input. <Claim 92> 92. The method of claim 91, wherein presenting a visual representation of the at least one movement including a representation of the determined amount of clearance between the at least one portion of the robot and the one or more objects in the operating environment comprises presenting a roadmap in the form of a graph having a plurality of nodes and a plurality of edges, each edge connecting the nodes of a respective pair of nodes, the nodes representing a respective configuration of the robot, the edges representing respective transitions between respective pairs of the configurations of the robot represented by the nodes of the pair of nodes connected by the respective edges, each transition corresponding to a respective movement of the robot. <Claim 93> 92. The method of claim 91 , wherein presenting a visual representation of the at least one movement including a representation of the determined amount of clearance between the at least one portion of the robot and the one or more objects in the operating environment includes presenting one or more paths in a three-dimensional (3D) representation, each path corresponding to a respective movement of the robot. <Claim 94> 94. The method of claim 92 or 93, wherein causing a visual representation of the at least one movement including a representation of the determined amount of clearance between the at least one portion of the robot and the one or more objects in the operating environment comprises causing at least one of a numerical value or a color to be presented representative of the determined amount of clearance. <Claim 95> 95. The method of claim 94, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein the step of causing at least one of a number or a color to be presented representative of the determined amount of clearance includes causing at least one of a number or a color to be presented representative of a minimum clearance experienced by any portion of the robot appendage during the movement spatially associated with at least one of the edges or paths representing the transition or movement. <Claim 96> 95. The method of claim 94, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein the step of causing at least one of a number or a color to be presented representative of the determined amount of clearance includes causing at least one of a number or a color to be presented representative of a minimum clearance experienced by two or more portions of the robot appendage during the movement spatially associated with at least one of the edges or paths representing the transition or movement. <Claim 97> 95. The method of claim 94, wherein the step of presenting at least one of a number or a color representing the determined amount of clearance comprises the step of presenting a heat map having two or more colors corresponding to respective amounts of clearance. <Claim 98> 92. The method of claim 91, further comprising presenting a user interface that allows a user to one or more of: adjust a travel speed associated with one or more edges; adjust a value of a path smoothing parameter; adjust one or more nodes in the graph; and add one or more nodes to the graph. <Claim 99> 92. The method of claim 91, wherein causing presentation of a roadmap in the form of a graph having a plurality of nodes and a plurality of edges comprises causing presentation of a graphical user interface in which the nodes and edges in the graph are user selectable icons. <Claim 100> 1. A system for use in motion planning, comprising: At least one processor; and at least one non-transitory processor-readable medium storing processor-executable instructions that, when executed by the at least one processor, cause the at least one processor to perform a method according to any one of claims 91 to 99. <Claim 101> 1. A system for use in motion planning, comprising: At least one processor; When executed by the at least one processor, the at least one processor determining, for at least one portion of a robot, a respective amount of clearance between the at least one portion of the robot and one or more objects in an operating environment, the respective amount of clearance representing an amount of clearance between the at least one portion of the robot and the one or more objects in the operating environment when the robot executes at least one movement according to a motion planning performed in a simulation or physical operation; presenting a visual representation of the at least one movement including a representation of the determined amount of clearance between the at least one portion of the robot and the one or more objects in the operating environment; receiving at least one input representing at least one adjustment to a movement of the robot; and at least one non-transitory processor-readable medium storing processor-executable instructions to cause the system to perform the steps of: adjusting a roadmap for the robot based at least in part on the received at least one input. <Claim 102> 102. The system of claim 101, wherein the processor-executable instructions, when executed, cause the at least one processor to present a visual representation of the at least one movement including a representation of the determined amount of clearance between the at least one portion of the robot and the one or more objects in the operating environment, the at least one processor to present a roadmap in the form of a graph having a plurality of nodes and a plurality of edges, each edge connecting a node of a respective pair of nodes, the nodes representing a respective configuration of the robot, the edges representing respective transitions between respective pairs of the configurations of the robot represented by the nodes of the pair of nodes connected by the respective edges, each transition corresponding to a respective movement of the robot. <Claim 103> 102. The system of claim 101, wherein the processor-executable instructions, when executed, cause the at least one processor to present a visual representation of the at least one movement including a representation of the determined amount of clearance between the at least one portion of the robot and the one or more objects in the operating environment, the at least one processor presenting one or more paths within a three-dimensional (3D) representation, each path corresponding to a respective movement of the robot. <Claim 104> 104. The system of claim 102 or 103, wherein the processor executable instructions, when executed, cause the at least one processor to present a visual representation of the at least one movement including a representation of the determined amount of clearance between the at least one portion of the robot and the one or more objects in the operating environment, the at least one processor being configured to present at least one of a numerical value or a color representative of the determined amount of clearance. <Claim 105> 105. The system of claim 104, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and the processor executable instructions, when executed, cause the at least one processor to present at least one of a number or a color representing a minimum clearance experienced by any portion of the robot appendage during the movement spatially associated with at least one of the edges or paths representing the transition or movement to present at least one of a number or a color representing the determined amount of clearance. <Claim 106> 105. The system of claim 104, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and the processor executable instructions, when executed, cause the at least one processor to present at least one of a number or a color representing a minimum clearance experienced by two or more portions of the robot appendage during the movement spatially associated with at least one of the edges or paths representing the transition or movement to present at least one of a number or a color representing the determined amount of clearance. <Claim 107> 105. The system of claim 104, wherein the processor-executable instructions, when executed, to cause the at least one processor to present at least one of a numerical value or a color representing the determined amount of clearance, cause the at least one processor to present a heat map having two or more colors corresponding to respective amounts of clearance. <Claim 108> 101. The system of claim 100, further comprising: presenting a user interface that allows a user to one or more of: adjust a travel speed associated with one or more edges; adjust a value of a path smoothing parameter; adjust one or more nodes in the graph; and add one or more nodes to the graph. <Claim 109> 101. The system of claim 100, wherein the processor-executable instructions, when executed, cause the at least one processor to present a graphical user interface to present a roadmap in the form of a graph having a plurality of nodes and a plurality of edges, the nodes and the edges being user-selectable icons.

Claims

1. A method of motion planning performed by a system having at least one processor and at least one non-transitory processor-readable medium storing processor-executable instructions executed by the at least one processor, comprising: determining, by the system, for at least one movement of the robot, for each of at least one or more portions of the robot, an amount of respective clearance between the portion of the robot and one or more objects in an operating environment; causing the system to present a roadmap for the movement of the robot in the form of a graph having a number of nodes and a number of edges, each edge connecting a respective pair of nodes, the nodes representing respective configurations of the robot in a configuration space (C-space) of the robot, and the edges representing respective transitions between respective pairs of the configurations of the robot represented by the respective pairs of nodes connected by the respective edges; causing the system to present a visual indication of the determined amount of clearance in the representation of the roadmap for at least one or more of the portions of the robot; The method, wherein the step of presenting a visual representation of the determined amount of clearance in the presentation of the roadmap includes presenting a visual representation of a minimum clearance experienced by at least a portion of the robot when moving between the two configurations as a respective visual representation spatially associated with a respective one of the edges representing a transition between the two configurations.

2. 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and causing a visual indication of the determined amount of clearance to be presented in the presentation of the roadmap includes causing a visual indication of the determined amount of clearance for all of the links, the joints, and the end of an arm tool of the robot appendage to be presented in the presentation of the roadmap.

3. 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, at least one cable, and an end of an arm tool, and wherein causing a visual indication of the determined amount of clearance to be presented in the presentation of the roadmap includes causing a visual indication of the determined amount of clearance relative to an entirety of the robot appendage to be presented in the presentation of the roadmap.

4. 2. The method of claim 1, wherein causing a visual indication of the determined amount of clearance to be presented in the presentation of the roadmap includes providing a visual indication of a minimum clearance experienced by any portion of the robot when moving between two configurations represented as respective pairs of nodes connected by respective edges.

5. 2. The method of claim 1 , wherein causing a visual indication of the determined amount of clearance to be presented in the presentation of the roadmap comprises providing a visual indication of a minimum clearance experienced by at least one portion of the robot when moving between two configurations as at least one numerical value spatially associated with a respective one of the edges representing the transition between the two configurations.

6. 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein causing a visual indication of the determined amount of clearance to be presented in the presentation of the roadmap includes providing a visual indication of a minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a single numerical value spatially associated with a respective one of the edges representing the transition between the two configurations, the single numerical value representing a minimum clearance smallest of all of the determined minimum clearances for all of the links, joints, and end of the arm tool of the robot appendage for the movement represented by the respective one of the edges.

7. 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein causing a visual indication of the determined amount of clearance to be presented in the presentation of the roadmap includes providing a visual indication of the minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a plurality of numerical values ​​spatially associated with the edges, the plurality of numerical values ​​representing the determined minimum clearance for all of the links, the joints, and the end of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage assumes when transitioning between the configurations represented by the pairs of nodes connected by the edges.

8. 2. The method of claim 1 , wherein presenting a visual indication of the determined amount of clearance in the presentation of the roadmap includes providing a visual indication of a minimum clearance experienced by at least a portion of the robot when moving between two configurations as one or more colors spatially associated with a respective one of the edges representing the transition between the two configurations, each color representing an amount of clearance.

9. 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein causing the step of presenting a visual indication of the determined amount of clearance in the presentation of the roadmap includes providing a visual indication of a minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a single color spatially associated with a respective one of the edges representing the transition between the two configurations, the single color representing a minimum clearance that is smallest among all of the determined minimum clearances for all of the links, joints, and end of the arm tool of the robot appendage for the movement represented by the respective edge.

10. 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein causing the step of presenting a visual indication of the determined amount of clearance in the presentation of the roadmap includes providing a visual indication of a minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a plurality of colors spatially associated with respective ones of the edges representing the transition between the two configurations, the plurality of colors representing the determined minimum clearance for all of the links, the joints, and the end of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage assumes when transitioning between the configurations represented by the nodes of the pairs of nodes connected by the respective ones of the edges.

11. 2. The method of claim 1, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein causing a visual indication of the determined amount of clearance to be presented in the presentation of the roadmap includes providing a visual indication of the minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a heat map spatially associated with a respective one of the edges representing the transition between the two configurations, the heat map representing the determined minimum clearance for all of the links, the joints, and the end of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage takes when transitioning between the configurations represented by the nodes of the pairs of nodes connected by the respective ones of the edges.

12. 2. The method of claim 1 , wherein determining respective amounts of clearance between the portion of the robot and one or more objects in an operating environment comprises determining respective amounts of clearance between the portion of the robot and a portion of another robot operating within the operating environment.

13. 1. A system for use in motion planning, comprising: At least one processor; When executed by the at least one processor, the at least one processor determining, for at least one movement of the robot, for each of at least one or more portions of the robot, a respective amount of clearance between the portion of the robot and one or more objects in an operating environment; presenting a roadmap for the movement of the robot in the form of a graph having a number of nodes and a number of edges, each edge connecting a respective pair of nodes, the nodes representing respective configurations of the robot in a configuration space (C-space) of the robot, and the edges representing respective transitions between respective pairs of the configurations of the robot represented by the respective pairs of nodes connected by the respective edges; causing a visual indication of the determined amount of clearance in the representation of the roadmap for at least one or more of the portions of the robot; At least one non-transitory processor-readable medium storing processor-executable instructions to cause the A system, comprising: a system for causing the at least one processor to present a visual representation of the determined amount of clearance in the presentation of the roadmap, the system comprising processor-executable instructions, when executed, that cause the at least one processor to present a visual representation of a minimum clearance experienced by at least a portion of the robot when moving between the two configurations as respective visual representations spatially associated with respective ones of the edges representing a transition between the two configurations.

14. 14. The system of claim 13, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and the processor executable instructions for causing the at least one processor to present a visual indication of the determined amount of clearance in the presentation of the roadmap for all of the links, joints, and end of the arm tool of the robot appendage.

15. 14. The system of claim 13, wherein the robot includes a robot appendage having at least two links, at least one joint, at least one cable, and an end of an arm tool, and the processor executable instructions for causing the at least one processor to present a visual indication of the determined amount of clearance in the presentation of the roadmap for an entire robot appendage.

16. 14. The system of any one of claims 13, wherein the processor executable instructions cause the at least one processor to present a visual representation of the determined amount of clearance in the presentation of the roadmap, the at least one processor presenting a visual representation of a minimum clearance experienced by any part of the robot when moving between two configurations represented as respective pairs of nodes connected by respective edges.

17. 14. The system of claim 13, wherein the processor executable instructions cause the at least one processor to present a visual representation of the determined amount of clearance in the presentation of the roadmap, the at least one processor presenting a visual representation of a minimum clearance experienced by at least one portion of the robot when moving between two configurations as at least one numerical value spatially associated with a respective one of the edges representing the transition between the two configurations.

18. 14. The system of claim 13, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein, for causing the robot to present a visual representation of the determined amount of clearance in the presentation of the roadmap, the processor executable instructions cause the at least one processor to present a visual representation of a minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a single numerical value spatially associated with a respective one of the edges representing the transition between the two configurations, the single numerical value representing a minimum clearance smallest of all of the determined minimum clearances for all of the links, joints, and end of the arm tool of the robot appendage for the movement represented by the respective one of the edges.

19. 14. The system of claim 13, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and for causing the robot to present a visual representation of the determined amount of clearance in the presentation of the roadmap, the processor executable instructions cause the at least one processor to present a visual representation of the minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a plurality of numerical values ​​spatially associated with the edges, the plurality of numerical values ​​representing the determined minimum clearance for all of the links, the joints, and the end of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage assumes when transitioning between the configurations represented by the pairs of nodes connected by the edges.

20. 14. The system of claim 13, wherein the processor executable instructions to cause the at least one processor to present a visual representation of the determined amount of clearance in the presentation of the roadmap cause the at least one processor to present a visual representation of a minimum clearance experienced by at least one portion of the robot when moving between two configurations as one or more colors spatially associated with a respective one of the edges representing the transition between the two configurations, each color representing an amount of clearance.

21. 14. The system of claim 13, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and wherein, for causing the robot to present a visual representation of the determined amount of clearance in the presentation of the roadmap, the processor executable instructions cause the at least one processor to present a visual representation of a minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a single color spatially associated with a respective one of the edges representing the transition between the two configurations, the single color representing a minimum clearance that is smallest among all of the determined minimum clearances for all of the links, joints, and end of the arm tool of the robot appendage for the movement represented by the respective edge.

22. 14. The system of claim 13, wherein the robot includes a robot appendage comprising at least two links, at least one joint, and an end of an arm tool, and wherein for causing the robot to present a visual representation of the determined amount of clearance in the presentation of the roadmap, the processor executable instructions cause the at least one processor to present a visual representation of a minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a plurality of colors spatially associated with respective ones of the edges representing the transition between the two configurations, the plurality of colors representing the determined minimum clearance for all of the links, the joints, and the end of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage assumes when transitioning between the configurations represented by the nodes of the pairs of nodes connected by the respective ones of the edges.

23. 14. The system of claim 13, wherein the robot includes a robot appendage having at least two links, at least one joint, and an end of an arm tool, and for causing the robot to present a visual representation of the determined amount of clearance in the presentation of the roadmap, the processor executable instructions cause the at least one processor to present a visual representation of the minimum clearance experienced by any portion of the robot appendage when moving between two configurations as a heat map spatially associated with a respective one of the edges representing the transition between the two configurations, the heat map representing the determined minimum clearance for all of the links, the joints, and the end of the arm tool of the robot appendage in each of three or more poses of the robot appendage that the robot appendage assumes when transitioning between the configurations represented by the nodes of the pairs of nodes connected by the respective ones of the edges.

24. 14. The system of claim 13, wherein to determine respective amounts of clearance between the portion of the robot and one or more objects in an operating environment, the at least one processor determines respective amounts of clearance between the portion of the robot and a portion of another robot operating within the operating environment.

25. receiving at least one input representing at least one adjustment to a movement of the robot; The method of claim 1 , further comprising: adjusting a roadmap for the robot based at least in part on the received at least one input.

26. 26. The method of claim 25, further comprising presenting a user interface that allows a user to one or more of: adjust a travel speed associated with one or more edges; adjust a value of a path smoothing parameter; adjust one or more nodes in the graph; and add one or more nodes to the graph.

27. 26. The method of claim 25, wherein causing a roadmap to be presented in the form of a graph having a plurality of nodes and a plurality of edges comprises causing a graphical user interface to be presented in which the nodes and edges in the graph are user selectable icons.

28. When executed by the at least one processor, the processor-executable instructions cause the at least one processor to: receiving at least one input representing at least one adjustment to a movement of the robot; The system of claim 13 , further comprising: a controller configured to adjust a roadmap for the robot based at least in part on the received at least one input.

29. When executed by the at least one processor, the processor-executable instructions cause the at least one processor to:

30. The system of claim 28, further comprising: a user interface that allows a user to one or more of: adjust a travel speed associated with one or more edges; adjust a value of a path smoothing parameter; adjust one or more nodes in the graph; and add one or more nodes to the graph.

30. 30. The system of claim 28, wherein the processor-executable instructions, when executed, cause the at least one processor to present a graphical user interface to present a roadmap in the form of a graph having a plurality of nodes and a plurality of edges, the nodes and the edges being user-selectable icons.

Citation Information

Patent Citations

  • Teaching device for robot

    JP1997212229A

  • Program creation support method, program creation support device and program

    JP2016190315A

  • Information processing method and information processor

    JP2016209969A

  • Device and method for supporting creation of robot work program, and robot work support program

    JP2019136848A

  • Simulation device of robot

    JP2019188530A