Method for detecting leg stubs of a legged robot, method for leg stub swing of a legged robot and system thereof

Abstract

The present invention relates to a reflex algorithm for a legged robot to use leg stub swing to reach a desired landing position when it detects an unexpected contact. The proprioceptive leg stub swing algorithm is a two-phase algorithm that is particularly useful in unstructured terrain environments where contact with protruding obstacles can damage visual sensors. The present invention relates to a leg stub swing reflex algorithm for robots, such as bipedal robots, quadrupedal robots, or other legged robots. A legged robot consists of a robotic system with one or more appendages used for locomotion. A legged robot moves through an environment by exerting a reaction force on the environment using forces generated by the legs coming into contact with environmental materials in some way.

Description

[Technical Field]

[0001] This is about legged robot technology. [Background technology]

[0002] Legged robots are able to navigate more unstructured terrain than wheeled robots. These legged robots have the advantage of being able to traverse obstacles that require stepping over, as they can utilize isolated footholds. Legged robots have unique legs that can withstand isolated footholds, and robots with legs that actuate with multiple degrees of freedom can apply forces in multiple directions, as opposed to robots that actuate with a single degree of freedom. These developments have made multi-legged robots extremely advanced. Summary of the Invention [Problem to be solved by the invention]

[0003] Despite advances in quadrupedal walking technology, perfecting the walking and locomotion capabilities of legged robots has proven a difficult task. Legged robots must frequently reposition their legs to keep moving, while wheeled robots can continuously apply forces to the environment. For robots that move on only one leg, the leg's end effector contacts the environment at rest, and as the robot body moves away from this environment contact position, the leg's workspace becomes insufficient. Leg forces during recirculation can be very large, and unexpected contact with obstacles places unnecessary strain on the robot body.

[0004] Several approaches have been implemented to solve the problem of unexpected walking obstacles. Previous optimizations have proposed controllers that can react to stub events by regenerating the swing trajectory online, but they always assume that the obstacle is a cinder-block-style step of known height, with only an uncertain horizontal position relative to the robot. The present invention does not assume such a shape for the obstacle and ignores the assumption that the height of the obstacle is smaller than the originally planned swing path.

[0005] For example, some quadruped and biped robots use exteroceptive sensing to observe the terrain and rely on predetermined knowledge of the terrain to calculate the swing path of their limbs and avoid obstacles during their swing. While this solves the problem at a basic level, swing failures can occur unexpectedly due to uncertain knowledge of leg position, poor visibility, or changes in the terrain. The present invention solves this problem by proprioceptively sensing an obstacle with the quadruped robot's toes or feet upon unexpected contact and instinctively or reactively swinging over the obstacle to avoid further contact. The approach utilized in the present invention does not rely solely on vision-based sensors, which suffer from the drawbacks discussed above. [Means for solving the problem]

[0006] The present invention relates to a leg stub re-swing reflex algorithm for robots, such as bipedal robots, quadrupedal robots, or other legged robots. A legged robot is a robotic system with one or more appendages used for locomotion. A legged robot moves through an environment by exerting a reaction force on the environment using the force generated by the legs coming into contact with environmental materials in some way.

[0007] The premise here is that as the body of a legged robot moves in a specific direction, the legs in contact with the environment eventually run out of workspace and reach a configuration where they can no longer effectively generate ground-reaction forces on the robot body unless they are repositioned elsewhere in the environment. Therefore, the legged robot can command the legs to break contact with the environment, allowing them to re-contact the environment in another area of ​​the workspace and apply ground reaction forces to the robot body in a more appropriate manner. Repositioning the legs within the environment is considered a leg "swing." In this invention, a swing involves a nominal desired trajectory from liftoff to a desired touchdown location, and any control method, either open-loop or closed-loop, allows the legs to approximately track or follow this trajectory. If, during a swing, the robot's legs contact the environment for any reason before reaching their intended location within the environment, a stub event occurs.

[0008] Proprioceptive Leg Stub Swing is a reflex algorithm for legged robots that uses proprioceptive methods to detect unexpected contact between the environment and any part of the leg during the swing phase. Then, upon detecting an unexpected contact, the leg swing path is recreated, starting from the current leg position with the goal of reaching the desired landing position, with actuators lifting the toe to effectively overcome the unexpected contact. Proprioceptive sensors provide information about the position, orientation, and velocity of each part of the robot and include sensors such as encoders, gyroscopes, and accelerometers.

[0009] During swing, the legs can detect stab events through proprioception. In particular, legged robots can detect stab events using only the motors, without dedicated contact sensors, explicit force / torque sensors not specific to the motors, or algorithmic calculations that are not a direct function of sensor measurements, such as leg time-of-flight or swing phase. This can include sensor data such as, but not limited to, encoder sensors, current sensors, and inertial measurement units (IMUs). The robot leg transmission and motor gear configuration are assumed to be sufficiently backdrivable to enable proprioceptive detection of stab events. Proprioceptive sensor data can be interpreted by methods based on physics models or machine learning components to identify unexpected contact events.

[0010] One example where this improvement is most commonly applied is on stairs, curbs, or other types of ground formats where parts are significantly raised and require adjustments in landing calculations to avoid collisions or falls.

[0011] Advantages of this proprioceptive reswing method include robustness to terrain irregularities that cannot be detected by non-proprioceptive methods. For example, stepping over rocks in tall grass where the grass obscures the rock from the visual sensors is possible. Another advantage is that if an undesirable environment contact occurs during the swing, the basic task of achieving a desired leg-environment touchdown location at a specific time does not need to be altered (or significantly altered). This is the benefit of using legs capable of both fast dynamic response and proprioceptive detection. This allows for more rapid locomotion compared to traditional quasi-static platforms / methods.

[0012] In this invention, the first phase of motion allows the leg to proprioceptively "feel" the curb when part of the leg strikes it. The robot's limb then reactively swings the leg over the curb to avoid catching the toe and potentially causing a trip or fall, allowing the robot to enter the second phase. This approach is much more effective because visual sensors are not always ideal in certain environments, such as tall grass or smoke, or when there are protruding obstacles that can crack the lens upon impact. Furthermore, certain harsh environments, especially unstructured terrain, can crack or damage the lens. As a result, algorithms such as reflex algorithms are better suited to these specialized environments.

[0013] The algorithm's swing is divided into two phases and combines proprioceptive detection and online correction of the robotic leg swing trajectory to exploit the dynamic response capabilities of the legs in an attempt to clear obstacles, allowing for rapid obstacle navigation in a way that slows the robot down without necessarily altering its spatiotemporal "goal" of reaching a proper touchdown event.

[0014] The first phase of the present invention involves proprioceptive stab detection to prevent unwanted environmental contact. An observer of leg dynamics detects external forces on the leg that exceed a certain threshold in Cartesian coordinate components during swing and at predetermined time intervals before landing. This detected external force constitutes "stab" detection. The first phase of the proprioceptive environmental contact detection phase operates normally during swing, but can be turned off so that environmental contact during certain parts of the swing is ignored. This feature is important to prevent false ground detection during liftoff. The first phase stab detection method can be implemented in any manner using proprioceptive sensors, but can be as simple as an observer of leg dynamics detecting estimated external forces that exceed a certain threshold in Cartesian coordinate components during swing and at predetermined time intervals before landing.

[0015] The second phase of the present invention is the re-swing response. The leg begins swinging again, but rather than starting from the nominal lift-off position, the leg swing begins from a stub position. The height of the swing peak is increased (among other modifications to the swing path) to increase the likelihood of overcoming unexpected contact with an obstacle or intrusion. This proprioceptive reflex provides robustness to the movement against unexpected contact and gives the legged robot an opportunity to correct the unexpected contact before it puts a major, unwanted wrench in the body that could cause a fall, collision, or other injury. In the second phase, the nominal desired swing path is modified to attempt to avoid the obstacle with a "reswing." Once the trajectory is modified, the leg can optionally re-enter the first phase, allowing the robot's control algorithm to be programmed to re-swing one or more times depending on the robot's parameters and conditions. Multiple re-swings may be required to proprioceptively climb an obstacle, and the ability to perform multiple re-swings can be enabled or disabled by the computer software controlling the robot.

[0016] In this phase, the legs modify their swing trajectory to vertically clear unwanted environmental contact points. In one embodiment of the present invention, the legs can be commanded to begin swinging again, but rather than starting from the nominal lift-off position, they can start from a stub position, increasing the height of the apex of the desired swing trajectory to vertically clear the current contact points and increase the likelihood of clearing unexpected obstacles, even if the unexpected obstacle extends vertically above the current contact points.

[0017] Other features and aspects of the present invention will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, which illustrate, by way of example, features in accordance with embodiments of the invention. This summary is not intended to limit the scope of the invention, which is defined solely by the claims appended hereto. [Brief explanation of the drawings]

[0018] Various embodiments are illustrated by way of example, and not by way of limitation, in the accompanying drawings, in which:

[0013] The invention having been generally described, reference will now be made to the accompanying drawings, which are not necessarily drawn to scale. [Figure 1] FIG. 1 is a diagram showing a legged robot of the present invention. [Figure 2] FIG. 2 is a diagram of a state machine for the first and second phases of reswing. [Figure 3] FIG. 3 is an embodiment of the present invention that climbs a curb with a normal walking gait without prior knowledge of the curb and without using a vision-based sensor. [Figure 4] Figure 4 shows the reswing response of the legged robot with the new swing path enclosed by the dotted line. [Figure 5] Figure 5 shows the anatomy of a legged robot. [Figure 6A]Figure 6A shows the original swing trajectory (solid line) and the modified swing trajectory (dashed line) resulting from detecting a collision with the dotted curb in the first phase and modifying the desired swing trajectory in the second phase. [Figure 6B] Figure 6B depicts multiple re-swings that can be used to clear higher obstacles, as further explained in the text. [Figure 6C] Figure 6C shows the trajectory of a re-swing that lands on an obstacle and uses it as a foothold. DETAILED DESCRIPTION OF THE INVENTION

[0019] Figure 1 shows a legged robot of the present invention. The legged robot is equipped with a computing box that houses an IMU and processor for executing algorithms and commands. The legged robot also has upper and lower limbs connected via actuators. The legged robot may also be equipped with an array of sensors in a sensor panel.

[0020] Figure 2 shows a state machine diagram for the first and second phases of a reswing. When a touch is detected, the first phase is used.

[0021] Figure 3 shows an embodiment of the present invention in which a person climbs a curb with a normal walking gait, without prior knowledge of the curb and without the use of vision-based sensors. An observer watching the leg dynamics detects external forces exceeding certain thresholds in Cartesian coordinate components during the swing and at predetermined time intervals before landing. This constitutes a "stab" detection.

[0022] Figure 4 shows the re-swing response of a legged robot with a new swing path, outlined by the dotted line. The leg begins swinging again, but instead of starting from the nominal lift-off position, it starts from a stub position. The height of the swing apex is increased, increasing the chance of overcoming unexpected contact.

[0023] Figure 5 shows the anatomy of a legged robot.

[0024] Figure 6A shows the original swing trajectory (solid line) and the modified swing trajectory (dashed line) obtained after detecting a collision with the dotted curb in the first phase and modifying the desired swing trajectory in the second phase. The swing speed can be increased so that the robot's step timing does not need to be changed. An example of such a trajectory replanning is shown in Figure 4. This recalculation of the swing trajectory can be performed online and quickly if the original swing trajectory is parameterized in a compact form and these parameters can be appropriately changed as a function of the stub position. Achieving a more aggressive reswing trajectory compared to conventional quasi-static machines is made possible by proprioceptive leg transmission.

[0025] Figure 6B shows a case where multiple reswings can be used to robustly clear a taller obstacle. The first swing (solid line) hits the obstacle, then the second swing (dashed line) retracts and hits the obstacle at a higher height. Finally, the desired trajectory height increases after each impact and reswing, so the third swing (dotted and dashed lines) clears the obstacle. Conditions for allowing or disallowing subsequent reswings can be programmed based on the environment, current task, and robot state.

[0026] Figure 6C shows a reswing being used to step onto an obstacle used as a foothold. By allowing reswings only midway through the desired swing trajectory, the reswing algorithm is robust to landing on terrain that is higher (or lower) than the original desired landing height. For example, when proprioceptively climbing a curb, the robot may not recognize (due to a lack of exteroception) that the terrain has increased in height and that it cannot reach the original landing height.

[0027] In this case, the original swing trajectory (solid line) hits the edge of the curb (raised dotted line) and then reswings (dashed line). The solid lines in each target trajectory (desired trajectory) represent the portion of the swing where reswings are allowed, and the dashed lines in each target trajectory represent the portion of the swing where reswings are not allowed. Alternatively, we can command the robot to forcefully pass through the first dotted line and assume that a collision at the second dotted line is an allowable landing. If the second reswing hits the ground prematurely at the dotted black circle, the height will be higher than the original target landing position (solid black circle), but because it is outside the allowable range for reswings, the leg simply touches down on the ground and successfully lands on the curb without attempting another reswing.

[0028] While various embodiments of the disclosed technology have been described above, it should be understood that they are presented by way of example only, and not limitation. Similarly, various figures may depict example architectural or other configurations of the disclosed technology, this is done to aid in understanding the features and functionality that may be included in the disclosed technology. The disclosed technology is not limited to the example architectures or configurations shown, and the desired functions may be implemented using a variety of alternative architectures and configurations. Indeed, it will be apparent to those skilled in the art how alternative functional, logical, or physical divisions and configurations can be implemented to implement the desired features of the technology disclosed herein. Also, various component module names may be applied to various divisions other than those shown herein. Furthermore, with respect to flow diagrams, operational descriptions, and method claims, the order of steps presented herein does not require various embodiments to perform the described functions in the same order, unless the context dictates otherwise.

[0029] While the disclosed technology has been described above in terms of various exemplary embodiments and implementations, it should be understood that various features, aspects, and functions described in one or more of the individual embodiments are not limited in application to the particular embodiment described, but may also be applicable to one or more other embodiments of the disclosed technology, either alone or in various combinations, regardless of whether such embodiment is described and whether such features are presented as part of the described embodiment. Thus, the breadth and scope of the technology disclosed herein should not be limited by any of the exemplary embodiments described above.

[0030] Terms and phrases used in this document, and variations thereof, unless expressly stated otherwise, should be construed as open-ended and not limiting. For the foregoing examples, the term "including" should be construed as meaning "including, without limitation," and the term "examples" is used to provide illustrative instances of the items under discussion, not as an exhaustive or limiting list thereof. The terms "a" or "an" should be construed as meaning "at least one," "one or more," and the like. Adjectives such as "conventional," "traditional," "usually," "standard," "known," and similar terms should not be construed as limiting the items being described to items available during a particular period or at a particular time, but should be construed as embracing conventional, traditional, usual, or standard technology that may be available or known at any time now or in the future. Similarly, when this document refers to technology that would be apparent or known to one of ordinary skill in the art, such technology includes technology that would be apparent or known to one of ordinary skill in the art at any time now or in the future.

Claims

1. 1. A method for detecting leg stubs of a legged robot, comprising: generating data regarding the position, orientation, and velocity of each part of the legged robot by proprioceptive sensors housed within the computing box; detecting an external force exceeding a threshold value of the Cartesian coordinate component during the swing for a predetermined time interval before landing; detecting an obstacle, the obstacle causing interference with the path of the legged robot; executing a proprioceptive leg stub swing reflex algorithm by a processor housed in a computing box, wherein the legged robot establishes a new swing path in response to detecting the obstacle.

2. 2. The method of claim 1, comprising the step of the legged robot leg responding to the re-swing reflex by restarting a swing phase initiated at a current position of the legged robot leg to reach an original landing position and execute a new swing path.

3. The method of claim 1 , wherein the proprioceptive sensors include motor sensors, including encoders, gyroscopes, and accelerometers for providing information regarding the position, orientation, and velocity of the legged robot.

4. The method of claim 3 further comprising motor sensors and leg transmissions of the legged robot for detecting environmental contact.

5. The method of claim 1 , wherein the legs of the legged robot are capable of absorbing repeated environmental contact.

6. 5. The method of claim 4, wherein the leg transmission and motor gearing arrangement is backdrivable to enable proprioceptive detection of multiple stab events.

7. 3. The method of claim 2, wherein the height of the apex of the re-swing trajectory is increased to increase the probability of overcoming unexpected contact.

8. 3. The method of claim 2, wherein the swing frequency of the re-swing trajectory is increased to reach the landing location at an expected time of landing regardless of the obstacle.

9. The method of claim 2 , wherein at least one stub detection is allowed to occur during a specific time interval during execution of the first re-swing trajectory.

10. 10. The method of claim 9, wherein a second reswing is allowed to occur following a second stub detection during execution of the first reswing trajectory.

11. 11. The method of claim 10, wherein the maximum number of reswings is greater than or equal to two and is limited to a predetermined number, and wherein the stub does not re-trigger the reswing during the execution of the final reswing.

12. 1. A method for leg stub reswing of a legged robot, comprising: generating data regarding the position, orientation and velocity of each part of the legged robot by proprioceptive sensors including at least one encoder, gyroscope and accelerometer for providing information regarding the position, orientation and velocity of the legged robot, the proprioceptive sensors being housed in a computing box; detecting an external force exceeding a threshold value of the Cartesian coordinate component during the swing for a predetermined time interval before landing; detecting an obstacle, the obstacle causing interference with the movement of the legged robot; executing a proprioceptive leg stub swing reflex algorithm by a processor housed within the computing box; increasing the height of the apex of the swing trajectory of the legged robot to overcome unexpected environmental contact; wherein the legged robot, in response to detecting the obstacle, breaks contact with the obstacle and interference and establishes a new swing path.

13. The method of claim 12 , further comprising providing motor sensors and leg transmissions of the legged robot to detect environmental contact.

14. The method of claim 12 , wherein the legs of the legged robot are capable of absorbing repeated environmental contact.

15. 14. The method of claim 13, wherein the leg transmission and motor gearing arrangement is back-drivable to enable proprioceptive detection of stab events.

16. The method of claim 12 , further comprising the step of: the proprioceptive detection of an event of the stub dynamically altering a swing trajectory of the leg belonging to the legged robot.

17. The method of claim 12 , wherein the legged robot uses the proprioceptive leg stub-swing reflex algorithm to navigate unstructured terrain.

18. 18. The method of claim 17, wherein the swing trajectory of the legged robot is parameterized in a compact form and is variable as a function of the position of the stub during the stub event.

19. A leg stub swing system for a legged robot, comprising: a legged robot comprising upper limbs, lower limbs, and feet, the upper limbs and lower limbs being attached by screw actuators; a sensor panel for proprioceptive sensors including encoders, gyroscopes, and accelerometers for providing information regarding the position, orientation, and velocity of said legged robot; a computing box housing an inertial measurement unit configured to run a proprioceptive leg stab swing reflex algorithm, the proprioceptive leg stab reflex algorithm detecting a toe stab event upon impact with an obstacle; a plurality of joint actuators that enable the legged robot to swing the legs over the obstacle upon the collision.

20. 20. The system of claim 19, wherein the legged robot comprises multiple legs for traversing unstructured terrain.

21. 21. The system of claim 20, wherein the computing box is disposed between an upper limb and a lower limb of the legged robot.

22. 20. The system of claim 19, wherein the leg stub reflex algorithm utilizes reflex replanning without assumptions regarding known heights of potential obstacles.

Images