Robot control method and apparatus, and storage medium and electronic device

By determining the support state of the mechanical foot and the movement trajectory of the zero moment point ZMP, the motion trajectory and joint angle trajectory of the bipedal robot are generated, which solves the accuracy and stability of the motion control of the bipedal robot, and realizes the Move stably.

WO2024230069A1PCT designated stage expired Publication Date: 2024-11-14ZHEJIANG LAB

Patent Information

Application Number
PCT/CN2023/124926
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-08
Filing Date
2023-10-17
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

The prior art is difficult to accurately and stably control the movement of bipedal robots, resulting in poor results in obstacle spanning and discontinuous path movement in complex terrain.

Method used

By determining the support state of the mechanical foot, the movement trajectory of the zero moment point ZMP, the posture information and movement trajectory of the mechanical foot, the movement trajectory of the center of mass and the joint angle trajectory are generated, which is used to control the motion planning of the bipedal robot.

Benefits of technology

Accurate and stable control of bipedal robots is achieved, and can better adapt to complex terrain and discontinuous path movements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2023124926_14112024_PF_FP_ABST
    Figure CN2023124926_14112024_PF_FP_ABST
Patent Text Reader

Abstract

A robot control method and apparatus, and a storage medium and an electronic device. The robot control method comprises: when a biped robot moves by means of mechanical feet, determining a mechanical-foot support state corresponding to each time stage (S101); according to the mechanical-foot support state corresponding to each time stage, determining a movement trajectory of a zero moment point (ZMP) between the mechanical feet, which ZMP corresponds to the biped robot (S102); for each mechanical foot of the biped robot, determining first pose information corresponding to the mechanical foot in a first time stage, wherein the first time stage comprises a plurality of time stages in which the mechanical foot is in a support state, and according to the first pose information, determining a motion trajectory corresponding to the mechanical foot (S103); according to the movement trajectory of the ZMP and the motion trajectory corresponding to each mechanical foot, determining a motion trajectory of the centroid of the biped robot (S104); and on the basis of the motion trajectory of the centroid and the motion trajectory corresponding to each mechanical foot, determining a joint angle trajectory corresponding to each target joint of the biped robot, and according to the joint angle trajectory, determining motion planning data for controlling the biped robot, so as to control, according to the motion planning data, the biped robot to move by means of the mechanical feet (S105).
Need to check novelty before this filing date? Find Prior Art

Description

Robot control method, device, storage medium and electronic equipment Technical Field

[0001] The present application relates to the field of robots, and in particular to a robot control method, device, storage medium and electronic equipment. Background Art

[0002] With the rapid development of mobile robotics technology, various robots are being widely used in a wide range of fields, including industry, services, and the military. Compared to traditional tracked robots, bipedal robots are better able to adapt to complex terrain. For example, bipedal robots can overcome obstacles and move along discontinuous paths, offering broad application prospects.

[0003] The structure of a bipedal robot is usually complex, and during movement, it often needs to follow a pre-set motion trajectory to achieve body balance and stability. Gait planning of a bipedal robot is an important basis for controlling the bipedal robot to perform stable movement.

[0004] However, simplified mathematical models are currently commonly used to plan the gait of bipedal robots, which is quite different from the actual model of the robot. For example, the inverted pendulum model characterizes whether the robot's motion is stable by analyzing the track energy, making it difficult to accurately and stably control the bipedal robot.

[0005] Therefore, how to control the bipedal robot to move stably is an urgent problem to be solved.

[0006] Summary of the Invention

[0007] The present application provides a robot control method, device, storage medium and electronic device to solve the above-mentioned problems existing in the prior art.

[0008] The technical solutions adopted in this application are as follows.

[0009] This application provides a robot control method, comprising:

[0010] Determine the mechanical foot support state corresponding to each time stage when the biped robot moves through the mechanical foot, wherein the mechanical foot support state includes: a single mechanical foot support state and a double mechanical foot support state;

[0011] Determining a moving trajectory of a zero moment point ZMP corresponding to the bipedal robot between each mechanical foot according to the mechanical foot support state corresponding to each time stage;

[0012] For each mechanical foot of the biped robot,

[0013] Determining first posture information corresponding to the robotic foot in a first time period; wherein the first time period includes multiple time periods when the robotic foot is in a supporting state;

[0014] determining a motion trajectory corresponding to the robotic foot according to the first posture information;

[0015] Determining the motion trajectory of the center of mass of the bipedal robot according to the movement trajectory of the ZMP and the motion trajectory corresponding to each mechanical foot;

[0016] Based on the motion trajectory of the center of mass and the motion trajectory corresponding to each mechanical foot, the joint angle trajectory corresponding to each target joint of the bipedal robot is determined, and the motion planning data for controlling the bipedal robot is determined according to the joint angle trajectory, so as to control the bipedal robot to move through each mechanical foot according to the motion planning data.

[0017] Optionally, determining the movement trajectory of the zero moment point ZMP corresponding to the bipedal robot between the mechanical feet according to the support state of the mechanical feet corresponding to each time stage includes:

[0018] For each time stage, if the biped robot is in a single mechanical foot support state during the time stage, determining that the ZMP is located at the foothold corresponding to the mechanical foot currently in the support state;

[0019] If the biped robot is in a bipedal support state during this time period, it is determined that the ZMP is located between the landing point corresponding to the previous mechanical foot and the landing point corresponding to the next mechanical foot.

[0020] Optionally, each of the time phases includes at least one of a starting step phase, an intermediate step phase, and an ending step phase, and the intermediate step phase includes at least one walking cycle of the bipedal robot.

[0021] Optionally, the starting step phase includes at least one of a stationary state sub-phase, a body swing sub-phase before walking, a center of gravity maintenance sub-phase, and a ZMP transfer sub-phase.

[0022] Optionally, determining the movement trajectory of the zero moment point ZMP corresponding to the bipedal robot between the mechanical feet according to the support state of the mechanical feet corresponding to each time stage includes:

[0023] determining a sequence of mechanical foot support states of the bipedal robot when it moves according to the mechanical foot support states corresponding to the respective time stages;

[0024] The movement trajectory of the ZMP is determined according to the mechanical foot support state sequence.

[0025] Optionally, determining a motion trajectory corresponding to the robotic foot according to the first posture information includes:

[0026] Determining, based on the first posture information, the posture information corresponding to each moment in a second time period of the robotic foot as second posture information; wherein the second time period includes multiple time periods when the robotic foot is in a swinging state;

[0027] Determine a motion trajectory corresponding to the robotic foot according to the first posture information and the second posture information.

[0028] Optionally, determining a motion trajectory corresponding to the robotic foot according to the first posture information and the second posture information includes:

[0029] Determine the motion trajectory corresponding to the robotic foot based on the first posture information and the second posture information, as well as at least one of a preset speed, acceleration, lifting height, and control point of the robotic foot during lifting and landing.

[0030] Optionally, before determining, for each mechanical foot of the bipedal robot, first position information corresponding to the mechanical foot in the first time period, the method further includes:

[0031] Determine the mechanical foot corresponding to the initial landing point of the biped robot.

[0032] Optionally, determining the motion trajectory of the center of mass of the bipedal robot according to the movement trajectory of the ZMP and the motion trajectory corresponding to each mechanical foot includes:

[0033] Determine the position of the center of mass at each moment according to the movement trajectory of the ZMP;

[0034] Determine the attitude angle corresponding to each mechanical foot at each moment according to the motion trajectory corresponding to each mechanical foot, and determine the attitude angle corresponding to the center of mass at each moment according to the attitude angle corresponding to each mechanical foot at each moment;

[0035] The motion trajectory of the center of mass is determined according to the attitude angle corresponding to the center of mass at each moment and the position corresponding to the center of mass at each moment.

[0036] Optionally, determining the joint angle trajectory corresponding to each target joint of the bipedal robot based on the motion trajectory of the center of mass and the motion trajectory corresponding to each mechanical foot includes:

[0037] Determining a motion trajectory corresponding to a floating base on the bipedal robot according to the motion trajectory corresponding to each mechanical foot;

[0038] The joint angle trajectory corresponding to each target joint of the biped robot is determined according to the motion trajectory corresponding to the floating base, the motion trajectory corresponding to each mechanical foot, and the motion trajectory of the center of mass.

[0039] Optionally, the floating base comprises: a mechanical pelvis of the bipedal robot.

[0040] The present application provides a robot control device, comprising:

[0041] A first determining module determines a corresponding mechanical foot support state at each time stage when the biped robot moves by means of the mechanical foot, wherein the mechanical foot support state includes a single mechanical foot support state and a double mechanical foot support state;

[0042] a second determining module, determining a moving trajectory of a zero moment point ZMP corresponding to the bipedal robot between each mechanical foot according to the supporting state of the mechanical foot corresponding to each time stage;

[0043] The third determining module is configured to determine, for each mechanical foot of the biped robot,

[0044] Determining first posture information corresponding to the robotic foot in a first time period; wherein the first time period includes multiple time periods when the robotic foot is in a supporting state;

[0045] determining a motion trajectory corresponding to the robotic foot according to the first posture information;

[0046] a fourth determining module, determining a motion trajectory of the center of mass of the bipedal robot according to the movement trajectory of the ZMP and the motion trajectories corresponding to the mechanical feet;

[0047] The control module determines the joint angle trajectory corresponding to each target joint of the bipedal robot based on the motion trajectory of the center of mass and the motion trajectory corresponding to each mechanical foot, and determines the motion planning data for controlling the bipedal robot according to the joint angle trajectory, so as to control the bipedal robot to move through each mechanical foot according to the motion planning data.

[0048] The present application provides a computer-readable storage medium, wherein the storage medium stores a computer program, and when the computer program is executed by a processor, the control method of the robot is implemented.

[0049] The present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned robot control method when executing the program.

[0050] At least one of the above technical solutions adopted in this application can achieve the following beneficial effects.

[0051] In the robot control method provided in the present application, the support state of the mechanical feet corresponding to each time stage when the bipedal robot moves through the mechanical feet is first determined, and the movement trajectory of the zero torque point ZMP corresponding to the bipedal robot between each mechanical foot is determined based on the support state of the mechanical feet corresponding to each time stage, and the posture information corresponding to each mechanical foot in each time stage in the support state is determined. According to the movement trajectory of the ZMP, the first posture information corresponding to the mechanical foot in the first time stage is determined for each mechanical foot of the bipedal robot; wherein the first time stage includes multiple time stages in which the mechanical foot is in the support state; according to the first posture information, the motion trajectory corresponding to the mechanical foot is determined; according to the movement trajectory of the ZMP and the motion trajectory corresponding to the mechanical feet, the motion trajectory of the center of mass of the bipedal robot is determined; based on the motion trajectory of the center of mass and the motion trajectory corresponding to the mechanical feet, the joint angle trajectory corresponding to each target joint of the bipedal robot is determined, and the motion planning data for controlling the bipedal robot is determined based on the joint angle trajectory, so as to control the bipedal robot to move through each mechanical foot according to the motion planning data.

[0052] It can be seen from the above method that the moving trajectory of the center of mass in this scheme is generated based on the moving trajectory of the ZMP, and the moving trajectory of the ZMP needs to be determined by the support state of the robot's mechanical foot during the movement process, so that the moving trajectory of the ZMP can be well adapted to the actual model of the robot. Moreover, since the ZMP is a stable action point that can enable the robot to maintain balance, under this premise, the moving trajectory of the center of mass determined based on this point and the subsequent determined joint angle trajectory are also bound to enable the robot to maintain a stable state during the entire movement process, and further enable the motion planning data generated according to the moving trajectory of the center of mass and the moving trajectory of the mechanical foot to ensure precise and stable control of the bipedal robot. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0054] FIG1 is a schematic flow chart of a robot control method provided in this application;

[0055] FIG2 is a schematic diagram of a mechanical foot support state of a bipedal robot provided in this application during movement;

[0056] FIG3 is a schematic diagram of the motion trajectory of each mechanical foot of a bipedal robot provided in this application;

[0057] FIG4 is a schematic diagram of the motion trajectory of the center of mass of a bipedal robot provided in this application;

[0058] FIG5 is a schematic diagram of an inverse solution process of a joint angle trajectory provided in this application;

[0059] FIG6 is a schematic diagram of the overall control process of a bipedal robot provided in this application;

[0060] FIG7 is a schematic diagram of a control device of a robot provided by the present application;

[0061] FIG8 is a schematic diagram of an electronic device provided by the present application corresponding to FIG1 . DETAILED DESCRIPTION

[0062] To make the purpose, technical solutions, and advantages of this application more clear, the technical solutions of this application will be clearly and completely described below in conjunction with the specific embodiments of this application and the corresponding drawings. Obviously, the embodiments described are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0063] The following describes in detail the technical solutions provided by various embodiments of the present application in conjunction with the accompanying drawings.

[0064] Due to the complex structure and diverse research directions of bipedal robot systems, encompassing a wide range of research areas, including structure, actuation, hardware design, balance, stability, planning, and navigation, their research and development requires the input and collaboration of a large number of researchers. Considering different physical simulation environments, the deployment and migration of prototype systems, and the addition of multiple control algorithms, it is crucial to propose a clearly structured, modularized bipedal robot gait planning system and implementation method.

[0065] Based on this, the present application provides a robot control method, as shown in FIG1 , comprising the following steps.

[0066] S101: Determine the corresponding mechanical foot support state at each time stage when the biped robot moves via the mechanical feet, wherein the mechanical foot support state includes a single mechanical foot support state and a double mechanical foot support state.

[0067] S102: Determine the movement trajectory of the zero torque point ZMP corresponding to the bipedal robot between the mechanical feet according to the supporting states of the mechanical feet corresponding to the respective time stages.

[0068] In this application, the execution entity for implementing a robot control method can be a designated device such as a server of a bipedal robot, or a control terminal of the bipedal robot. For ease of description, this application only uses the control terminal as an example to illustrate a robot control method provided in this application.

[0069] The bipedal robot includes two mechanical feet, a first mechanical foot and a second mechanical foot, corresponding to the left and right feet of the bipedal robot, respectively. The bipedal robot can determine the support state of the mechanical feet at various time stages when moving via the mechanical feet.

[0070] In the present application, the above-mentioned mechanical foot support state may include: a single mechanical foot support state and a double mechanical foot support state, and the single mechanical foot support state includes a first mechanical foot support state and a second mechanical foot support state.

[0071] The control terminal can determine the step length, walking cycle, landing point and posture angle of each mechanical foot of the biped robot during movement based on the expected gait input by the user.

[0072] When a biped robot performs human-like walking, it is necessary to consider the double mechanical foot support state (Double Support Phase, DSP) stage and the single mechanical foot support state (Single Support Phase, SSP) stage during the walking process. In the SSP stage, the ZMP (Zero Moment Point) is always in the mechanical foot in the support state, and in the DSP stage, the ZMP moves from the previous support foot to the next support foot. At this time, the ZMP is located between the landing point corresponding to the previous support foot and the landing point corresponding to the next support foot. Therefore, the planning of the ZMP trajectory needs to correspond to the time series of different mechanical foot support states, and the control terminal can determine the mechanical foot support state sequence of the biped robot when it is moving based on the mechanical foot support state corresponding to each time stage. For ease of understanding, the present application provides a schematic diagram of the mechanical foot support state during the movement of a biped robot, as shown in Figure 2.

[0073] FIG2 is a schematic diagram of the mechanical foot support state of a bipedal robot provided in this application during movement.

[0074] The overall process Tsup_series of the bipedal robot's motion planning consists of three time stages, which are:

[0075] Starting step (Tsup0), intermediate steps (Tsup1~Tsup(n-2)), ending step (T sup_end ).

[0076] The initial step Tsup0 consists of four subphases: the stationary state subphase t1, the body swing subphase t2 before walking, the center of gravity maintenance subphase t3, and the ZMP transfer subphase t4. The ZMP transfer subphase is the DSP state, in which the ZMP moves from the foothold of the first supporting foot to the foothold of the second supporting foot.

[0077] The intermediate step is a cyclic phase in the walking process, starting from the SSP state. The duration of the SSP state is a multiple of the walking cycle of the current step (1-k). Then comes the DSP state. The duration of the DSP state is equal to half of the sum of the current walking cycle and the next walking cycle. Taking Tsup1 as an example, the duration of the DSP state after the SSP state of Tsup1 ends is 0.5k*Tsup1+ 0.5k*Tsup2, where k is a preset coefficient.

[0078] End step T sup_end It also includes 4 sub-stages, starting from the end moment of the SSP of the penultimate step, after the DSP time of t1, completing the last swing before static state, maintaining the time of t2, and then returning to the static state after the DSP time of t3.

[0079] In the present application, the user can input the walking cycle of each step in advance, and the control terminal can automatically generate the time of each stage and the duration corresponding to each sub-stage according to the walking time of each step.

[0080] Of course, the walking cycle of each step mentioned above can also be automatically generated by the control terminal.

[0081] Furthermore, the control terminal can determine the mechanical foot support state sequence of the bipedal robot during movement based on the mechanical foot support state corresponding to each time stage, and then the control terminal can generate a continuous ZMP trajectory through the ZMP generator based on the support state sequence and the positions of each foothold and the posture angle of each mechanical foot of the bipedal robot during movement.

[0082] In this way, the control terminal can make the ZMP be located on the current supporting foot when the biped robot is in the SSP state, and make the ZMP move from the previous supporting foot to the next supporting foot when the biped robot is in the DSP state.

[0083] S103: For each mechanical foot of the bipedal robot, determine first position information corresponding to the mechanical foot in a first time period; and determine a motion trajectory corresponding to the mechanical foot according to the position information.

[0084] The control terminal can use a foothold trajectory generator to determine, for each mechanical foot of the bipedal robot, multiple time periods during which the mechanical foot is in a supporting state as a first time period, and multiple time periods during which the mechanical foot is in a swinging state as a second time period, thereby determining the posture information corresponding to the mechanical foot in the first time period. Based on the posture information, the motion trajectory corresponding to the mechanical foot is determined. Thus, the motion trajectory corresponding to each mechanical foot can be obtained.

[0085] The footfall trajectory generator must first determine the mechanical foot corresponding to the bipedal robot's initial footfall. Specifically, it determines whether the first foot lifted by the bipedal robot is the first or second mechanical foot. When the mechanical foot corresponding to the initial footfall is the first mechanical foot, the corresponding relationship between the position and posture of each mechanical foot and the aforementioned support state sequence is shown in Table 1.

[0086] Table 1

[0087] When the mechanical foot corresponding to the initial landing point of the bipedal robot is the second mechanical foot, the corresponding relationship between the position and posture of each mechanical foot and the above support state sequence is shown in Table 2.

[0088] Table 2

[0089] In Tables 1 and 2, the positions and postures of the first and second robotic feet are aligned with the support state sequence. The number of input footholds is defined as an even number n, with the first foothold numbered p(0), and so on, with the last foothold numbered p(n-1). The rotation angle sequence of the input footholds is defined as r, with the rotation angle corresponding to p(0) being r(0) and the rotation angle corresponding to p(n-1) being r(n-1). 255 indicates that the robotic foot is in the swinging state at that time stage, and the other robotic foot must be in the support state at this time.

[0090] It should be noted that when turning, the coordinate system transformation matrix needs to be used to correct and update the position of the landing point to achieve the desired movement. The above-mentioned landing point position and rotation angle can be pre-set by the user, of course, or automatically generated by the control terminal.

[0091] According to the rules of humanoid walking, the first and second mechanical feet alternately support each other while also swinging in the air. Therefore, a swing leg trajectory generator can be used to generate a continuous motion trajectory of the swing foot in three-dimensional space.

[0092] During this process, for each mechanical foot of the bipedal robot, the control terminal can calculate the posture information corresponding to the mechanical foot at each moment in the second time stage based on the posture information corresponding to the mechanical foot in the first time stage, and then determine the corresponding motion trajectory of the mechanical foot based on the posture information corresponding to the mechanical foot in the first time stage and the posture information corresponding to the mechanical foot at each moment in the second time stage.

[0093] Taking Table 1 or Table 2 as an example, when the position of the mechanical foot is 255, it indicates that the mechanical foot is in a swinging state during this time period. Therefore, the terminal control terminal needs to perform motion planning on the motion trajectory between the lifting position and the landing position to generate the position trajectory of the mechanical foot when it is in the swinging state.

[0094] In the present application, the control terminal may use interpolation methods that meet motion requirements, such as segmented curves, polynomial curves, Bezier curves, and spline curves, to determine the position trajectory of the mechanical foot in a swinging state.

[0095] Similarly, when the posture of the robotic foot is 255, interpolation methods such as segmented curves and polynomial curves can also be used to determine the posture trajectory of the robotic foot.

[0096] Then, the motion trajectory corresponding to each robotic foot is determined by combining the above position trajectory and posture trajectory.

[0097] It should be noted that when determining the motion trajectory of the bipedal robot, in addition to considering the posture information of each mechanical foot mentioned above, at least one of the preset speed, acceleration, lifting height and convex hull generated by the control points of each mechanical foot during the lifting and landing process can also be considered to determine the motion trajectory corresponding to each mechanical foot.

[0098] It should be noted that the above-mentioned preset speed, acceleration, lift height, and convex hull generated by the control points can be motion constraints for the bipedal robot pre-set by the user. For ease of understanding, this application provides a schematic diagram of the motion trajectory of each mechanical foot of the bipedal robot, as shown in Figure 3.

[0099] FIG3 is a schematic diagram of the motion trajectory of each mechanical foot of a bipedal robot provided in this application.

[0100] The left foot of the bipedal robot can be its first mechanical foot, and the right foot can be its second mechanical foot. The solid line in the figure corresponds to the motion trajectory of the first mechanical foot, and the dotted line corresponds to the motion trajectory of the second mechanical foot.

[0101] S104: Determine the motion trajectory of the center of mass of the bipedal robot according to the movement trajectory of the ZMP and the motion trajectory corresponding to each mechanical foot.

[0102] Since the bipedal robot's gait planning system primarily generates motion trajectories for key locations (such as the center of mass and left and right feet) and then solves for joint angle trajectories using an inverse solution module, the control terminal can use the center of mass trajectory generator to determine the center of mass position at each moment based on the ZMP's trajectory. Furthermore, for each moment, the control terminal can determine the posture angle of each robotic foot based on the motion trajectory of each robotic foot.

[0103] Then, based on the attitude angle corresponding to each mechanical foot at that moment, the attitude angle corresponding to the center of mass at that moment is determined, and then based on the attitude angle corresponding to the center of mass at each moment and the position corresponding to the center of mass at each moment, the motion trajectory of the center of mass is determined.

[0104] For the spatial position of the bipedal robot at each moment, when the robot walks on flat ground, the height of the center of mass in the vertical direction remains unchanged. When the robot goes up and down stairs, the movement of the center of mass in the vertical direction needs to be planned according to the task of going up and down stairs. When the robot turns, the posture of the center of mass needs to rotate with the turning of the landing point to maintain the balance of the body, where the center of mass posture angle = 1 / 2 (first mechanical foot posture angle + second mechanical foot posture angle). For ease of understanding, the present application provides a schematic diagram of the motion trajectory of the center of mass of a bipedal robot, as shown in Figure 4.

[0105] FIG4 is a schematic diagram of the motion trajectory of the center of mass of a bipedal robot provided in this application.

[0106] Among them, the upper part of Figure 4 is the movement trajectory of the biped robot ZMP in the horizontal direction (x-axis direction) (the trajectory corresponding to the solid line in the figure) and the motion trajectory of the center of mass (the trajectory corresponding to the dotted line in the figure), and the lower part is the movement trajectory of the biped robot ZMP in the vertical direction (y-axis direction) (the trajectory corresponding to the solid line in the figure) and the motion trajectory of the center of mass (the trajectory corresponding to the dotted line in the figure).

[0107] S105: Based on the motion trajectory of the center of mass and the motion trajectory corresponding to each mechanical foot, determine the joint angle trajectory corresponding to each target joint of the bipedal robot, and determine the motion planning data for controlling the bipedal robot according to the joint angle trajectory, so as to control the bipedal robot to move through each mechanical foot according to the motion planning data.

[0108] After determining the motion trajectory of the center of mass and the motion trajectory of each mechanical foot, the control terminal can input the motion trajectory of the center of mass and the motion trajectory of each mechanical foot into the inverse solution module, thereby outputting the joint angle trajectory of each mechanical leg of the biped robot through the inverse solution module.

[0109] Specifically, the control terminal can select a fixed point of the bipedal robot as a floating base. In the present application, the floating base can be the mechanical pelvis of the bipedal robot, and then the center of mass movement can be converted into movement of the floating base position based on the positional relationship between the mechanical pelvis and the center of mass.

[0110] Usually, there is a certain distance between the ankle of a bipedal robot and the ground, and in the motion planning of each mechanical foot, the trajectory of the middle position of the sole of the foot is designed. According to the relative relationship between the ankle and the middle position of the sole of the foot, the movement of the left and right feet is converted into the movement of the ankles of the left and right feet. Finally, according to the motion trajectory corresponding to the floating base, the motion trajectory corresponding to each mechanical foot, the motion trajectory of the center of mass, and the configuration of the robot, the joint angle trajectory of each target joint that realizes the desired gait is obtained through the leg inverse solution algorithm. The control terminal can then determine the overall motion planning data of the bipedal robot based on the joint angle trajectory, and then send the motion planning data to the bipedal robot, thereby controlling the bipedal robot to move. For ease of understanding, the present application provides a schematic diagram of the inverse solution process of a joint angle trajectory, as shown in Figure 5.

[0111] FIG5 is a schematic diagram of an inverse solution process of a joint angle trajectory provided in this application.

[0112] Among them, the control terminal can input the ZMP trajectory generated by the ZMP generator into the center of mass trajectory generator to determine the motion trajectory of the center of mass, determine the motion trajectory of each mechanical foot according to the swing leg trajectory generator, and then input the motion trajectory of the center of mass and the motion trajectory of each mechanical foot into the inverse solution module to infer the pelvic (floating base) trajectory and ankle joint trajectory, and then determine the joint angle trajectory of each target joint of the biped robot through inverse kinematics calculations.

[0113] The control terminal can send motion planning data to the biped robot via a wired connection, or via a wireless connection such as Wi-Fi or Bluetooth, which is not specifically limited in this application. For ease of understanding, this application provides a schematic diagram of the overall control process of a biped robot, as shown in Figure 6.

[0114] FIG6 is a schematic diagram of the overall control process of a bipedal robot provided in this application.

[0115] Among them, the user can input the desired gait of the biped robot (such as the length of the walking cycle, the length of each time stage, the landing point position and the posture angle of each mechanical foot, etc.), and then the control terminal can generate the ZMP trajectory through the ZMP generator, determine the motion trajectory of the center of mass through the center of mass trajectory generator, and, according to the support state sequence corresponding to each time stage, generate the motion trajectory of the left and right feet (the first mechanical foot and the second mechanical foot) by the landing point generator of the robot's left and right feet and the swing leg trajectory generator. Through the inverse solution module, the joint angle trajectory is determined according to the center of mass trajectory and the motion trajectory of the left and right feet, and then the motion planning data is generated according to the joint angle trajectory to control the movement of the biped robot.

[0116] It can be seen from the above method that the moving trajectory of the center of mass in this scheme is generated based on the moving trajectory of the ZMP. Since the ZMP is a stable action point that can keep the robot balanced, under this premise, the moving trajectory of the center of mass determined based on this point and the subsequent determined joint angle trajectory are bound to enable the robot to maintain a stable state during the entire movement process, so that the motion planning data generated according to the moving trajectory of the center of mass and the moving trajectory of the mechanical foot can further ensure precise and stable control of the bipedal robot.

[0117] The above are one or more robot control methods implemented in this application. Based on the same idea, this application also provides a corresponding robot control device, as shown in Figure 7.

[0118] FIG7 is a schematic diagram of a robot control device provided by the present application, comprising:

[0119] The first determining module 701 determines the corresponding mechanical foot support state at each time stage when the biped robot moves by means of the mechanical foot, wherein the mechanical foot support state includes: a single mechanical foot support state and a double mechanical foot support state;

[0120] The second determining module 702 determines the movement trajectory of the zero moment point ZMP corresponding to the biped robot between the mechanical feet according to the support state of the mechanical feet corresponding to the respective time stages;

[0121] The third determining module 703 is for each mechanical foot of the biped robot:

[0122] Determining first posture information corresponding to the robotic foot in a first time period; wherein the first time period includes multiple time periods when the robotic foot is in a supporting state;

[0123] determining a motion trajectory corresponding to the robotic foot according to the first posture information;

[0124] A fourth determining module 704 determines a motion trajectory of the center of mass of the bipedal robot according to the motion trajectory of the ZMP and the motion trajectories corresponding to the mechanical feet;

[0125] The control module 705 determines the joint angle trajectory corresponding to each target joint of the bipedal robot based on the motion trajectory of the center of mass and the motion trajectory corresponding to each mechanical foot, and determines the motion planning data for controlling the bipedal robot according to the joint angle trajectory, so as to control the bipedal robot to move through each mechanical foot according to the motion planning data.

[0126] Optionally, the second determination module 702 is specifically used to, for each time stage, if the bipedal robot is in a single mechanical foot support state during the time stage, determine that the ZMP is located at the landing point corresponding to the mechanical foot that is currently in the support state; if the bipedal robot is in a two-foot support state during the time stage, determine that the ZMP is located between the landing point corresponding to the previous mechanical foot and the landing point corresponding to the next mechanical foot.

[0127] Optionally, each of the time phases includes at least one of a starting step phase, an intermediate step phase, and an ending step phase, and the intermediate step phase includes at least one walking cycle of the bipedal robot.

[0128] Optionally, the starting step phase includes at least one of a stationary state sub-phase, a body swing sub-phase before walking, a center of gravity maintenance sub-phase, and a ZMP transfer sub-phase.

[0129] Optionally, the second determination module 702 is specifically used to determine the mechanical foot support state sequence of the bipedal robot when it moves according to the mechanical foot support state corresponding to each time stage; and determine the movement trajectory of the ZMP according to the mechanical foot support state sequence.

[0130] Optionally, the third determination module 703 is specifically used to determine the posture information corresponding to each moment of the mechanical foot in the second time stage as the second posture information based on the first posture information; wherein the second time stage includes multiple time stages when the mechanical foot is in a swinging state; and determine the motion trajectory corresponding to the mechanical foot based on the first posture information and the second posture information.

[0131] Optionally, the third determination module 703 is specifically used to determine the motion trajectory corresponding to the robotic foot based on the first posture information and the second posture information, as well as at least one of the preset speed, acceleration, lifting height and control point of the robotic foot during the lifting and landing process.

[0132] Optionally, for each mechanical foot of the biped robot, before determining the first position information corresponding to the mechanical foot in the first time stage, the third determination module 703 is further used to determine the mechanical foot corresponding to the initial landing point of the biped robot.

[0133] Optionally, the fourth determination module 704 is specifically used to determine the position corresponding to the center of mass at each moment according to the moving trajectory of the ZMP; determine the posture angle corresponding to each mechanical foot at each moment according to the motion trajectory corresponding to each mechanical foot, and determine the posture angle corresponding to the center of mass at each moment according to the posture angle corresponding to each mechanical foot at each moment; determine the motion trajectory of the center of mass according to the posture angle corresponding to the center of mass at each moment and the position corresponding to the center of mass at each moment.

[0134] Optionally, the control module 705 is specifically used to determine the motion trajectory corresponding to the floating base on the bipedal robot based on the motion trajectory corresponding to each mechanical foot; and determine the joint angle trajectory corresponding to each target joint of the bipedal robot based on the motion trajectory corresponding to the floating base, the motion trajectory corresponding to each mechanical foot, and the motion trajectory of the center of mass.

[0135] Optionally, the floating base comprises: a mechanical pelvis of the bipedal robot.

[0136] The present application also provides a computer-readable storage medium, which stores a computer program. The computer program can be used to execute a robot control method provided in FIG. 1 above.

[0137] The present application also provides a schematic structural diagram of an electronic device corresponding to Figure 1 as shown in Figure 8. As shown in Figure 8, at the hardware level, the electronic device includes a processor, an internal bus, a network interface, a memory and a non-volatile memory, and of course may also include hardware required for other services. The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs it to implement the robot control method described in Figure 1 above. Of course, in addition to software implementation, this application does not exclude other implementation methods, such as logic devices or a combination of software and hardware, etc., that is to say, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.

[0138] Improvements to a technology can be clearly distinguished as either hardware improvements (for example, improvements to circuit structures such as diodes, transistors, and switches) or software improvements (improvements to process flows). However, with technological advancements, many process flow improvements today can now be considered direct improvements to hardware circuit structures. Designers almost always create the corresponding hardware circuit structure by programming the improved process flow into the hardware circuit. Therefore, it cannot be said that a process flow improvement cannot be implemented using a hardware module. For example, a programmable logic device (PLD), such as a field programmable gate array (FPGA), is an integrated circuit whose logical function is determined by user programming. Designers can "integrate" a digital system onto a PLD by programming it themselves, without having to hire a chip manufacturer to design and manufacture a dedicated integrated circuit chip. Moreover, nowadays, instead of manually fabricating integrated circuit chips, this programming is mostly done using "logic compiler" software. This is similar to the software compiler used when developing programs. Before compilation, the original code must also be written in a specific programming language, called a hardware description language (HDL). There is not just one HDL, but many, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. The most commonly used are VHDL (Very-High-Speed ​​Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art will also understand that by simply programming the method flow in one of these hardware description languages ​​and then programming it into an integrated circuit, a hardware circuit that implements the logic method flow can be easily obtained.

[0139] The controller can be implemented in any suitable manner. For example, the controller can take the form of a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro)processor, logic gates, switches, application-specific integrated circuits (ASICs), programmable logic controllers, and embedded microcontrollers. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320. The memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art will also know that in addition to implementing the controller in a purely computer-readable program code format, the controller can be implemented in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, and embedded microcontrollers by logically programming the method steps. Therefore, such a controller can be considered a hardware component, and the devices included therein for implementing various functions can also be considered as structures within the hardware component. Or even, the devices for implementing various functions can be considered as both software modules that implement the method and structures within the hardware component.

[0140] The systems, devices, modules, or units described in the above embodiments may be implemented by computer chips or entities, or by products having certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0141] For the convenience of description, the above devices are described as being divided into various units according to their functions. Of course, when implementing this application, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0142] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0143] The present application is described with reference to the flow chart and / or block diagram of the method, device (system), and computer program product according to the embodiment of the present application. It should be understood that each flow process and / or box in the flow chart and / or block diagram and the combination of the flow process and / or box in the flow chart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processing machine or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for realizing the function specified in one flow chart flow or multiple flows and / or one box or multiple boxes of the block diagram.

[0144] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0145] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0146] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0147] Memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0148] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0149] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0150] The present application may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communications network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

[0151] The various embodiments in this application are described in a progressive manner. Similar parts between the various embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences between the other embodiments. In particular, the system embodiment is generally similar to the method embodiment, so the description is relatively simple. For relevant parts, refer to the partial description of the method embodiment.

[0152] The foregoing is merely an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should all be included within the scope of the claims of the present application.

Claims

1. A robot control method, characterized in that: include: Determine the corresponding mechanical foot support state at each time stage when the biped robot moves by means of the mechanical foot, wherein the mechanical foot support state includes: a single mechanical foot support state and a double mechanical foot support state; Determine the moving trajectory of the zero moment point ZMP corresponding to the biped robot between the mechanical feet according to the supporting state of the mechanical feet corresponding to each time stage; For each mechanical foot of the biped robot, Determine the first position information corresponding to the mechanical foot in a first time stage; wherein the first time stage includes a plurality of time stages in which the mechanical foot is in a supporting state; Determining a motion trajectory corresponding to the robotic foot according to the first posture information; Determining the motion trajectory of the center of mass of the bipedal robot according to the movement trajectory of the ZMP and the motion trajectories corresponding to the mechanical feet; Based on the motion trajectory of the center of mass and the motion trajectory corresponding to each mechanical foot, the joint angle trajectory corresponding to each target joint of the bipedal robot is determined, and the motion planning data for controlling the bipedal robot is determined according to the joint angle trajectory, so as to control the bipedal robot to move through each mechanical foot according to the motion planning data.

2. The method according to claim 1, characterized in that Determining the moving trajectory of the zero moment point ZMP corresponding to the biped robot between the mechanical feet according to the mechanical foot support states corresponding to the respective time stages, including: For each time stage, if the biped robot is in a single mechanical foot supporting state during the time stage, determining that the ZMP is located at a foothold corresponding to the mechanical foot currently in the supporting state; If the biped robot is in a bipedal support state during this time period, it is determined that the ZMP is located between the landing point corresponding to the previous mechanical foot and the landing point corresponding to the next mechanical foot.

3. The method according to claim 1, characterized in that Each of the time phases includes at least one of a starting step phase, an intermediate step phase, and an ending step phase, and the intermediate step phase includes at least one walking cycle of the biped robot.

4. The method according to claim 3, characterized in that The starting step phase includes at least one of a static state sub-phase, a body swing sub-phase before walking, a center of gravity maintaining sub-phase, and a ZMP transfer sub-phase.

5. The method according to claim 1, characterized in that Determining the moving trajectory of the zero moment point ZMP corresponding to the biped robot between the mechanical feet according to the mechanical foot support states corresponding to the respective time stages, including: Determining a sequence of mechanical foot support states of the bipedal robot when it moves according to the mechanical foot support states corresponding to the respective time stages; The movement trajectory of the ZMP is determined according to the mechanical foot support state sequence.

6. The method according to claim 1, characterized in that Determining a motion trajectory corresponding to the robotic foot according to the first posture information includes: According to the first posture information, determining the posture information corresponding to each moment of the mechanical foot in the second time stage as the second posture information; wherein the second time stage includes a plurality of time stages in which the mechanical foot is in a swinging state; A motion trajectory corresponding to the robotic foot is determined according to the first posture information and the second posture information.

7. The method according to claim 6, characterized in that Determining a motion trajectory corresponding to the robotic foot according to the first posture information and the second posture information includes: The motion trajectory corresponding to the mechanical foot is determined according to the first posture information and the second posture information, and at least one of a preset speed, acceleration, lifting height and control point of the mechanical foot during lifting and landing.

8. The method according to claim 1, characterized in that For each mechanical foot of the biped robot, before determining the first position information corresponding to the mechanical foot in the first time stage, the method further includes: Determine the mechanical foot corresponding to the initial landing point of the biped robot.

9. The method according to claim 1, characterized in that Determining the motion trajectory of the center of mass of the bipedal robot according to the movement trajectory of the ZMP and the motion trajectories corresponding to the mechanical feet includes: Determine the position of the center of mass at each moment according to the moving trajectory of the ZMP; Determine the attitude angle corresponding to each mechanical foot at each moment according to the motion trajectory corresponding to each mechanical foot, and determine the attitude angle corresponding to the center of mass at each moment according to the attitude angle corresponding to each mechanical foot at each moment; The motion trajectory of the center of mass is determined according to the attitude angle corresponding to the center of mass at each moment and the position corresponding to the center of mass at each moment.

10. The method according to claim 1, characterized in that Determining the joint angle trajectory corresponding to each target joint of the biped robot based on the motion trajectory of the center of mass and the motion trajectory corresponding to each mechanical foot includes: Determining the motion trajectory corresponding to the floating base on the bipedal robot according to the motion trajectory corresponding to each mechanical foot; The joint angle trajectory corresponding to each target joint of the biped robot is determined according to the motion trajectory corresponding to the floating base, the motion trajectory corresponding to each mechanical foot, and the motion trajectory of the center of mass.

11. The method according to claim 10, characterized in that The floating base includes: a mechanical pelvis of the biped robot.

12. A robot control device, characterized in that: include: A first determination module determines the corresponding mechanical foot support state at each time stage when the biped robot moves through the mechanical foot, wherein the mechanical foot support state includes: a single mechanical foot support state and a double mechanical foot support state; A second determination module determines a moving trajectory of a zero moment point ZMP corresponding to the biped robot between each mechanical foot according to the mechanical foot support state corresponding to each time stage; The third determining module is for each mechanical foot of the biped robot, Determine the first position information corresponding to the mechanical foot in a first time stage; wherein the first time stage includes a plurality of time stages in which the mechanical foot is in a supporting state; Determining a motion trajectory corresponding to the robotic foot according to the first posture information; a fourth determination module, determining a motion trajectory of the center of mass of the bipedal robot according to a movement trajectory of the ZMP and motion trajectories corresponding to the mechanical feet; The control module determines the joint angle trajectory corresponding to each target joint of the bipedal robot based on the motion trajectory of the center of mass and the motion trajectory corresponding to each mechanical foot, and determines the motion planning data for controlling the bipedal robot according to the joint angle trajectory, so as to control the bipedal robot to move through each mechanical foot according to the motion planning data.

13. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 11 is implemented.

14. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 1 to 11 is implemented.

Citation Information

Patent Citations

  • Biped humanoid robot, nonlinear gait planning method thereof and control method

    CN108345211A

  • Robot control method and device, computer readable storage medium and robot

    CN111015653A

  • Robot control method and device, computer readable storage medium and robot

    CN112975941A

  • Balance control method for dynamic walking of biped robot

    CN113830197A

  • Whole body compliance control method applied to quick walking of biped robot

    CN115933723A

Cited By

  • Multi-limb exoskeleton walking balance control method, device and equipment and storage medium

    CN119260742A